-- Logs begin at Wed 2022-07-20 02:40:28 UTC, end at Wed 2022-07-20 06:23:29 UTC. -- Jul 20 04:04:12.620773 n-d-764486-11 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 04:04:12.629791 n-d-764486-11 devstack@n-api.service[108379]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 04:04:12 2022] *** Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: nodename: n-d-764486-11 Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: machine: x86_64 Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: clock source: unix Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: pcre jit disabled Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: detected number of CPU cores: 4 Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: current working directory: / Jul 20 04:04:12.631772 n-d-764486-11 devstack@n-api.service[108379]: detected binary path: /usr/bin/uwsgi-core Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: your processes number limit is 47680 Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: your memory page size is 4096 bytes Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: detected max file descriptor number: 2048 Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: lock engine: pthread robust mutexes Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: thunder lock: enabled Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 04:04:12.632636 n-d-764486-11 devstack@n-api.service[108379]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 04:04:12.675708 n-d-764486-11 devstack@n-api.service[108379]: Python main interpreter initialized at 0x561c9e4189c0 Jul 20 04:04:12.675708 n-d-764486-11 devstack@n-api.service[108379]: python threads support enabled Jul 20 04:04:12.675708 n-d-764486-11 devstack@n-api.service[108379]: your server socket listen backlog is limited to 100 connections Jul 20 04:04:12.675708 n-d-764486-11 devstack@n-api.service[108379]: your mercy for graceful operations on workers is 90 seconds Jul 20 04:04:12.676022 n-d-764486-11 devstack@n-api.service[108379]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 04:04:12.676108 n-d-764486-11 devstack@n-api.service[108379]: *** Operational MODE: preforking *** Jul 20 04:04:12.676379 n-d-764486-11 devstack@n-api.service[108379]: *** uWSGI is running in multiple interpreter mode *** Jul 20 04:04:12.676379 n-d-764486-11 devstack@n-api.service[108379]: spawned uWSGI master process (pid: 108379) Jul 20 04:04:12.676558 n-d-764486-11 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 04:04:12.677082 n-d-764486-11 devstack@n-api.service[108379]: spawned uWSGI worker 1 (pid: 108380, cores: 1) Jul 20 04:04:12.679111 n-d-764486-11 devstack@n-api.service[108379]: spawned uWSGI worker 2 (pid: 108381, cores: 1) Jul 20 04:04:12.679111 n-d-764486-11 devstack@n-api.service[108379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 04:04:13.329348 n-d-764486-11 devstack@n-api.service[108381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:04:13.344272 n-d-764486-11 devstack@n-api.service[108380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:04:14.442349 n-d-764486-11 devstack@n-api.service[108381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:04:14.442349 n-d-764486-11 devstack@n-api.service[108381]: from cryptography.utils import int_from_bytes Jul 20 04:04:14.442939 n-d-764486-11 devstack@n-api.service[108381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:04:14.442939 n-d-764486-11 devstack@n-api.service[108381]: from cryptography.utils import int_from_bytes Jul 20 04:04:14.448324 n-d-764486-11 devstack@n-api.service[108380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:04:14.448324 n-d-764486-11 devstack@n-api.service[108380]: from cryptography.utils import int_from_bytes Jul 20 04:04:14.448798 n-d-764486-11 devstack@n-api.service[108380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:04:14.448798 n-d-764486-11 devstack@n-api.service[108380]: from cryptography.utils import int_from_bytes Jul 20 04:04:16.922329 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:04:16.922882 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:04:16.923081 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:04:16.923430 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:04:16.923682 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:04:16.924065 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.924416 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.924732 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.925045 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.925371 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.925677 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.925991 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.926302 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.926621 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.926877 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.927185 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.927526 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764486-11 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.927842 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.928142 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.928475 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.928792 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.929089 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.929403 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.929664 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:04:16.930042 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.930138 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:04:16.930234 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.930429 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:04:16.930604 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.930791 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:04:16.930905 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.931048 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:04:16.931209 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.931435 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.931579 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.931764 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.931881 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.932099 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.932227 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.932423 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.932519 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.932750 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.932846 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.933057 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.933174 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.933371 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.933472 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.933685 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.933771 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764486-11 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934008 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934093 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934268 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934355 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934588 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934700 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.934910 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764486-11 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935013 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935226 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935320 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935528 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935612 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935837 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.935932 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.936153 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.936239 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.936482 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.936573 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.936803 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.936908 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.937108 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.937201 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.937416 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.937605 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.937711 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.937913 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938007 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938219 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938324 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938525 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938631 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938862 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.938956 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.939164 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.939262 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.939462 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.939555 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.939709 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.939794 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940009 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940104 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940322 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940422 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940668 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940764 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.940981 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941072 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764486-11 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941229 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941365 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941459 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941675 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941768 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.941986 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.942072 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.942358 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.942443 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.942660 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.942745 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.942960 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.943053 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.943786 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.943873 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.944088 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.944180 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.944405 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.944505 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.944711 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.944890 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945099 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945195 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945309 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945404 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945616 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945710 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.945929 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946027 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946231 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946326 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946531 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946627 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946846 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.946935 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947145 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947244 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947446 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947532 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947693 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947776 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.947995 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.948094 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.948315 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.948470 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.948655 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.948741 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.948972 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949078 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949221 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949309 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949470 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949565 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949785 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.949872 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950098 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950192 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950406 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950504 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950710 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950797 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.950989 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951103 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951285 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951385 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951582 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951678 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951883 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.951968 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.952180 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.952281 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.952505 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.952594 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.952803 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.952888 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953098 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953193 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953397 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953483 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953697 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953784 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.953998 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.954161 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.954297 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.954526 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.954612 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.954792 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.954913 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.955102 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.955203 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.955439 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.955537 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.955744 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.955849 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956048 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956144 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956374 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956481 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956676 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956774 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.956974 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957063 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957273 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957369 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957575 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957670 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957885 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.957973 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.958183 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.958271 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.958480 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.958590 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.958789 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.958935 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.959617 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.959712 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.959924 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960034 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960242 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960337 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960584 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960684 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960889 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.960985 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.961193 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.961281 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.961491 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.961586 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.961796 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.961884 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.962099 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.962187 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.962407 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.962496 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.962705 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.962811 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963001 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963088 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963299 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963386 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963594 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963689 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963895 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.963984 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.964196 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.964284 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.964520 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.964620 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.964817 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.964901 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.965130 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.965244 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.965430 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.965517 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.965732 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.965818 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966031 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966120 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966333 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966422 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966634 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966721 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.966936 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.967034 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.967254 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.967342 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.967559 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.967646 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.967864 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.967965 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.968178 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.968266 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.968506 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.968609 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.968812 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.968913 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.969128 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.969223 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.969429 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.969517 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.969733 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.969836 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.970046 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.970133 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.970351 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.970438 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.970663 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.970763 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.970954 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.971043 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.971259 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.971354 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.971563 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.971658 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.971867 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.971955 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.972171 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.972265 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.972500 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.972605 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.972805 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.972976 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.973119 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.973270 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.973413 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.973548 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.973974 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.974110 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.974288 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.974471 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.974611 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.974747 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.974942 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:04:16.975078 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.975260 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.975356 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.975592 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.975698 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.975908 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976004 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976221 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976320 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976554 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976642 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976862 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.976957 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.977182 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.977276 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.977507 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.977593 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.977816 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.977910 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.978131 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.978231 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.978442 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.978528 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.978748 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.978837 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.979058 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.979156 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.979368 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.979454 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.979681 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.979767 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980009 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980102 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980316 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980421 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980649 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980737 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.980958 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981047 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981270 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981361 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981576 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981660 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981882 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.981970 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.982190 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.982276 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.982491 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.982577 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.982832 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.982963 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.983172 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.983259 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.983481 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.983579 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.983788 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.983873 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.984105 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.984198 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.984438 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.984540 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.984742 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.984827 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985056 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985185 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985359 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985455 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985668 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985754 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.985976 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986062 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986283 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986379 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986583 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986669 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986890 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.986976 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.987197 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.987285 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.987497 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.987583 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.987806 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.987891 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.988113 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.988199 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.988433 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.988522 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.988754 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.988850 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.989054 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.989151 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.989357 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.989450 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.989671 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.989756 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990010 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990106 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990315 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990400 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990622 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990757 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.990915 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991003 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991220 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991306 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991526 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991619 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991830 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.991914 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.992152 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.992237 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.992500 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.992607 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.992803 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.992947 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.993121 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.993217 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.993425 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.993530 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.993737 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.993823 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994033 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994118 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994337 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994432 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994640 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994724 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.994965 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995053 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995256 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995341 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995560 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995653 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995857 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.995941 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.996202 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.996296 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.996473 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.996571 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.996775 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.996861 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997072 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997166 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997389 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997475 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997695 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997782 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.997995 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998081 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998293 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998378 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998591 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998684 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998900 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.998986 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.999220 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.999305 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.999528 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.999626 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.999840 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:16.999926 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.000168 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.000254 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.000507 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.000612 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.000814 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.000908 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.001125 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.001217 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.001435 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.001522 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.001740 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.001826 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002042 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002126 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002347 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002439 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002646 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002737 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.002949 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003091 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003251 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003348 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003557 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003642 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003854 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.003939 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.004154 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.004243 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.004476 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.004575 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.004778 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.004864 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.005088 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.005175 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.005411 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.005504 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.006234 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.006333 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.006538 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.006624 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.006839 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.006931 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.007140 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.007234 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.007466 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.007595 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.007774 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.007859 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.008081 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.008174 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.008409 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.008500 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.008721 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.008818 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009037 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009135 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009342 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009428 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009656 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009741 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.009966 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010052 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010276 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010362 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010578 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010662 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010885 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.010971 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.011184 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.011267 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.011494 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.011580 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.011810 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.011902 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.012122 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.012214 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.012454 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.012541 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.012764 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.012850 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013079 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013163 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013383 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013477 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013685 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013771 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.013993 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014086 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014293 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014391 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014595 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014686 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014901 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.014987 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.015214 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.015313 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.015523 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.015617 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.015835 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.015928 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.016142 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.016239 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.016469 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.016570 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.016774 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.016859 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017076 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017174 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017376 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017462 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017682 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017768 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.017989 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.018076 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.018291 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.018382 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.018603 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.018689 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.018916 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019002 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019216 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019315 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019514 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019599 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019832 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.019919 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.020144 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.020229 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.020470 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.020560 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.020773 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.020868 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.021074 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.021160 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022057 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022167 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022372 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022459 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022679 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022779 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.022981 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.023149 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.023285 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.023413 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.023596 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.023689 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.023906 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024000 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024212 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024297 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024544 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024631 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024845 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.024946 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.025160 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.025247 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.025466 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.025587 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.025771 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.025858 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026074 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026160 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026377 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026461 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026684 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026771 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.026992 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.027092 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.027297 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.027388 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.027604 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.027690 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.027907 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028001 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028204 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028289 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028533 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028628 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028845 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.028930 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.029149 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.029409 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.029499 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.029740 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.029826 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030059 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030145 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030377 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030463 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030681 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030766 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.030993 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.031078 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.031311 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.031405 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.031621 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.031707 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.031935 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032020 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032241 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032482 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032568 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032658 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032863 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.032950 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.033164 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.033259 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.033469 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.033561 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.033766 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.033858 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034067 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034161 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034368 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034456 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034672 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034756 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.034970 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035056 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035270 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035362 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035567 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035691 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035867 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.035954 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.036168 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.036252 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.036557 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.036647 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.036888 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.036977 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.037197 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.037449 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.037554 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.037834 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.037950 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.038091 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.038179 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.038390 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.038487 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.038688 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.038785 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039015 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039102 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039315 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039415 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039644 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039734 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.039964 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040052 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040267 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040387 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040600 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040703 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040900 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.040995 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.041200 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.041327 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.041504 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.041603 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.041802 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.041903 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.042099 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.042187 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.042400 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.042501 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.042705 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.042800 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043004 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043099 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043302 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043398 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043606 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043707 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043906 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.043994 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.044206 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.044295 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.044527 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.044618 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.044835 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.044923 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.045129 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.045217 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.045439 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.045538 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.045744 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.045892 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046036 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046173 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046308 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046449 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046612 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046755 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.046899 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047035 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047201 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047335 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047505 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047648 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047787 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.047925 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.048096 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.048233 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.048415 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.048519 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.048702 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.048807 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049000 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049088 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049305 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049400 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049609 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049695 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049906 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.049992 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.050228 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.050315 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.050529 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.050615 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.050827 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.050912 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.051118 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.051212 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.051424 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.051511 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.051721 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.051807 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052019 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052106 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052318 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052433 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052680 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052765 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.052981 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053068 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053279 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053372 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053584 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053715 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053879 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.053965 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.054175 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.054261 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.054472 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.054571 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.054776 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.054861 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055072 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055157 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055369 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055465 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055666 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055752 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.055964 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056070 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056259 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056402 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056583 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056671 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056883 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.056969 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.057179 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.057274 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.057478 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.057565 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.057775 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.057860 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058095 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058182 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058395 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058480 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058693 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058778 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.058992 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059079 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059298 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059391 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059601 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059696 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059902 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.059989 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.060208 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.060294 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.060544 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.060643 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.060845 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.060938 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.061144 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.061230 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.061448 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.061541 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.061751 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.061837 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062054 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062139 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062352 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062450 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062660 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062748 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.062962 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063048 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063262 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063357 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063560 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063646 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063861 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.063956 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.064159 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.064254 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.064499 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.064591 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.064807 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.064905 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.065108 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.065196 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.065408 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.065502 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.065712 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.065798 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066021 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066108 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066327 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066413 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066633 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066719 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.066940 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067034 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067247 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067332 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067553 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067639 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067855 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.067949 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.068692 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.068819 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069002 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069154 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069305 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069433 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069626 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069752 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.069932 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070071 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070237 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070326 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070542 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070629 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070842 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.070937 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.071149 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.071235 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.071447 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.071534 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.071754 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.071869 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.072074 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.072162 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.072410 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.072501 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.072737 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.072824 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073040 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073134 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073350 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073436 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073659 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073753 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.073968 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074071 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074266 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074360 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074575 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074662 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074886 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.074979 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.075198 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.075285 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.075509 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.075597 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.075821 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.075908 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.076129 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.076226 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.076455 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.076543 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.076767 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.076855 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077069 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077162 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077370 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077458 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077670 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077764 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.077986 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078081 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078285 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078370 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078591 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078678 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078893 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.078997 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.079201 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.079287 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.079505 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.079592 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.079929 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080024 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080240 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080326 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080576 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080666 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080881 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.080969 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.081189 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.081275 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.081499 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.081586 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.081800 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.081886 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.082111 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.082198 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.082413 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.082498 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.082730 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.082816 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.083049 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.083135 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.083356 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.083450 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.083738 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.084373 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.084594 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.084683 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.084899 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.084998 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.085209 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.085295 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.085531 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.085617 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.085835 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.085930 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.086143 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.086241 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.086447 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.086557 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.086766 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.086862 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.087069 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.087165 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.087388 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.087475 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.087751 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.087844 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088054 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088153 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088376 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088465 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088684 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088816 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.088987 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.089129 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.089305 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.089440 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.089607 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.089760 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.089907 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.090079 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.090212 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.090401 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.090518 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.090727 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.090927 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091018 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091108 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091311 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091406 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091635 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091738 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.091954 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092041 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092261 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092385 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092602 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092692 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092908 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.092996 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.093211 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.093296 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.093528 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.093615 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.093835 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.093921 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.094135 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.094229 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.094435 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.094561 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.094733 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.094856 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.095070 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.095157 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.095370 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.095458 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.095687 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.095780 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096010 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096105 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096333 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096475 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096670 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096757 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.096973 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097106 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097277 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097366 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097598 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097685 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097900 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.097997 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.098209 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.098297 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.098505 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.098591 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099069 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099170 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099394 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099484 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099692 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099778 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.099992 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.100079 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.100295 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.100402 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.100627 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.100726 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.100927 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101016 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101225 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101312 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101523 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101617 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101839 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.101929 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.102138 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.102225 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.102452 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.102539 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.102751 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.102838 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103046 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103131 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103347 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103446 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103643 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103729 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.103988 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.104089 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.104275 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.104472 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.104624 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.104720 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.104934 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105020 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105244 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105345 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105565 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105652 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105871 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.105958 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.106186 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.106286 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.106497 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.106601 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.106806 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.106894 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.107106 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.107193 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.107409 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.107496 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.107718 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.107804 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108017 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108104 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108319 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108483 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108644 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108731 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.108950 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.109037 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.109250 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.109338 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.109549 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.109644 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.109848 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.110062 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.110170 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.110390 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.110488 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.110703 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.110791 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111013 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111109 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111324 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111411 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111632 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111719 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.111933 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112019 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112239 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112324 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112572 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112662 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112881 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.112968 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.113187 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.113287 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.113501 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.113587 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.113814 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.113899 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.114121 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.114215 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.114441 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.114529 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.114749 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.114842 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.115116 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.115222 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.115430 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.115517 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.115739 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.115825 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.116050 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.116145 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.116389 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.116533 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.116710 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.116806 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117011 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117100 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117321 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117407 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117631 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117717 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.117935 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.118021 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.118242 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.118444 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.118551 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.118774 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.118870 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.119088 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.119183 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.119402 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.119498 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.119714 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.119803 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.120026 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.120112 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.120377 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.120511 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.120766 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.121089 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.121398 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.121487 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.121706 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.121791 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.122020 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.122107 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.122346 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.122535 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.122679 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.122872 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.123000 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.123292 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.123379 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.123618 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.123705 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.123942 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.124030 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.124256 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.124342 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.124595 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.124683 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.124912 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.125001 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.125222 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.125336 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.125577 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.125692 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.125889 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.126009 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.126207 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.126442 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.126529 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.126832 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.126959 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.127145 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.127354 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.127449 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.127721 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.127809 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.128030 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.128117 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.128369 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.128460 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.128688 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.128934 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.129221 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.129405 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.129569 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.129690 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.129887 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.130024 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.130220 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.130356 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.130541 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.131174 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.131374 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.131521 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.131678 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.131796 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.132001 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.132101 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.132307 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.132635 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.132732 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.132950 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133037 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133259 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133354 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133562 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133648 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133864 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.133952 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.134177 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.134277 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.134490 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.134669 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.134820 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.134970 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135143 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135270 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135398 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135483 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135690 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135790 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.135991 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.136085 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.136294 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.136402 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.136622 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.136773 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.136931 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137026 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137231 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137318 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137536 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137640 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137837 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.137923 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.138138 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.138388 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.138504 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.138733 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.138868 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139043 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139152 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139337 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139440 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139642 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139730 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.139941 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.140027 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.140246 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.140345 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.140605 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.140700 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.140912 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141000 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141219 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141315 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141518 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141612 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141833 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.141919 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.142136 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.142231 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.142443 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.142530 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.142750 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.142843 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143057 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143145 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143360 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143447 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143673 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143762 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.143979 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.144214 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.144301 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.144569 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.144668 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.144890 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.144985 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.145205 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.145298 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.145516 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.145604 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.145822 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.145917 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.146121 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.146253 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.146997 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.147168 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.147306 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.147498 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.147619 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.147812 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.147923 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.148123 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.148222 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.148457 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.148560 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.148771 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.148858 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.149080 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.149176 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.149390 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.149476 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.149698 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.149789 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150007 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150102 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150313 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150408 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150621 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150717 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.150934 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151022 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151239 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151333 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151544 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151639 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151856 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.151945 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.152162 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.152249 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.152518 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.152607 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.152836 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.152925 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.153150 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.153371 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.153458 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.153706 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.153801 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154026 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154113 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154342 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154427 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154648 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154735 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.154962 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155063 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155265 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155352 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155569 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155657 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155871 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.155957 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.156193 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.156287 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.156531 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.156621 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.156846 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.156944 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.157161 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.157321 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.157477 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.157565 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.157789 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.157877 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.158099 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.158204 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.158410 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.158497 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.158717 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.158803 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159024 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159117 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159333 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159418 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159643 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159739 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.159951 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160040 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160265 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160379 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160596 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160683 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160902 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.160990 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.161204 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.161291 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.161510 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.161609 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.161842 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.161933 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.162151 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.162237 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.162484 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.162585 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.162786 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.162874 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163093 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163179 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163391 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163489 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163690 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163777 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.163989 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.164076 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.164286 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.164402 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.164617 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.164746 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.164915 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.165059 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.165213 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.165381 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.165511 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.165703 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.165811 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166015 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166110 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166336 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166423 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166657 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166743 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.166965 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.167060 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.167334 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.167638 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.167772 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.167940 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.168129 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.168228 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.168501 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.168593 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.168853 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.168939 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.169192 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.169280 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.169508 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.169641 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.169815 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.169902 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.170123 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.170223 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.170429 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.170515 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.170744 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.170830 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171056 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171142 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171364 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171451 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171669 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171767 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.171974 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.172061 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.172287 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.172388 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.172618 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.172713 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.172921 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173014 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173226 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173312 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173529 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173623 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173837 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.173930 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.174136 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.174222 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.174440 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.174540 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.174759 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.174845 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.175078 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.175362 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.175457 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.175688 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.175776 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176001 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176088 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176307 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176426 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176641 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176735 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.176952 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.177040 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.177257 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.177401 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.178080 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.178168 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.178386 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.178471 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.178693 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.178787 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179007 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179093 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179315 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179402 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179622 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179709 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.179934 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.180021 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.180249 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.180342 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.180588 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.180683 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.180910 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181006 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181222 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181309 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181535 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181622 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181848 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.181935 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.182183 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.182278 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.182494 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.182587 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.182804 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.182890 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.183116 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.183211 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.183428 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.183516 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.183741 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.183828 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.184039 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.184132 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.184279 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:04:17.184421 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.184710 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.185018 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.185344 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.185661 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.185986 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.186306 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.186616 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.186947 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.187258 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.187569 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.187883 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.188203 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.188541 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.188860 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.189172 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.189484 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.189799 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.190117 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.190444 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.190772 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.191084 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.191408 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.191735 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.192084 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.192417 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.192768 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.193142 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.193961 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.194273 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.194579 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:04:17.194823 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:04:17.246430 n-d-764486-11 devstack@n-api.service[108381]: INFO dbcounter [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Registered counter for database nova_api Jul 20 04:04:17.257194 n-d-764486-11 devstack@n-api.service[108380]: INFO dbcounter [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Registered counter for database nova_api Jul 20 04:04:17.358302 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_db.sqlalchemy.engines [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.364737 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writer thread running {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.367305 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.373584 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writer thread running {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.420503 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.context [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=108381) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:04:17.424453 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_concurrency.lockutils [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:04:17.426028 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_concurrency.lockutils [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:04:17.426809 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_concurrency.lockutils [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:04:17.428991 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.context [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=108380) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:04:17.429467 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_concurrency.lockutils [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:04:17.431418 n-d-764486-11 devstack@n-api.service[108381]: INFO dbcounter [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Registered counter for database nova_cell0 Jul 20 04:04:17.432930 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:04:17.434518 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:04:17.435263 n-d-764486-11 devstack@n-api.service[108381]: INFO dbcounter [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Registered counter for database nova_cell1 Jul 20 04:04:17.435367 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:04:17.437405 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:04:17.439373 n-d-764486-11 devstack@n-api.service[108380]: INFO dbcounter [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Registered counter for database nova_cell0 Jul 20 04:04:17.442701 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_db.sqlalchemy.engines [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.443800 n-d-764486-11 devstack@n-api.service[108380]: INFO dbcounter [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Registered counter for database nova_cell1 Jul 20 04:04:17.446040 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_db.sqlalchemy.engines [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.451200 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.453821 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.458027 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writer thread running {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.460171 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writer thread running {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.461549 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writer thread running {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.463570 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writer thread running {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.608924 n-d-764486-11 devstack@n-api.service[108380]: INFO dbcounter [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Registered counter for database nova_cell0 Jul 20 04:04:17.611296 n-d-764486-11 devstack@n-api.service[108381]: INFO dbcounter [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Registered counter for database nova_cell0 Jul 20 04:04:17.618142 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.621607 n-d-764486-11 devstack@n-api.service[108381]: DEBUG oslo_db.sqlalchemy.engines [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:04:17.622469 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writer thread running {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.625991 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writer thread running {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:04:17.956658 n-d-764486-11 devstack@n-api.service[108380]: WARNING keystonemiddleware.auth_token [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:04:17.957816 n-d-764486-11 devstack@n-api.service[108381]: WARNING keystonemiddleware.auth_token [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:04:17.964393 n-d-764486-11 devstack@n-api.service[108380]: WARNING keystonemiddleware.auth_token [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:04:17.965707 n-d-764486-11 devstack@n-api.service[108381]: WARNING keystonemiddleware.auth_token [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:04:18.303638 n-d-764486-11 devstack@n-api.service[108380]: WARNING keystonemiddleware.auth_token [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:04:18.307922 n-d-764486-11 devstack@n-api.service[108381]: WARNING keystonemiddleware.auth_token [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:04:18.309628 n-d-764486-11 devstack@n-api.service[108380]: WARNING keystonemiddleware.auth_token [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:04:18.313886 n-d-764486-11 devstack@n-api.service[108381]: WARNING keystonemiddleware.auth_token [None req-56c86d1a-9e57-44d1-be48-fe3264e0dfd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:04:18.314854 n-d-764486-11 devstack@n-api.service[108380]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c9e4189c0 pid: 108380 (default app) Jul 20 04:04:18.316922 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:04:18.318647 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Jul 20 04:04:18.319052 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Jul 20 04:04:18 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:04:18.319640 n-d-764486-11 devstack@n-api.service[108381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561c9e4189c0 pid: 108381 (default app) Jul 20 04:05:33.904994 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:33.906558 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 20 04:05:33.906963 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:33.918747 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writing DB stats nova_api:SELECT=3 {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:33.920114 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writing DB stats nova_cell1:SELECT=3 {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:33.920975 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writing DB stats nova_cell0:SELECT=3 {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:33.922079 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:34.781315 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-928caf66-f93d-444a-9756-e01dbd6c3efa admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:34.811314 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-928caf66-f93d-444a-9756-e01dbd6c3efa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.897707 Jul 20 04:05:34.812611 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:05:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:05:37.029839 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:37.031380 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-e1f1cdc7-0bd1-4856-bddb-bb5ac2e41542 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Jul 20 04:05:37.031777 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:37.497317 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-01c43789-57df-4587-a695-93f27efd04fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "swap": 0, "vcpus": 1, "id": "c1"}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:37.516204 n-d-764486-11 devstack@n-api.service[108381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:05:37.516204 n-d-764486-11 devstack@n-api.service[108381]: warnings.warn(msg) Jul 20 04:05:37.544333 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-01c43789-57df-4587-a695-93f27efd04fa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506506 Jul 20 04:05:37.545450 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:05:37.772244 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-9959a851-c9f9-4c01-8d01-ebaac78791c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:37.774745 n-d-764486-11 devstack@n-api.service[108380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:05:37.774745 n-d-764486-11 devstack@n-api.service[108380]: warnings.warn(msg) Jul 20 04:05:37.777453 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_api:SELECT=3 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:37.778322 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_cell0:SELECT=3 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:37.779104 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_cell1:SELECT=3 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:37.780131 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:05:37.848513 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-9959a851-c9f9-4c01-8d01-ebaac78791c4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294063 Jul 20 04:05:37.849319 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jul 20 04:05:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:05:40.114796 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-01c43789-57df-4587-a695-93f27efd04fa admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:40.115858 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-01c43789-57df-4587-a695-93f27efd04fa admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 20 04:05:40.116258 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:40.870012 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-c7bb7921-3497-49d5-9919-39a96a5b079b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:40.888993 n-d-764486-11 devstack@n-api.service[108380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:05:40.888993 n-d-764486-11 devstack@n-api.service[108380]: warnings.warn(msg) Jul 20 04:05:40.919210 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-c7bb7921-3497-49d5-9919-39a96a5b079b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.796633 Jul 20 04:05:40.920657 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:05:40.936135 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-dd133cbe-d868-4c6f-a03b-100c55bb614a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:40.939448 n-d-764486-11 devstack@n-api.service[108381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:05:40.939448 n-d-764486-11 devstack@n-api.service[108381]: warnings.warn(msg) Jul 20 04:05:40.980368 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-dd133cbe-d868-4c6f-a03b-100c55bb614a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051301 Jul 20 04:05:40.980970 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jul 20 04:05:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:05:43.431200 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-c7bb7921-3497-49d5-9919-39a96a5b079b admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:43.432826 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-c7bb7921-3497-49d5-9919-39a96a5b079b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002399 Jul 20 04:05:43.433594 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:43.949012 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-154d4197-a084-4088-b529-d0a4b49246ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "vcpus": 1}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:43.970110 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-154d4197-a084-4088-b529-d0a4b49246ec admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529571 Jul 20 04:05:43.976737 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:05:43.983717 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-67c2de63-ca9a-4596-aefe-15c25073dafa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:44.009679 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-67c2de63-ca9a-4596-aefe-15c25073dafa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029816 Jul 20 04:05:44.017000 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jul 20 04:05:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:05:46.535164 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-154d4197-a084-4088-b529-d0a4b49246ec admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:46.536185 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-154d4197-a084-4088-b529-d0a4b49246ec admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 04:05:46.537333 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:46.904337 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-6634fa4d-83c3-4bb2-85da-d4e5357cab68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "name": "ds2G"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:46.924590 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-6634fa4d-83c3-4bb2-85da-d4e5357cab68 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.381991 Jul 20 04:05:46.925245 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:05:46.938079 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-9bff80a8-a1a7-41a7-859a-c7559d7997ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:46.961612 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-9bff80a8-a1a7-41a7-859a-c7559d7997ef admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027805 Jul 20 04:05:46.962363 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jul 20 04:05:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:05:49.291715 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-6634fa4d-83c3-4bb2-85da-d4e5357cab68 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:49.292758 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-6634fa4d-83c3-4bb2-85da-d4e5357cab68 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 20 04:05:49.293154 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:49.770433 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-44879bbd-5914-4226-81a2-a6e4bd325c89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:49.789573 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-44879bbd-5914-4226-81a2-a6e4bd325c89 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489794 Jul 20 04:05:49.800525 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:05:49.805224 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-51a59f61-5f1d-4ab4-ac23-4254500a4cbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:49.830146 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-51a59f61-5f1d-4ab4-ac23-4254500a4cbb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028197 Jul 20 04:05:49.831478 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jul 20 04:05:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:05:52.161616 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-44879bbd-5914-4226-81a2-a6e4bd325c89 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:52.162748 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-44879bbd-5914-4226-81a2-a6e4bd325c89 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 20 04:05:52.163623 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:52.605794 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-20436a60-780c-4916-b69b-ab599a172c5e admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:52.628932 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-20436a60-780c-4916-b69b-ab599a172c5e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458841 Jul 20 04:05:52.644386 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:05:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:05:54.888289 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-44879bbd-5914-4226-81a2-a6e4bd325c89 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:54.889458 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-44879bbd-5914-4226-81a2-a6e4bd325c89 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Jul 20 04:05:54.889869 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:55.302856 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-9cb8fc92-6a98-4869-9e96-645d05ce0623 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:55.320168 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-9cb8fc92-6a98-4869-9e96-645d05ce0623 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.424264 Jul 20 04:05:55.320689 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:05:55.332587 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-1ca90d04-f0f7-406d-9f82-3f985f65e42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:55.356120 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-1ca90d04-f0f7-406d-9f82-3f985f65e42d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027242 Jul 20 04:05:55.357706 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jul 20 04:05:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:05:57.560607 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-9cb8fc92-6a98-4869-9e96-645d05ce0623 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:05:57.561619 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-9cb8fc92-6a98-4869-9e96-645d05ce0623 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jul 20 04:05:57.562026 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:05:57.983138 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-09e93a35-8833-4aab-8ae1-3a8e2d686520 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "2", "ram": 2048, "name": "m1.small", "disk": 20}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:58.001267 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-09e93a35-8833-4aab-8ae1-3a8e2d686520 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433075 Jul 20 04:05:58.001784 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:05:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:05:58.014389 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-f6d701f1-0946-4b5b-8332-3ae70e734d33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:05:58.037122 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-f6d701f1-0946-4b5b-8332-3ae70e734d33 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026963 Jul 20 04:05:58.037680 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jul 20 04:05:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:06:00.307176 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-09e93a35-8833-4aab-8ae1-3a8e2d686520 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:00.308184 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-09e93a35-8833-4aab-8ae1-3a8e2d686520 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 20 04:06:00.308614 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:00.705841 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-66a28952-2acf-467f-9750-7afb1eb6fa6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "swap": 0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:00.723628 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-66a28952-2acf-467f-9750-7afb1eb6fa6d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.409104 Jul 20 04:06:00.724173 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:06:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:06:00.735815 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-a01d59c3-85b3-4c1f-9315-42882ea3c038 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:00.758393 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-a01d59c3-85b3-4c1f-9315-42882ea3c038 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026197 Jul 20 04:06:00.759164 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jul 20 04:06:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:06:02.986723 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-66a28952-2acf-467f-9750-7afb1eb6fa6d admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:02.987735 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-66a28952-2acf-467f-9750-7afb1eb6fa6d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 20 04:06:02.988134 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:03.401422 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-b2e829c4-4128-47bc-a2ff-346a59627d2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:03.422412 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-b2e829c4-4128-47bc-a2ff-346a59627d2c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.428221 Jul 20 04:06:03.422970 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:06:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:06:03.434880 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-89357973-9382-49ed-9d32-6680ba0ff99a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:03.460398 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-89357973-9382-49ed-9d32-6680ba0ff99a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029118 Jul 20 04:06:03.461722 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jul 20 04:06:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:06:05.801371 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-b2e829c4-4128-47bc-a2ff-346a59627d2c admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:05.803030 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-b2e829c4-4128-47bc-a2ff-346a59627d2c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002504 Jul 20 04:06:05.803429 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:06.252407 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-05674b0a-f2d6-48bb-942f-f29a9417ec85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:06.271615 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-05674b0a-f2d6-48bb-942f-f29a9417ec85 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462109 Jul 20 04:06:06.281354 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jul 20 04:06:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:06:06.284936 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-bf45010e-2f15-4954-94f0-2dd1e9e1bacc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:06.289898 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:06.309212 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-bf45010e-2f15-4954-94f0-2dd1e9e1bacc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027977 Jul 20 04:06:06.310121 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jul 20 04:06:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:06:30.310256 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-05674b0a-f2d6-48bb-942f-f29a9417ec85 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:30.311269 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-05674b0a-f2d6-48bb-942f-f29a9417ec85 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 20 04:06:30.311668 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:30.696243 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-6b3df877-e13d-474f-aeb9-707b87f2f6be admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:30.713396 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-6b3df877-e13d-474f-aeb9-707b87f2f6be admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395872 Jul 20 04:06:30.713931 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:06:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:06:31.771247 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-05674b0a-f2d6-48bb-942f-f29a9417ec85 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:31.772244 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-05674b0a-f2d6-48bb-942f-f29a9417ec85 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 20 04:06:31.772670 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:32.304613 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-86bb2e6a-9006-47a4-ab70-28124be90ef4 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:32.310123 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.wsgi [None req-86bb2e6a-9006-47a4-ab70-28124be90ef4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-86bb2e6a-9006-47a4-ab70-28124be90ef4 admin admin] Request method failure captured: Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Accept: application/json Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Accept-Encoding: gzip, deflate Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Connection: keep-alive Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Content-Length: 0 Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Host: 10.222.0.49 Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Openstack-Api-Version: compute 2.90 Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: Openstack-System-Scope: None Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: User-Agent: python-novaclient Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Auth-Token: gAAAAABi139HsIiKmBxpaV6Zbga4c4Jb0gfGfQ7f_FhF2nxoEIQzRyCGcB9tH9mYeIkU6r1UMsTmgmF-5gz-odsdChhsGy6XXYjF6V5XmPo9SjltaEyFvJodUNYxGjMZ7FyAnQE4A4mZ9vkcHrBxWDEjrTB__P177r9CL3vElsiSvFUf_vlv_ys Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Domain-Id: None Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Domain-Name: None Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Identity-Status: Confirmed Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Is-Admin-Project: True Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Domain-Id: default Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Domain-Name: Default Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Name: admin Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Role: member,reader,admin Jul 20 04:06:32.313358 n-d-764486-11 devstack@n-api.service[108381]: X-Roles: member,reader,admin Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_81b279f4131e4077b1cf11523534d3b8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant: admin Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant-Name: admin Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-User: admin Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-User-Domain-Id: default Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-User-Domain-Name: Default Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-User-Id: 14380145625b448ba177d5a91c909f0d Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: X-User-Name: admin Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: method: > Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: exception: Flavor 42 could not be found. Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: action_args: {'id': '42'} Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:06:32.315034 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:32.316250 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.317724 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-86bb2e6a-9006-47a4-ab70-28124be90ef4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:06:32.319036 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-86bb2e6a-9006-47a4-ab70-28124be90ef4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388646 Jul 20 04:06:32.319036 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:06:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:06:32.324833 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-2b87d8d2-d716-4dcf-83cd-1f4b5e48b3bb admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:32.327702 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:06:32.347903 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-2b87d8d2-d716-4dcf-83cd-1f4b5e48b3bb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027136 Jul 20 04:06:32.348475 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:06:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:06:32.358023 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-0e64cf6d-cb4c-43a6-bfb2-5e53ba24067f admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:32.378818 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-0e64cf6d-cb4c-43a6-bfb2-5e53ba24067f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024373 Jul 20 04:06:32.379350 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:06:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:06:32.388944 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-34f936d0-c722-44e5-b481-c11b98d578f9 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:32.395176 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.wsgi [None req-34f936d0-c722-44e5-b481-c11b98d578f9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-34f936d0-c722-44e5-b481-c11b98d578f9 admin admin] Request method failure captured: Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Accept: application/json Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Accept-Encoding: gzip, deflate Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Connection: keep-alive Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Content-Length: 0 Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Host: 10.222.0.49 Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Openstack-Api-Version: compute 2.90 Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: Openstack-System-Scope: None Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: User-Agent: python-novaclient Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Auth-Token: gAAAAABi139HsIiKmBxpaV6Zbga4c4Jb0gfGfQ7f_FhF2nxoEIQzRyCGcB9tH9mYeIkU6r1UMsTmgmF-5gz-odsdChhsGy6XXYjF6V5XmPo9SjltaEyFvJodUNYxGjMZ7FyAnQE4A4mZ9vkcHrBxWDEjrTB__P177r9CL3vElsiSvFUf_vlv_ys Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Domain-Id: None Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Domain-Name: None Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Identity-Status: Confirmed Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Is-Admin-Project: True Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Domain-Id: default Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Domain-Name: Default Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Name: admin Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Role: member,reader,admin Jul 20 04:06:32.398449 n-d-764486-11 devstack@n-api.service[108380]: X-Roles: member,reader,admin Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_81b279f4131e4077b1cf11523534d3b8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant: admin Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant-Name: admin Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-User: admin Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-User-Domain-Id: default Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-User-Domain-Name: Default Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-User-Id: 14380145625b448ba177d5a91c909f0d Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: X-User-Name: admin Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: method: > Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: exception: Flavor 42 could not be found. Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: action_args: {'id': '42'} Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:06:32.399985 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:32.401065 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:32.403124 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-34f936d0-c722-44e5-b481-c11b98d578f9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:06:32.404406 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-34f936d0-c722-44e5-b481-c11b98d578f9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014890 Jul 20 04:06:32.404406 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:06:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:06:33.358248 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-0e64cf6d-cb4c-43a6-bfb2-5e53ba24067f admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:33.359257 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-0e64cf6d-cb4c-43a6-bfb2-5e53ba24067f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 20 04:06:33.359652 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:33.877834 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-5692bc91-2d29-420f-99c7-7d7af92efc85 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:33.883744 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.wsgi [None req-5692bc91-2d29-420f-99c7-7d7af92efc85 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-5692bc91-2d29-420f-99c7-7d7af92efc85 admin admin] Request method failure captured: Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Accept: application/json Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Accept-Encoding: gzip, deflate Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Connection: keep-alive Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Content-Length: 0 Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Host: 10.222.0.49 Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Openstack-Api-Version: compute 2.90 Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: Openstack-System-Scope: None Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: User-Agent: python-novaclient Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Auth-Token: gAAAAABi139JaMhS5ZhlUg64AJhCOPktSUtj29Q6vXk1s7N94mPyk_r_Qg1NzWigbzJZC5tDZb8a7QVIW3gOwdTYZ_L-Y-KcuZGqcFG8yoBIpW0wwMzJkQ1XhfYNig3GDJNF74PymxUrAu-Ke23H81x-sp_BkRtgAIKR3FAbn8x1NtrZIQT_GfM Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Domain-Id: None Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Domain-Name: None Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Identity-Status: Confirmed Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Is-Admin-Project: True Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Domain-Id: default Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Domain-Name: Default Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Name: admin Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Role: member,reader,admin Jul 20 04:06:33.885282 n-d-764486-11 devstack@n-api.service[108380]: X-Roles: member,reader,admin Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_81b279f4131e4077b1cf11523534d3b8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant: admin Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant-Name: admin Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-User: admin Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-User-Domain-Id: default Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-User-Domain-Name: Default Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-User-Id: 14380145625b448ba177d5a91c909f0d Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: X-User-Name: admin Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: method: > Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: exception: Flavor 84 could not be found. Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: action_args: {'id': '84'} Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:06:33.887364 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:33.888247 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.889613 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-5692bc91-2d29-420f-99c7-7d7af92efc85 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:06:33.890874 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-5692bc91-2d29-420f-99c7-7d7af92efc85 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391204 Jul 20 04:06:33.890874 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:06:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:06:33.896741 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-50fdcd8a-4672-45a7-9316-7f2dabe22421 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:33.911624 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-50fdcd8a-4672-45a7-9316-7f2dabe22421 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018441 Jul 20 04:06:33.912153 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:06:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:06:33.921470 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-869da83b-c923-4a75-977c-edd43e6f6329 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:33.934981 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-869da83b-c923-4a75-977c-edd43e6f6329 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016967 Jul 20 04:06:33.935501 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:06:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:06:33.945016 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-16ee73fe-619a-4164-bf15-c2324016befa admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:33.950835 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.wsgi [None req-16ee73fe-619a-4164-bf15-c2324016befa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-16ee73fe-619a-4164-bf15-c2324016befa admin admin] Request method failure captured: Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Accept: application/json Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Accept-Encoding: gzip, deflate Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Connection: keep-alive Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Content-Length: 0 Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Host: 10.222.0.49 Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Openstack-Api-Version: compute 2.90 Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: Openstack-System-Scope: None Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: User-Agent: python-novaclient Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Auth-Token: gAAAAABi139JaMhS5ZhlUg64AJhCOPktSUtj29Q6vXk1s7N94mPyk_r_Qg1NzWigbzJZC5tDZb8a7QVIW3gOwdTYZ_L-Y-KcuZGqcFG8yoBIpW0wwMzJkQ1XhfYNig3GDJNF74PymxUrAu-Ke23H81x-sp_BkRtgAIKR3FAbn8x1NtrZIQT_GfM Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Domain-Id: None Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Domain-Name: None Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Identity-Status: Confirmed Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Is-Admin-Project: True Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Domain-Id: default Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Domain-Name: Default Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Name: admin Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Role: member,reader,admin Jul 20 04:06:33.952321 n-d-764486-11 devstack@n-api.service[108381]: X-Roles: member,reader,admin Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_81b279f4131e4077b1cf11523534d3b8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant: admin Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant-Name: admin Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-User: admin Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-User-Domain-Id: default Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-User-Domain-Name: Default Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-User-Id: 14380145625b448ba177d5a91c909f0d Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: X-User-Name: admin Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: method: > Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: exception: Flavor 84 could not be found. Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: action_args: {'id': '84'} Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:06:33.953801 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:33.954634 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:33.956297 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-16ee73fe-619a-4164-bf15-c2324016befa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:06:33.957554 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-16ee73fe-619a-4164-bf15-c2324016befa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012822 Jul 20 04:06:33.957554 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:06:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:06:34.912395 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-869da83b-c923-4a75-977c-edd43e6f6329 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:34.913590 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-869da83b-c923-4a75-977c-edd43e6f6329 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jul 20 04:06:34.913985 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:35.428496 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-1c20fc23-956b-4ca2-83c1-761a4681a1cb admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:35.434288 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.wsgi [None req-1c20fc23-956b-4ca2-83c1-761a4681a1cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-1c20fc23-956b-4ca2-83c1-761a4681a1cb admin admin] Request method failure captured: Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Accept: application/json Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Accept-Encoding: gzip, deflate Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Connection: keep-alive Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Content-Length: 0 Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Host: 10.222.0.49 Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Openstack-Api-Version: compute 2.90 Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: Openstack-System-Scope: None Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: User-Agent: python-novaclient Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Auth-Token: gAAAAABi139KBzRRug7pzFfHyL5TiWkMAtzkOsTLmpmXQnR3GPublZPiD3M0_DgCdnW9ADSoTaH_7s6mdt0kWFkB6rrI1M2yGKWqavR9sj-H7-sJlU-lsZd10bstqDylkclljSvkSgbRn-RbL5C8ob1KTAaRiBB2_o-bjBwXKQDr3XjSFv27-ic Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Domain-Id: None Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Domain-Name: None Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Identity-Status: Confirmed Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Is-Admin-Project: True Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Domain-Id: default Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Domain-Name: Default Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Project-Name: admin Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Role: member,reader,admin Jul 20 04:06:35.435765 n-d-764486-11 devstack@n-api.service[108381]: X-Roles: member,reader,admin Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_81b279f4131e4077b1cf11523534d3b8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant: admin Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-Tenant-Name: admin Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-User: admin Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-User-Domain-Id: default Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-User-Domain-Name: Default Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-User-Id: 14380145625b448ba177d5a91c909f0d Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: X-User-Name: admin Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: method: > Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: exception: Flavor 451 could not be found. Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: action_args: {'id': '451'} Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:06:35.437326 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:35.438288 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.439648 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-1c20fc23-956b-4ca2-83c1-761a4681a1cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:06:35.440941 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-1c20fc23-956b-4ca2-83c1-761a4681a1cb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387526 Jul 20 04:06:35.440941 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:06:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:06:35.446827 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-9d64ecb6-edb2-43c0-bd13-ea48e6f8a19f admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:35.460677 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-9d64ecb6-edb2-43c0-bd13-ea48e6f8a19f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017389 Jul 20 04:06:35.461390 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:06:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:06:35.473463 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:35.488109 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019021 Jul 20 04:06:35.488669 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:06:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:06:35.498519 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-f2627bc7-2762-4ca3-884e-9aee2e86f24f admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:35.503942 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.wsgi [None req-f2627bc7-2762-4ca3-884e-9aee2e86f24f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-f2627bc7-2762-4ca3-884e-9aee2e86f24f admin admin] Request method failure captured: Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Accept: application/json Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Accept-Encoding: gzip, deflate Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Connection: keep-alive Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Content-Length: 0 Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Host: 10.222.0.49 Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Openstack-Api-Version: compute 2.90 Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: Openstack-System-Scope: None Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: User-Agent: python-novaclient Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Auth-Token: gAAAAABi139KBzRRug7pzFfHyL5TiWkMAtzkOsTLmpmXQnR3GPublZPiD3M0_DgCdnW9ADSoTaH_7s6mdt0kWFkB6rrI1M2yGKWqavR9sj-H7-sJlU-lsZd10bstqDylkclljSvkSgbRn-RbL5C8ob1KTAaRiBB2_o-bjBwXKQDr3XjSFv27-ic Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Domain-Id: None Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Domain-Name: None Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Identity-Status: Confirmed Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Is-Admin-Project: True Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Domain-Id: default Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Domain-Name: Default Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Project-Name: admin Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Role: member,reader,admin Jul 20 04:06:35.505505 n-d-764486-11 devstack@n-api.service[108380]: X-Roles: member,reader,admin Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/81b279f4131e4077b1cf11523534d3b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_81b279f4131e4077b1cf11523534d3b8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant: admin Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant-Id: 81b279f4131e4077b1cf11523534d3b8 Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-Tenant-Name: admin Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-User: admin Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-User-Domain-Id: default Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-User-Domain-Name: Default Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-User-Id: 14380145625b448ba177d5a91c909f0d Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: X-User-Name: admin Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: method: > Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: exception: Flavor 451 could not be found. Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: action_args: {'id': '451'} Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:06:35.506853 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:35.507642 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: ERROR nova.api.openstack.wsgi Jul 20 04:06:35.508732 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-f2627bc7-2762-4ca3-884e-9aee2e86f24f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:06:35.509881 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-f2627bc7-2762-4ca3-884e-9aee2e86f24f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012250 Jul 20 04:06:35.509881 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:06:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 04:06:36.473726 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:36.474735 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 04:06:36.475164 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:36.995320 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-a7bbb534-6fec-4bb1-9318-ef6d95d44ce7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:37.013122 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-a7bbb534-6fec-4bb1-9318-ef6d95d44ce7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402996 Jul 20 04:06:37.013666 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jul 20 04:06:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:06:37.981173 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:37.982184 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 20 04:06:37.982577 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:38.497001 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-75124b10-f1d0-4068-bded-827b3efc6b5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:38.513914 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-75124b10-f1d0-4068-bded-827b3efc6b5a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.394406 Jul 20 04:06:38.514458 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jul 20 04:06:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:06:39.478439 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:39.479426 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 20 04:06:39.479818 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:40.003427 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-89d0a9fa-ecc9-44e5-897a-b9b42826537f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:40.021486 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-89d0a9fa-ecc9-44e5-897a-b9b42826537f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404574 Jul 20 04:06:40.022031 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jul 20 04:06:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:06:40.979797 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:40.981476 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 04:06:40.981872 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:41.493740 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-337a434e-99fd-4573-9e9a-241fc19cd7a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:06:41.515015 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-337a434e-99fd-4573-9e9a-241fc19cd7a4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.397653 Jul 20 04:06:41.515589 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jul 20 04:06:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:06:42.487068 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:42.488063 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 20 04:06:42.488492 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:06:43.006027 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-f2241337-8903-4c8b-9a19-4e9ed85f5bd2 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:06:43.024708 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-f2241337-8903-4c8b-9a19-4e9ed85f5bd2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400881 Jul 20 04:06:43.025246 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Jul 20 04:06:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:07:34.377370 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.378454 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-80d07f85-f6e6-4c1f-9aed-a5f5de0a429b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 04:07:34.378853 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:07:34.390030 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:34.766551 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-9b17159b-775a-4fbf-8c52-aa7f18e7f71f admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.786040 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-9b17159b-775a-4fbf-8c52-aa7f18e7f71f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401134 Jul 20 04:07:34.786574 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:07:34.810110 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-671f5117-25eb-4971-8c79-36d6f8a55002 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.813465 n-d-764486-11 devstack@n-api.service[108381]: DEBUG dbcounter [-] [108381] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=108381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:07:34.818883 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-671f5117-25eb-4971-8c79-36d6f8a55002 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012383 Jul 20 04:07:34.819402 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:07:34.830791 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-827fa0e4-6d36-4735-91e6-7c1442af41bf admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.838316 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-827fa0e4-6d36-4735-91e6-7c1442af41bf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010999 Jul 20 04:07:34.838818 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:34.851303 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-be7b4799-ec36-4394-940e-0c0f868f6af0 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.860030 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-be7b4799-ec36-4394-940e-0c0f868f6af0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012823 Jul 20 04:07:34.860631 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:07:34.871629 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-54c2f253-4762-4f32-8913-6a1c478b0c1b admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:07:34.879260 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-54c2f253-4762-4f32-8913-6a1c478b0c1b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011077 Jul 20 04:07:34.879767 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Wed Jul 20 04:07:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:12:51.883442 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-be7b4799-ec36-4394-940e-0c0f868f6af0 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:51.884488 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-be7b4799-ec36-4394-940e-0c0f868f6af0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 20 04:12:51.884884 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:52.024465 n-d-764486-11 devstack@n-api.service[108380]: DEBUG dbcounter [-] [108380] Writing DB stats nova_api:SELECT=6 {{(pid=108380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:12:52.164214 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-54a4b174-503c-443e-9104-053f5259147b admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:52.165396 n-d-764486-11 devstack@n-api.service[108380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:52.165396 n-d-764486-11 devstack@n-api.service[108380]: warnings.warn(msg) Jul 20 04:12:52.166590 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-54a4b174-503c-443e-9104-053f5259147b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.167053 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-54a4b174-503c-443e-9104-053f5259147b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.167839 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-54a4b174-503c-443e-9104-053f5259147b admin admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:52.168264 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-54a4b174-503c-443e-9104-053f5259147b admin admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:52.209524 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-54a4b174-503c-443e-9104-053f5259147b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.185760 Jul 20 04:12:52.210403 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:12:52 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:12:53.031753 n-d-764486-11 devstack@n-api.service[108381]: DEBUG nova.api.openstack.wsgi [None req-be7b4799-ec36-4394-940e-0c0f868f6af0 admin admin] Calling method '>' {{(pid=108381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.032795 n-d-764486-11 devstack@n-api.service[108381]: INFO nova.api.openstack.requestlog [None req-be7b4799-ec36-4394-940e-0c0f868f6af0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 20 04:12:53.033196 n-d-764486-11 devstack@n-api.service[108381]: [pid: 108381|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:12:53.224290 n-d-764486-11 devstack@n-api.service[108380]: DEBUG nova.api.openstack.wsgi [None req-174d971e-ca7f-4b9b-90ef-d817801a97e9 admin admin] Calling method '>' {{(pid=108380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:12:53.225488 n-d-764486-11 devstack@n-api.service[108380]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:12:53.225488 n-d-764486-11 devstack@n-api.service[108380]: warnings.warn(msg) Jul 20 04:12:53.226653 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-174d971e-ca7f-4b9b-90ef-d817801a97e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.227083 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-174d971e-ca7f-4b9b-90ef-d817801a97e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.227854 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-174d971e-ca7f-4b9b-90ef-d817801a97e9 admin admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:12:53.228304 n-d-764486-11 devstack@n-api.service[108380]: DEBUG oslo_concurrency.lockutils [None req-174d971e-ca7f-4b9b-90ef-d817801a97e9 admin admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:12:53.251485 n-d-764486-11 devstack@n-api.service[108380]: INFO nova.api.openstack.requestlog [None req-174d971e-ca7f-4b9b-90ef-d817801a97e9 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.078753 Jul 20 04:12:53.251972 n-d-764486-11 devstack@n-api.service[108380]: [pid: 108380|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:12:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:13:41.202930 n-d-764486-11 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 04:13:41.203681 n-d-764486-11 devstack@n-api.service[108379]: Wed Jul 20 04:13:41 2022 - graceful shutdown triggered... Jul 20 04:13:41.204177 n-d-764486-11 devstack@n-api.service[108380]: Gracefully killing worker 1 (pid: 108380)... Jul 20 04:13:41.204582 n-d-764486-11 devstack@n-api.service[108381]: Gracefully killing worker 2 (pid: 108381)... Jul 20 04:13:42.204536 n-d-764486-11 devstack@n-api.service[108379]: worker 1 buried after 1 seconds Jul 20 04:13:42.204536 n-d-764486-11 devstack@n-api.service[108379]: worker 2 buried after 1 seconds Jul 20 04:13:42.204536 n-d-764486-11 devstack@n-api.service[108379]: goodbye to uWSGI. Jul 20 04:13:42.206103 n-d-764486-11 systemd[1]: devstack@n-api.service: Succeeded. Jul 20 04:13:42.206750 n-d-764486-11 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 04:13:42.209932 n-d-764486-11 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 04:13:42.227403 n-d-764486-11 devstack@n-api.service[123712]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 04:13:42 2022] *** Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: nodename: n-d-764486-11 Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: machine: x86_64 Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: clock source: unix Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: pcre jit disabled Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: detected number of CPU cores: 4 Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: current working directory: / Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: detected binary path: /usr/bin/uwsgi-core Jul 20 04:13:42.251506 n-d-764486-11 devstack@n-api.service[123712]: your processes number limit is 47680 Jul 20 04:13:42.252647 n-d-764486-11 devstack@n-api.service[123712]: your memory page size is 4096 bytes Jul 20 04:13:42.252647 n-d-764486-11 devstack@n-api.service[123712]: detected max file descriptor number: 2048 Jul 20 04:13:42.252647 n-d-764486-11 devstack@n-api.service[123712]: lock engine: pthread robust mutexes Jul 20 04:13:42.252647 n-d-764486-11 devstack@n-api.service[123712]: thunder lock: enabled Jul 20 04:13:42.252647 n-d-764486-11 devstack@n-api.service[123712]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 04:13:42.252647 n-d-764486-11 devstack@n-api.service[123712]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 04:13:42.296181 n-d-764486-11 devstack@n-api.service[123712]: Python main interpreter initialized at 0x56022ce9b9c0 Jul 20 04:13:42.296181 n-d-764486-11 devstack@n-api.service[123712]: python threads support enabled Jul 20 04:13:42.296181 n-d-764486-11 devstack@n-api.service[123712]: your server socket listen backlog is limited to 100 connections Jul 20 04:13:42.296181 n-d-764486-11 devstack@n-api.service[123712]: your mercy for graceful operations on workers is 90 seconds Jul 20 04:13:42.296664 n-d-764486-11 devstack@n-api.service[123712]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 04:13:42.296664 n-d-764486-11 devstack@n-api.service[123712]: *** Operational MODE: preforking *** Jul 20 04:13:42.296904 n-d-764486-11 devstack@n-api.service[123712]: *** uWSGI is running in multiple interpreter mode *** Jul 20 04:13:42.296904 n-d-764486-11 devstack@n-api.service[123712]: spawned uWSGI master process (pid: 123712) Jul 20 04:13:42.297114 n-d-764486-11 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 04:13:42.297975 n-d-764486-11 devstack@n-api.service[123712]: spawned uWSGI worker 1 (pid: 123723, cores: 1) Jul 20 04:13:42.298094 n-d-764486-11 devstack@n-api.service[123712]: spawned uWSGI worker 2 (pid: 123724, cores: 1) Jul 20 04:13:42.300394 n-d-764486-11 devstack@n-api.service[123712]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 04:13:42.952447 n-d-764486-11 devstack@n-api.service[123723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:13:42.953072 n-d-764486-11 devstack@n-api.service[123724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 04:13:44.154113 n-d-764486-11 devstack@n-api.service[123723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:13:44.154113 n-d-764486-11 devstack@n-api.service[123723]: from cryptography.utils import int_from_bytes Jul 20 04:13:44.154746 n-d-764486-11 devstack@n-api.service[123723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:13:44.154746 n-d-764486-11 devstack@n-api.service[123723]: from cryptography.utils import int_from_bytes Jul 20 04:13:44.160753 n-d-764486-11 devstack@n-api.service[123724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:13:44.160753 n-d-764486-11 devstack@n-api.service[123724]: from cryptography.utils import int_from_bytes Jul 20 04:13:44.161218 n-d-764486-11 devstack@n-api.service[123724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 04:13:44.161218 n-d-764486-11 devstack@n-api.service[123724]: from cryptography.utils import int_from_bytes Jul 20 04:13:46.485785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:13:46.486322 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:13:46.486556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:13:46.486917 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:13:46.487170 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:13:46.487551 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.487872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.488188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.488526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.488853 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.489159 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.489475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.489791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.490155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.490413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.490724 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.491045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764486-11 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.491361 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.491661 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.491967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.492282 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.492604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.492977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.493227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.493718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.494164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.494467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.494903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.495105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.495416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.495725 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.496045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.496379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.496897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.497017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 04:13:46.497422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.497589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 04:13:46.497706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 04:13:46.497983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764486-11 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.498156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 04:13:46.498254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.498343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 04:13:46.498649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.498782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.498969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.499116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.499275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.499595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.499768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.499936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.500180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.500304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.500516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.500648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.500842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.500948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.501172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.501280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.501450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.501556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.501763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.501862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.502098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.502211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-764486-11 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.502414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.502515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.502731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.502828 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503330 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503765 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.503952 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.504111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.504264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.504435 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.504564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.504769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.504889 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.505079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.505183 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.505383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.505485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.505721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.505847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506046 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506296 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.506862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.507941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.508093 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.508338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-764486-11 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.508469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.508703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.508797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509004 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509606 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.509919 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.510035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.510235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.510352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.510552 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.510661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.510871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511170 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.511919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.512112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.512214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.512468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.512575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.512784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.512887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.513088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.513185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.513393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.513490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.513711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.513826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.514961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.515182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.515276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.515501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.515595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.515745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.515852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.516042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.516147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.516295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.516416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.516651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.516746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.517998 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.518995 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519894 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.519996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.520196 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.520315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.520527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.520640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.520841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.520951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.521154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.521742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.521963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522565 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.522964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.523179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.523280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.523479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.523571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.523796 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.523890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.524261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.524439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.524547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.524634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.524724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.524816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525444 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.525907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.526964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.527137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.527310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.527470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.527627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.527781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.527930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.528931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529057 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.529940 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.530149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.530256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.530453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.530546 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.530762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.530918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.531097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.531236 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.531385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.531536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.531683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.531834 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.531990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.532128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.532267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.532418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.532560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.532686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.532879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.533015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.533183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.533343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.533486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.533661 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.533803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.533970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.534109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.534280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.534436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.534603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.534706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.534912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.535022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.535223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.535323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.535533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.535641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.535850 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.535951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.536164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.536265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.536500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.536592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.536826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.536967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.537680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.537798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.538005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.538126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.538317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.538421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.538630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.538723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.538933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.539030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.539238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.539339 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.539549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.539641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.539849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.539947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.540170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.540270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.540561 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.540664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.540886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.541022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.541193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.541287 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.541499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.541600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.541807 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.541906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 04:13:46.542117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.542219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.542438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.542537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.542762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.542898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543384 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.543996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.544144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.544304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.544481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.544637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.544779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.544944 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.545036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.545258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.545360 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.545572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.545671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.545884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.546085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.546206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.546400 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.546523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.546714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.546852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.547949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.548116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.548251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.548458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.548570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.548790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.548890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.549109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.549208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.549423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.549530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.549764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.549865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.550065 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.550164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.550393 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.550497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.550694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.550797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551312 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.551935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.552041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.552258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.552386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.552629 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.552721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.552934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553561 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553863 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.553962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.554173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.554272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.554471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.554570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.554780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.554880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.555116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.555216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.555429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.555532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.555738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.555842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556371 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.556994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.557132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.557307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.557441 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.557615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.557777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.557920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.558106 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.558225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.558409 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.558545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.558730 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.558824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559364 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.559974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560275 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.560999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.561211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.561350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.561512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.561652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.561813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.561905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.562114 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.562220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.562413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.562513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.562711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.562804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563339 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.563938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.564049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.564236 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.564428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.564572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.564664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.564886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565018 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.565921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.566143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.566235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.566450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.566550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.566758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.566849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.567998 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.568091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.568342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.568478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.568670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.568773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.568971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.569996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.570201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.570295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.570501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.570592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.570803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.570908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.571125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.571266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.571411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.571502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.571703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.571804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572106 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.572979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.573087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.573299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.573403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.573588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.573693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.573920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.574934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.575147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.575247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.575467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.575572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.575775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.575875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.576089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.576188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.576413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.576528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.576724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.576823 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577130 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.577972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.578063 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.578289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.578380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.578596 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.578696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.578901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.579906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.580121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.580221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.580455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.580550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.580768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.580896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.581070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.581194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.581366 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.581485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.581678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.581805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.582545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.582698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.582818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.582928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.583045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.583171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.583312 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.583495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.583620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584338 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.584999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.585908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.586111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.586201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.586409 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.586510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.586709 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.586808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.587969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.588062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.588278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.588408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.588615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.588708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.588923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.589930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.590143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.590246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.590450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.590543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.590758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.591124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.591323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.591422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.591628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.591719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.591932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592339 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592869 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.592978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.593174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.593278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.593484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.593626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.593778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.593870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.594091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.594184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.594393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.594657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.594770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.594981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.595188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.595315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.595445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.595576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.595671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.595883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596301 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.596963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.597158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.597250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.597474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.597574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.597778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.597882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598387 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598783 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.598993 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.599083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.599292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.599423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.600152 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.600246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.600484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.600593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.600785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.600877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.601993 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.602987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.603196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.603294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.603502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.603594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.603799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.603908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.604097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.604372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.604511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.604760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.604878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.605981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.606120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.606286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.606391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.606588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.606681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.606909 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.607900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.608108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.608199 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.608431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.608527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.608732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.608832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609335 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.609943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610236 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610626 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610833 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.610932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.611143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.611242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.611448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.611541 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.611745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.611846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612674 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.612975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613073 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613889 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.613997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.614188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.614280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.614486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.614632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.614784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.614891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.615139 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.615254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.615449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.615546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.615749 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.615848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.616994 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.617132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.617301 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.617401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.617601 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.617702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.617902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618012 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618607 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.618925 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.619119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.619247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.619421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.619512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.619717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.619816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620312 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.620938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621831 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.621931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.622128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.622221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.622436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.622536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.622738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.622830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.623927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.624097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.624238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.624330 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.624574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.624720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.624876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.625930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.626110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.626229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.626419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.626533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.626717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.626813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.627933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.628974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.629175 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.629292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.629477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.629642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.629793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.629951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630550 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.630999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.631220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.631364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.631518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.631660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.631800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.631954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.632102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.632249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.632436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.632587 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.632736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.632881 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.633917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634075 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634826 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.634968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.635132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.635228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.635436 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.635574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.635745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.635890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.636051 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.636164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.636376 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.636495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.636680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.636833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.637920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638362 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.638974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.639147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.639290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.639427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.639581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.639726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.639875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640191 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640459 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640788 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.640990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.641083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.641299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.641397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.641605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.641705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.641911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642506 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.642902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.643110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.643201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.643407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.643499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.643710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.643808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.644979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.645110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.645286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.645418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.645600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.645714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.645906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.646031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.646852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.646974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.647549 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.647880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648219 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.648968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.649079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.649282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.649390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.649587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.649724 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.649954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.650055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.650273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.650375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.650582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.650676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.650901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651313 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.651911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.652142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.652244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.652471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.652579 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.652777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.652953 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.653081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.653209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.653403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.653526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.653708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.653814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.654027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.654120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.654428 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.654523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.654730 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.654825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655124 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.655951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.656056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.656242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.656442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.656586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.656702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.656888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.657943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.658159 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.658264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.658460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.658597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.658779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.658871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.659995 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.660101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.660335 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.660459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.660654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.660750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.660973 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.661080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.661301 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.661402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.661626 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.661726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.662476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.662578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.662813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.662908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.663137 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.663231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.663447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.663539 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.663760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.663854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.664067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.664169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.664387 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.664482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.664720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.664888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665515 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.665958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.666142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.666256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.666423 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.666560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.666723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.666858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.667945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.668120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.668262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.668529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.668624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.668840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.668947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.669163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.669256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.669458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.669557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.669768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.669868 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.670075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.670183 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.670383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.670475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.670696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.670796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.671956 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.672048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.672267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.672381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.672602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.672703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.672913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.673942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.674146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.674246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.674448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.674584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.674760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.674858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.675984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.676253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.676385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.676545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.676676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.676857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.676969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.677167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.677260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.677491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.678997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.679210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.679311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.679512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.679612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.679831 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.679933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.680146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.680247 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.680488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.680596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.680804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.680902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.681117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.681215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.681426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.681518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.681734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.681829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.682978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.683078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.683285 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.683379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.683593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.683700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.683902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684538 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.684969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.685155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.685261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.685461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.685566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.685768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.685986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.686086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.686426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.686544 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.686639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.686713 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.686925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.687958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.688178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.688291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.688517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.688715 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.688820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.689031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.689133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.689359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.689453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.689680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.689779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.690945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691243 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691541 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.691949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.692156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.692249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.692483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.692594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.692805 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.692907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.693135 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.693716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.693949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.694088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.694266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.694366 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.694571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.694662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.694883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.695100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.695202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.695466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.695573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.695753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.695853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.696076 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.696177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.696431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.696588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.696722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.696826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697351 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.697957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.698063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.698268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.698380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.698573 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.698791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.698903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.699113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.699231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.699449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.699553 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.699754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.699848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.700053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.700180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.700383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.700489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.700680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.700776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.701905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.702910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.703106 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.703207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.703465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.703695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.703773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.703853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.704000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.704114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.704304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.704567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.704663 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.704915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.705021 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.705211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.705305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.705572 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.705752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.705916 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.706077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.706222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.706370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.706537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.706701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.706850 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.707001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.707148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.707311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.707542 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.707707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.707854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.708011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.708198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.708384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.708545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.708712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.708712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709075 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709255 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709441 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709724 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.709829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710487 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.710978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.711967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.712178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.712274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.712506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.712602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.712810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.712904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.713121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.713222 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.713424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.713523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.713733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.713825 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714130 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.714955 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.715048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.715268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.715362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.715574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.715732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.716169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.716280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.716469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.716565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.716785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.716949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.717095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.740816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.740816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741373 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.741975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742894 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.742952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743300 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.743892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.744072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.744248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.744654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.744919 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.745782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746352 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.746482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.747960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.748954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.749963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.750978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.751907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752495 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.752990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.753912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754131 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.754359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.755143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.756560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.756560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.756560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.757923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.758956 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.759095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.759302 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.759492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.759705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.759899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.760078 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.760253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.760512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.760776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761093 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.761859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762364 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:13:46.762799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.762799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.763121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.763458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.763790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.764141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.764906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.765190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.766326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.768627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.769090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.769435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.769827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.770143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.770498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.770828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.771179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.771520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.771862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.772194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.772541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.772864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.773200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.773521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.773864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.774203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.774522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.774859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.775193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.775558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.775878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.776231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.776617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.776965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.777282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.777592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 04:13:46.777841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 04:13:46.916131 n-d-764486-11 devstack@n-api.service[123723]: INFO dbcounter [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Registered counter for database nova_api Jul 20 04:13:46.931979 n-d-764486-11 devstack@n-api.service[123724]: INFO dbcounter [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Registered counter for database nova_api Jul 20 04:13:46.937386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_db.sqlalchemy.engines [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:46.944318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writer thread running {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:46.951053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_db.sqlalchemy.engines [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:46.957657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writer thread running {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.001244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.context [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=123723) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:13:47.005339 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.007046 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.007775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.009776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.011775 n-d-764486-11 devstack@n-api.service[123723]: INFO dbcounter [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Registered counter for database nova_cell0 Jul 20 04:13:47.014903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.context [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=123724) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 04:13:47.015982 n-d-764486-11 devstack@n-api.service[123723]: INFO dbcounter [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Registered counter for database nova_cell1 Jul 20 04:13:47.019127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.020748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.021855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:13:47.024104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:13:47.025293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_db.sqlalchemy.engines [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:47.026050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_db.sqlalchemy.engines [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:47.026385 n-d-764486-11 devstack@n-api.service[123724]: INFO dbcounter [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Registered counter for database nova_cell0 Jul 20 04:13:47.030475 n-d-764486-11 devstack@n-api.service[123724]: INFO dbcounter [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Registered counter for database nova_cell1 Jul 20 04:13:47.033781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writer thread running {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.035073 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writer thread running {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.037984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_db.sqlalchemy.engines [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:47.042090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_db.sqlalchemy.engines [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:47.043651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writer thread running {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.182355 n-d-764486-11 devstack@n-api.service[123723]: INFO dbcounter [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Registered counter for database nova_cell0 Jul 20 04:13:47.185714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writer thread running {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.189303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_db.sqlalchemy.engines [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:47.194404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writer thread running {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.194624 n-d-764486-11 devstack@n-api.service[123724]: INFO dbcounter [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Registered counter for database nova_cell0 Jul 20 04:13:47.205321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_db.sqlalchemy.engines [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 04:13:47.211056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writer thread running {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 04:13:47.511086 n-d-764486-11 devstack@n-api.service[123723]: WARNING keystonemiddleware.auth_token [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:13:47.518297 n-d-764486-11 devstack@n-api.service[123723]: WARNING keystonemiddleware.auth_token [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:13:47.534975 n-d-764486-11 devstack@n-api.service[123724]: WARNING keystonemiddleware.auth_token [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:13:47.542309 n-d-764486-11 devstack@n-api.service[123724]: WARNING keystonemiddleware.auth_token [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:13:47.856716 n-d-764486-11 devstack@n-api.service[123723]: WARNING keystonemiddleware.auth_token [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:13:47.862675 n-d-764486-11 devstack@n-api.service[123723]: WARNING keystonemiddleware.auth_token [None req-cd75c941-ef20-4cac-b6d1-90e2725a07f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:13:47.868956 n-d-764486-11 devstack@n-api.service[123723]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56022ce9b9c0 pid: 123723 (default app) Jul 20 04:13:47.882142 n-d-764486-11 devstack@n-api.service[123724]: WARNING keystonemiddleware.auth_token [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 04:13:47.888101 n-d-764486-11 devstack@n-api.service[123724]: WARNING keystonemiddleware.auth_token [None req-33fe97f5-cc95-4e41-8dd9-3c95f41bbad2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 04:13:47.894272 n-d-764486-11 devstack@n-api.service[123724]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56022ce9b9c0 pid: 123724 (default app) Jul 20 04:14:31.819712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:31.821530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:31.822631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:31.823945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:33.469135 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e89ddd24-aeee-4480-b431-624acadf099f tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:33.471054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e89ddd24-aeee-4480-b431-624acadf099f tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.471560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e89ddd24-aeee-4480-b431-624acadf099f tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.473044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e89ddd24-aeee-4480-b431-624acadf099f tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:33.473774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e89ddd24-aeee-4480-b431-624acadf099f tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:33.556382 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e89ddd24-aeee-4480-b431-624acadf099f tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.749792 Jul 20 04:14:33.557515 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1/1] 10.222.0.49 () {58 vars in 1163 bytes} [Wed Jul 20 04:14:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:34.111170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-437c3077-2459-48eb-8459-4a59e16d6869 tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.115268 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:34.115268 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:34.117457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437c3077-2459-48eb-8459-4a59e16d6869 tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.118094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437c3077-2459-48eb-8459-4a59e16d6869 tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.118897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437c3077-2459-48eb-8459-4a59e16d6869 tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.119467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437c3077-2459-48eb-8459-4a59e16d6869 tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.120251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:34.121266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:34.122504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:34.123368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:34.193749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-437c3077-2459-48eb-8459-4a59e16d6869 tempest-AZAdminV2TestJSON-415050029 tempest-AZAdminV2TestJSON-415050029-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.625953 Jul 20 04:14:34.194538 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:34.321562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Calling method '.version_select at 0x7f839a617dc0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.324390 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:34.324390 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:34.341991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=123723) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:14:34.343840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.343840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.370810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.371697 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.386293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.387310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:34.394817 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c0cd418c-f4b0-4710-addc-8a90a4041de3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.637796 Jul 20 04:14:34.395850 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1207 bytes} [Wed Jul 20 04:14:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:14:34.413392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0814cb5e-1174-4958-9fc6-fc027465c5d3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1989998310"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:34.434074 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:34.434074 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:34.435603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-0814cb5e-1174-4958-9fc6-fc027465c5d3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Generated uuid eda149d2-8443-4a5b-a5f1-25b4e1741684 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:34.542371 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0814cb5e-1174-4958-9fc6-fc027465c5d3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.132771 Jul 20 04:14:34.542979 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2/4] 10.222.0.49 () {62 vars in 1204 bytes} [Wed Jul 20 04:14:34 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:34.560153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a7a6d177-4fbc-4755-ab28-22f022432532 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1417740952"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:34.655445 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:34.655445 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:34.771514 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a7a6d177-4fbc-4755-ab28-22f022432532 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.221352 Jul 20 04:14:34.777413 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 3/5] 10.222.0.49 () {62 vars in 1209 bytes} [Wed Jul 20 04:14:34 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:34.782752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-560713ee-d3af-4f36-a0f2-64bf58c458d6 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:34.783624 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:34.783624 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:34.821405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-560713ee-d3af-4f36-a0f2-64bf58c458d6 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.042510 Jul 20 04:14:34.822399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3/6] 10.222.0.49 () {60 vars in 1189 bytes} [Wed Jul 20 04:14:34 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:34.834091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0ea06f15-e1a8-49fc-bde3-0d78a97c76e3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:34.835749 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:34.835749 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:34.845769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ea06f15-e1a8-49fc-bde3-0d78a97c76e3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:34.846215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ea06f15-e1a8-49fc-bde3-0d78a97c76e3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.899345 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0ea06f15-e1a8-49fc-bde3-0d78a97c76e3 tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 1.069902 Jul 20 04:14:35.906059 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 4/7] 10.222.0.49 () {62 vars in 1231 bytes} [Wed Jul 20 04:14:34 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:35.969613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd18eba4-83b2-40cc-91b4-7192c137525f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:35.973652 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:35.973652 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:35.976302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd18eba4-83b2-40cc-91b4-7192c137525f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.980163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd18eba4-83b2-40cc-91b4-7192c137525f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:35.981170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd18eba4-83b2-40cc-91b4-7192c137525f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:35.986980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd18eba4-83b2-40cc-91b4-7192c137525f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.076150 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd18eba4-83b2-40cc-91b4-7192c137525f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.079490 Jul 20 04:14:36.079831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:14:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:36.242766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5bdce545-ca90-411a-8108-4de4c9a7485c tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-136118540", "id": 1794181233, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:36.286019 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:36.286019 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:36.297813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '.version_select at 0x7f8399c95ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.298888 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:36.298888 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:36.308847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=123724) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 04:14:36.309671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.310117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.345577 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5bdce545-ca90-411a-8108-4de4c9a7485c tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.437947 Jul 20 04:14:36.348670 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 5/9] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:35 2022] POST /compute/v2.1/flavors => generated 430 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:36.367094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.367904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.381687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.382345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.389545 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b3eea4f-0d59-4200-a014-05f97b930b3b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.308227 Jul 20 04:14:36.390600 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:36.396851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a57b8163-57dd-412e-b183-9a7c9221c77f tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:36.398629 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:36.398629 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:36.411158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a57b8163-57dd-412e-b183-9a7c9221c77f tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:36.411880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a57b8163-57dd-412e-b183-9a7c9221c77f tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:36.667501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f53a25ba-ddf9-4879-b585-fbc18d3cf7af tempest-AZAdminNegativeTestJSON-885764367 tempest-AZAdminNegativeTestJSON-885764367-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:36.668411 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:36.668411 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:36.669226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f53a25ba-ddf9-4879-b585-fbc18d3cf7af tempest-AZAdminNegativeTestJSON-885764367 tempest-AZAdminNegativeTestJSON-885764367-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '7b3d929c828f4219982f0d97d7942503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0036e5b4d4ee4311afb15cb3f5405af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f53a25ba-ddf9-4879-b585-fbc18d3cf7af tempest-AZAdminNegativeTestJSON-885764367 tempest-AZAdminNegativeTestJSON-885764367-project] Request method failure captured: Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Eo4rKfeRZ5Os0Y2HhbJPpCGI8u5VQ4Sq3pFdLQoiksssfPbXM1VkBuJ564LJWuOe5hTG7pwXUOU07G0iTtwZ6gcgR60dpJOxJ8-XjqSaugyTcP8Ci3HIkOCpafWoO87U0vzwwc_eujSkSSoIMbUBCI2JI9wINP2g-1EZq0b9PK2w0 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 0036e5b4d4ee4311afb15cb3f5405af6 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AZAdminNegativeTestJSON-885764367 Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:36.672296 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0036e5b4d4ee4311afb15cb3f5405af6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0036e5b4d4ee4311afb15cb3f5405af6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0036e5b4d4ee4311afb15cb3f5405af6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0036e5b4d4ee4311afb15cb3f5405af6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AZAdminNegativeTestJSON-885764367 Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 0036e5b4d4ee4311afb15cb3f5405af6 Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-885764367 Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AZAdminNegativeTestJSON-885764367-project Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7b3d929c828f4219982f0d97d7942503 Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AZAdminNegativeTestJSON-885764367-project Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:14:36.673436 n-d-764486-11 devstack@n-api.service[123723]: action_args: {} Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:36.674041 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:36.675693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f53a25ba-ddf9-4879-b585-fbc18d3cf7af tempest-AZAdminNegativeTestJSON-885764367 tempest-AZAdminNegativeTestJSON-885764367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:36.676594 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f53a25ba-ddf9-4879-b585-fbc18d3cf7af tempest-AZAdminNegativeTestJSON-885764367 tempest-AZAdminNegativeTestJSON-885764367-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.323929 Jul 20 04:14:36.694109 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:14:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:36.713732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f876af6d-3e57-445f-ad09-e9ee7bee4037 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc19f2bfb97b4da58bf8dbaae4e97eb6"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:36.720029 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:36.720029 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:37.435473 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f876af6d-3e57-445f-ad09-e9ee7bee4037 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1794181233/action" status: 200 len: 97 microversion: 2.1 time: 0.738711 Jul 20 04:14:37.442217 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 7/12] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Jul 20 04:14:36 2022] POST /compute/v2.1/flavors/1794181233/action => generated 97 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:37.527856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a57b8163-57dd-412e-b183-9a7c9221c77f tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.135718 Jul 20 04:14:37.529212 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 6/13] 10.222.0.49 () {62 vars in 1231 bytes} [Wed Jul 20 04:14:36 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:14:37.541262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-def4b117-de46-4533-93b4-93286272294e tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.544644 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:37.544644 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:37.605967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-def4b117-de46-4533-93b4-93286272294e tempest-AggregatesAdminTestV241-1356446349 tempest-AggregatesAdminTestV241-1356446349-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.066813 Jul 20 04:14:37.608007 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 7/14] 10.222.0.49 () {60 vars in 1192 bytes} [Wed Jul 20 04:14:37 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:37.656058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffe48318-9ebd-4e78-b441-4e684c19f8b5 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1212615721"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.658660 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:37.658660 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:37.674227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-ffe48318-9ebd-4e78-b441-4e684c19f8b5 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid a5fb1f30-a990-4c93-85b3-e769f372fec4 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:37.727153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffe48318-9ebd-4e78-b441-4e684c19f8b5 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081829 Jul 20 04:14:37.728214 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 8/15] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:37.771723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4780c6d-e8f2-4457-9573-c87455a3e631 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.773102 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:37.773102 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:37.797870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4780c6d-e8f2-4457-9573-c87455a3e631 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:37.798240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4780c6d-e8f2-4457-9573-c87455a3e631 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:37.860242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-703057b2-6f0d-4ccf-8fd4-6f0a36634f37 tempest-FlavorsAccessTestJSON-1818320029 tempest-FlavorsAccessTestJSON-1818320029-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:37.939074 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-703057b2-6f0d-4ccf-8fd4-6f0a36634f37 tempest-FlavorsAccessTestJSON-1818320029 tempest-FlavorsAccessTestJSON-1818320029-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.495217 Jul 20 04:14:37.955312 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:37 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:37.965057 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ded6a53-b037-4691-894a-a8ee1a50921b tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc19f2bfb97b4da58bf8dbaae4e97eb6"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:37.966880 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:37.966880 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:38.067408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4780c6d-e8f2-4457-9573-c87455a3e631 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.306354 Jul 20 04:14:38.068015 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 9/17] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.078591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.086110 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.086110 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.100533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.101223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.166173 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-764486-11. Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 40 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:14:38.189373 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: {"add_host": {"host": "n-h2-764486-11"}} Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:14:38.191431 n-d-764486-11 devstack@n-api.service[123724]: exception: Aggregate 2 already has host n-h2-764486-11. Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-764486-11'}}} Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:14:38.192433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-764486-11-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:14:38.193536 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:14:38.194687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:14:38.195796 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-764486-11-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 14, 38, 142536), 'updated_at': None, 'host': 'n-h2-764486-11', 'aggregate_id': 2}] Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.196878 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-764486-11. Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.197869 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-764486-11. Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:38.199101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:38.206208 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-764486-11. Jul 20 04:14:38.206208 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.208455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-764486-11. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:38.209586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f4e83cf-fb62-4782-80ef-d587b661e2e3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 96 microversion: 2.1 time: 0.134884 Jul 20 04:14:38.212265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 10/18] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates/2/action => generated 96 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Jul 20 04:14:38.225708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e980aef5-268f-4832-a407-330d9381f058 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.228300 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.228300 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.255655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e980aef5-268f-4832-a407-330d9381f058 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.256431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e980aef5-268f-4832-a407-330d9381f058 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.415993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e980aef5-268f-4832-a407-330d9381f058 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.200665 Jul 20 04:14:38.416860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 11/19] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.427593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ed9be6c-af69-4c05-ac62-8001d66dbf84 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.428722 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.428722 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.465481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ed9be6c-af69-4c05-ac62-8001d66dbf84 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.041951 Jul 20 04:14:38.468563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 12/20] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:38 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:14:38.482717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-249a4751-d1e7-434f-959c-9181d7cc89d0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-181627617"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.486045 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.486045 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.502667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-249a4751-d1e7-434f-959c-9181d7cc89d0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid 15935331-d7c9-4e1a-94d0-3166fd2ad266 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:38.544723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-249a4751-d1e7-434f-959c-9181d7cc89d0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.070494 Jul 20 04:14:38.546473 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 13/21] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:38.803359 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7ded6a53-b037-4691-894a-a8ee1a50921b tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1794181233/action" status: 200 len: 21 microversion: 2.1 time: 0.844933 Jul 20 04:14:38.804417 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 9/22] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Jul 20 04:14:37 2022] POST /compute/v2.1/flavors/1794181233/action => generated 21 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:38.812823 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c04cd5f8-b480-46f5-ac5c-c3ec222d69f3 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2109400975", "name": "tempest-test_aggregate-1621391046"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.831095 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.831095 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:38.832867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-c04cd5f8-b480-46f5-ac5c-c3ec222d69f3 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid 56620f5b-148c-489d-a975-69f1d97c5f47 for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:38.865575 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c04cd5f8-b480-46f5-ac5c-c3ec222d69f3 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.056226 Jul 20 04:14:38.866310 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 10/23] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.871053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c1bb7382-6d9d-47fd-aa34-4b490028d963 tempest-FlavorsAccessTestJSON-1818320029 tempest-FlavorsAccessTestJSON-1818320029-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.891299 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c1bb7382-6d9d-47fd-aa34-4b490028d963 tempest-FlavorsAccessTestJSON-1818320029 tempest-FlavorsAccessTestJSON-1818320029-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023721 Jul 20 04:14:38.892040 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:38.894838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-628eeae1-b868-4618-a75e-8089cde5d6bc tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.896067 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.896067 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.896911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d99b6569-94cb-4e39-8d6f-92647c919405 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.897022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-628eeae1-b868-4618-a75e-8089cde5d6bc tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '7ae3035c2dce429caad2251447900465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1e1365f0004a3f890c58d16cb0b040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:38.897880 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.897880 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-628eeae1-b868-4618-a75e-8089cde5d6bc tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Request method failure captured: Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 40 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EnjFCkawR4D32Hze2sNonp8_-yGC51GRGVV7fEBWuyuUaS9pEOC-ho4vPDtDgMOx440hwPVQkKLbESQyefJuaA_LPUArFq_n77Ta-oWmmGWyjbKUTkWq6JncV4G07YH_jIM3FbbEcnXDFvEXgdeF3W-u5PK1vpHoxOmCS4S9zTZN4 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:14:38.899080 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea1e1365f0004a3f890c58d16cb0b040", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7ae3035c2dce429caad2251447900465 Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: {"add_host": {"host": "n-h2-764486-11"}} Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:14:38.900344 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-764486-11'}}} Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:38.901141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 04:14:38.902107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:38.903210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-628eeae1-b868-4618-a75e-8089cde5d6bc tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:38.903905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-628eeae1-b868-4618-a75e-8089cde5d6bc tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.349110 Jul 20 04:14:38.906673 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 14/25] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 353 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:38.912581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1bc59afd-0014-4151-964e-885072d71514 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.913759 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.913759 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.914732 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d99b6569-94cb-4e39-8d6f-92647c919405 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.021525 Jul 20 04:14:38.915714 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:14:38 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:38.920187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8311dc76-37df-459a-94b2-d2df3c122864 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:38.921501 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.921501 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:38.956686 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8311dc76-37df-459a-94b2-d2df3c122864 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039402 Jul 20 04:14:38.957357 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:38 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:14:38.963270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cf97e35b-5ac6-44bf-82b3-d4ca5857e522 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.965125 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.965125 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:38.969826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1bc59afd-0014-4151-964e-885072d71514 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1794181233" status: 202 len: 0 microversion: 2.1 time: 0.061109 Jul 20 04:14:38.970414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:38 2022] DELETE /compute/v2.1/flavors/1794181233 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:38.975539 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cf97e35b-5ac6-44bf-82b3-d4ca5857e522 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:38.976054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cf97e35b-5ac6-44bf-82b3-d4ca5857e522 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:38.977098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfa94f63-6e14-4745-af44-e594360d4f09 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-897966697"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:38.978553 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:38.978553 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:38.979767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-dfa94f63-6e14-4745-af44-e594360d4f09 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid 164e6ddf-b125-4369-a8ac-52c073c219d9 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:39.011160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfa94f63-6e14-4745-af44-e594360d4f09 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038181 Jul 20 04:14:39.012475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 16/29] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:39.018476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e27718a0-6644-4f86-8b65-4db6a973cbc7 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.058252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e27718a0-6644-4f86-8b65-4db6a973cbc7 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044160 Jul 20 04:14:39.059077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 17/30] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:39.064002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1077185105"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.066322 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.066322 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:39.078119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.078882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.091684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:39.092281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:39.102032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1077185105 could not be found. Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 58 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:14:39.106053 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: {"add_host": {"host": "tempest-nonexist_host-1077185105"}} Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:14:39.107344 n-d-764486-11 devstack@n-api.service[123724]: exception: Compute host tempest-nonexist_host-1077185105 could not be found. Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1077185105'}}} Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1077185105' is not mapped to any cell Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.108172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 20 04:14:39.109272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1077185105 could not be found. Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1077185105 could not be found. Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.110615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1077185105 could not be found. Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1077185105 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d3340a3-afff-48ab-83df-ec3d4cb99eb0 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.049084 Jul 20 04:14:39.113028 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 18/31] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:39.118711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5fd4b297-ad83-4a06-bd65-3a1a0a0ebaa3 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1441025072", "id": 153508246, "os-flavor-access:is_public": "False"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.121128 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.121128 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:39.147698 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cf97e35b-5ac6-44bf-82b3-d4ca5857e522 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 316 microversion: 2.1 time: 0.189098 Jul 20 04:14:39.152609 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 14/32] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:14:38 2022] POST /compute/v2.1/os-aggregates/4/action => generated 316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:39.153724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5fd4b297-ad83-4a06-bd65-3a1a0a0ebaa3 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.041451 Jul 20 04:14:39.154305 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 19/33] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:39.164231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a4aef376-63fe-4952-9897-20bb1bc6e272 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.168142 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.168142 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.169749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b3dee44-484b-4a1b-b456-4be11dc92f9a tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.176834 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.176834 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:39.199898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b3dee44-484b-4a1b-b456-4be11dc92f9a tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/153508246/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.038836 Jul 20 04:14:39.210226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 20/34] 10.222.0.49 () {58 vars in 1205 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/flavors/153508246/os-flavor-access => generated 21 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:39.212281 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a4aef376-63fe-4952-9897-20bb1bc6e272 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.058192 Jul 20 04:14:39.213497 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 15/35] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:14:39.223009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-90a19326-3aed-46e2-8333-7abf9bacb1e1 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.224921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5f14997-cf00-48fd-81e8-e28ea0b576d9 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.226286 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.226286 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-90a19326-3aed-46e2-8333-7abf9bacb1e1 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 283 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:14:39.244527 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:14:39.245783 n-d-764486-11 devstack@n-api.service[123723]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:39.246499 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:39.247180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:39.248410 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:39.249233 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:14:39.249233 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.249985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-90a19326-3aed-46e2-8333-7abf9bacb1e1 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.250584 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-90a19326-3aed-46e2-8333-7abf9bacb1e1 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031573 Jul 20 04:14:39.251524 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 16/36] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:14:39.253396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:39.262778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6d129659-9691-4bc5-be14-dd439512c5a3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6d129659-9691-4bc5-be14-dd439512c5a3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 27 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:14:39.265581 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: {"aggregate": {"name": ""}} Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.266970 n-d-764486-11 devstack@n-api.service[123723]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi '' Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.267775 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:14:39.269342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.271234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6d129659-9691-4bc5-be14-dd439512c5a3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.271234 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6d129659-9691-4bc5-be14-dd439512c5a3 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009237 Jul 20 04:14:39.271234 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 17/37] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:14:39.279308 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5f14997-cf00-48fd-81e8-e28ea0b576d9 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/153508246" status: 202 len: 0 microversion: 2.1 time: 0.065827 Jul 20 04:14:39.281226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 21/38] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/flavors/153508246 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:39.283578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1b004091-b849-4049-b195-b05a57379886 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-527254784"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.289907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16574484-06e5-46e0-a612-f6c9e3669ce6 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.291109 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.291109 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.292343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1b004091-b849-4049-b195-b05a57379886 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '7ae3035c2dce429caad2251447900465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1e1365f0004a3f890c58d16cb0b040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1b004091-b849-4049-b195-b05a57379886 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Request method failure captured: Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 59 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EnjFCkawR4D32Hze2sNonp8_-yGC51GRGVV7fEBWuyuUaS9pEOC-ho4vPDtDgMOx440hwPVQkKLbESQyefJuaA_LPUArFq_n77Ta-oWmmGWyjbKUTkWq6JncV4G07YH_jIM3FbbEcnXDFvEXgdeF3W-u5PK1vpHoxOmCS4S9zTZN4 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:39.298994 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea1e1365f0004a3f890c58d16cb0b040", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7ae3035c2dce429caad2251447900465 Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: {"aggregate": {"name": "tempest-test_aggregate-527254784"}} Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.300994 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-527254784'}}} Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:39.301732 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:39.302891 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 04:14:39.303988 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.307024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1b004091-b849-4049-b195-b05a57379886 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.308210 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1b004091-b849-4049-b195-b05a57379886 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.030752 Jul 20 04:14:39.309322 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 18/39] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:39.324552 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c66b9693-6c7e-477c-8d16-ce08c7d3847d tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-537641229"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.339214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-c66b9693-6c7e-477c-8d16-ce08c7d3847d tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid 93a84983-1fa7-4ffd-8182-1447676e33dc for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:39.355632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16574484-06e5-46e0-a612-f6c9e3669ce6 tempest-FlavorsAccessTestJSON-1141040849 tempest-FlavorsAccessTestJSON-1141040849-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069125 Jul 20 04:14:39.356240 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 22/40] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:39.382895 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c66b9693-6c7e-477c-8d16-ce08c7d3847d tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065505 Jul 20 04:14:39.384021 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 19/41] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:39.395711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f932b26-72b9-43e6-bf10-6c16a21b0769 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-537641229"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.397181 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.397181 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:39.398615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-7f932b26-72b9-43e6-bf10-6c16a21b0769 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid 8a7f36fd-1f44-4265-a036-c7f46bd83bd7 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:39.416531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7f932b26-72b9-43e6-bf10-6c16a21b0769 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-537641229 already exists. Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f932b26-72b9-43e6-bf10-6c16a21b0769 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 59 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:14:39.418938 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: {"aggregate": {"name": "tempest-test_aggregate-537641229"}} Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:14:39.420202 n-d-764486-11 devstack@n-api.service[123724]: exception: Aggregate tempest-test_aggregate-537641229 already exists. Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-537641229'}}} Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 20 04:14:39.420911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-537641229 already exists. Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:39.422025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-537641229 already exists. Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-537641229 already exists. Jul 20 04:14:39.423281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.425107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f932b26-72b9-43e6-bf10-6c16a21b0769 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-537641229 already exists. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.425937 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f932b26-72b9-43e6-bf10-6c16a21b0769 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.035654 Jul 20 04:14:39.426667 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 23/42] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:39.435764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cc182467-c605-43a3-9008-d39720efa650 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.436573 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.436573 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.483553 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cc182467-c605-43a3-9008-d39720efa650 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.052392 Jul 20 04:14:39.488709 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 20/43] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:14:39.494377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fc10c557-e3f7-4bb9-ab2f-e10357944059 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1597038369"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.496189 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.496189 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.497310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-fc10c557-e3f7-4bb9-ab2f-e10357944059 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid befc1e8c-b0d3-419d-8b7a-6e2df191e382 for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:39.532730 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fc10c557-e3f7-4bb9-ab2f-e10357944059 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042686 Jul 20 04:14:39.534290 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 21/44] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:39.548430 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-205676d2-73a1-4b03-96e2-45bd6519a486 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.549217 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.549217 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.550103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-205676d2-73a1-4b03-96e2-45bd6519a486 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '7ae3035c2dce429caad2251447900465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1e1365f0004a3f890c58d16cb0b040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-205676d2-73a1-4b03-96e2-45bd6519a486 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Request method failure captured: Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EnjFCkawR4D32Hze2sNonp8_-yGC51GRGVV7fEBWuyuUaS9pEOC-ho4vPDtDgMOx440hwPVQkKLbESQyefJuaA_LPUArFq_n77Ta-oWmmGWyjbKUTkWq6JncV4G07YH_jIM3FbbEcnXDFvEXgdeF3W-u5PK1vpHoxOmCS4S9zTZN4 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:39.552101 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea1e1365f0004a3f890c58d16cb0b040", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7ae3035c2dce429caad2251447900465 Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:14:39.553396 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '7'} Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.554148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 04:14:39.555088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.558913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-205676d2-73a1-4b03-96e2-45bd6519a486 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.560059 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-205676d2-73a1-4b03-96e2-45bd6519a486 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.017593 Jul 20 04:14:39.563468 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 22/45] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:39.572415 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-918f1ed6-5468-47bf-941d-7658d42a7c81 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.603492 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-918f1ed6-5468-47bf-941d-7658d42a7c81 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.035597 Jul 20 04:14:39.607940 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 23/46] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:14:39.616936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3b2a2576-f07b-4fb1-b1f8-8a1a1867243f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.617868 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.617868 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.634833 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-3b2a2576-f07b-4fb1-b1f8-8a1a1867243f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3b2a2576-f07b-4fb1-b1f8-8a1a1867243f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:14:39.642710 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: exception: Aggregate -1 could not be found. Jul 20 04:14:39.644595 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '-1'} Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:14:39.645331 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.646459 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.647576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3b2a2576-f07b-4fb1-b1f8-8a1a1867243f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.648397 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3b2a2576-f07b-4fb1-b1f8-8a1a1867243f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035121 Jul 20 04:14:39.650537 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 24/47] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:39.659100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d9719305-ec01-4652-a3b3-1d4f6b1a52d5 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1658513985"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:39.662671 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.662671 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.663896 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-d9719305-ec01-4652-a3b3-1d4f6b1a52d5 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid 6772d96a-c46a-49c9-ac37-9422a03653b2 for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:14:39.677362 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:39.744152 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d9719305-ec01-4652-a3b3-1d4f6b1a52d5 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.089463 Jul 20 04:14:39.748500 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 25/48] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:39.762120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-51009f42-2827-433b-a388-66519bc32e35 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.765672 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.765672 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.768251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-51009f42-2827-433b-a388-66519bc32e35 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '7ae3035c2dce429caad2251447900465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1e1365f0004a3f890c58d16cb0b040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-51009f42-2827-433b-a388-66519bc32e35 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Request method failure captured: Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EnjFCkawR4D32Hze2sNonp8_-yGC51GRGVV7fEBWuyuUaS9pEOC-ho4vPDtDgMOx440hwPVQkKLbESQyefJuaA_LPUArFq_n77Ta-oWmmGWyjbKUTkWq6JncV4G07YH_jIM3FbbEcnXDFvEXgdeF3W-u5PK1vpHoxOmCS4S9zTZN4 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:39.773694 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea1e1365f0004a3f890c58d16cb0b040", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7ae3035c2dce429caad2251447900465 Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:14:39.774899 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '8'} Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.775505 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.777213 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-51009f42-2827-433b-a388-66519bc32e35 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.779840 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-51009f42-2827-433b-a388-66519bc32e35 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.020802 Jul 20 04:14:39.779840 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 26/49] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:39.797557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-74a29017-4f75-4ce6-a477-91747c66bd8f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.802311 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.802311 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.854903 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-74a29017-4f75-4ce6-a477-91747c66bd8f tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.068293 Jul 20 04:14:39.863184 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 27/50] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:39 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:14:39.874303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-47bac559-e385-42b1-beb8-4b353f67a800 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.877114 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.877114 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.892921 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-47bac559-e385-42b1-beb8-4b353f67a800 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-47bac559-e385-42b1-beb8-4b353f67a800 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:14:39.894508 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: exception: Aggregate -1 could not be found. Jul 20 04:14:39.895616 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '-1'} Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.896225 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 04:14:39.897270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.898324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-47bac559-e385-42b1-beb8-4b353f67a800 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.898324 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-47bac559-e385-42b1-beb8-4b353f67a800 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031724 Jul 20 04:14:39.898324 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 28/51] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:39.915640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2ec44f97-ed95-4ee5-9a00-82642859ae74 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:39.917601 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:39.917601 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:39.918512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2ec44f97-ed95-4ee5-9a00-82642859ae74 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '7ae3035c2dce429caad2251447900465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1e1365f0004a3f890c58d16cb0b040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2ec44f97-ed95-4ee5-9a00-82642859ae74 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Request method failure captured: Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EnjFCkawR4D32Hze2sNonp8_-yGC51GRGVV7fEBWuyuUaS9pEOC-ho4vPDtDgMOx440hwPVQkKLbESQyefJuaA_LPUArFq_n77Ta-oWmmGWyjbKUTkWq6JncV4G07YH_jIM3FbbEcnXDFvEXgdeF3W-u5PK1vpHoxOmCS4S9zTZN4 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:39.928703 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea1e1365f0004a3f890c58d16cb0b040", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7ae3035c2dce429caad2251447900465 Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:14:39.930857 n-d-764486-11 devstack@n-api.service[123723]: action_args: {} Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:39.931572 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:39.932696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2ec44f97-ed95-4ee5-9a00-82642859ae74 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:39.933778 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2ec44f97-ed95-4ee5-9a00-82642859ae74 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.022903 Jul 20 04:14:39.933778 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 29/52] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:14:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:40.193831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-495959716", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "availability_zone": "tempest-test_az-2109400975"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:40.216595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.217518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:40.218614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:40.219861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.452229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Calling method '.version_select at 0x7f8398b70ca0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.453085 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:41.453085 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:41.457570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.458001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.496095 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.496791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.539177 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.540865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.562008 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2ff38793-14c2-4fe5-9001-1a57a41d3bad tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.798993 Jul 20 04:14:41.566156 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 30/53] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:41.578170 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Calling method '.version_select at 0x7f8398b700d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.579619 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:41.579619 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:41.585406 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.586351 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.631107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.631805 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.682462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.685591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.702412 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f9d21298-af30-4f0c-bf0a-e3843323b825 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h2-764486-11/servers" status: 200 len: 105 microversion: 2.1 time: 0.129081 Jul 20 04:14:41.708614 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 31/54] 10.222.0.49 () {58 vars in 1214 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-764486-11/servers => generated 105 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:41.727209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Calling method '.version_select at 0x7f8398a2c310>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.729086 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:41.729086 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:41.734070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.736339 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.770993 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.774210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.801471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.801940 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.825967 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-854cffdb-64ae-4eb3-811e-348deb33edfa tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.110348 Jul 20 04:14:41.826576 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 32/55] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:41.842687 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ee865eb-8db3-4f74-be4a-c42c79780561 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Calling method '.version_select at 0x7f83989fbee0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:41.845942 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:41.845942 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:41.847315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ee865eb-8db3-4f74-be4a-c42c79780561 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.848951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ee865eb-8db3-4f74-be4a-c42c79780561 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.899803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ee865eb-8db3-4f74-be4a-c42c79780561 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:41.900563 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ee865eb-8db3-4f74-be4a-c42c79780561 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:41.922380 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5ee865eb-8db3-4f74-be4a-c42c79780561 tempest-HypervisorAdminUnderV252Test-235569192 tempest-HypervisorAdminUnderV252Test-235569192-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h2-764486-11/search" status: 200 len: 105 microversion: 2.1 time: 0.088836 Jul 20 04:14:41.923585 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 33/56] 10.222.0.49 () {58 vars in 1211 bytes} [Wed Jul 20 04:14:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-764486-11/search => generated 105 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:41.978559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:14:42.571907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:14:42.572336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:14:42.573262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:14:42.573379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:14:42.573807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:14:42.615987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.616378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.620313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:42.620805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:42.694437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Getting quotas for project 5f627778e3f14b178d117484817d5d35. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:42.714806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Getting quotas for user 64f4724ea5c041a5848b2e0091ae8fa6 and project 5f627778e3f14b178d117484817d5d35. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:42.750373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:14:42.754001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:14:42.862939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7067490d-433f-4ea8-b2c9-6598a5b25f50 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.391277 Jul 20 04:14:42.869401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 24/57] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:14:42.874233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-250dc8dd-0cc1-4db3-b768-0689ff8ecd35 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:42.874979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-250dc8dd-0cc1-4db3-b768-0689ff8ecd35 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:43.507639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:44.331412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-250dc8dd-0cc1-4db3-b768-0689ff8ecd35 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:44.355636 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-250dc8dd-0cc1-4db3-b768-0689ff8ecd35 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1242 microversion: 2.1 time: 1.485549 Jul 20 04:14:44.359087 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 34/58] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:42 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1242 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:45.375408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:45.376664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:45.419533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.422804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.423839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:45.430326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:45.888906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:45.929801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23b14516-fc93-4d93-9b10-c2db294fcac0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1234 microversion: 2.1 time: 0.558425 Jul 20 04:14:45.931772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 25/59] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:45 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1234 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:46.954665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:46.955358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:46.967907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-44eaf376-1e46-408c-9fb2-129d278b2d5d tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1382151148", "ram": 512, "vcpus": 1, "disk": 10, "id": 915364696, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:46.969737 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:46.969737 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:46.986961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.987334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:46.988133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:46.994983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:47.029453 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-44eaf376-1e46-408c-9fb2-129d278b2d5d tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.880654 Jul 20 04:14:47.032753 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 35/60] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:46 2022] POST /compute/v2.1/flavors => generated 413 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:47.057819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-85caeb7a-9f21-4966-976b-cd87cdc318cd tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:47.067405 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:47.067405 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:47.184336 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-85caeb7a-9f21-4966-976b-cd87cdc318cd tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.143140 Jul 20 04:14:47.211058 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 36/61] 10.222.0.49 () {60 vars in 1220 bytes} [Wed Jul 20 04:14:47 2022] POST /compute/v2.1/flavors/915364696/os-extra_specs => generated 66 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:47.488471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:47.505377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d7502f9-ea4a-4646-8a14-3b05b4ec43b5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1296 microversion: 2.1 time: 0.556197 Jul 20 04:14:47.507556 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 26/62] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:46 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1296 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:47.947291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3bf605df-33e3-4936-a448-08aacfb69f04 tempest-FlavorsExtraSpecsTestJSON-660338725 tempest-FlavorsExtraSpecsTestJSON-660338725-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.001012 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3bf605df-33e3-4936-a448-08aacfb69f04 tempest-FlavorsExtraSpecsTestJSON-660338725 tempest-FlavorsExtraSpecsTestJSON-660338725-project] 10.222.0.49 "GET /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.788547 Jul 20 04:14:48.001647 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 37/63] 10.222.0.49 () {58 vars in 1199 bytes} [Wed Jul 20 04:14:47 2022] GET /compute/v2.1/flavors/915364696/os-extra_specs => generated 66 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.013253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ef2b9b9-39b6-4004-9d77-0236836317d4 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:48.015714 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:48.015714 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:48.070671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ef2b9b9-39b6-4004-9d77-0236836317d4 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062101 Jul 20 04:14:48.085639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0459ea88-dd22-43f9-96fd-325a659bb4e1 tempest-FlavorsExtraSpecsTestJSON-660338725 tempest-FlavorsExtraSpecsTestJSON-660338725-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.090985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 27/64] 10.222.0.49 () {60 vars in 1220 bytes} [Wed Jul 20 04:14:48 2022] POST /compute/v2.1/flavors/915364696/os-extra_specs => generated 66 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.105219 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0459ea88-dd22-43f9-96fd-325a659bb4e1 tempest-FlavorsExtraSpecsTestJSON-660338725 tempest-FlavorsExtraSpecsTestJSON-660338725-project] 10.222.0.49 "GET /compute/v2.1/flavors/915364696/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023408 Jul 20 04:14:48.106319 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 38/65] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/flavors/915364696/os-extra_specs/hw:numa_nodes => generated 22 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:14:48.122049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08b0b4bc-de72-4d14-a013-f169999b3295 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:48.221698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08b0b4bc-de72-4d14-a013-f169999b3295 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.108095 Jul 20 04:14:48.231448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 28/66] 10.222.0.49 () {60 vars in 1220 bytes} [Wed Jul 20 04:14:48 2022] POST /compute/v2.1/flavors/915364696/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.241315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-19fe5016-a13b-4643-a3ea-70f88a732805 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.254040 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-19fe5016-a13b-4643-a3ea-70f88a732805 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017265 Jul 20 04:14:48.254531 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 39/67] 10.222.0.49 () {58 vars in 1199 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/flavors/915364696/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.264390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2fb6ff5-a01b-42d2-9579-ee91abcc7a4c tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:48.266002 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:48.266002 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:48.358237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2fb6ff5-a01b-42d2-9579-ee91abcc7a4c tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/915364696/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.085306 Jul 20 04:14:48.359107 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 29/68] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:14:48 2022] PUT /compute/v2.1/flavors/915364696/os-extra_specs/hw:numa_nodes => generated 22 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:14:48.369460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0814145f-0d1c-4213-84ef-5d963cff3c37 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.384556 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0814145f-0d1c-4213-84ef-5d963cff3c37 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018462 Jul 20 04:14:48.395338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-783357a9-8d6d-43cb-a2a9-392d2950be01 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.396128 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:48.396128 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:48.397760 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 40/69] 10.222.0.49 () {58 vars in 1199 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/flavors/915364696/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.457923 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-783357a9-8d6d-43cb-a2a9-392d2950be01 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/915364696/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.066566 Jul 20 04:14:48.469308 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-67a837ff-9ce8-47cf-9c34-ecfdfbfa7f8b tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.470316 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:48.470316 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:48.477347 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 30/70] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:14:48 2022] DELETE /compute/v2.1/flavors/915364696/os-extra_specs/hw:numa_nodes => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:14:48.526694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.527307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:48.532581 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-67a837ff-9ce8-47cf-9c34-ecfdfbfa7f8b tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/915364696/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.053625 Jul 20 04:14:48.544124 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 41/71] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:14:48 2022] DELETE /compute/v2.1/flavors/915364696/os-extra_specs/hw:cpu_policy => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:14:48.551499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.552212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.553424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:48.554040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:48.564257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4f0db075-7ef9-4628-a0cf-33422686e32a tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.599954 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4f0db075-7ef9-4628-a0cf-33422686e32a tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/915364696/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.052737 Jul 20 04:14:48.615422 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 42/72] 10.222.0.49 () {58 vars in 1199 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/flavors/915364696/os-extra_specs => generated 19 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:48.722131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:48.749393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b685a3f1-6092-4199-9062-d994231ce41d tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1296 microversion: 2.1 time: 0.220334 Jul 20 04:14:48.759129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 31/73] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:48.762385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1fd640d-efe7-4233-816c-4af453e93815 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.763203 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:48.763203 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:48.809904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1fd640d-efe7-4233-816c-4af453e93815 tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/915364696" status: 202 len: 0 microversion: 2.1 time: 0.058458 Jul 20 04:14:48.811141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 32/74] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:48 2022] DELETE /compute/v2.1/flavors/915364696 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:48.819347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e51e9569-9f9f-4401-88e9-99f1a1168b7b tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:48.873566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e51e9569-9f9f-4401-88e9-99f1a1168b7b tempest-FlavorsExtraSpecsTestJSON-523073734 tempest-FlavorsExtraSpecsTestJSON-523073734-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058380 Jul 20 04:14:48.874791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 33/75] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:49.755986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34856327-a31f-40f0-bcff-67af6ab0f2b1 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-68203783", "id": 276239758, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:49.768611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.769226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:49.785740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.803551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.805950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:49.810139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:49.842723 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-34856327-a31f-40f0-bcff-67af6ab0f2b1 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 1.225602 Jul 20 04:14:49.853242 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 43/76] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:48 2022] POST /compute/v2.1/flavors => generated 425 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:49.865531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9d1a368d-d6a1-4ff2-b3c7-00800c22c11a tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:49.873345 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:49.873345 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:49.956089 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9d1a368d-d6a1-4ff2-b3c7-00800c22c11a tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/276239758" status: 202 len: 0 microversion: 2.1 time: 0.101029 Jul 20 04:14:49.958574 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 44/77] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:49 2022] DELETE /compute/v2.1/flavors/276239758 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:49.982019 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4691397f-7a11-413e-a95b-c6ae99c2f8eb tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.075898 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4691397f-7a11-413e-a95b-c6ae99c2f8eb tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.112731 Jul 20 04:14:50.080632 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 45/78] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.082777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:50.097134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6f0a166-ccfd-4bde-b514-0d99ca415f8a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1296 microversion: 2.1 time: 0.333123 Jul 20 04:14:50.112711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 34/79] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:49 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1296 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.113571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d1750ea5-2f93-4e19-a5b8-947ad4e15850 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1072479591", "id": 2104821421, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.151872 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d1750ea5-2f93-4e19-a5b8-947ad4e15850 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.043362 Jul 20 04:14:50.163381 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 46/80] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:50 2022] POST /compute/v2.1/flavors => generated 417 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:50.196391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d678b5cd-c505-4892-958e-0cf384590e5e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.267528 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d678b5cd-c505-4892-958e-0cf384590e5e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.096630 Jul 20 04:14:50.269717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 35/81] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.282674 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-985486eb-ad8d-450f-91b5-3a97e533b449 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.306412 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-985486eb-ad8d-450f-91b5-3a97e533b449 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2104821421" status: 202 len: 0 microversion: 2.1 time: 0.027357 Jul 20 04:14:50.308567 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 47/82] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:50 2022] DELETE /compute/v2.1/flavors/2104821421 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:50.317160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3d888ad-421d-4718-8217-730ff229fbea tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.399617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3d888ad-421d-4718-8217-730ff229fbea tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087831 Jul 20 04:14:50.403275 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 36/83] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.418396 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3d79e3d2-ca92-47ee-b056-7f64a90c758e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1994463735", "id": 1652895893, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.465532 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3d79e3d2-ca92-47ee-b056-7f64a90c758e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.044848 Jul 20 04:14:50.467398 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 48/84] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:50 2022] POST /compute/v2.1/flavors => generated 429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:50.478637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-573c56ef-faeb-4889-9af7-f5239435fe7d tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.479764 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:50.479764 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:50.545248 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-573c56ef-faeb-4889-9af7-f5239435fe7d tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1652895893" status: 202 len: 0 microversion: 2.1 time: 0.059689 Jul 20 04:14:50.545928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 37/85] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:50 2022] DELETE /compute/v2.1/flavors/1652895893 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:50.554292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-11218036-ad18-4938-a261-b66d37bb45b9 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.602606 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-11218036-ad18-4938-a261-b66d37bb45b9 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052117 Jul 20 04:14:50.618889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15391ab0-8aa5-4dc7-8670-6bd22f23f852 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1826247347", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.622646 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:50.622646 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:50.628716 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 49/86] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.647596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15391ab0-8aa5-4dc7-8670-6bd22f23f852 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032894 Jul 20 04:14:50.648258 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 38/87] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:50 2022] POST /compute/v2.1/flavors => generated 507 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:50.659737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-08e8a186-984b-4a97-90d5-e86b23955da2 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.710771 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-08e8a186-984b-4a97-90d5-e86b23955da2 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/0336ba53-91d7-4f1e-85fc-7dfc80a47386" status: 202 len: 0 microversion: 2.1 time: 0.055485 Jul 20 04:14:50.712756 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 50/88] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:50 2022] DELETE /compute/v2.1/flavors/0336ba53-91d7-4f1e-85fc-7dfc80a47386 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:50.721929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1009eafc-bb7c-4288-9801-5b28e3e5a26f tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.799845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1009eafc-bb7c-4288-9801-5b28e3e5a26f tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077023 Jul 20 04:14:50.806860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 39/89] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:50.823559 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-97302f7f-20d2-4d5f-8069-dfee67d8a0fd tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1516273966", "id": "39a50540-d06e-47b9-bb99-dc4a28d7655b", "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:50.873000 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-97302f7f-20d2-4d5f-8069-dfee67d8a0fd tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.055113 Jul 20 04:14:50.873604 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 51/90] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:50 2022] POST /compute/v2.1/flavors => generated 507 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:50.884867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-203c052e-9646-4951-8d3d-ac5cda459bdc tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:50.887926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:50.950680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-203c052e-9646-4951-8d3d-ac5cda459bdc tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/39a50540-d06e-47b9-bb99-dc4a28d7655b" status: 202 len: 0 microversion: 2.1 time: 0.069586 Jul 20 04:14:50.951076 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 40/91] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:14:50 2022] DELETE /compute/v2.1/flavors/39a50540-d06e-47b9-bb99-dc4a28d7655b => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:50.959891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d1289132-f5db-4cca-b118-21458f23919f tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.002538 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=12,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:51.031025 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d1289132-f5db-4cca-b118-21458f23919f tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056884 Jul 20 04:14:51.031905 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 52/92] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.048218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3facb9cd-86f6-4f02-8b6e-f77a89f494b4 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1552574849", "id": 967833679, "os-flavor-access:is_public": "True"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:51.115420 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.116160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:51.125269 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3facb9cd-86f6-4f02-8b6e-f77a89f494b4 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.080927 Jul 20 04:14:51.127694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 41/93] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:51 2022] POST /compute/v2.1/flavors => generated 411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:51.130211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.148768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.150102 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:51.152109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:51.157238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3ff651f-4c60-436c-856a-cfd498d7769c tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.203454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3ff651f-4c60-436c-856a-cfd498d7769c tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/967833679" status: 200 len: 411 microversion: 2.1 time: 0.068079 Jul 20 04:14:51.208333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 42/94] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/flavors/967833679 => generated 411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:51.661984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:51.683009 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e1af863e-d675-4182-b5cd-9138df49e3d4 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1296 microversion: 2.1 time: 0.572068 Jul 20 04:14:51.698764 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 53/95] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1296 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:51.726374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9393b961-63bb-4b9d-957d-430dbbb5133b tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.824499 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9393b961-63bb-4b9d-957d-430dbbb5133b tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.608346 Jul 20 04:14:51.828231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 43/96] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:51.848720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e11d7cc4-f142-4936-a27e-47f6d5243e9c tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.850416 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:51.850416 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:51.895383 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e11d7cc4-f142-4936-a27e-47f6d5243e9c tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/967833679" status: 202 len: 0 microversion: 2.1 time: 0.057008 Jul 20 04:14:51.897469 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 54/97] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:51 2022] DELETE /compute/v2.1/flavors/967833679 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:51.919171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0485ec1b-5ecf-4997-bf34-ada1c23cf9a8 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:51.985791 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0485ec1b-5ecf-4997-bf34-ada1c23cf9a8 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083529 Jul 20 04:14:51.988822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 44/98] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:52.005858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e110648f-ed4e-4336-a35e-1b6daacb568a tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1236416975", "id": 1281757911, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:52.007283 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:52.007283 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:52.036600 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e110648f-ed4e-4336-a35e-1b6daacb568a tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.035933 Jul 20 04:14:52.041063 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 55/99] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:51 2022] POST /compute/v2.1/flavors => generated 430 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:52.059933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5a15fca-e286-471e-872d-fd44821cadea tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "1281757911"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:52.074912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f5a15fca-e286-471e-872d-fd44821cadea tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] HTTP exception thrown: Flavor 1281757911 could not be found. Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5a15fca-e286-471e-872d-fd44821cadea tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] Request method failure captured: Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 107 Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E1oI3JvbjUCDq16FGTSDUNfN6qm-DxmLxODO3A8c23AYdk9Uw5kxxcaM2iM4Eu6xzygr86R1oYdPoEILniSZeO1KrZak-jbuFhOq4XCbecs-p3lQcZARNFLvwx0ci6fNz0JaG5NCjfbXIYrANL9sH43bkHc5OYMlVj1O7L_OcojHY Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cd7ef65a1c124411a5212ed2e912f369 Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FlavorsAdminTestJSON-1911184585 Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:14:52.079258 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cd7ef65a1c124411a5212ed2e912f369"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd7ef65a1c124411a5212ed2e912f369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cd7ef65a1c124411a5212ed2e912f369"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cd7ef65a1c124411a5212ed2e912f369", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FlavorsAdminTestJSON-1911184585 Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cd7ef65a1c124411a5212ed2e912f369 Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1911184585 Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FlavorsAdminTestJSON-1911184585-project Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 04cc424239204e678d80c3ea033afb33 Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FlavorsAdminTestJSON-1911184585-project Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "test", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "1281757911"}} Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:14:52.080969 n-d-764486-11 devstack@n-api.service[123724]: exception: Flavor 1281757911 could not be found. Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '1281757911'}}} Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1281757911 could not be found. Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.081831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1281757911 could not be found. Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:52.083291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:52.084488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:52.084488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:52.084488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:52.084488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1281757911 could not be found. Jul 20 04:14:52.084488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:52.085665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5a15fca-e286-471e-872d-fd44821cadea tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] Returning 400 to user: Flavor 1281757911 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:52.088696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5a15fca-e286-471e-872d-fd44821cadea tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.039270 Jul 20 04:14:52.091323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 45/100] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/servers => generated 81 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:14:52.098732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c93374d2-ebb2-42bf-a603-4ca51ea0792b tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.162973 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c93374d2-ebb2-42bf-a603-4ca51ea0792b tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1281757911" status: 202 len: 0 microversion: 2.1 time: 0.068870 Jul 20 04:14:52.164211 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 56/101] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:52 2022] DELETE /compute/v2.1/flavors/1281757911 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:52.173536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-632feb3c-c825-4699-9293-ec3352f19a15 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.206816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-632feb3c-c825-4699-9293-ec3352f19a15 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038021 Jul 20 04:14:52.213034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 46/102] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:52.230398 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d39d1183-49b3-40e1-8cbf-1e609c5e6557 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-404650252", "id": 893731815, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:52.281047 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d39d1183-49b3-40e1-8cbf-1e609c5e6557 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.054892 Jul 20 04:14:52.282191 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 57/103] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/flavors => generated 411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:52.293115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f24eefd2-d45d-4b12-829c-8e3765495e7a tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-776904795", "id": 1377902876, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:52.324858 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f24eefd2-d45d-4b12-829c-8e3765495e7a tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.035480 Jul 20 04:14:52.331111 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 58/104] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:52.346531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ee219832-d8a4-4c8d-9dce-a7b25d2d7076 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.446289 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ee219832-d8a4-4c8d-9dce-a7b25d2d7076 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.104551 Jul 20 04:14:52.447666 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 59/105] 10.222.0.49 () {58 vars in 1168 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:52.458530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3fb7d11d-af4f-40fa-a2ec-d417c0a0dcad tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.478514 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3fb7d11d-af4f-40fa-a2ec-d417c0a0dcad tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.023848 Jul 20 04:14:52.491018 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 60/106] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:52.496690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4ed07efb-8567-43ed-8496-b88a346f1c8e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.514801 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4ed07efb-8567-43ed-8496-b88a346f1c8e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.022171 Jul 20 04:14:52.518685 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 61/107] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:52.529985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-05e7e362-b76f-47f9-b1a1-c0197a991dbb tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.549191 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-05e7e362-b76f-47f9-b1a1-c0197a991dbb tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.022994 Jul 20 04:14:52.553765 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 62/108] 10.222.0.49 () {58 vars in 1168 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:52.581675 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fdd3aa46-5022-49f4-8b97-677515ef703e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.666976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:52.681139 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fdd3aa46-5022-49f4-8b97-677515ef703e tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.098155 Jul 20 04:14:52.683204 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 63/109] 10.222.0.49 () {58 vars in 1168 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:52.711327 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:52.715222 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:52.730498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:52.755620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.758112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:52.759531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:52.782451 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:53.357702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1e59f7a-3327-4e8a-87b2-c427b5227641 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-762304854", "id": 1534393580, "os-flavor-access:is_public": "False"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:53.375771 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:53.427754 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dc4d01d6-86ac-45d0-8b00-972a7326da5c tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1296 microversion: 2.1 time: 0.723501 Jul 20 04:14:53.428855 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 64/110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:52 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1296 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:53.462883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dabb772f-a547-427a-8c54-d7902b836699 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.478910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1e59f7a-3327-4e8a-87b2-c427b5227641 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 1.231675 Jul 20 04:14:53.489573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 47/111] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:52 2022] POST /compute/v2.1/flavors => generated 438 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:14:53.525660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2b12d28-3526-46ce-9ba5-417efa176b8f tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:53.531889 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:53.531889 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:53.562050 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dabb772f-a547-427a-8c54-d7902b836699 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.112839 Jul 20 04:14:53.563510 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 65/112] 10.222.0.49 () {58 vars in 1174 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:53.593056 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-83103f85-9c48-4080-a12a-bb753fa73f78 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.647557 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-83103f85-9c48-4080-a12a-bb753fa73f78 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.056082 Jul 20 04:14:53.649580 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 66/113] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:53.685652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7efca38d-20e7-4b0d-9a51-27045480dbee tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.763038 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7efca38d-20e7-4b0d-9a51-27045480dbee tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.081594 Jul 20 04:14:53.768283 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 67/114] 10.222.0.49 () {58 vars in 1168 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:53.791784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-27b9df92-6977-4df3-b39f-04a3caccbae8 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.794230 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:53.794230 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:53.856319 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-27b9df92-6977-4df3-b39f-04a3caccbae8 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1377902876" status: 202 len: 0 microversion: 2.1 time: 0.066836 Jul 20 04:14:53.858750 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 68/115] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:53 2022] DELETE /compute/v2.1/flavors/1377902876 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:53.878800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bb44a5f5-7ecd-4307-83b4-626363f10391 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:53.985070 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bb44a5f5-7ecd-4307-83b4-626363f10391 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106820 Jul 20 04:14:53.997152 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 69/116] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.032475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8c05b932-5e9b-4149-a5ed-cbf154b33454 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.171296 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8c05b932-5e9b-4149-a5ed-cbf154b33454 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/893731815" status: 202 len: 0 microversion: 2.1 time: 0.163398 Jul 20 04:14:54.177372 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 70/117] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:54 2022] DELETE /compute/v2.1/flavors/893731815 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:14:54.188196 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ed961c2c-2ec2-40f7-854d-cb082f78af50 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.249250 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ed961c2c-2ec2-40f7-854d-cb082f78af50 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069183 Jul 20 04:14:54.262162 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 71/118] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.272096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e4a2ec9c-308a-48c2-ba63-a5fb211edfd0 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-481870278", "id": 2030487816, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:54.273842 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:54.273842 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:54.317567 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e4a2ec9c-308a-48c2-ba63-a5fb211edfd0 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048856 Jul 20 04:14:54.319737 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 72/119] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:54.341018 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c746eafb-eee7-46d6-854a-6ea21f83ff07 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.359948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:54.408863 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c746eafb-eee7-46d6-854a-6ea21f83ff07 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080409 Jul 20 04:14:54.410190 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 73/120] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:54.426372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9ae9a3e5-f309-430b-a3b9-f6bacf3f7607 tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.499052 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9ae9a3e5-f309-430b-a3b9-f6bacf3f7607 tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077480 Jul 20 04:14:54.500295 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 74/121] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:14:54.543380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.546138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:54.556739 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.557798 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.559181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:54.563045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:54.865653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2b12d28-3526-46ce-9ba5-417efa176b8f tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1534393580/action" status: 200 len: 97 microversion: 2.1 time: 1.361314 Jul 20 04:14:54.872873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 48/122] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Jul 20 04:14:53 2022] POST /compute/v2.1/flavors/1534393580/action => generated 97 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:54.881153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ca34c46-0a2d-46be-a9e9-2096a604caaf tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:54.911290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ca34c46-0a2d-46be-a9e9-2096a604caaf tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2030487816" status: 202 len: 0 microversion: 2.1 time: 0.035640 Jul 20 04:14:54.912909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 49/123] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:54 2022] DELETE /compute/v2.1/flavors/2030487816 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:54.919829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3727e887-308c-487e-bad2-e5ed4752c231 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:55.409917 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:55.419520 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b16dd6d7-62cc-4b0c-b1d6-91b4d4c0e8ae tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.917948 Jul 20 04:14:55.426206 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 75/124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:54 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:55.434067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b876913d-0f0d-4470-b8bf-569b506a09ec tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.488183 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b876913d-0f0d-4470-b8bf-569b506a09ec tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058923 Jul 20 04:14:55.489277 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 76/125] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:55.519630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8bf947ce-bf39-40ca-b9d5-bdd49af1dab1 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1776841425", "id": 1047649825, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:55.522104 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:55.522104 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:55.561807 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8bf947ce-bf39-40ca-b9d5-bdd49af1dab1 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053231 Jul 20 04:14:55.563396 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 77/126] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:55.596143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d26e54a7-8261-4ed0-8a7a-fc1819109ec0 tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.624432 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d26e54a7-8261-4ed0-8a7a-fc1819109ec0 tempest-FlavorsAdminTestJSON-1911184585 tempest-FlavorsAdminTestJSON-1911184585-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.034071 Jul 20 04:14:55.625335 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 78/127] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:55 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:55.646920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-430d0fb3-bbf9-4517-9af4-f8c2f9c7d890 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.648464 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:55.648464 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:55.696333 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-430d0fb3-bbf9-4517-9af4-f8c2f9c7d890 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1047649825" status: 202 len: 0 microversion: 2.1 time: 0.057441 Jul 20 04:14:55.698645 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 79/128] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:55 2022] DELETE /compute/v2.1/flavors/1047649825 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:55.714605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2c68f2e9-ee1b-42c8-aa36-46f95b4b9951 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:55.743400 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2c68f2e9-ee1b-42c8-aa36-46f95b4b9951 tempest-FlavorsAdminTestJSON-966187551 tempest-FlavorsAdminTestJSON-966187551-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040430 Jul 20 04:14:55.756600 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 80/129] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:56.141689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3727e887-308c-487e-bad2-e5ed4752c231 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] HTTP exception thrown: Flavor access already exists for flavor 27 and project d88a4d7e02a040408698719bc28f4dc4 combination. Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3727e887-308c-487e-bad2-e5ed4752c231 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Request method failure captured: Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/flavors/1534393580/action HTTP/1.1 Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 67 Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E6p8b8g9DGkJMjMqsKJDMEg6YL3GIZcIdszqL3IkO32pPYbJEQcXT3vDzOskmCgl_XXTrqwQnyAMLHBMgvPjGLRsOAz4vREVmMlMbU-q0qcssdH0arVQe4tgxURfa2aOjSjpnGRoZ7gZ2MmIhArjUB7Cizt2HRrxLDTLLRN741JGo Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b03d67bd4085495f9cbeda981b4b2823 Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:14:56.150011 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b03d67bd4085495f9cbeda981b4b2823", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b03d67bd4085495f9cbeda981b4b2823 Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 75eb545809d64163b517d85a6bc25d87 Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: {"addTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} Jul 20 04:14:56.151152 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: exception: Flavor access already exists for flavor 27 and project d88a4d7e02a040408698719bc28f4dc4 combination. Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1534393580', 'body': {'addTenantAccess': {'tenant': 'd88a4d7e02a040408698719bc28f4dc4'}}} Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:14:56.151903 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27-d88a4d7e02a040408698719bc28f4dc4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:14:56.152881 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:14:56.153857 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:14:56.156335 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27-d88a4d7e02a040408698719bc28f4dc4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 14, 56, 131360), 'updated_at': None, 'flavor_id': 27, 'project_id': 'd88a4d7e02a040408698719bc28f4dc4'}] Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.159350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 27 and project d88a4d7e02a040408698719bc28f4dc4 combination. Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.161562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 27 and project d88a4d7e02a040408698719bc28f4dc4 combination. Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:56.163982 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:56.167209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 27 and project d88a4d7e02a040408698719bc28f4dc4 combination. Jul 20 04:14:56.167209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:56.169954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3727e887-308c-487e-bad2-e5ed4752c231 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Returning 409 to user: Flavor access already exists for flavor 27 and project d88a4d7e02a040408698719bc28f4dc4 combination. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:56.170938 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3727e887-308c-487e-bad2-e5ed4752c231 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1534393580/action" status: 409 len: 152 microversion: 2.1 time: 1.256849 Jul 20 04:14:56.179645 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 50/130] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Jul 20 04:14:54 2022] POST /compute/v2.1/flavors/1534393580/action => generated 152 bytes in 1266 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:56.182456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-449b856c-b7cb-460c-bb50-f1d271469e6a tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:56.184162 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:56.184162 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:56.437247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:56.442688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:56.455382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.456144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.457132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:56.457878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:56.744266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:56.754484 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83ff5ed6-212a-4fcf-9639-37f1115addc0 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.321575 Jul 20 04:14:56.755886 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 51/131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:57.685777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c441735-9668-4342-bb5a-3b47bf681f38 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.738535 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c441735-9668-4342-bb5a-3b47bf681f38 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.977626 Jul 20 04:14:57.742165 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 52/132] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:14:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:57.874980 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-449b856c-b7cb-460c-bb50-f1d271469e6a tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1534393580/action" status: 200 len: 21 microversion: 2.1 time: 1.697009 Jul 20 04:14:57.875579 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 81/133] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Jul 20 04:14:56 2022] POST /compute/v2.1/flavors/1534393580/action => generated 21 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:57.898612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:57.904526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:14:57.916520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=16,nova_api:INSERT=5 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:14:57.931834 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.932759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:57.935103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:57.939461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:58.464145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bff2329d-a9f8-4323-86c4-a29fddfbb827 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-541290191", "id": 1254793648, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:58.466870 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:58.466870 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:58.510609 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bff2329d-a9f8-4323-86c4-a29fddfbb827 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.758950 Jul 20 04:14:58.513937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 53/134] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:57 2022] POST /compute/v2.1/flavors => generated 424 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:58.533279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd3d2160-f2d0-4bac-b579-247598673813 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.534981 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:58.534981 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:58.591446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd3d2160-f2d0-4bac-b579-247598673813 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1534393580" status: 202 len: 0 microversion: 2.1 time: 0.070818 Jul 20 04:14:58.592609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 54/135] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:14:58 2022] DELETE /compute/v2.1/flavors/1534393580 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:14:58.909605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d689f4f-cd1b-470e-9018-5c24c9f53403 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Calling method '.version_select at 0x7f83986d9940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.913480 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:58.913480 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:14:58.916393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d689f4f-cd1b-470e-9018-5c24c9f53403 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f5e40c04419e412b8605b3317c53a044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70540771ad0b499fa99f6a29d765010f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d689f4f-cd1b-470e-9018-5c24c9f53403 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Request method failure captured: Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E9n5Kp_2K16t1yQAyGXPhwpgILkWWZaYmfyErxZ2lpatN_TP858I-MF-1MibPS2QfFT31P7Gg2gB45ZVDuRcToaOtt9s8DUdsp6m1ilgBz0GitOLGHIcg1FyjvZK-673gpDHjlklUjdu7LNymouc8H6lT-KdEzISd8mkjBHl0S8xk Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:14:58.928944 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70540771ad0b499fa99f6a29d765010f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f5e40c04419e412b8605b3317c53a044 Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:14:58.930519 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:58.931464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 04:14:58.932984 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:14:58.938670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d689f4f-cd1b-470e-9018-5c24c9f53403 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:58.941313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d689f4f-cd1b-470e-9018-5c24c9f53403 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.345745 Jul 20 04:14:58.946793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 55/136] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 353 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:58.962048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d96a69be-ad8a-45c2-a5ca-8b711b3a0700 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:58.992099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d96a69be-ad8a-45c2-a5ca-8b711b3a0700 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043591 Jul 20 04:14:58.993313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 56/137] 10.222.0.49 () {58 vars in 1181 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:59.003855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9954f261-d6cd-4c2f-a068-9cf4fda3d3cd tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.037534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9954f261-d6cd-4c2f-a068-9cf4fda3d3cd tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.042533 Jul 20 04:14:59.052163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 57/138] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:58 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:59.138745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.149783 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-38fae0ab-5e29-4cd3-8869-59452e581cad tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 1.264460 Jul 20 04:14:59.163031 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 82/139] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:14:57 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:14:59.177466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4b26ec29-8f32-4e58-b206-867aea4b1101 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Calling method '.version_select at 0x7f83988fdee0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.178748 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:59.178748 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:59.183671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4b26ec29-8f32-4e58-b206-867aea4b1101 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f5e40c04419e412b8605b3317c53a044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70540771ad0b499fa99f6a29d765010f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4b26ec29-8f32-4e58-b206-867aea4b1101 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Request method failure captured: Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E9n5Kp_2K16t1yQAyGXPhwpgILkWWZaYmfyErxZ2lpatN_TP858I-MF-1MibPS2QfFT31P7Gg2gB45ZVDuRcToaOtt9s8DUdsp6m1ilgBz0GitOLGHIcg1FyjvZK-673gpDHjlklUjdu7LNymouc8H6lT-KdEzISd8mkjBHl0S8xk Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:59.187835 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70540771ad0b499fa99f6a29d765010f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: f5e40c04419e412b8605b3317c53a044 Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: action_args: {} Jul 20 04:14:59.190083 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:59.190995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 04:14:59.192404 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.195843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4b26ec29-8f32-4e58-b206-867aea4b1101 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:59.197676 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4b26ec29-8f32-4e58-b206-867aea4b1101 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.033031 Jul 20 04:14:59.207795 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 83/140] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:59.226700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5e286d2e-2076-4cd8-90ab-085ed23ddf07 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-131890219", "id": 1197451265, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:59.232608 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:59.232608 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:59.271021 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5e286d2e-2076-4cd8-90ab-085ed23ddf07 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.057598 Jul 20 04:14:59.273028 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 84/141] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:59 2022] POST /compute/v2.1/flavors => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:59.294752 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21663e09-a8c4-4321-b2c1-d9fda0209de6 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1256363494", "id": 835869917, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:59.359064 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-21663e09-a8c4-4321-b2c1-d9fda0209de6 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.084335 Jul 20 04:14:59.363117 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 85/142] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:14:59 2022] POST /compute/v2.1/flavors => generated 435 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:59.377563 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-36288f56-2ba3-4409-9d9e-61ddd5a1ac8b tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Calling method '.version_select at 0x7f83988c51f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.378609 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:59.378609 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:59.379997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-36288f56-2ba3-4409-9d9e-61ddd5a1ac8b tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f5e40c04419e412b8605b3317c53a044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70540771ad0b499fa99f6a29d765010f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-36288f56-2ba3-4409-9d9e-61ddd5a1ac8b tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Request method failure captured: Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E9n5Kp_2K16t1yQAyGXPhwpgILkWWZaYmfyErxZ2lpatN_TP858I-MF-1MibPS2QfFT31P7Gg2gB45ZVDuRcToaOtt9s8DUdsp6m1ilgBz0GitOLGHIcg1FyjvZK-673gpDHjlklUjdu7LNymouc8H6lT-KdEzISd8mkjBHl0S8xk Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:14:59.382651 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70540771ad0b499fa99f6a29d765010f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: f5e40c04419e412b8605b3317c53a044 Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: action_args: {} Jul 20 04:14:59.384109 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:14:59.384884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 04:14:59.386089 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.388566 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-36288f56-2ba3-4409-9d9e-61ddd5a1ac8b tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:59.390029 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-36288f56-2ba3-4409-9d9e-61ddd5a1ac8b tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019642 Jul 20 04:14:59.396155 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 86/143] 10.222.0.49 () {58 vars in 1178 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:14:59.402749 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4b7dffde-40e7-45bc-8479-4ec450d2c82b tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.415654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4b7dffde-40e7-45bc-8479-4ec450d2c82b tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017776 Jul 20 04:14:59.416892 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 87/144] 10.222.0.49 () {58 vars in 1181 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:14:59.423976 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-50d8bba6-4b8f-4f97-9a93-fcf5850619e9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.424966 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:59.424966 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:14:59.435475 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-50d8bba6-4b8f-4f97-9a93-fcf5850619e9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-50d8bba6-4b8f-4f97-9a93-fcf5850619e9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Request method failure captured: Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/flavors/835869917/os-flavor-access HTTP/1.1 Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E6p8b8g9DGkJMjMqsKJDMEg6YL3GIZcIdszqL3IkO32pPYbJEQcXT3vDzOskmCgl_XXTrqwQnyAMLHBMgvPjGLRsOAz4vREVmMlMbU-q0qcssdH0arVQe4tgxURfa2aOjSjpnGRoZ7gZ2MmIhArjUB7Cizt2HRrxLDTLLRN741JGo Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: b03d67bd4085495f9cbeda981b4b2823 Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:14:59.438741 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b03d67bd4085495f9cbeda981b4b2823", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: b03d67bd4085495f9cbeda981b4b2823 Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 75eb545809d64163b517d85a6bc25d87 Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: exception: Access list not available for public flavors. Jul 20 04:14:59.441075 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '835869917'} Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 20 04:14:59.441877 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:14:59.446223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-50d8bba6-4b8f-4f97-9a93-fcf5850619e9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:14:59.447321 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-50d8bba6-4b8f-4f97-9a93-fcf5850619e9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/835869917/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029167 Jul 20 04:14:59.451284 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 88/145] 10.222.0.49 () {58 vars in 1205 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/flavors/835869917/os-flavor-access => generated 91 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:14:59.599605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ac6e7dea-44e8-4077-9e74-f1a04a83cbce req-5ce7abb6-397b-440c-94a0-35ea9bcc079c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56cf52ee-9464-4a97-935f-f36eeb252609", "tag": "ea5a88ef-7096-457a-9bba-a18b2ee02539"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:59.634501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ac6e7dea-44e8-4077-9e74-f1a04a83cbce req-5ce7abb6-397b-440c-94a0-35ea9bcc079c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.634965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ac6e7dea-44e8-4077-9e74-f1a04a83cbce req-5ce7abb6-397b-440c-94a0-35ea9bcc079c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.713238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ac6e7dea-44e8-4077-9e74-f1a04a83cbce req-5ce7abb6-397b-440c-94a0-35ea9bcc079c service nova] Creating event network-changed:ea5a88ef-7096-457a-9bba-a18b2ee02539 for instance 56cf52ee-9464-4a97-935f-f36eeb252609 on n-h2-764486-11 Jul 20 04:14:59.714147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ac6e7dea-44e8-4077-9e74-f1a04a83cbce req-5ce7abb6-397b-440c-94a0-35ea9bcc079c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:14:59.717548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.721399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.722757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.724923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.751734 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.rpcapi [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:14:59.769638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] Releasing lock "compute-rpcapi-router" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:14:59.773564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Calling method '.version_select at 0x7f83988fd0d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.789373 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.789922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.833600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0abf9648-5c17-49da-91b0-c05aa9ec5a0d None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.779599 Jul 20 04:14:59.834938 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 58/146] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:59.840830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.841271 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.843182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0fe2e25f-0db8-474e-ab5b-8ac33169fd9d tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Action: 'create', calling method: .version_select at 0x7f8398718e50>, body: {"keypair": {"name": "tempest-keypair-1830281682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm8u6BeC5Hcma8SdYp58OIz/vgNZuiAyQsJwmydtMjYUvoSDqBt+nh+/3n8vOMM+fDpOmv1kWU1VifJxW02IfIttYSMrtkVJBffA1taGltQKoLeHI0UyR9Kgsvy91iIdg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:14:59.886790 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:14:59.888582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:14:59.899656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0fe2e25f-0db8-474e-ab5b-8ac33169fd9d tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Getting quotas for project 4fbc880ec5e14aafa307eb780a1cd051. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:14:59.933038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0fe2e25f-0db8-474e-ab5b-8ac33169fd9d tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Getting quotas for user 5c2ac596c69843009cfd28dd0e90d56e and project 4fbc880ec5e14aafa307eb780a1cd051. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:14:59.935051 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1173062d-341c-436c-bb84-136c830c1dca tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.476065 Jul 20 04:14:59.936118 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 89/147] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:14:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:14:59.958011 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2e1267f7-979b-40ea-b89f-7bfba01444eb tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:14:59.958950 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:14:59.958950 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:00.013034 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2e1267f7-979b-40ea-b89f-7bfba01444eb tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/835869917" status: 202 len: 0 microversion: 2.1 time: 0.075242 Jul 20 04:15:00.013729 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 90/148] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:14:59 2022] DELETE /compute/v2.1/flavors/835869917 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:00.025833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0fe2e25f-0db8-474e-ab5b-8ac33169fd9d tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189486 Jul 20 04:15:00.026432 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 59/149] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:14:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:00.037706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cba39216-814d-41ac-bb9a-2d3bef5cf39d tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.039569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c389dbbe-4801-49f2-9cde-c8896b8fdc3d tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Calling method '.version_select at 0x7f83988fd430>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.040770 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:00.040770 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:00.044591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c389dbbe-4801-49f2-9cde-c8896b8fdc3d tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f5e40c04419e412b8605b3317c53a044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70540771ad0b499fa99f6a29d765010f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c389dbbe-4801-49f2-9cde-c8896b8fdc3d tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Request method failure captured: Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E9n5Kp_2K16t1yQAyGXPhwpgILkWWZaYmfyErxZ2lpatN_TP858I-MF-1MibPS2QfFT31P7Gg2gB45ZVDuRcToaOtt9s8DUdsp6m1ilgBz0GitOLGHIcg1FyjvZK-673gpDHjlklUjdu7LNymouc8H6lT-KdEzISd8mkjBHl0S8xk Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:00.047622 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70540771ad0b499fa99f6a29d765010f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: f5e40c04419e412b8605b3317c53a044 Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '1'} Jul 20 04:15:00.048962 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:00.049843 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 04:15:00.050925 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.056895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c389dbbe-4801-49f2-9cde-c8896b8fdc3d tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:00.057968 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c389dbbe-4801-49f2-9cde-c8896b8fdc3d tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.039231 Jul 20 04:15:00.061118 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 91/150] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:00.076630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0cd48934-b46c-4f21-9f37-f14cdf229572 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Calling method '.version_select at 0x7f83988c5af0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.083490 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-0cd48934-b46c-4f21-9f37-f14cdf229572 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] HTTP exception thrown: Hypervisor with ID '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942' could not be found. Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0cd48934-b46c-4f21-9f37-f14cdf229572 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Request method failure captured: Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors/4fb3e6ba-99e6-4f5b-9e15-fde990c6d942/uptime HTTP/1.1 Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FCwfM45MCusozuGXAhTIXCcOGg9FfHk4gvY7ohhFs3oDANrtIxnec1ziVaLSatKGDQ1PIUFb4QQrFtgWjiTKmZ_jsqgxFJOqcntNPAGhgaZtWExktOVHORiGCGx5a_MSG1kGT54gCd_H0bMR9DyN84PsFKdGyAkCTMrZNdsewsDZo Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 1370fefc8be74100ac8eda265c89535e Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1614622336 Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:00.104325 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1370fefc8be74100ac8eda265c89535e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1370fefc8be74100ac8eda265c89535e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1370fefc8be74100ac8eda265c89535e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1370fefc8be74100ac8eda265c89535e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1614622336 Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 1370fefc8be74100ac8eda265c89535e Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1614622336 Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 990e51d40fef462d95cbd0d2631b72eb Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: exception: Hypervisor with ID '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942' could not be found. Jul 20 04:15:00.105800 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942'} Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942' Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:15:00.106646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942' could not be found. Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.108265 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942' could not be found. Jul 20 04:15:00.110037 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.110576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cba39216-814d-41ac-bb9a-2d3bef5cf39d tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.078074 Jul 20 04:15:00.110576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 60/151] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:00.111756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0cd48934-b46c-4f21-9f37-f14cdf229572 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Returning 404 to user: Hypervisor with ID '4fb3e6ba-99e6-4f5b-9e15-fde990c6d942' could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:00.112925 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0cd48934-b46c-4f21-9f37-f14cdf229572 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/4fb3e6ba-99e6-4f5b-9e15-fde990c6d942/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043737 Jul 20 04:15:00.118648 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 92/152] 10.222.0.49 () {58 vars in 1277 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/os-hypervisors/4fb3e6ba-99e6-4f5b-9e15-fde990c6d942/uptime => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:00.126933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Calling method '.version_select at 0x7f839868d040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.127353 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cf0258b2-c4dc-44a8-8e88-3bc2fddae7c7 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1580303266", "id": 384288149, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:00.127968 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:00.127968 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:00.129023 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:00.129023 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:00.131080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.131545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.159571 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cf0258b2-c4dc-44a8-8e88-3bc2fddae7c7 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.037182 Jul 20 04:15:00.161146 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 93/153] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:00 2022] POST /compute/v2.1/flavors => generated 436 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:00.174543 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.175920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:00.185019 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.186186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.187345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.189090 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.197489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.197489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.231457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:00.231909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:00.251613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82bc4d13-2926-4d91-9823-e00076cb0af1 tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.131896 Jul 20 04:15:00.260083 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 61/154] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:00.934201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85c47f32-f6ee-45d2-b5b2-92e649d186bf tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:00.935785 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:00.935785 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85c47f32-f6ee-45d2-b5b2-92e649d186bf tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ec47b719cc464690850d2612b2a2fb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88a4d7e02a040408698719bc28f4dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85c47f32-f6ee-45d2-b5b2-92e649d186bf tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Request method failure captured: Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/flavors/384288149/action HTTP/1.1 Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 67 Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E4vKUe76r0P-yuISYt9RuDUrVgxF_xuFjjWbYXSDaaPoedv_VzX_RcVbj-CSS_eLwmLE2MaC2ckDl1_2Nw4oRC3EyRrBWMSIGKklBUWDspVrzGVVUo1BPHNE1U2ahVHO2VAnzlyJPhJ3wV1Snb3tUqvBMka3uI6zzCEi1KwEGuTwQ Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d88a4d7e02a040408698719bc28f4dc4 Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-761110256 Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:00.940837 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d88a4d7e02a040408698719bc28f4dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d88a4d7e02a040408698719bc28f4dc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d88a4d7e02a040408698719bc28f4dc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d88a4d7e02a040408698719bc28f4dc4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-761110256 Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d88a4d7e02a040408698719bc28f4dc4 Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-761110256 Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FlavorsAccessNegativeTestJSON-761110256-project Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: ec47b719cc464690850d2612b2a2fb62 Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-761110256-project Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: {"addTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} Jul 20 04:15:00.942194 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '384288149', 'body': {'addTenantAccess': {'tenant': 'd88a4d7e02a040408698719bc28f4dc4'}}} Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:00.943419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 04:15:00.945091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.946138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85c47f32-f6ee-45d2-b5b2-92e649d186bf tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:00.946138 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85c47f32-f6ee-45d2-b5b2-92e649d186bf tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] 10.222.0.49 "POST /compute/v2.1/flavors/384288149/action" status: 403 len: 130 microversion: 2.1 time: 0.677895 Jul 20 04:15:00.946138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 62/155] 10.222.0.49 () {60 vars in 1196 bytes} [Wed Jul 20 04:15:00 2022] POST /compute/v2.1/flavors/384288149/action => generated 130 bytes in 679 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:00.963535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fa9e49c-cc92-44e3-979d-363ce6cf37b2 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Calling method '.version_select at 0x7f839861d670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:00.965147 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:00.965147 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:00.973618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1fa9e49c-cc92-44e3-979d-363ce6cf37b2 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f5e40c04419e412b8605b3317c53a044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70540771ad0b499fa99f6a29d765010f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fa9e49c-cc92-44e3-979d-363ce6cf37b2 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Request method failure captured: Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E9n5Kp_2K16t1yQAyGXPhwpgILkWWZaYmfyErxZ2lpatN_TP858I-MF-1MibPS2QfFT31P7Gg2gB45ZVDuRcToaOtt9s8DUdsp6m1ilgBz0GitOLGHIcg1FyjvZK-673gpDHjlklUjdu7LNymouc8H6lT-KdEzISd8mkjBHl0S8xk Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:00.982505 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70540771ad0b499fa99f6a29d765010f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70540771ad0b499fa99f6a29d765010f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 70540771ad0b499fa99f6a29d765010f Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646 Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f5e40c04419e412b8605b3317c53a044 Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1891508646-project Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1'} Jul 20 04:15:00.983692 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:00.984392 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 04:15:00.985438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:00.986763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fa9e49c-cc92-44e3-979d-363ce6cf37b2 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:00.986763 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1fa9e49c-cc92-44e3-979d-363ce6cf37b2 tempest-HypervisorAdminNegativeTestJSON-1891508646 tempest-HypervisorAdminNegativeTestJSON-1891508646-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.039382 Jul 20 04:15:00.986763 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 63/156] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:01.219520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:01.228786 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c930bbba-5728-4879-a307-1cd7fd3282db tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 1.060843 Jul 20 04:15:01.248476 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 94/157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.255505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4bd499d4-f964-4ebe-bc13-77e14eb19df7 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.256578 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:01.256578 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:01.303898 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4bd499d4-f964-4ebe-bc13-77e14eb19df7 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/384288149" status: 202 len: 0 microversion: 2.1 time: 0.052421 Jul 20 04:15:01.308018 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 95/158] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:15:01 2022] DELETE /compute/v2.1/flavors/384288149 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:01.327381 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2f97542-e79d-4103-9d43-13fd627f286b tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Calling method '.version_select at 0x7f83988b3af0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.328738 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:01.328738 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:01.330470 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-b2f97542-e79d-4103-9d43-13fd627f286b tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] HTTP exception thrown: Hypervisor with ID 'b99789d2-bcb8-4215-a456-42ca8b464dc3' could not be found. Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2f97542-e79d-4103-9d43-13fd627f286b tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Request method failure captured: Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors/b99789d2-bcb8-4215-a456-42ca8b464dc3 HTTP/1.1 Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FCwfM45MCusozuGXAhTIXCcOGg9FfHk4gvY7ohhFs3oDANrtIxnec1ziVaLSatKGDQ1PIUFb4QQrFtgWjiTKmZ_jsqgxFJOqcntNPAGhgaZtWExktOVHORiGCGx5a_MSG1kGT54gCd_H0bMR9DyN84PsFKdGyAkCTMrZNdsewsDZo Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 1370fefc8be74100ac8eda265c89535e Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1614622336 Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:01.337310 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1370fefc8be74100ac8eda265c89535e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1370fefc8be74100ac8eda265c89535e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1370fefc8be74100ac8eda265c89535e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1370fefc8be74100ac8eda265c89535e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1614622336 Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 1370fefc8be74100ac8eda265c89535e Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1614622336 Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 990e51d40fef462d95cbd0d2631b72eb Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: exception: Hypervisor with ID 'b99789d2-bcb8-4215-a456-42ca8b464dc3' could not be found. Jul 20 04:15:01.339023 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'b99789d2-bcb8-4215-a456-42ca8b464dc3'} Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b99789d2-bcb8-4215-a456-42ca8b464dc3' Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 04:15:01.339816 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:01.341222 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b99789d2-bcb8-4215-a456-42ca8b464dc3' could not be found. Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b99789d2-bcb8-4215-a456-42ca8b464dc3' could not be found. Jul 20 04:15:01.342358 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:01.347202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2f97542-e79d-4103-9d43-13fd627f286b tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] Returning 404 to user: Hypervisor with ID 'b99789d2-bcb8-4215-a456-42ca8b464dc3' could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:01.348402 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b2f97542-e79d-4103-9d43-13fd627f286b tempest-HypervisorAdminNegativeTestJSON-1614622336 tempest-HypervisorAdminNegativeTestJSON-1614622336-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/b99789d2-bcb8-4215-a456-42ca8b464dc3" status: 404 len: 123 microversion: 2.1 time: 0.039114 Jul 20 04:15:01.356248 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 96/159] 10.222.0.49 () {58 vars in 1256 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/os-hypervisors/b99789d2-bcb8-4215-a456-42ca8b464dc3 => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:01.362319 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fb8231be-9581-4505-93ed-d030cdc42979 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.435624 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fb8231be-9581-4505-93ed-d030cdc42979 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.075703 Jul 20 04:15:01.436492 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 97/160] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:01.468163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8b3fc985-2937-4684-bc82-66b9d4d8a22e tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1954675288", "id": 510800942, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:01.476839 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:01.476839 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:01.530463 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8b3fc985-2937-4684-bc82-66b9d4d8a22e tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.072145 Jul 20 04:15:01.533530 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 98/161] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:01.545940 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-01fbf8e8-6780-4107-afd3-9b47896be5f9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:01.552370 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:01.552370 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:01.580963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66580ec3-ac4e-4236-8d1d-80e7d3635bcd tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Calling method '.version_select at 0x7f839861d1f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:01.587707 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:01.587707 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:01.594088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66580ec3-ac4e-4236-8d1d-80e7d3635bcd tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.597630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66580ec3-ac4e-4236-8d1d-80e7d3635bcd tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.605088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66580ec3-ac4e-4236-8d1d-80e7d3635bcd tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:01.609164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66580ec3-ac4e-4236-8d1d-80e7d3635bcd tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:01.713664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66580ec3-ac4e-4236-8d1d-80e7d3635bcd tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.716923 Jul 20 04:15:01.726055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 64/162] 10.222.0.49 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:00 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:02.400186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01576321-7c53-44c9-8ceb-eba2b271298d tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Calling method '.version_select at 0x7f839861d8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.403326 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:02.403326 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:02.408909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01576321-7c53-44c9-8ceb-eba2b271298d tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a46b6b9097f04346b4d63dca390924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc45a0cda1d447c8c5a512b67a0f98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01576321-7c53-44c9-8ceb-eba2b271298d tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Request method failure captured: Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FC8-b59NULJtBop89i9QlbHIWUHQ_KRv51HqIzv0RD13cbf8-oORwQMb4BMd6eA7XKCnHjUgYwMnoDShK7p6LqxZAq2cEy8F6MB52OJez2iYIX_ZvPb9RxJWuvwjh_KG_DolAm23vFTcGxCJoyN8zqQQW0lziNfA4s44OE7xv0MFU Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:02.416013 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbc45a0cda1d447c8c5a512b67a0f98a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a46b6b9097f04346b4d63dca390924b2 Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:15:02.417640 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:02.418600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 04:15:02.419943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.427816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01576321-7c53-44c9-8ceb-eba2b271298d tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:02.429332 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01576321-7c53-44c9-8ceb-eba2b271298d tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.701208 Jul 20 04:15:02.431094 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 65/163] 10.222.0.49 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:01 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 704 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:02.449748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.453409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:02.478192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.479668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.483459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:02.484339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:02.598067 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-01fbf8e8-6780-4107-afd3-9b47896be5f9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/510800942/action" status: 200 len: 96 microversion: 2.1 time: 1.057910 Jul 20 04:15:02.603211 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 99/164] 10.222.0.49 () {60 vars in 1196 bytes} [Wed Jul 20 04:15:01 2022] POST /compute/v2.1/flavors/510800942/action => generated 96 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:02.630074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1faf9cf5-821b-41ec-85e0-c93e19cdd871 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Calling method '.version_select at 0x7f83988c5280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.631274 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:02.631274 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:02.633163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1faf9cf5-821b-41ec-85e0-c93e19cdd871 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a46b6b9097f04346b4d63dca390924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc45a0cda1d447c8c5a512b67a0f98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1faf9cf5-821b-41ec-85e0-c93e19cdd871 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Request method failure captured: Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hosts/n-d-764486-11/reboot HTTP/1.1 Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FC8-b59NULJtBop89i9QlbHIWUHQ_KRv51HqIzv0RD13cbf8-oORwQMb4BMd6eA7XKCnHjUgYwMnoDShK7p6LqxZAq2cEy8F6MB52OJez2iYIX_ZvPb9RxJWuvwjh_KG_DolAm23vFTcGxCJoyN8zqQQW0lziNfA4s44OE7xv0MFU Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:02.638656 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbc45a0cda1d447c8c5a512b67a0f98a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: a46b6b9097f04346b4d63dca390924b2 Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'n-d-764486-11'} Jul 20 04:15:02.640001 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:02.640884 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 04:15:02.642017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.643091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1faf9cf5-821b-41ec-85e0-c93e19cdd871 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:02.643091 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1faf9cf5-821b-41ec-85e0-c93e19cdd871 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-764486-11/reboot" status: 403 len: 111 microversion: 2.1 time: 0.032970 Jul 20 04:15:02.644995 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 100/165] 10.222.0.49 () {58 vars in 1190 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/os-hosts/n-d-764486-11/reboot => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:02.675003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cff6c3c2-9d27-48c3-a694-13a4f091d86b tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:02.679014 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:02.679014 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:02.680046 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cff6c3c2-9d27-48c3-a694-13a4f091d86b tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ec47b719cc464690850d2612b2a2fb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88a4d7e02a040408698719bc28f4dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cff6c3c2-9d27-48c3-a694-13a4f091d86b tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Request method failure captured: Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/flavors/510800942/action HTTP/1.1 Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 70 Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E4vKUe76r0P-yuISYt9RuDUrVgxF_xuFjjWbYXSDaaPoedv_VzX_RcVbj-CSS_eLwmLE2MaC2ckDl1_2Nw4oRC3EyRrBWMSIGKklBUWDspVrzGVVUo1BPHNE1U2ahVHO2VAnzlyJPhJ3wV1Snb3tUqvBMka3uI6zzCEi1KwEGuTwQ Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: d88a4d7e02a040408698719bc28f4dc4 Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-761110256 Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:02.686081 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d88a4d7e02a040408698719bc28f4dc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d88a4d7e02a040408698719bc28f4dc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d88a4d7e02a040408698719bc28f4dc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d88a4d7e02a040408698719bc28f4dc4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-761110256 Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: d88a4d7e02a040408698719bc28f4dc4 Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-761110256 Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsAccessNegativeTestJSON-761110256-project Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: ec47b719cc464690850d2612b2a2fb62 Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-761110256-project Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: {"removeTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} Jul 20 04:15:02.687614 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '510800942', 'body': {'removeTenantAccess': {'tenant': 'd88a4d7e02a040408698719bc28f4dc4'}}} Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can( Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:02.688532 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 04:15:02.691920 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.693532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cff6c3c2-9d27-48c3-a694-13a4f091d86b tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:02.693532 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cff6c3c2-9d27-48c3-a694-13a4f091d86b tempest-FlavorsAccessNegativeTestJSON-761110256 tempest-FlavorsAccessNegativeTestJSON-761110256-project] 10.222.0.49 "POST /compute/v2.1/flavors/510800942/action" status: 403 len: 133 microversion: 2.1 time: 0.041298 Jul 20 04:15:02.693532 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 101/166] 10.222.0.49 () {60 vars in 1196 bytes} [Wed Jul 20 04:15:02 2022] POST /compute/v2.1/flavors/510800942/action => generated 133 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:02.702590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-94baba8b-69bb-4faa-bf41-7bb1cd0991c9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Calling method '.version_select at 0x7f83988c5310>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.720434 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-94baba8b-69bb-4faa-bf41-7bb1cd0991c9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-94baba8b-69bb-4faa-bf41-7bb1cd0991c9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:02.723501 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:15:02.724976 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:02.725911 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:15:02.727162 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:02.728427 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.740765 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-94baba8b-69bb-4faa-bf41-7bb1cd0991c9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:02.741650 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-94baba8b-69bb-4faa-bf41-7bb1cd0991c9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.048950 Jul 20 04:15:02.755041 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 102/167] 10.222.0.49 () {58 vars in 1211 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:02.760431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-61850c61-ffa2-4c63-8bed-a04d3debff0e tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d88a4d7e02a040408698719bc28f4dc4"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:02.965215 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-61850c61-ffa2-4c63-8bed-a04d3debff0e tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/510800942/action" status: 200 len: 21 microversion: 2.1 time: 0.211362 Jul 20 04:15:02.968051 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 103/168] 10.222.0.49 () {60 vars in 1196 bytes} [Wed Jul 20 04:15:02 2022] POST /compute/v2.1/flavors/510800942/action => generated 21 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:02.979374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-624142fc-2947-40bc-9d2a-b2a3d4ce23a3 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Calling method '.version_select at 0x7f83988b3550>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:02.984890 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:02.984890 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:02.987868 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-624142fc-2947-40bc-9d2a-b2a3d4ce23a3 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a46b6b9097f04346b4d63dca390924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc45a0cda1d447c8c5a512b67a0f98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-624142fc-2947-40bc-9d2a-b2a3d4ce23a3 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Request method failure captured: Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hosts/n-d-764486-11 HTTP/1.1 Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FC8-b59NULJtBop89i9QlbHIWUHQ_KRv51HqIzv0RD13cbf8-oORwQMb4BMd6eA7XKCnHjUgYwMnoDShK7p6LqxZAq2cEy8F6MB52OJez2iYIX_ZvPb9RxJWuvwjh_KG_DolAm23vFTcGxCJoyN8zqQQW0lziNfA4s44OE7xv0MFU Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:02.991731 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbc45a0cda1d447c8c5a512b67a0f98a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: a46b6b9097f04346b4d63dca390924b2 Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'n-d-764486-11'} Jul 20 04:15:02.993485 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:02.994944 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 04:15:02.996890 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:02.999030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-624142fc-2947-40bc-9d2a-b2a3d4ce23a3 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.003419 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-624142fc-2947-40bc-9d2a-b2a3d4ce23a3 tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-764486-11" status: 403 len: 109 microversion: 2.1 time: 0.033571 Jul 20 04:15:03.009327 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 104/169] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/os-hosts/n-d-764486-11 => generated 109 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:03.021694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7a2002f7-12ab-4844-8e35-af72d2166cac tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.069904 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7a2002f7-12ab-4844-8e35-af72d2166cac tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/510800942" status: 202 len: 0 microversion: 2.1 time: 0.058632 Jul 20 04:15:03.071979 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 105/170] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:15:03 2022] DELETE /compute/v2.1/flavors/510800942 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:03.082975 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-74a9e138-de98-468b-bb27-ffc33e51fb91 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Calling method '.version_select at 0x7f83988c5280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.115766 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-74a9e138-de98-468b-bb27-ffc33e51fb91 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-74a9e138-de98-468b-bb27-ffc33e51fb91 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:03.119113 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:15:03.120598 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.121332 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.122392 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.130069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-74a9e138-de98-468b-bb27-ffc33e51fb91 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.131313 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-74a9e138-de98-468b-bb27-ffc33e51fb91 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.057300 Jul 20 04:15:03.134315 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 106/171] 10.222.0.49 () {58 vars in 1190 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:03.151316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bb2d6b8f-83c1-4a7d-9709-def414cbd6b9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.201951 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bb2d6b8f-83c1-4a7d-9709-def414cbd6b9 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.063962 Jul 20 04:15:03.203007 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 107/172] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.219223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a9c9a0c3-7b39-40c9-bcf7-a88da9f778fe tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Calling method '.version_select at 0x7f83988b3af0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.221397 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:03.221397 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:03.222800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a9c9a0c3-7b39-40c9-bcf7-a88da9f778fe tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a46b6b9097f04346b4d63dca390924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc45a0cda1d447c8c5a512b67a0f98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a9c9a0c3-7b39-40c9-bcf7-a88da9f778fe tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Request method failure captured: Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hosts/n-d-764486-11/shutdown HTTP/1.1 Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FC8-b59NULJtBop89i9QlbHIWUHQ_KRv51HqIzv0RD13cbf8-oORwQMb4BMd6eA7XKCnHjUgYwMnoDShK7p6LqxZAq2cEy8F6MB52OJez2iYIX_ZvPb9RxJWuvwjh_KG_DolAm23vFTcGxCJoyN8zqQQW0lziNfA4s44OE7xv0MFU Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:03.224610 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbc45a0cda1d447c8c5a512b67a0f98a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: a46b6b9097f04346b4d63dca390924b2 Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'n-d-764486-11'} Jul 20 04:15:03.226125 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:03.227075 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 04:15:03.228612 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.229905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a9c9a0c3-7b39-40c9-bcf7-a88da9f778fe tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.231478 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a9c9a0c3-7b39-40c9-bcf7-a88da9f778fe tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-764486-11/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027178 Jul 20 04:15:03.232816 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 108/173] 10.222.0.49 () {58 vars in 1196 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/os-hosts/n-d-764486-11/shutdown => generated 113 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:03.240485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.242411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-873dcb59-6574-43fd-a92f-7d333e27a496 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1076894687", "id": 882290152, "os-flavor-access:is_public": "False"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.249434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76554b11-6d3d-4398-bae4-ff3ea39cde6e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.816902 Jul 20 04:15:03.250415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 66/174] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:02 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:03.256051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3826045-a1fd-4a70-8702-3ec3ddb36410 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Calling method '.version_select at 0x7f839861d8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.264007 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:03.264007 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:03.289455 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-873dcb59-6574-43fd-a92f-7d333e27a496 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.055279 Jul 20 04:15:03.290645 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 109/175] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:03 2022] POST /compute/v2.1/flavors => generated 436 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:03.290853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b3826045-a1fd-4a70-8702-3ec3ddb36410 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3826045-a1fd-4a70-8702-3ec3ddb36410 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:03.293771 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:15:03.295009 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:03.295708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:15:03.296864 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3826045-a1fd-4a70-8702-3ec3ddb36410 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.302161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3826045-a1fd-4a70-8702-3ec3ddb36410 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.043681 Jul 20 04:15:03.304753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 67/176] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:03.309277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-86844aeb-fe06-4536-b4b1-23a623173c4b tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b9dc01952bcb4022ba6f7133f4d450c4"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.332888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88e0a214-03d5-4095-8329-314c56eeddec tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Calling method '.version_select at 0x7f839861dee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.333279 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:03.333279 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:03.335975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88e0a214-03d5-4095-8329-314c56eeddec tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a46b6b9097f04346b4d63dca390924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc45a0cda1d447c8c5a512b67a0f98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88e0a214-03d5-4095-8329-314c56eeddec tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Request method failure captured: Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hosts/n-d-764486-11/startup HTTP/1.1 Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FC8-b59NULJtBop89i9QlbHIWUHQ_KRv51HqIzv0RD13cbf8-oORwQMb4BMd6eA7XKCnHjUgYwMnoDShK7p6LqxZAq2cEy8F6MB52OJez2iYIX_ZvPb9RxJWuvwjh_KG_DolAm23vFTcGxCJoyN8zqQQW0lziNfA4s44OE7xv0MFU Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:03.339765 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbc45a0cda1d447c8c5a512b67a0f98a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a46b6b9097f04346b4d63dca390924b2 Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'n-d-764486-11'} Jul 20 04:15:03.341266 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:03.342150 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 04:15:03.343362 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.348651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88e0a214-03d5-4095-8329-314c56eeddec tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.354092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88e0a214-03d5-4095-8329-314c56eeddec tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-764486-11/startup" status: 403 len: 110 microversion: 2.1 time: 0.048284 Jul 20 04:15:03.356048 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 68/177] 10.222.0.49 () {58 vars in 1193 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/os-hosts/n-d-764486-11/startup => generated 110 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:03.366809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21633e49-1044-4363-8c82-a5cf68d722e9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Calling method '.version_select at 0x7f8398757dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.389343 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-21633e49-1044-4363-8c82-a5cf68d722e9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21633e49-1044-4363-8c82-a5cf68d722e9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:03.391447 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'nonexistent_hostname'} Jul 20 04:15:03.392789 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:03.393651 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 04:15:03.394613 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.395714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.401978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21633e49-1044-4363-8c82-a5cf68d722e9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.403741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21633e49-1044-4363-8c82-a5cf68d722e9 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.041617 Jul 20 04:15:03.406462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 69/178] 10.222.0.49 () {58 vars in 1214 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:03.418156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0360c9b-dcbc-45c4-9b3a-78f52ffc7503 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Action: 'update', calling method: .version_select at 0x7f839861d820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0360c9b-dcbc-45c4-9b3a-78f52ffc7503 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-hosts/n-d-764486-11 HTTP/1.1 Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 51 Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:03.421296 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: {"status": "enable", "maintenance_mode": "invalid"} Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.422762 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'n-d-764486-11', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.424194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.425957 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.427213 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.427213 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:03.427213 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:03.427213 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.427213 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.429085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0360c9b-dcbc-45c4-9b3a-78f52ffc7503 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.430306 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0360c9b-dcbc-45c4-9b3a-78f52ffc7503 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-764486-11" status: 400 len: 199 microversion: 2.1 time: 0.017562 Jul 20 04:15:03.431409 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 70/179] 10.222.0.49 () {60 vars in 1189 bytes} [Wed Jul 20 04:15:03 2022] PUT /compute/v2.1/os-hosts/n-d-764486-11 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:03.448876 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-86844aeb-fe06-4536-b4b1-23a623173c4b tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] HTTP exception thrown: Flavor access not found for 35 / b9dc01952bcb4022ba6f7133f4d450c4 combination. Jul 20 04:15:03.451501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2e00f20-edae-49a9-a8d8-50b375bb1afa tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Action: 'update', calling method: .version_select at 0x7f83986e83a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-86844aeb-fe06-4536-b4b1-23a623173c4b tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Request method failure captured: Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/flavors/882290152/action HTTP/1.1 Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 70 Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E6p8b8g9DGkJMjMqsKJDMEg6YL3GIZcIdszqL3IkO32pPYbJEQcXT3vDzOskmCgl_XXTrqwQnyAMLHBMgvPjGLRsOAz4vREVmMlMbU-q0qcssdH0arVQe4tgxURfa2aOjSjpnGRoZ7gZ2MmIhArjUB7Cizt2HRrxLDTLLRN741JGo Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: b03d67bd4085495f9cbeda981b4b2823 Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:03.451748 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b03d67bd4085495f9cbeda981b4b2823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b03d67bd4085495f9cbeda981b4b2823", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: b03d67bd4085495f9cbeda981b4b2823 Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-782974926 Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 75eb545809d64163b517d85a6bc25d87 Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: {"removeTenantAccess": {"tenant": "b9dc01952bcb4022ba6f7133f4d450c4"}} Jul 20 04:15:03.453197 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: exception: Flavor access not found for 35 / b9dc01952bcb4022ba6f7133f4d450c4 combination. Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '882290152', 'body': {'removeTenantAccess': {'tenant': 'b9dc01952bcb4022ba6f7133f4d450c4'}}} Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 20 04:15:03.454024 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / b9dc01952bcb4022ba6f7133f4d450c4 combination. Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / b9dc01952bcb4022ba6f7133f4d450c4 combination. Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.455286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.456610 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.456610 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.456610 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:03.456610 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:03.456610 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / b9dc01952bcb4022ba6f7133f4d450c4 combination. Jul 20 04:15:03.456610 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2e00f20-edae-49a9-a8d8-50b375bb1afa tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-hosts/n-d-764486-11 HTTP/1.1 Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 51 Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:03.457024 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: {"status": "invalid", "maintenance_mode": "enable"} Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.458510 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'n-d-764486-11', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.460276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.464004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2e00f20-edae-49a9-a8d8-50b375bb1afa tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2e00f20-edae-49a9-a8d8-50b375bb1afa tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-764486-11" status: 400 len: 189 microversion: 2.1 time: 0.011308 Jul 20 04:15:03.465471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 71/180] 10.222.0.49 () {60 vars in 1189 bytes} [Wed Jul 20 04:15:03 2022] PUT /compute/v2.1/os-hosts/n-d-764486-11 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:03.468491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f39b9c0-b83a-4283-b285-5b5acecf2bcb tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Action: 'update', calling method: .version_select at 0x7f839861daf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.469354 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:03.469354 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:03.469866 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-86844aeb-fe06-4536-b4b1-23a623173c4b tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Returning 404 to user: Flavor access not found for 35 / b9dc01952bcb4022ba6f7133f4d450c4 combination. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.470974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f39b9c0-b83a-4283-b285-5b5acecf2bcb tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a46b6b9097f04346b4d63dca390924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc45a0cda1d447c8c5a512b67a0f98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:03.472575 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-86844aeb-fe06-4536-b4b1-23a623173c4b tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/882290152/action" status: 404 len: 124 microversion: 2.1 time: 0.166912 Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f39b9c0-b83a-4283-b285-5b5acecf2bcb tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Request method failure captured: Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-hosts/n-d-764486-11 HTTP/1.1 Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 50 Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FC8-b59NULJtBop89i9QlbHIWUHQ_KRv51HqIzv0RD13cbf8-oORwQMb4BMd6eA7XKCnHjUgYwMnoDShK7p6LqxZAq2cEy8F6MB52OJez2iYIX_ZvPb9RxJWuvwjh_KG_DolAm23vFTcGxCJoyN8zqQQW0lziNfA4s44OE7xv0MFU Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:03.472708 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbc45a0cda1d447c8c5a512b67a0f98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbc45a0cda1d447c8c5a512b67a0f98a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cbc45a0cda1d447c8c5a512b67a0f98a Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1310644657 Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a46b6b9097f04346b4d63dca390924b2 Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1310644657-project Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:15:03.474061 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'n-d-764486-11', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:03.475004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 04:15:03.476527 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.477770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f39b9c0-b83a-4283-b285-5b5acecf2bcb tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.477770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f39b9c0-b83a-4283-b285-5b5acecf2bcb tempest-HostsAdminNegativeTestJSON-1310644657 tempest-HostsAdminNegativeTestJSON-1310644657-project] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-764486-11" status: 403 len: 111 microversion: 2.1 time: 0.009964 Jul 20 04:15:03.479723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 72/181] 10.222.0.49 () {60 vars in 1189 bytes} [Wed Jul 20 04:15:03 2022] PUT /compute/v2.1/os-hosts/n-d-764486-11 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:03.480324 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 110/182] 10.222.0.49 () {60 vars in 1196 bytes} [Wed Jul 20 04:15:03 2022] POST /compute/v2.1/flavors/882290152/action => generated 124 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:03.493585 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9645d71d-4b04-4ed9-98c4-fa04f92edfd4 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.496256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46599877-fdbd-4e33-ab7f-9d0a10c91f04 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Action: 'update', calling method: .version_select at 0x7f8398637f70>, body: {"status": null, "maintenance_mode": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46599877-fdbd-4e33-ab7f-9d0a10c91f04 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-hosts/n-d-764486-11 HTTP/1.1 Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 42 Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:03.498718 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: {"status": null, "maintenance_mode": null} Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:15:03.499919 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'n-d-764486-11', 'body': {'status': None, 'maintenance_mode': None}} Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi None Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.501163 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.502701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.503961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:03.503961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:03.503961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 04:15:03.503961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.503961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46599877-fdbd-4e33-ab7f-9d0a10c91f04 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.503961 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46599877-fdbd-4e33-ab7f-9d0a10c91f04 tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-764486-11" status: 400 len: 127 microversion: 2.1 time: 0.020176 Jul 20 04:15:03.510193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 73/183] 10.222.0.49 () {60 vars in 1189 bytes} [Wed Jul 20 04:15:03 2022] PUT /compute/v2.1/os-hosts/n-d-764486-11 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:03.525961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93ac7cbb-1c68-47fb-8d7f-903facc6d6ef tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Action: 'update', calling method: .version_select at 0x7f8398757a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:03.528418 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.hosts [None req-93ac7cbb-1c68-47fb-8d7f-903facc6d6ef tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Enabling host nonexistent_hostname. Jul 20 04:15:03.554262 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9645d71d-4b04-4ed9-98c4-fa04f92edfd4 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/882290152" status: 202 len: 0 microversion: 2.1 time: 0.054541 Jul 20 04:15:03.554262 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 111/184] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:15:03 2022] DELETE /compute/v2.1/flavors/882290152 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-93ac7cbb-1c68-47fb-8d7f-903facc6d6ef tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93ac7cbb-1c68-47fb-8d7f-903facc6d6ef tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Request method failure captured: Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 50 Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FEPFJUzAVLx93gI65Ixcbv6kMJoTakiHu7HwllVdmNmXxkOh0JOvT2IRKRKIfyIKBY6CIgozzyEGJyI5GSYdwlV6b7oRmemEe3-7SkxNp_RgRviIqReYe-cbBYaWvh_Flj38g-cRKuExM9BG_3x6a4l4ry39wzTjb1YmtpvFv0Mco Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:03.554479 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc27026081f4c2997cb501267f37f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc27026081f4c2997cb501267f37f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc27026081f4c2997cb501267f37f48", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: abc27026081f4c2997cb501267f37f48 Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1028127703 Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7895c20ac90a40b0b9e479eae0513188 Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1028127703-project-admin Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.559948 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:15:03.561030 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:03.562620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:03.564804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93ac7cbb-1c68-47fb-8d7f-903facc6d6ef tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:03.565829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93ac7cbb-1c68-47fb-8d7f-903facc6d6ef tempest-HostsAdminNegativeTestJSON-1028127703 tempest-HostsAdminNegativeTestJSON-1028127703-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030313 Jul 20 04:15:03.565829 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 74/185] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:15:03 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:03.574449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-52c9c720-a97e-4bf2-ab1a-032252e30e94 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:03.669924 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-52c9c720-a97e-4bf2-ab1a-032252e30e94 tempest-FlavorsAccessNegativeTestJSON-782974926 tempest-FlavorsAccessNegativeTestJSON-782974926-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.107379 Jul 20 04:15:03.699634 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 112/186] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:03 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:04.281741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:04.284886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:04.322384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.323173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.324765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:04.326790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:04.381415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=79 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:04.835137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:04.845872 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf288eef-7f72-418c-8f24-c5de8f75bb6a tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.578205 Jul 20 04:15:04.860755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 75/187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:04 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:05.871591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:05.875196 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:05.883706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.884156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.884958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:05.885450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:05.891705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=75 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:06.511071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:06.530093 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b775b73f-6c5b-418e-9312-a206e8824fb3 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.665957 Jul 20 04:15:06.542104 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 113/188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:05 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:06.584381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-148567729", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "1197451265", "adminPass": "***", "networks": [{"uuid": "02851ba5-6671-4a40-a0b6-12252ce9120c"}], "security_groups": [{"name": "tempest-securitygroup--1419117801"}], "key_name": "tempest-keypair-1830281682", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:06.821932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] validate_networks() for [('02851ba5-6671-4a40-a0b6-12252ce9120c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:07.550023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:07.551409 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:07.558965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.559679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.560957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:07.561546 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:07.998955 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:08.008244 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-be230eb3-4b8d-4fe0-b999-0a93001b68d5 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.463656 Jul 20 04:15:08.010643 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 114/189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:07 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:08.585255 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cd18d077-c0da-4096-8318-3d06c4f67282 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1960613043", "ram": 512, "vcpus": 1, "disk": 10, "id": 468830132, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:08.587184 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:08.587184 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:08.641182 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cd18d077-c0da-4096-8318-3d06c4f67282 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.557242 Jul 20 04:15:08.651059 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 115/190] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:08 2022] POST /compute/v2.1/flavors => generated 413 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:09.075034 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d38d9686-ff70-4927-a40c-a0584bc620f7 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.103242 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-d38d9686-ff70-4927-a40c-a0584bc620f7 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] HTTP exception thrown: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d38d9686-ff70-4927-a40c-a0584bc620f7 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Request method failure captured: Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/flavors/468830132/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FJVdItoDII_rGja1o2IxkBl4RxRafCU6NxDJaMZPCI9adohhocUk9UUuDi-lcR9WpclKbjL8QjXn2iMWIB6hVGl-ySRqxDThkTc8DpabnxNOZ6Q_VtWyYJHZhK1XeyjZgjOCXkbP94Fp_rylBZvcusg2k0J0_mXNMsnZR1n5-B-QU Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:09.115878 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04f11215df064c8096ac258d9ec97e6c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bc00beadb0be46e5b6de218bfaef4983 Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.117431 n-d-764486-11 devstack@n-api.service[123723]: exception: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'id': 'hw:cpu_thread_policy'} Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.118182 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d38d9686-ff70-4927-a40c-a0584bc620f7 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Returning 404 to user: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d38d9686-ff70-4927-a40c-a0584bc620f7 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] 10.222.0.49 "GET /compute/v2.1/flavors/468830132/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.464574 Jul 20 04:15:09.119571 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 116/191] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:15:08 2022] GET /compute/v2.1/flavors/468830132/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:09.125401 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.126487 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.143475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.143931 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.145000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.145439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.305907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:09.308146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:09.308983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:09.309613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:09.310390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:09.315785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:09.338258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.338730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.339832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:09.340281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:09.385888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Getting quotas for project 4fbc880ec5e14aafa307eb780a1cd051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:09.386187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.399872 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-72535766-88ad-4fad-ba7d-9982726e9397 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.280759 Jul 20 04:15:09.400752 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 117/192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.401291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Getting quotas for user 5c2ac596c69843009cfd28dd0e90d56e and project 4fbc880ec5e14aafa307eb780a1cd051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:09.416258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75e91fe8-b8e5-4564-be30-0a68431b0b0e tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.417222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:09.419840 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.419840 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:09.421042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-75e91fe8-b8e5-4564-be30-0a68431b0b0e tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'bc00beadb0be46e5b6de218bfaef4983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f11215df064c8096ac258d9ec97e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.421907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75e91fe8-b8e5-4564-be30-0a68431b0b0e tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Request method failure captured: Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/flavors/468830132/os-extra_specs HTTP/1.1 Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 66 Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FJVdItoDII_rGja1o2IxkBl4RxRafCU6NxDJaMZPCI9adohhocUk9UUuDi-lcR9WpclKbjL8QjXn2iMWIB6hVGl-ySRqxDThkTc8DpabnxNOZ6Q_VtWyYJHZhK1XeyjZgjOCXkbP94Fp_rylBZvcusg2k0J0_mXNMsnZR1n5-B-QU Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:09.423090 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04f11215df064c8096ac258d9ec97e6c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bc00beadb0be46e5b6de218bfaef4983 Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 20 04:15:09.424328 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:09.425072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 04:15:09.426467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.429046 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75e91fe8-b8e5-4564-be30-0a68431b0b0e tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.430422 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-75e91fe8-b8e5-4564-be30-0a68431b0b0e tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] 10.222.0.49 "POST /compute/v2.1/flavors/468830132/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.027825 Jul 20 04:15:09.431523 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 118/193] 10.222.0.49 () {60 vars in 1220 bytes} [Wed Jul 20 04:15:09 2022] POST /compute/v2.1/flavors/468830132/os-extra_specs => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:09.445885 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6b717175-c78f-4d36-b1b7-e3d5235c12e0 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.472948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=14 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:09.528395 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6b717175-c78f-4d36-b1b7-e3d5235c12e0 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/468830132/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091371 Jul 20 04:15:09.529852 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 119/194] 10.222.0.49 () {60 vars in 1220 bytes} [Wed Jul 20 04:15:09 2022] POST /compute/v2.1/flavors/468830132/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:09.538770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fbbb872e-568d-4bb6-8550-ea8dd0a8ab1a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.959811 Jul 20 04:15:09.540704 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 76/195] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:09.549194 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-37c68ab7-5922-4801-8788-7d8e0efd5d75 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.551765 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.551765 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:09.553047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-37c68ab7-5922-4801-8788-7d8e0efd5d75 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'bc00beadb0be46e5b6de218bfaef4983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f11215df064c8096ac258d9ec97e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-37c68ab7-5922-4801-8788-7d8e0efd5d75 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Request method failure captured: Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FJVdItoDII_rGja1o2IxkBl4RxRafCU6NxDJaMZPCI9adohhocUk9UUuDi-lcR9WpclKbjL8QjXn2iMWIB6hVGl-ySRqxDThkTc8DpabnxNOZ6Q_VtWyYJHZhK1XeyjZgjOCXkbP94Fp_rylBZvcusg2k0J0_mXNMsnZR1n5-B-QU Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:09.555383 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04f11215df064c8096ac258d9ec97e6c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bc00beadb0be46e5b6de218bfaef4983 Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.556613 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'id': 'hw:numa_nodes'} Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:09.557238 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 04:15:09.559262 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.562184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-37c68ab7-5922-4801-8788-7d8e0efd5d75 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.568941 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-37c68ab7-5922-4801-8788-7d8e0efd5d75 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] 10.222.0.49 "DELETE /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.025858 Jul 20 04:15:09.569174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6153b096-3701-4e76-9625-ff1113d6b96a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.569832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6153b096-3701-4e76-9625-ff1113d6b96a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:09.571751 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 120/196] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:15:09 2022] DELETE /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:09.583069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5a2e47e2-6b78-4ed1-95f3-cebede9ace85 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.617415 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5a2e47e2-6b78-4ed1-95f3-cebede9ace85 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/468830132/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040476 Jul 20 04:15:09.622819 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 121/197] 10.222.0.49 () {60 vars in 1220 bytes} [Wed Jul 20 04:15:09 2022] POST /compute/v2.1/flavors/468830132/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:09.635800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20495f0f-083e-4eb4-a94d-b34baaf734b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.637948 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.637948 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:09.639230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-20495f0f-083e-4eb4-a94d-b34baaf734b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'bc00beadb0be46e5b6de218bfaef4983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f11215df064c8096ac258d9ec97e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20495f0f-083e-4eb4-a94d-b34baaf734b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Request method failure captured: Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: request: PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 22 Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FJVdItoDII_rGja1o2IxkBl4RxRafCU6NxDJaMZPCI9adohhocUk9UUuDi-lcR9WpclKbjL8QjXn2iMWIB6hVGl-ySRqxDThkTc8DpabnxNOZ6Q_VtWyYJHZhK1XeyjZgjOCXkbP94Fp_rylBZvcusg2k0J0_mXNMsnZR1n5-B-QU Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:09.643059 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04f11215df064c8096ac258d9ec97e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04f11215df064c8096ac258d9ec97e6c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 04f11215df064c8096ac258d9ec97e6c Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bc00beadb0be46e5b6de218bfaef4983 Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: {"hw:numa_nodes": "1"} Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.644267 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:09.645015 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 04:15:09.646226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.649616 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20495f0f-083e-4eb4-a94d-b34baaf734b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.650503 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-20495f0f-083e-4eb4-a94d-b34baaf734b1 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411 tempest-FlavorsExtraSpecsNegativeTestJSON-2097531411-project] 10.222.0.49 "PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026507 Jul 20 04:15:09.655709 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 122/198] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:15:09 2022] PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:09.664542 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-96e8b069-b412-4bbf-aabe-7b06b1c9669d tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.677865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6153b096-3701-4e76-9625-ff1113d6b96a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:09.682356 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-96e8b069-b412-4bbf-aabe-7b06b1c9669d tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] HTTP exception thrown: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-96e8b069-b412-4bbf-aabe-7b06b1c9669d tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Request method failure captured: Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/flavors/468830132/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FLtCemdN7DmmpqQ0wcBK5Oz2JtQPtijn0Y0NDCkM-qTPb5LsIl-pO1cEFsj_9zD8Vzjxl6kUqt1MOFa_JI3LdMWKB2g1X1C74Bnc2se9GkAeRH-EICDIgTmG3aU1646rzKoaxPX6hvTY__DHHbRFiNX-8oJKIwlEmTDDF8TIgRmeE Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 89a61260e7864b97a765dcbf2ab2c649 Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:09.683810 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89a61260e7864b97a765dcbf2ab2c649", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 89a61260e7864b97a765dcbf2ab2c649 Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: ad8d20c679a743af87908ceb3d84e791 Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.685068 n-d-764486-11 devstack@n-api.service[123723]: exception: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'id': 'hw:cpu_thread_policy'} Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.685672 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-96e8b069-b412-4bbf-aabe-7b06b1c9669d tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Returning 404 to user: Flavor 468830132 has no extra specs with key hw:cpu_thread_policy. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.686825 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-96e8b069-b412-4bbf-aabe-7b06b1c9669d tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/468830132/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.027364 Jul 20 04:15:09.689825 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 123/199] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:15:09 2022] DELETE /compute/v2.1/flavors/468830132/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:15:09.704568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca5e3c00-4826-4b32-9c0a-0a3a7f2092a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.709112 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-ca5e3c00-4826-4b32-9c0a-0a3a7f2092a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca5e3c00-4826-4b32-9c0a-0a3a7f2092a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Request method failure captured: Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: request: PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 27 Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FLtCemdN7DmmpqQ0wcBK5Oz2JtQPtijn0Y0NDCkM-qTPb5LsIl-pO1cEFsj_9zD8Vzjxl6kUqt1MOFa_JI3LdMWKB2g1X1C74Bnc2se9GkAeRH-EICDIgTmG3aU1646rzKoaxPX6hvTY__DHHbRFiNX-8oJKIwlEmTDDF8TIgRmeE Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 89a61260e7864b97a765dcbf2ab2c649 Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:09.716532 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89a61260e7864b97a765dcbf2ab2c649", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 89a61260e7864b97a765dcbf2ab2c649 Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: ad8d20c679a743af87908ceb3d84e791 Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: {"hw:cpu_policy": "shared"} Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.717934 n-d-764486-11 devstack@n-api.service[123723]: exception: Request body and URI mismatch Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.718872 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.720290 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:09.720290 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:09.720290 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 20 04:15:09.720290 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.721897 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6153b096-3701-4e76-9625-ff1113d6b96a tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1264 microversion: 2.1 time: 0.169981 Jul 20 04:15:09.723710 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca5e3c00-4826-4b32-9c0a-0a3a7f2092a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.725463 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ca5e3c00-4826-4b32-9c0a-0a3a7f2092a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.027686 Jul 20 04:15:09.727539 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 124/200] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:15:09 2022] PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:15:09.745681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 77/201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:09.752380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2ce3e64-2363-47f4-a419-c3f85b72a4ea tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2ce3e64-2363-47f4-a419-c3f85b72a4ea tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Request method failure captured: Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: request: PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 49 Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FLtCemdN7DmmpqQ0wcBK5Oz2JtQPtijn0Y0NDCkM-qTPb5LsIl-pO1cEFsj_9zD8Vzjxl6kUqt1MOFa_JI3LdMWKB2g1X1C74Bnc2se9GkAeRH-EICDIgTmG3aU1646rzKoaxPX6hvTY__DHHbRFiNX-8oJKIwlEmTDDF8TIgRmeE Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 89a61260e7864b97a765dcbf2ab2c649 Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:09.765735 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/89a61260e7864b97a765dcbf2ab2c649"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_89a61260e7864b97a765dcbf2ab2c649", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 89a61260e7864b97a765dcbf2ab2c649 Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: ad8d20c679a743af87908ceb3d84e791 Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 20 04:15:09.767679 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'flavor_id': '468830132', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi On instance: Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 20 04:15:09.768496 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.769931 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:09.771336 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:09.771336 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:09.771336 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:15:09.771336 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:15:09.771336 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 04:15:09.771336 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:09.780248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2ce3e64-2363-47f4-a419-c3f85b72a4ea tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:09.781283 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b2ce3e64-2363-47f4-a419-c3f85b72a4ea tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.040220 Jul 20 04:15:09.782899 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 125/202] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:15:09 2022] PUT /compute/v2.1/flavors/468830132/os-extra_specs/hw:numa_nodes => generated 117 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:15:09.796302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c3c6ca6-586d-4584-ad16-1be295c9de1a tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.796723 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:09.796723 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:09.857832 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c3c6ca6-586d-4584-ad16-1be295c9de1a tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/468830132" status: 202 len: 0 microversion: 2.1 time: 0.068385 Jul 20 04:15:09.867505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2ba245d8-5f27-4402-82c7-f548fca8b887 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:09.881365 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 78/203] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:15:09 2022] DELETE /compute/v2.1/flavors/468830132 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:09.956898 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2ba245d8-5f27-4402-82c7-f548fca8b887 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263 tempest-FlavorsExtraSpecsNegativeTestJSON-1755221263-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.088459 Jul 20 04:15:09.979607 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 126/204] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:09 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.422503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.425087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.448105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.448909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.455224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:10.456996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:10.721597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.731664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0259e390-e893-4a22-98a4-96263637d7a9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.318953 Jul 20 04:15:10.732670 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 79/205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:10.755874 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-99e81e97-7675-439d-8c75-1989fb83fc15 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:10.756534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-99e81e97-7675-439d-8c75-1989fb83fc15 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:10.843941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-99e81e97-7675-439d-8c75-1989fb83fc15 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:10.859304 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-99e81e97-7675-439d-8c75-1989fb83fc15 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1264 microversion: 2.1 time: 0.109395 Jul 20 04:15:10.861406 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 127/206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:10 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1264 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:11.373554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-818830628", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "7e6d563b-6d30-4058-9507-057aaaf62886"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.467162 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-02b96a12-7528-4359-a379-1f98e976474b req-5c427eab-76f7-4047-ae59-aa5391bf2e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56cf52ee-9464-4a97-935f-f36eeb252609", "name": "network-vif-plugged", "status": "completed", "tag": "ea5a88ef-7096-457a-9bba-a18b2ee02539"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:11.497351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] validate_networks() for [('7e6d563b-6d30-4058-9507-057aaaf62886', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:11.507620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-02b96a12-7528-4359-a379-1f98e976474b req-5c427eab-76f7-4047-ae59-aa5391bf2e23 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.510050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-02b96a12-7528-4359-a379-1f98e976474b req-5c427eab-76f7-4047-ae59-aa5391bf2e23 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.559740 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-02b96a12-7528-4359-a379-1f98e976474b req-5c427eab-76f7-4047-ae59-aa5391bf2e23 service nova] Creating event network-vif-plugged:ea5a88ef-7096-457a-9bba-a18b2ee02539 for instance 56cf52ee-9464-4a97-935f-f36eeb252609 on n-h2-764486-11 Jul 20 04:15:11.567826 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-02b96a12-7528-4359-a379-1f98e976474b req-5c427eab-76f7-4047-ae59-aa5391bf2e23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:15:11.569964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.571080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.573935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.577693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.607192 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.compute.rpcapi [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 04:15:11.609818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] Releasing lock "compute-rpcapi-router" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:15:11.639661 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-75c0b6ee-9135-4857-aaf7-2dabaabfbdbe None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.554128 Jul 20 04:15:11.642638 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 128/207] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:11.757208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:11.759197 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:11.778430 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.778895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:11.779664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:11.786332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.254574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:12.255890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:12.256565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:12.257159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:12.257925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:12.272794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.273525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.274555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.275231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.299545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:12.304516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for user ab72bd0852ad4f72a0c96a7ddf1bdd63 and project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:12.319096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:12.321737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:12.383454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fab340de-1305-423f-b9a4-0bd092b35345 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368494 Jul 20 04:15:12.389759 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 80/208] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:12.396298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:12.397182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.404742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.405556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.406906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:12.407868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:12.530404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.541391 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4584861-fca8-4ced-b5ee-5824bca04317 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1322 microversion: 2.1 time: 0.149995 Jul 20 04:15:12.547245 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 81/209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:12.718512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.733105 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d220e390-4aaf-4f3b-a61b-10f3c727d315 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.985768 Jul 20 04:15:12.734340 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 129/210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:11 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:12.750114 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dc950443-c032-402a-854f-d06a09e52968 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:12.751607 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dc950443-c032-402a-854f-d06a09e52968 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:12.905227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dc950443-c032-402a-854f-d06a09e52968 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:12.919545 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dc950443-c032-402a-854f-d06a09e52968 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1210 microversion: 2.1 time: 0.180840 Jul 20 04:15:12.920522 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 130/211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1210 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:13.185910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Calling method '.version_select at 0x7f839861daf0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.189886 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:13.189886 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:13.192126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.197677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.247037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.247961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.289336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.289844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.306661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f80a0141-8d7d-4ea8-985b-f2fa9eaaae09 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.756368 Jul 20 04:15:13.310145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 82/212] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:13.568059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.569553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.586542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.589775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.591693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.605525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.780497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.789225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88abd5ea-09ef-40cb-a570-a4a3ebb6f5e3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1322 microversion: 2.1 time: 0.226040 Jul 20 04:15:13.791878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 83/213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:13.797015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.798491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.807715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.808783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.811780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.814012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:13.926357 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a570ac14-e8e8-4ccd-a2ae-80e0bdb29dbf tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Calling method '.version_select at 0x7f83988111f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.927859 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:13.927859 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:13.929216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a570ac14-e8e8-4ccd-a2ae-80e0bdb29dbf tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'aebbbcbe514740fa9168c59af318432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17e91fa5a764b90aa9b9b50bacf6a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a570ac14-e8e8-4ccd-a2ae-80e0bdb29dbf tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Request method failure captured: Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors/n-h2-764486-11/search HTTP/1.1 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FNT-SgWTOaLBPNzUxtJQXd0pd-rDWLeGB0_L-8i2vNiadZ0GzEcLPbwAfI6J210T6YsnqunjJMCQ9xzs5-NsNklJbpTURdTPe9ZdRNfQD4cQJJzyy2VMYrAc8aPUg4kj-pXEzlv9CbUoLQyqOmwOu-UDJkl0CU5R1yV8RAtjUTZQ8 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: b17e91fa5a764b90aa9b9b50bacf6a47 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-961476832 Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:13.933268 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b17e91fa5a764b90aa9b9b50bacf6a47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b17e91fa5a764b90aa9b9b50bacf6a47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b17e91fa5a764b90aa9b9b50bacf6a47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b17e91fa5a764b90aa9b9b50bacf6a47", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-961476832 Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: b17e91fa5a764b90aa9b9b50bacf6a47 Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-961476832 Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-961476832-project Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: aebbbcbe514740fa9168c59af318432e Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-961476832-project Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:15:13.934792 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'n-h2-764486-11'} Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:13.935777 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 04:15:13.937363 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:13.940172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a570ac14-e8e8-4ccd-a2ae-80e0bdb29dbf tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:13.942384 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a570ac14-e8e8-4ccd-a2ae-80e0bdb29dbf tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h2-764486-11/search" status: 403 len: 117 microversion: 2.1 time: 0.626124 Jul 20 04:15:13.949322 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 131/214] 10.222.0.49 () {58 vars in 1211 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/os-hypervisors/n-h2-764486-11/search => generated 117 bytes in 629 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:13.955842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:13.956993 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:13.995304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:13.998831 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.003943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.005244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.181926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.213493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.227222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95a77c85-4cf2-416e-b30b-5e2a35e16803 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1338 microversion: 2.1 time: 0.423734 Jul 20 04:15:14.227934 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 84/215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1338 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.239998 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-199a8fd7-9ded-4da0-ab88-68717c10a075 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1228 microversion: 2.1 time: 0.293040 Jul 20 04:15:14.242612 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 132/216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:13 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1228 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:14.263684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Calling method '.version_select at 0x7f839861d1f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.264666 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:14.264666 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:14.265914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.266404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.307575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Request method failure captured: Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FP15Fr0pkLUFBg3kp2CFBjO3hzkj0mPS5T76Ce0AC5R9bcCzRAHVd4pvEeR_7D5qXfzFR-EM9UVBo7PYlxsKVdLbVa9cE0jxpARbuN0c_KYMl5ZXCp89hyGwCLuSzILIC0fna-N0ZoVbcD9cj-Zg3VtKLxvzUzSbrJZlSGAjwxwGs Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 655a95c7a753424cad9d77718d174b02 Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-888692684 Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:14.310150 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/655a95c7a753424cad9d77718d174b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/655a95c7a753424cad9d77718d174b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/655a95c7a753424cad9d77718d174b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_655a95c7a753424cad9d77718d174b02", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-888692684 Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 655a95c7a753424cad9d77718d174b02 Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-888692684 Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9669ba5fcfe44f47b7b5d77e122a0a05 Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:15:14.311489 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:14.312194 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:14.313394 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:14.313394 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:14.313394 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:14.313394 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 04:15:14.313394 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.315547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:14.319585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ca2d03f-f7f9-449d-9d6e-9df769d4593c tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.083229 Jul 20 04:15:14.320737 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 85/217] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:14.329398 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Calling method '.version_select at 0x7f8398811b80>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.330507 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:14.330507 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:14.331689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.332249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.348231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.348798 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.361780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.362246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.372327 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5f25ff43-5d2a-4517-ae92-1a188af6866d tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.046608 Jul 20 04:15:14.372955 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 133/218] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:14.384967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-967070fa-c1ae-403f-82c8-28fd16bb7989 tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Calling method '.version_select at 0x7f8398637160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.387165 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:14.387165 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:14.389488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-967070fa-c1ae-403f-82c8-28fd16bb7989 tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'aebbbcbe514740fa9168c59af318432e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17e91fa5a764b90aa9b9b50bacf6a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-967070fa-c1ae-403f-82c8-28fd16bb7989 tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Request method failure captured: Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FNT-SgWTOaLBPNzUxtJQXd0pd-rDWLeGB0_L-8i2vNiadZ0GzEcLPbwAfI6J210T6YsnqunjJMCQ9xzs5-NsNklJbpTURdTPe9ZdRNfQD4cQJJzyy2VMYrAc8aPUg4kj-pXEzlv9CbUoLQyqOmwOu-UDJkl0CU5R1yV8RAtjUTZQ8 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b17e91fa5a764b90aa9b9b50bacf6a47 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-961476832 Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:14.391902 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b17e91fa5a764b90aa9b9b50bacf6a47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b17e91fa5a764b90aa9b9b50bacf6a47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b17e91fa5a764b90aa9b9b50bacf6a47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b17e91fa5a764b90aa9b9b50bacf6a47", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-961476832 Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b17e91fa5a764b90aa9b9b50bacf6a47 Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-961476832 Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-961476832-project Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: aebbbcbe514740fa9168c59af318432e Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-961476832-project Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1'} Jul 20 04:15:14.393170 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:14.394077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 04:15:14.395197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.397984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-967070fa-c1ae-403f-82c8-28fd16bb7989 tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:14.399951 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-967070fa-c1ae-403f-82c8-28fd16bb7989 tempest-HypervisorAdminNegativeUnderV252Test-961476832 tempest-HypervisorAdminNegativeUnderV252Test-961476832-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019805 Jul 20 04:15:14.401266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 86/219] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:14.419884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Calling method '.version_select at 0x7f8398811280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.422504 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:14.422504 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:14.425898 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.428902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.446347 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] HTTP exception thrown: No hypervisor matching 'b2960c99-70e2-4e95-aac9-047782c41d20' could be found. Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Request method failure captured: Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-hypervisors/b2960c99-70e2-4e95-aac9-047782c41d20/servers HTTP/1.1 Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FP15Fr0pkLUFBg3kp2CFBjO3hzkj0mPS5T76Ce0AC5R9bcCzRAHVd4pvEeR_7D5qXfzFR-EM9UVBo7PYlxsKVdLbVa9cE0jxpARbuN0c_KYMl5ZXCp89hyGwCLuSzILIC0fna-N0ZoVbcD9cj-Zg3VtKLxvzUzSbrJZlSGAjwxwGs Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 655a95c7a753424cad9d77718d174b02 Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-888692684 Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:14.449182 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/655a95c7a753424cad9d77718d174b02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/655a95c7a753424cad9d77718d174b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/655a95c7a753424cad9d77718d174b02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_655a95c7a753424cad9d77718d174b02", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-888692684 Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 655a95c7a753424cad9d77718d174b02 Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-888692684 Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 9669ba5fcfe44f47b7b5d77e122a0a05 Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: exception: No hypervisor matching 'b2960c99-70e2-4e95-aac9-047782c41d20' could be found. Jul 20 04:15:14.450485 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'b2960c99-70e2-4e95-aac9-047782c41d20'} Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'b2960c99-70e2-4e95-aac9-047782c41d20' could be found. Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.451300 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'b2960c99-70e2-4e95-aac9-047782c41d20' could be found. Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:14.452304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] Returning 404 to user: No hypervisor matching 'b2960c99-70e2-4e95-aac9-047782c41d20' could be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:14.453204 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e3a0da45-d89f-42de-ae8b-33902c189c55 tempest-HypervisorAdminNegativeUnderV252Test-888692684 tempest-HypervisorAdminNegativeUnderV252Test-888692684-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/b2960c99-70e2-4e95-aac9-047782c41d20/servers" status: 404 len: 123 microversion: 2.1 time: 0.045515 Jul 20 04:15:14.459108 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 134/220] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/os-hypervisors/b2960c99-70e2-4e95-aac9-047782c41d20/servers => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:14.810052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:14.811438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:14.829745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.830517 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.832647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:14.834895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:14.974419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:14.998843 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6f66eafa-b9a8-4e2b-8176-da3602d3f9fc tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1322 microversion: 2.1 time: 0.193990 Jul 20 04:15:14.999940 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 135/221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:14 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:15.032626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2108765027", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:15.133300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:15.246508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.247125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.264206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.265799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.267055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.267498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.482064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:15.482825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:15.486472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:15.487352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:15.488046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:15.509142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.510138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.518216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.518719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.548294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:15.553510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for user 3e8f4a044b904befbddb93375b6e213a and project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:15.572574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:15.576494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:15.727696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d4dd7fa-d1b1-43aa-99b2-8545ec91664a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129739 Jul 20 04:15:15.740475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 87/222] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:15.759809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.760737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.779391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.781588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.783239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:15.784907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:15.916142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:15.928588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5525a1d6-9967-497f-8892-edce902d2feb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1290 microversion: 2.1 time: 0.186857 Jul 20 04:15:15.932525 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 88/223] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1290 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:15.945722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61862870-9065-435f-8cbe-dd2122dfa810 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:15.952182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61862870-9065-435f-8cbe-dd2122dfa810 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:15.995511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.011190 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fda8bc77-8842-49ee-8e51-d3e357e153b9 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1487 microversion: 2.1 time: 0.769983 Jul 20 04:15:16.012093 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 136/224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1487 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:16.035852 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.036582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.068944 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.069401 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.073870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.076053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.257271 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.272282 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f9e7b393-21ad-40eb-8df7-2fdd1f54040b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1322 microversion: 2.1 time: 0.239948 Jul 20 04:15:16.275417 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 137/225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.285206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.285833 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:16.348689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.349138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.357324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.359673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.524343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61862870-9065-435f-8cbe-dd2122dfa810 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:16.534322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61862870-9065-435f-8cbe-dd2122dfa810 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1213 microversion: 2.1 time: 0.599597 Jul 20 04:15:16.538756 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 89/226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:15 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1213 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:16.988053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a97d24d-7836-453b-9a5d-b888f9a93247 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83985b58b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:16.989751 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:16.989751 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:16.991225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a97d24d-7836-453b-9a5d-b888f9a93247 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.991904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a97d24d-7836-453b-9a5d-b888f9a93247 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:16.994134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a97d24d-7836-453b-9a5d-b888f9a93247 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:16.996019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a97d24d-7836-453b-9a5d-b888f9a93247 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.035811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a97d24d-7836-453b-9a5d-b888f9a93247 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.436157 Jul 20 04:15:17.042751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 90/227] 10.222.0.49 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:17.048721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.049533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.058641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.059414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.060457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.061080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.224086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.231716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0095468c-642f-4a0c-befd-93c352e22070 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1332 microversion: 2.1 time: 0.187397 Jul 20 04:15:17.232629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 91/228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.237645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa872c13-c5f1-4590-bdc5-8c02b8a5acb0 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83985b5b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.239075 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:17.239075 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:17.240193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa872c13-c5f1-4590-bdc5-8c02b8a5acb0 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.240665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa872c13-c5f1-4590-bdc5-8c02b8a5acb0 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.241461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa872c13-c5f1-4590-bdc5-8c02b8a5acb0 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.241885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa872c13-c5f1-4590-bdc5-8c02b8a5acb0 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.267063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa872c13-c5f1-4590-bdc5-8c02b8a5acb0 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.033239 Jul 20 04:15:17.268448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 92/229] 10.222.0.49 () {58 vars in 1138 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:17.280747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f3074f2-e80c-49ec-ba2f-7ea204c87f1d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83986e8af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.282326 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:17.282326 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:17.284111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f3074f2-e80c-49ec-ba2f-7ea204c87f1d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.284649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f3074f2-e80c-49ec-ba2f-7ea204c87f1d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.285549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f3074f2-e80c-49ec-ba2f-7ea204c87f1d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.286053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f3074f2-e80c-49ec-ba2f-7ea204c87f1d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.309960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f3074f2-e80c-49ec-ba2f-7ea204c87f1d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.034324 Jul 20 04:15:17.310482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 93/230] 10.222.0.49 () {58 vars in 1144 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:15:17.317707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.318335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.326398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.326894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.327717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.328316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.402453 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ad1d661c-0431-4208-965b-11f263f4d2ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1640 microversion: 2.1 time: 1.125828 Jul 20 04:15:17.404511 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 138/231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:16 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1640 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.408719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.416880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b00a7af5-5974-45bc-baf7-0af72b8dbc64 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1322 microversion: 2.1 time: 0.105185 Jul 20 04:15:17.418247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 94/232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.426096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.426719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.435682 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.436154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.437111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.437920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.477873 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:15:17.557028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.558097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.570911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.572270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.574360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.575414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.710741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:17.721136 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad6834fc-07e8-4579-b2f9-e113bbb7604f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1217 microversion: 2.1 time: 0.169587 Jul 20 04:15:17.721930 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 95/233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:17.859021 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-49e69c0b-e599-4a2d-a737-bc6dcd81d364 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "DELETE /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 204 len: 0 microversion: 2.1 time: 0.442024 Jul 20 04:15:17.860961 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 139/234] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:17 2022] DELETE /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:17.869754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:17.870417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:17.877635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.878142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:17.879499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:17.879996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.103970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.114076 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-471f8c03-98b7-4358-aef9-30ef0e647a76 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1493 microversion: 2.1 time: 0.248970 Jul 20 04:15:18.114672 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 96/235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:17 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1493 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:18.252446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.253685 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.281578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.286726 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.292824 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.294574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.441268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.442286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.462859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.464603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.465842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.469941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.681525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.687771 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.691500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87a9de66-6e6e-4f72-ae98-1a8c6751e28e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1322 microversion: 2.1 time: 0.261316 Jul 20 04:15:18.692098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 97/236] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:18.702064 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-772fab92-256c-4744-bfaf-b088dec57d6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1332 microversion: 2.1 time: 0.455910 Jul 20 04:15:18.704606 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 140/237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1332 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:18.711258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1b7eefc9-d3d8-48ee-a9e3-f8661ef6fd0c req-c0b04e83-6f03-4643-8074-d56892ba8fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a97a688-e2f9-48fe-8a35-cac05b5a9dfd", "tag": "8778c0bb-598f-42c2-9839-926c9d7f74e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:18.737914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1b7eefc9-d3d8-48ee-a9e3-f8661ef6fd0c req-c0b04e83-6f03-4643-8074-d56892ba8fe8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.738354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1b7eefc9-d3d8-48ee-a9e3-f8661ef6fd0c req-c0b04e83-6f03-4643-8074-d56892ba8fe8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.742095 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:18.742715 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:18.755643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.758085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.758705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1b7eefc9-d3d8-48ee-a9e3-f8661ef6fd0c req-c0b04e83-6f03-4643-8074-d56892ba8fe8 service nova] Creating event network-changed:8778c0bb-598f-42c2-9839-926c9d7f74e1 for instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd on n-h2-764486-11 Jul 20 04:15:18.760684 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:18.763928 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:18.770361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1b7eefc9-d3d8-48ee-a9e3-f8661ef6fd0c req-c0b04e83-6f03-4643-8074-d56892ba8fe8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058636 Jul 20 04:15:18.771311 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 98/238] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:18.958985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:18.968601 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fa056c03-adb0-44a7-be65-09a92c92c06a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1271 microversion: 2.1 time: 0.229447 Jul 20 04:15:18.976387 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 141/239] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:18 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:19.132823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:19.133770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:19.142467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.143275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.144402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.145050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.710327 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:19.725806 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:19.757033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.757474 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:19.758258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:19.758693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.045515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.058856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d58ca8d3-d492-4155-8e52-f2ce7bc3d0bd tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1493 microversion: 2.1 time: 0.929555 Jul 20 04:15:20.069367 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 99/240] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:19 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1493 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:20.087689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.088696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.092778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:20.117665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.118686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.119852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.120834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.495306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.507668 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2cc696e6-fbb0-48cf-bbfe-c0aa1436a4a1 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.802399 Jul 20 04:15:20.508940 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 142/241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:19 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:20.523523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:20.526104 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:20.532790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.541880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.544767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29e8023b-bbdf-4864-81e9-031838b550ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1332 microversion: 2.1 time: 0.474205 Jul 20 04:15:20.546089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.549971 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:20.550638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:20.559079 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 100/242] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1332 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:20.576701 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:20.756371 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:20.764857 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1917d5d6-fe24-4765-b5af-aa71cba41cb2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1271 microversion: 2.1 time: 0.252030 Jul 20 04:15:20.765442 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 143/243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:21.077100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.077716 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.089007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.091680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.093264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.095552 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.213236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6ee0d65-c7b6-4b6a-a05d-8269588ab7d1 tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] Calling method '.version_select at 0x7f839861dee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.214231 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:21.214231 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:21.240620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6ee0d65-c7b6-4b6a-a05d-8269588ab7d1 tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.267081 Jul 20 04:15:21.241446 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 101/244] 10.222.0.49 () {60 vars in 1225 bytes} [Wed Jul 20 04:15:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:21.264220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44ba78b3-c404-40ad-97b2-fe48caa6129c tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] Action: 'update', calling method: .version_select at 0x7f83985a6310>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:21.269034 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:21.269034 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:21.595029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44ba78b3-c404-40ad-97b2-fe48caa6129c tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.346733 Jul 20 04:15:21.604852 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 102/245] 10.222.0.49 () {62 vars in 1246 bytes} [Wed Jul 20 04:15:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:15:21.606070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:21.614878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.615875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.640417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.640893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.642521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.645272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.674450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:21.847767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f4724ea5c041a5848b2e0091ae8fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f627778e3f14b178d117484817d5d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:21.861557 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-81756c3d-33a9-48c9-9808-0254482b0115 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 200 len: 1493 microversion: 2.1 time: 0.788643 Jul 20 04:15:21.870941 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 144/246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:21 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 1493 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:21.870941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:21.870941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:21.898574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.898781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:21.899575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:21.899999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.174372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.183221 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-22380809-6b3e-4eea-a616-c060d43bf47b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1332 microversion: 2.1 time: 0.319476 Jul 20 04:15:22.184424 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 145/247] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:21 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1332 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.210455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a938e346-80df-4b0e-8978-08f8c39ae4e2 tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] Calling method '.version_select at 0x7f83988ed4c0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.211341 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:22.211341 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:22.217541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.232927 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6969cdfd-8611-4379-97b7-36314ffe80d6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.626498 Jul 20 04:15:22.233701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 103/248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:21 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.238953 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a938e346-80df-4b0e-8978-08f8c39ae4e2 tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.053171 Jul 20 04:15:22.243192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.244120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.246894 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 146/249] 10.222.0.49 () {60 vars in 1225 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:22.257407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-d8000954-354c-42c5-b9d4-188a7b72cd36 req-5264bd4c-0004-4839-9e0f-2bff1a21f1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56cf52ee-9464-4a97-935f-f36eeb252609", "name": "network-vif-deleted", "tag": "ea5a88ef-7096-457a-9bba-a18b2ee02539"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:22.258729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.269788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.270651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.271162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.272190 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-d8000954-354c-42c5-b9d4-188a7b72cd36 req-5264bd4c-0004-4839-9e0f-2bff1a21f1c4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.272861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-d8000954-354c-42c5-b9d4-188a7b72cd36 req-5264bd4c-0004-4839-9e0f-2bff1a21f1c4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.286100 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-d8000954-354c-42c5-b9d4-188a7b72cd36 req-5264bd4c-0004-4839-9e0f-2bff1a21f1c4 service nova] Creating event network-vif-deleted:ea5a88ef-7096-457a-9bba-a18b2ee02539 for instance 56cf52ee-9464-4a97-935f-f36eeb252609 on n-h2-764486-11 Jul 20 04:15:22.295126 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-d8000954-354c-42c5-b9d4-188a7b72cd36 req-5264bd4c-0004-4839-9e0f-2bff1a21f1c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043568 Jul 20 04:15:22.295967 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 147/250] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:22.303291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-462832b3-8b96-4e21-871c-13c8d303230e tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] Action: 'update', calling method: .version_select at 0x7f8398899550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:22.305218 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:22.305218 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:22.468957 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-462832b3-8b96-4e21-871c-13c8d303230e tempest-QuotaClassesAdmin257Test-1896138450 tempest-QuotaClassesAdmin257Test-1896138450-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.171397 Jul 20 04:15:22.469618 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 148/251] 10.222.0.49 () {62 vars in 1246 bytes} [Wed Jul 20 04:15:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:22.833954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:22.848046 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4d2b455-3e79-4cb1-806c-07c615eb9ad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.610480 Jul 20 04:15:22.848740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 104/252] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:22.879556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:22.880455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:22.889276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.890962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.892524 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.893100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:22.919083 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] HTTP exception thrown: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Request method failure captured: Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 HTTP/1.1 Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EoI_W5nHCiCRyAZsOkgINTVPC4oqGJbFa0ugDbj50rgkWU7fbeeO4QJIgtdYjcbB6rVrLVpITB-1ma6B6zKVLmcSRMRmh-NqffCillS0TF_zPJlgWbOBqQyobOCsYLYD8_2zQPY2H-ItD3VEA4UtVfw5u1eRi1Plx0fuqs8WiC3DY Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 5f627778e3f14b178d117484817d5d35 Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:22.923343 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5f627778e3f14b178d117484817d5d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5f627778e3f14b178d117484817d5d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5f627778e3f14b178d117484817d5d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5f627778e3f14b178d117484817d5d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 5f627778e3f14b178d117484817d5d35 Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminTestJSON-1452893066-project Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 64f4724ea5c041a5848b2e0091ae8fa6 Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminTestJSON-1452893066-project Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:22.924690 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '56cf52ee-9464-4a97-935f-f36eeb252609'} Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:22.925758 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:22.927096 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:22.930556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Returning 404 to user: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:22.931541 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a6e76653-0be6-498c-9053-9e1e9ff97f81 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 404 len: 111 microversion: 2.1 time: 0.056736 Jul 20 04:15:22.934198 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 149/253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:22 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:22.944683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fc63bac-a8dd-43ce-814d-1b350d08889d tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:22.946711 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:22.946711 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:22.969835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fc63bac-a8dd-43ce-814d-1b350d08889d tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:22.970809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fc63bac-a8dd-43ce-814d-1b350d08889d tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.137871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1fc63bac-a8dd-43ce-814d-1b350d08889d tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.197968 Jul 20 04:15:23.139120 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 105/254] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:15:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:23.150113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-39b9b269-9b01-44a3-aae7-de03428524d7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.151320 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:23.151320 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:23.192115 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-39b9b269-9b01-44a3-aae7-de03428524d7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045957 Jul 20 04:15:23.192676 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 150/255] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:23 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:23.221217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5576775-3039-498d-8aee-565af1c09956 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-441442997"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:23.225802 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:23.225802 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:23.227240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-c5576775-3039-498d-8aee-565af1c09956 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid c5a9065e-c17b-4a35-926f-a6ec96d1db9b for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:23.245273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.248016 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.272714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5576775-3039-498d-8aee-565af1c09956 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068089 Jul 20 04:15:23.279418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 106/256] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:23.279557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.280752 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.283171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:23.283886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:23.284014 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.284842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.292656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.293189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.304903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.305738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.780128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:23.792109 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-624fb1ca-62b2-4cd2-9188-4ba1370c73e9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1310 microversion: 2.1 time: 0.577655 Jul 20 04:15:23.792718 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 151/257] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1310 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:23.801870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1469b47e-5704-495a-a2ef-0f1b785c9ce8 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:23.804803 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:23.804803 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:23.805234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:23.813103 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e1ef35c4-7454-4f67-ab88-3c67a64992a3 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.536666 Jul 20 04:15:23.814081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 107/258] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:23.815725 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:SELECT=80,nova_api:UPDATE=8,nova_api:DELETE=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:23.826875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1469b47e-5704-495a-a2ef-0f1b785c9ce8 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.827333 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1469b47e-5704-495a-a2ef-0f1b785c9ce8 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.924177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5fe07adf-6333-4fb8-8bba-ad58c1014b24 req-47f55b4d-180b-4abc-9d24-f0f7bad882dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328dd8aa-9d14-40c7-8afd-05306640e26e", "tag": "89c6b692-291c-4b48-9870-10b30c95d138"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:23.958610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5fe07adf-6333-4fb8-8bba-ad58c1014b24 req-47f55b4d-180b-4abc-9d24-f0f7bad882dd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:23.960792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5fe07adf-6333-4fb8-8bba-ad58c1014b24 req-47f55b4d-180b-4abc-9d24-f0f7bad882dd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:23.985398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5fe07adf-6333-4fb8-8bba-ad58c1014b24 req-47f55b4d-180b-4abc-9d24-f0f7bad882dd service nova] Creating event network-changed:89c6b692-291c-4b48-9870-10b30c95d138 for instance 328dd8aa-9d14-40c7-8afd-05306640e26e on n-h1-764486-11 Jul 20 04:15:23.996724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5fe07adf-6333-4fb8-8bba-ad58c1014b24 req-47f55b4d-180b-4abc-9d24-f0f7bad882dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180503 Jul 20 04:15:23.997376 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1469b47e-5704-495a-a2ef-0f1b785c9ce8 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.203629 Jul 20 04:15:23.998553 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 152/259] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:15:23 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.003819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.004102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 108/260] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.005080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.011702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da4e88a6-d095-4138-8339-b306352f64d0 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.017720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.018397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.019003 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.019003 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:24.020051 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.021245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da4e88a6-d095-4138-8339-b306352f64d0 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '7ae3035c2dce429caad2251447900465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1e1365f0004a3f890c58d16cb0b040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.021943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da4e88a6-d095-4138-8339-b306352f64d0 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Request method failure captured: Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 43 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EnjFCkawR4D32Hze2sNonp8_-yGC51GRGVV7fEBWuyuUaS9pEOC-ho4vPDtDgMOx440hwPVQkKLbESQyefJuaA_LPUArFq_n77Ta-oWmmGWyjbKUTkWq6JncV4G07YH_jIM3FbbEcnXDFvEXgdeF3W-u5PK1vpHoxOmCS4S9zTZN4 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:15:24.026466 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ea1e1365f0004a3f890c58d16cb0b040"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ea1e1365f0004a3f890c58d16cb0b040", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ea1e1365f0004a3f890c58d16cb0b040 Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-362785337 Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 7ae3035c2dce429caad2251447900465 Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-362785337-project Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: {"remove_host": {"host": "n-h2-764486-11"}} Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:15:24.027819 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h2-764486-11'}}} Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:24.029067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 04:15:24.030098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.036137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da4e88a6-d095-4138-8339-b306352f64d0 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:24.037306 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da4e88a6-d095-4138-8339-b306352f64d0 tempest-AggregatesAdminNegativeTestJSON-362785337 tempest-AggregatesAdminNegativeTestJSON-362785337-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.032293 Jul 20 04:15:24.038456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 109/261] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:24.050354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1903ae3b-4cbc-4695-a139-a9fd11192b24 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.076036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1903ae3b-4cbc-4695-a139-a9fd11192b24 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.081110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1903ae3b-4cbc-4695-a139-a9fd11192b24 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.288042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1903ae3b-4cbc-4695-a139-a9fd11192b24 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.245318 Jul 20 04:15:24.315701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 110/262] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:24.338957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e567473e-995a-4635-903c-b9e79a3d61c9 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.341229 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.341229 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:24.396694 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e567473e-995a-4635-903c-b9e79a3d61c9 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.072601 Jul 20 04:15:24.401205 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 111/263] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:24 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:24.411710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f1cd65d-9d06-4072-bba0-013c67ae4112 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-584123888"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.414868 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.414868 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:24.417216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-6f1cd65d-9d06-4072-bba0-013c67ae4112 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Generated uuid 89be3251-5502-40b1-85ba-cb5d4aab2d5e for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:24.458943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f1cd65d-9d06-4072-bba0-013c67ae4112 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051723 Jul 20 04:15:24.461490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 112/264] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:24.470897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cacb8354-6399-4c47-948d-567bfcda66e7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-373970621"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.472857 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.472857 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:24.475553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-cacb8354-6399-4c47-948d-567bfcda66e7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid fa28fd56-c83d-435a-b6f3-fc04aafd8633 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:24.486957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:24.498068 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9834401c-4c8f-4bbf-ae3a-41e79bca7679 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.498132 Jul 20 04:15:24.498701 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 153/265] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:23 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:24.513600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.516621 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.516621 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:24.520531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cacb8354-6399-4c47-948d-567bfcda66e7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055808 Jul 20 04:15:24.521363 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 113/266] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.528388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9bd3e995-5345-421b-9e1d-3b0a2e8c5a43 req-c815a58c-4807-478f-be0b-05b09ea9959f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0842d27-0ea4-4e23-8321-c75d8126da87", "tag": "f319198d-e04b-46c7-95ef-23ee0048fe7f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.537162 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.537897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.540726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9bd3e995-5345-421b-9e1d-3b0a2e8c5a43 req-c815a58c-4807-478f-be0b-05b09ea9959f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.541305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9bd3e995-5345-421b-9e1d-3b0a2e8c5a43 req-c815a58c-4807-478f-be0b-05b09ea9959f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.553803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.555728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9bd3e995-5345-421b-9e1d-3b0a2e8c5a43 req-c815a58c-4807-478f-be0b-05b09ea9959f service nova] Creating event network-changed:f319198d-e04b-46c7-95ef-23ee0048fe7f for instance a0842d27-0ea4-4e23-8321-c75d8126da87 on n-h1-764486-11 Jul 20 04:15:24.556955 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.561158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9bd3e995-5345-421b-9e1d-3b0a2e8c5a43 req-c815a58c-4807-478f-be0b-05b09ea9959f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036877 Jul 20 04:15:24.562343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 114/267] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.568675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-410981b6-f06c-4143-8ec8-a6e774f2a025 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.570537 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.570537 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:24.581691 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.compute.aggregates [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:15:24.582853 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Jul 20 04:15:24.583184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-410981b6-f06c-4143-8ec8-a6e774f2a025 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.583772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-410981b6-f06c-4143-8ec8-a6e774f2a025 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Request method failure captured: Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 42 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EqO9QPw8dSgTVFUaeciX_y7LinA4N_-1ykgIH6pMuz4yKqncQKMH2YSxTaq9kcOkbaNVkxnp9Jsfcanzy0-hL2TYvU-HraYZifKKuqN2VkBvnFhrYxi6PSRiMCOAsByiSevt-KcZcHFJE-vFvkY0Ppgs0DeRgaxY0CRn_IkY-fd48 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:24.585814 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74abcbb6197d40c58293df93e77010b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74abcbb6197d40c58293df93e77010b1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 74abcbb6197d40c58293df93e77010b1 Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261 Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 6089b08b832242638710ee19d11df41e Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: {"remove_host": {"host": "nonexist_host"}} Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:24.587384 n-d-764486-11 devstack@n-api.service[123723]: exception: Cannot remove host nonexist_host in aggregate 10 Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 04:15:24.588148 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 20 04:15:24.589297 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.592304 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6ec6ef03-0a6c-4f10-8760-af45fcdd8a8e tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.085393 Jul 20 04:15:24.595079 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 154/268] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:24.606311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f7f11cc7-ef8e-436b-a7a0-5a547a6ded45 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.607179 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.607179 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:24.649453 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f7f11cc7-ef8e-436b-a7a0-5a547a6ded45 tempest-AggregatesAdminNegativeTestJSON-2013991261 tempest-AggregatesAdminNegativeTestJSON-2013991261-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053516 Jul 20 04:15:24.650464 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 155/269] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:24 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:24.758759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-410981b6-f06c-4143-8ec8-a6e774f2a025 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.194667 Jul 20 04:15:24.759899 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 115/270] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.769621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-89a68ef7-78a4-4bb8-8798-c728315de7ca tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.770519 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.770519 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:24.781653 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-89a68ef7-78a4-4bb8-8798-c728315de7ca tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.015574 Jul 20 04:15:24.784999 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 156/271] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:24.792880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-768fef01-ace1-4af9-b07a-c10ca24876ba tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:24.794149 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:24.794149 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:24.809468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:24.810072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:24.821469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-768fef01-ace1-4af9-b07a-c10ca24876ba tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.823972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-768fef01-ace1-4af9-b07a-c10ca24876ba tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.830689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.831135 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.831918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:24.837885 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:24.983085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=7,nova_api:INSERT=11,nova_api:DELETE=5 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:25.002512 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-768fef01-ace1-4af9-b07a-c10ca24876ba tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.213373 Jul 20 04:15:25.003175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 116/272] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:25.022976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.023721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.037833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.038290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.039081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.039540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.247207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.258348 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-52902b17-0731-4a44-8530-f9fa3d048a5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1310 microversion: 2.1 time: 0.451536 Jul 20 04:15:25.260289 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 157/273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:24 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1310 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:25.269039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-99b16764-55af-4e5f-8074-65f85926857f tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.272381 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.272381 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:25.327305 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-99b16764-55af-4e5f-8074-65f85926857f tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.064405 Jul 20 04:15:25.328085 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 158/274] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:25 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:25.342264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c44954fb-3b57-48b5-a503-cf688c7291e7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-130136639"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:25.345419 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.345419 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:25.347011 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-c44954fb-3b57-48b5-a503-cf688c7291e7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid f69256e5-1b35-43b0-a576-b442f62d48bd for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:25.347132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:25.358243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a39ed7d1-9820-4342-b5ef-8b2abaf1ed29 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.348593 Jul 20 04:15:25.358888 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 117/275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:25.395959 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c44954fb-3b57-48b5-a503-cf688c7291e7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058601 Jul 20 04:15:25.403147 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 159/276] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:25.409348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfacfeb6-63c2-4961-993b-52bc56f47830 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:25.410660 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.410660 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:25.428886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfacfeb6-63c2-4961-993b-52bc56f47830 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.429340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfacfeb6-63c2-4961-993b-52bc56f47830 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.517936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.519252 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:25.529983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.531184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.536031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.536611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.583060 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfacfeb6-63c2-4961-993b-52bc56f47830 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.177028 Jul 20 04:15:25.583060 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 118/277] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:25 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:25.591376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd5fb28b-86e1-452b-bbb0-2c1e2a63d1c6 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.592288 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.592288 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:25.607662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd5fb28b-86e1-452b-bbb0-2c1e2a63d1c6 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.019710 Jul 20 04:15:25.608553 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 119/278] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:25.619225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2349d7be-fce0-49f4-a0ae-d9d7a07203e2 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:25.620530 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.620530 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:25.637786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2349d7be-fce0-49f4-a0ae-d9d7a07203e2 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.637978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2349d7be-fce0-49f4-a0ae-d9d7a07203e2 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:25.817631 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2349d7be-fce0-49f4-a0ae-d9d7a07203e2 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.198360 Jul 20 04:15:25.819714 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 120/279] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:25 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:25.831234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8e5a83c-6fe4-4abe-9bd7-310e92f87f0c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:25.831993 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.831993 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:25.867915 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8e5a83c-6fe4-4abe-9bd7-310e92f87f0c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041192 Jul 20 04:15:25.877242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 121/280] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:15:25.886132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7010acc5-7e8d-4c73-8816-b320752f8848 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-897382394"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:25.888207 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.888207 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:25.890409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-7010acc5-7e8d-4c73-8816-b320752f8848 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid afc81a9a-9c6c-44d5-ad83-eb0f7d8c83cf for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:25.921182 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7010acc5-7e8d-4c73-8816-b320752f8848 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041248 Jul 20 04:15:25.923892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 122/281] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:25.940055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eeb1d85f-9cac-49c3-8384-95631ffc4042 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:25.942394 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:25.942394 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:25.962732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eeb1d85f-9cac-49c3-8384-95631ffc4042 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:25.963198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eeb1d85f-9cac-49c3-8384-95631ffc4042 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.140465 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eeb1d85f-9cac-49c3-8384-95631ffc4042 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.209855 Jul 20 04:15:26.143081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 123/282] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:25 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:26.152691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9526f1cf-e406-4b70-962b-3f2003a1846e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:26.155069 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:26.155069 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:26.170299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:26.179560 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8883288d-0273-4fe3-81a8-d948940b6d91 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.666567 Jul 20 04:15:26.186025 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 160/283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:25 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:26.198922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9526f1cf-e406-4b70-962b-3f2003a1846e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.198922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9526f1cf-e406-4b70-962b-3f2003a1846e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.276109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.277892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.288829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.291053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.295166 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.297569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.425912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9526f1cf-e406-4b70-962b-3f2003a1846e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.277417 Jul 20 04:15:26.430486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 124/284] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:26 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:26.445208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:26.448431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:26.463461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.463738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:26.466342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:26.466789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.205045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.215940 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5b31c804-aeec-49ec-a8cd-bcea9d154f16 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1310 microversion: 2.1 time: 0.943537 Jul 20 04:15:27.217142 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 161/285] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1310 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:27.237219 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a9056773-1bb8-402b-8f61-3942b0448fcd tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.238466 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.238466 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:27.277561 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a9056773-1bb8-402b-8f61-3942b0448fcd tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.058881 Jul 20 04:15:27.286676 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 162/286] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:27.292977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=16 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:27.309831 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.310990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:27.322628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.323412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.324449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.325317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.412575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.421651 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b72ed05-80c0-4de5-8677-f32c61dbeff8 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.990154 Jul 20 04:15:27.422881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 125/287] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:26 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:27.441127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07c42d9c-7522-4d27-b663-6907d390a555 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1975679164"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:27.443334 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.443334 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.444413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-07c42d9c-7522-4d27-b663-6907d390a555 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid 93f57647-8439-430c-95d4-7bf2b68b5299 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:27.480725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07c42d9c-7522-4d27-b663-6907d390a555 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056648 Jul 20 04:15:27.488322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 126/288] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.494015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cf68194-0fc3-483e-934a-a2510b3e66ca tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83985c7160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.495220 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.495220 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.496936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf68194-0fc3-483e-934a-a2510b3e66ca tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.497397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf68194-0fc3-483e-934a-a2510b3e66ca tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.498390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf68194-0fc3-483e-934a-a2510b3e66ca tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.499387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf68194-0fc3-483e-934a-a2510b3e66ca tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.527611 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cf68194-0fc3-483e-934a-a2510b3e66ca tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.038089 Jul 20 04:15:27.535098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 127/289] 10.222.0.49 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.536610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bcf0d3c5-5314-4c69-8499-20e6e23aa232 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.537382 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.537382 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.581530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bcf0d3c5-5314-4c69-8499-20e6e23aa232 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050828 Jul 20 04:15:27.582124 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 128/290] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:27.599649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6a2929e-6182-4ce4-85d0-4a7c97845fa7 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f8398571280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.601344 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.601344 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.602889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a2929e-6182-4ce4-85d0-4a7c97845fa7 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.603475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a2929e-6182-4ce4-85d0-4a7c97845fa7 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.605251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a2929e-6182-4ce4-85d0-4a7c97845fa7 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.605830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a2929e-6182-4ce4-85d0-4a7c97845fa7 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.645445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6a2929e-6182-4ce4-85d0-4a7c97845fa7 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.050356 Jul 20 04:15:27.654451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 129/291] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.661837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f1afe12-bc25-4ad1-8741-4fbd8d8fa2ab tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.663915 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.663915 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.671647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5f1afe12-bc25-4ad1-8741-4fbd8d8fa2ab tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f1afe12-bc25-4ad1-8741-4fbd8d8fa2ab tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Request method failure captured: Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ErlDvSpq-zWJbjrzFlAkx9QnXmVYwY_FmQ44OoKeKvKJCTo4fws2aXrBEM1JzpIBZ5XrM3PcKCwPMOmFTLonBn3-aiSLCd0xMcfYTUy3QDbGQbf7AR4qO-I2oGc7NARROrwis1nwgcI5dMjKH-WhazRU_XkUF2XBZwq7zoFW7NgYU Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:27.674619 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d888ef02cbf473d92b20cefe036a894", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 88ee59b5f0cf4c429575b655c85ee087 Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: exception: Aggregate 14 could not be found. Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '14'} Jul 20 04:15:27.676051 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:27.676961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 20 04:15:27.678177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.683198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f1afe12-bc25-4ad1-8741-4fbd8d8fa2ab tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:27.684571 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f1afe12-bc25-4ad1-8741-4fbd8d8fa2ab tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.028777 Jul 20 04:15:27.689823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 130/292] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:27.694869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72a0d3a7-57f2-4c84-9f67-7ce31e9648f6 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83985c70d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.696214 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.696214 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.697478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a0d3a7-57f2-4c84-9f67-7ce31e9648f6 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.697964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a0d3a7-57f2-4c84-9f67-7ce31e9648f6 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.698757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a0d3a7-57f2-4c84-9f67-7ce31e9648f6 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.699180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a0d3a7-57f2-4c84-9f67-7ce31e9648f6 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.738416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72a0d3a7-57f2-4c84-9f67-7ce31e9648f6 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.047363 Jul 20 04:15:27.747954 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 131/293] 10.222.0.49 () {58 vars in 1127 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.751325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ea59190-b85d-47d0-b3e5-793cdb9fb97c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.752323 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.752323 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.774197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7ea59190-b85d-47d0-b3e5-793cdb9fb97c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ea59190-b85d-47d0-b3e5-793cdb9fb97c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Request method failure captured: Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ErlDvSpq-zWJbjrzFlAkx9QnXmVYwY_FmQ44OoKeKvKJCTo4fws2aXrBEM1JzpIBZ5XrM3PcKCwPMOmFTLonBn3-aiSLCd0xMcfYTUy3QDbGQbf7AR4qO-I2oGc7NARROrwis1nwgcI5dMjKH-WhazRU_XkUF2XBZwq7zoFW7NgYU Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:27.776982 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d888ef02cbf473d92b20cefe036a894", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 88ee59b5f0cf4c429575b655c85ee087 Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: exception: Aggregate 14 could not be found. Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '14'} Jul 20 04:15:27.778437 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:27.779304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:27.780705 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ea59190-b85d-47d0-b3e5-793cdb9fb97c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:27.782083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ea59190-b85d-47d0-b3e5-793cdb9fb97c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.033803 Jul 20 04:15:27.785449 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 132/294] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:27.792640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14ea7959-5790-4548-b10a-9926e6cf8200 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83985c7790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.794184 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.794184 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.803683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14ea7959-5790-4548-b10a-9926e6cf8200 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.804134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14ea7959-5790-4548-b10a-9926e6cf8200 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.826643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14ea7959-5790-4548-b10a-9926e6cf8200 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.827095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14ea7959-5790-4548-b10a-9926e6cf8200 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.876180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:27.880576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14ea7959-5790-4548-b10a-9926e6cf8200 tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-h2-764486-11" status: 200 len: 471 microversion: 2.1 time: 0.093692 Jul 20 04:15:27.885182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 133/295] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/os-hosts/n-h2-764486-11 => generated 471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:27.886488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81317971-df5c-499d-8058-2fa16be58503 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1655910097", "name": "tempest-test_aggregate-2143931034"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:27.892675 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7ed80187-b88a-4908-b281-f80e53732be3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.604038 Jul 20 04:15:27.903174 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 163/296] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:27.907879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0ffa8fac-2fe5-4071-854a-ff12cd8e250d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Calling method '.version_select at 0x7f83986c3940>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:27.908725 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.908725 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:27.932240 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:27.932240 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:27.932720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-81317971-df5c-499d-8058-2fa16be58503 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid a754096d-d320-4e85-968c-9cbdbd5cddb5 for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:27.938328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ffa8fac-2fe5-4071-854a-ff12cd8e250d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.939306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ffa8fac-2fe5-4071-854a-ff12cd8e250d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.988418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ffa8fac-2fe5-4071-854a-ff12cd8e250d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:27.989208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ffa8fac-2fe5-4071-854a-ff12cd8e250d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:27.990886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81317971-df5c-499d-8058-2fa16be58503 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.108686 Jul 20 04:15:27.996969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 134/297] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Jul 20 04:15:27 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.005047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-659e075f-f6d6-450f-afcd-6ae79d5cc49c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.005807 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.005807 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:28.057092 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0ffa8fac-2fe5-4071-854a-ff12cd8e250d tempest-HostsAdminTestJSON-7016249 tempest-HostsAdminTestJSON-7016249-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-h1-764486-11" status: 200 len: 603 microversion: 2.1 time: 0.152763 Jul 20 04:15:28.059749 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 164/298] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:27 2022] GET /compute/v2.1/os-hosts/n-h1-764486-11 => generated 603 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.069390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-659e075f-f6d6-450f-afcd-6ae79d5cc49c tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.070564 Jul 20 04:15:28.071146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 135/299] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:28.084226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f185def1-84d5-4455-95d2-d0d17916948b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.087989 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.087989 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:28.105528 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-f185def1-84d5-4455-95d2-d0d17916948b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f185def1-84d5-4455-95d2-d0d17916948b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Request method failure captured: Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14ErlDvSpq-zWJbjrzFlAkx9QnXmVYwY_FmQ44OoKeKvKJCTo4fws2aXrBEM1JzpIBZ5XrM3PcKCwPMOmFTLonBn3-aiSLCd0xMcfYTUy3QDbGQbf7AR4qO-I2oGc7NARROrwis1nwgcI5dMjKH-WhazRU_XkUF2XBZwq7zoFW7NgYU Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:15:28.112618 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d888ef02cbf473d92b20cefe036a894", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 88ee59b5f0cf4c429575b655c85ee087 Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: exception: Aggregate 15 could not be found. Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '15'} Jul 20 04:15:28.113934 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.114647 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Jul 20 04:15:28.115667 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.117964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f185def1-84d5-4455-95d2-d0d17916948b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:28.119018 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f185def1-84d5-4455-95d2-d0d17916948b tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.042731 Jul 20 04:15:28.131050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcaf729e-0029-48ba-ba47-511641189cd7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.133289 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.133289 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:28.135857 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 165/300] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:28.152872 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dcaf729e-0029-48ba-ba47-511641189cd7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcaf729e-0029-48ba-ba47-511641189cd7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Request method failure captured: Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ErlDvSpq-zWJbjrzFlAkx9QnXmVYwY_FmQ44OoKeKvKJCTo4fws2aXrBEM1JzpIBZ5XrM3PcKCwPMOmFTLonBn3-aiSLCd0xMcfYTUy3QDbGQbf7AR4qO-I2oGc7NARROrwis1nwgcI5dMjKH-WhazRU_XkUF2XBZwq7zoFW7NgYU Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:28.154969 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d888ef02cbf473d92b20cefe036a894"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d888ef02cbf473d92b20cefe036a894", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d888ef02cbf473d92b20cefe036a894 Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-513086424 Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 88ee59b5f0cf4c429575b655c85ee087 Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AggregatesAdminTestJSON-513086424-project-admin Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: exception: Aggregate 15 could not be found. Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '15'} Jul 20 04:15:28.156891 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:15:28.157606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:28.158628 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:28.159742 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:28.159742 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:28.159742 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:28.159742 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Jul 20 04:15:28.159742 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:28.162081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcaf729e-0029-48ba-ba47-511641189cd7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:28.163540 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcaf729e-0029-48ba-ba47-511641189cd7 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.037456 Jul 20 04:15:28.174818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a966caee-98c0-4d36-91aa-bb206a8cc0f4 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1528220764"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.177067 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.177067 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:28.178769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-a966caee-98c0-4d36-91aa-bb206a8cc0f4 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid e1de374c-9aee-49a2-a3e8-8a618d04a88a for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:28.179950 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 136/301] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:28 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:15:28.232710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.233818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.245596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.246040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.246809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.247273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.286570 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a966caee-98c0-4d36-91aa-bb206a8cc0f4 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.116233 Jul 20 04:15:28.287791 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 166/302] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.301024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f4ec820d-45ef-4485-b7f7-bec616715a4f tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.321363 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.321363 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:28.345431 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f4ec820d-45ef-4485-b7f7-bec616715a4f tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.051106 Jul 20 04:15:28.354030 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 167/303] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.369090 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2f8ed1a4-53a8-409b-a9c5-392ecaa79a38 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.373984 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.373984 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:28.428309 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2f8ed1a4-53a8-409b-a9c5-392ecaa79a38 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.072392 Jul 20 04:15:28.436760 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 168/304] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:15:28 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.450346 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.451912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.475003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.476734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.477921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.478738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.571873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:28.583274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76823592-73d6-40f5-9027-dd39f6e47039 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1310 microversion: 2.1 time: 0.354287 Jul 20 04:15:28.584179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 137/305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:28.594412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d789ada-6f6e-4eab-aa5c-0edc19aa259d tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.596125 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.596125 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:28.606436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d789ada-6f6e-4eab-aa5c-0edc19aa259d tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.020021 Jul 20 04:15:28.608267 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 138/306] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.620913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1e0278fb-3372-4178-a8b0-99e77821b994 req-7314d5a2-5455-464a-8170-9e0dd9dc6581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a97a688-e2f9-48fe-8a35-cac05b5a9dfd", "name": "network-vif-plugged", "status": "completed", "tag": "8778c0bb-598f-42c2-9839-926c9d7f74e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.632538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1e0278fb-3372-4178-a8b0-99e77821b994 req-7314d5a2-5455-464a-8170-9e0dd9dc6581 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.633098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1e0278fb-3372-4178-a8b0-99e77821b994 req-7314d5a2-5455-464a-8170-9e0dd9dc6581 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.649473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1e0278fb-3372-4178-a8b0-99e77821b994 req-7314d5a2-5455-464a-8170-9e0dd9dc6581 service nova] Creating event network-vif-plugged:8778c0bb-598f-42c2-9839-926c9d7f74e1 for instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd on n-h2-764486-11 Jul 20 04:15:28.656025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1e0278fb-3372-4178-a8b0-99e77821b994 req-7314d5a2-5455-464a-8170-9e0dd9dc6581 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046072 Jul 20 04:15:28.657491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 139/307] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.663072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52044ed1-0a57-4d7c-b340-1be2c096b995 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.664047 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.664047 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:28.675434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:28.731507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52044ed1-0a57-4d7c-b340-1be2c096b995 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.072027 Jul 20 04:15:28.732403 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 140/308] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:28 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:28.751436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-631900cb-08a6-434d-943d-c3f9c12c4e1e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-399095638", "availability_zone": "tempest-test_az-945227807"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.756432 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:28.756432 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:28.766752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-631900cb-08a6-434d-943d-c3f9c12c4e1e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid 3de639ad-d544-4201-8e6b-1f75f9fa504f for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:28.824922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-631900cb-08a6-434d-943d-c3f9c12c4e1e tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.083057 Jul 20 04:15:28.833369 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 141/309] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Jul 20 04:15:28 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:28.847338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58da4264-76c6-4e5b-a721-9f71f24afcf5 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-399095638_new", "availability_zone": "tempest-test_az-945227807_new"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:28.847597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:28.864231 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dbabf513-5180-4294-8f4a-b264777bd7f6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.420216 Jul 20 04:15:28.865389 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 169/310] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:28.911347 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:28.912211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:28.919447 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.920155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:28.921108 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:28.921694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.006192 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:29.006192 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:29.048030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58da4264-76c6-4e5b-a721-9f71f24afcf5 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.048515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58da4264-76c6-4e5b-a721-9f71f24afcf5 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.107778 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58da4264-76c6-4e5b-a721-9f71f24afcf5 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.273006 Jul 20 04:15:29.109463 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 142/311] 10.222.0.49 () {60 vars in 1172 bytes} [Wed Jul 20 04:15:28 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:29.151097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:29.161152 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e4ab2c9a-39e2-48ad-89b0-a0e621493a75 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.254566 Jul 20 04:15:29.161759 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 170/312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:28 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:29.169065 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-01ac5757-72bc-4bca-9d13-1b115293f709 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.169824 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:29.169824 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:29.177090 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-01ac5757-72bc-4bca-9d13-1b115293f709 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.014298 Jul 20 04:15:29.178279 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 171/313] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:29.195638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-361fab2a-d3bc-487d-a4fd-e003bbc050ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.196446 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:29.196446 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:29.239654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-361fab2a-d3bc-487d-a4fd-e003bbc050ec tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.053356 Jul 20 04:15:29.240817 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 172/314] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:29 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:15:29.251126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2282d69-8219-45aa-b81b-078f92e15770 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1173481696"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:29.252903 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:29.252903 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:29.253829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.aggregate [None req-b2282d69-8219-45aa-b81b-078f92e15770 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Generated uuid fddcaa8b-7934-4a49-9898-b6688271015f for aggregate {{(pid=123723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:15:29.284374 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b2282d69-8219-45aa-b81b-078f92e15770 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038134 Jul 20 04:15:29.287643 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 173/315] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:15:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:29.299748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-768af3bb-94a3-4846-8eaf-b4c11e4162d2 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.303331 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:29.303331 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:29.313038 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-768af3bb-94a3-4846-8eaf-b4c11e4162d2 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.018629 Jul 20 04:15:29.314159 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 174/316] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:29.341799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-43d10911-a54e-4b8b-bdd5-bf586f070662 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.344309 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:29.344309 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:29.406920 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-43d10911-a54e-4b8b-bdd5-bf586f070662 tempest-AggregatesAdminTestJSON-513086424 tempest-AggregatesAdminTestJSON-513086424-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.083944 Jul 20 04:15:29.407151 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 175/317] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:15:29 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 04:15:29.419640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.420320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.427762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.428211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.429084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.429511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.447305 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] HTTP exception thrown: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Request method failure captured: Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 HTTP/1.1 Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EoI_W5nHCiCRyAZsOkgINTVPC4oqGJbFa0ugDbj50rgkWU7fbeeO4QJIgtdYjcbB6rVrLVpITB-1ma6B6zKVLmcSRMRmh-NqffCillS0TF_zPJlgWbOBqQyobOCsYLYD8_2zQPY2H-ItD3VEA4UtVfw5u1eRi1Plx0fuqs8WiC3DY Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 5f627778e3f14b178d117484817d5d35 Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:29.449549 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5f627778e3f14b178d117484817d5d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5f627778e3f14b178d117484817d5d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5f627778e3f14b178d117484817d5d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5f627778e3f14b178d117484817d5d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 5f627778e3f14b178d117484817d5d35 Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminTestJSON-1452893066-project Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 64f4724ea5c041a5848b2e0091ae8fa6 Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminTestJSON-1452893066-project Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.450765 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '56cf52ee-9464-4a97-935f-f36eeb252609'} Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:29.451431 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.452601 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.455970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Returning 404 to user: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:29.457634 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-efd2b97c-d213-4286-9b46-ec54714eeaa1 tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "DELETE /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 404 len: 111 microversion: 2.1 time: 0.043430 Jul 20 04:15:29.459296 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 176/318] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:15:29 2022] DELETE /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:29.473904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.474525 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] [instance: 56cf52ee-9464-4a97-935f-f36eeb252609] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.491501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.491954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.493421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.494460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.525995 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] HTTP exception thrown: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Request method failure captured: Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 HTTP/1.1 Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EoI_W5nHCiCRyAZsOkgINTVPC4oqGJbFa0ugDbj50rgkWU7fbeeO4QJIgtdYjcbB6rVrLVpITB-1ma6B6zKVLmcSRMRmh-NqffCillS0TF_zPJlgWbOBqQyobOCsYLYD8_2zQPY2H-ItD3VEA4UtVfw5u1eRi1Plx0fuqs8WiC3DY Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 5f627778e3f14b178d117484817d5d35 Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:29.527698 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5f627778e3f14b178d117484817d5d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5f627778e3f14b178d117484817d5d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5f627778e3f14b178d117484817d5d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5f627778e3f14b178d117484817d5d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 5f627778e3f14b178d117484817d5d35 Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1452893066 Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-AggregatesAdminTestJSON-1452893066-project Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 64f4724ea5c041a5848b2e0091ae8fa6 Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-AggregatesAdminTestJSON-1452893066-project Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.529655 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '56cf52ee-9464-4a97-935f-f36eeb252609'} Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:29.530340 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. Jul 20 04:15:29.535800 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:29.539764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] Returning 404 to user: Instance 56cf52ee-9464-4a97-935f-f36eeb252609 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:29.539764 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ce7285fd-4a79-43b9-9143-6d358724497e tempest-AggregatesAdminTestJSON-1452893066 tempest-AggregatesAdminTestJSON-1452893066-project] 10.222.0.49 "GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609" status: 404 len: 111 microversion: 2.1 time: 0.063889 Jul 20 04:15:29.539764 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 177/319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/servers/56cf52ee-9464-4a97-935f-f36eeb252609 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:29.604055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.604055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.611980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.612913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.615637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.617343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.715834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b722c1c-3a38-4baa-9922-58b7e2be7f60 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] Action: 'create', calling method: .version_select at 0x7f83985c7d30>, body: {"security_group": {"name": "tempest-securitygroup-361376606", "description": "tempest-description-887830652"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:29.897266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:29.908225 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5d87b847-5e3e-47ad-bd9c-ad461afd8b6e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1310 microversion: 2.1 time: 0.310974 Jul 20 04:15:29.909632 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 178/320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:29.914934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:29.915770 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:29.926769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.927250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:29.928025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:29.928633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.147278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.156081 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dfd36915-2d98-417d-a6af-36db6a2a5fa4 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.245166 Jul 20 04:15:30.160158 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 179/321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:29 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:30.181744 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:30.182257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:30.188840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b722c1c-3a38-4baa-9922-58b7e2be7f60 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.077716 Jul 20 04:15:30.195674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 143/322] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:15:29 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:30.200613 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.201163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.203769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18cf2280-92c9-41a2-b3a1-beb1183c2a61 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] Action: 'create', calling method: .version_select at 0x7f83985b59d0>, body: {"security_group": {"name": "tempest-securitygroup-2024764246", "description": "tempest-description-81031322"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:30.205676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.206351 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.237863 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:30.424968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:30.433221 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-13299b2b-92ff-4dba-8fa5-b1f66ae0e45e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.258461 Jul 20 04:15:30.433810 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 180/323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:30 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:30.479621 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18cf2280-92c9-41a2-b3a1-beb1183c2a61 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.281281 Jul 20 04:15:30.480575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 144/324] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:15:30 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:30.928216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:30.929907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:30.948184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.948751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:30.950181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:30.950865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.169390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-61fb4de8-c065-48b1-84a6-b0921449b5f7 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Action: 'create', calling method: .version_select at 0x7f839874daf0>, body: {"security_group": {"name": "tempest-securitygroup-658632650", "description": "tempest-description-2029537403"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:31.311558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:31.333555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d8c052b-5dd4-4cc6-8c6a-0698266bb47e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1492 microversion: 2.1 time: 0.411774 Jul 20 04:15:31.337193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 145/325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:30 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1492 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:31.353826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.356165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.371064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.373569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.375613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.378405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.591633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=51,nova_cell0:UPDATE=7 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:31.651959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:31.663211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-197f85e6-7839-4cd1-bde4-79644f2e691f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.324325 Jul 20 04:15:31.664093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 146/326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:31.790879 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-61fb4de8-c065-48b1-84a6-b0921449b5f7 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.298300 Jul 20 04:15:31.792616 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 181/327] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:15:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:31.801787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:31.802721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:31.815674 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.822421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:31.823265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:31.823706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.066406 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:32.078689 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e7a642f9-402d-40b5-b1ec-a3df16b3a0c8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.283012 Jul 20 04:15:32.080801 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 182/328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:32.096113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6daf5659-a874-4cde-a70f-c72e758824b2 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Action: 'create', calling method: .version_select at 0x7f839874daf0>, body: {"security_group": {"name": "tempest-securitygroup-988824959", "description": "tempest-description-1664563280"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:32.450331 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6daf5659-a874-4cde-a70f-c72e758824b2 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.368251 Jul 20 04:15:32.457366 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 183/329] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:15:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:32.464103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Calling method '.version_select at 0x7f8398613e50>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:32.470251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=8 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:32.550735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:32.552802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:32.568988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.569503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.571547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:32.573875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:32.581950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:33.430435 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be822924-7448-417e-ae97-24bc349608ab tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1645 microversion: 2.1 time: 1.765094 Jul 20 04:15:33.437028 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 147/330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:31 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1645 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.449676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.453863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:33.467065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.474935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.481456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.493101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.852148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:33.868023 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fcd383c2-05a2-4213-8bed-28ffc92adb5b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.428268 Jul 20 04:15:33.869814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 148/331] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:33.876754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:33.877922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:33.897483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.898785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:33.899922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:33.900613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.530582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:34.543474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5431d7a-1585-45b1-9476-e50e9533dcd8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.672162 Jul 20 04:15:34.544253 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 149/332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:33 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:34.547522 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:34.561265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-de3a162c-eb33-4211-84e8-c7472df16ce3 req-999b5b76-50bf-4d9f-9417-e65cc8add897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0842d27-0ea4-4e23-8321-c75d8126da87", "name": "network-vif-plugged", "status": "completed", "tag": "f319198d-e04b-46c7-95ef-23ee0048fe7f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:34.577053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-de3a162c-eb33-4211-84e8-c7472df16ce3 req-999b5b76-50bf-4d9f-9417-e65cc8add897 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.577495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-de3a162c-eb33-4211-84e8-c7472df16ce3 req-999b5b76-50bf-4d9f-9417-e65cc8add897 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.599634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-de3a162c-eb33-4211-84e8-c7472df16ce3 req-999b5b76-50bf-4d9f-9417-e65cc8add897 service nova] Creating event network-vif-plugged:f319198d-e04b-46c7-95ef-23ee0048fe7f for instance a0842d27-0ea4-4e23-8321-c75d8126da87 on n-h1-764486-11 Jul 20 04:15:34.618014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-de3a162c-eb33-4211-84e8-c7472df16ce3 req-999b5b76-50bf-4d9f-9417-e65cc8add897 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072592 Jul 20 04:15:34.618981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 150/333] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:34.623847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:34.624597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:34.669774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.670224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:34.673027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:34.676418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.056998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c74ab9fd-0b85-45dd-9b9c-3c8155077409 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1645 microversion: 2.1 time: 0.436579 Jul 20 04:15:35.057659 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 151/334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:34 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1645 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.170232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f22e0e79-1318-4615-a7cb-6c04b28acd59 does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:35.170918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Neutron security group f22e0e79-1318-4615-a7cb-6c04b28acd59 not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:15:35.172162 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.compute.security_groups [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Security Group ID f22e0e79-1318-4615-a7cb-6c04b28acd59 does not exist {{(pid=123723) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 20 04:15:35.199996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f22e0e79-1318-4615-a7cb-6c04b28acd59 does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:15:35.200836 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Neutron security group f22e0e79-1318-4615-a7cb-6c04b28acd59 not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:15:35.201479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.compute.security_groups [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Security Group ID f22e0e79-1318-4615-a7cb-6c04b28acd59 does not exist {{(pid=123723) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 20 04:15:35.312907 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0446d511-f1a1-4b5c-8ee0-e66aefa94353 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9849 microversion: 2.1 time: 2.853343 Jul 20 04:15:35.314536 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 184/335] 10.222.0.49 () {58 vars in 1190 bytes} [Wed Jul 20 04:15:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9849 bytes in 2856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.320345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.322153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:35.324500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:35.337376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a129d70-9019-43c7-972b-d7a8a8b81da9 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-178576453", "id": 36511372, "os-flavor-access:is_public": "True"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:35.339569 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.339569 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:35.343858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.344570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.345677 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.346268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.376269 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a129d70-9019-43c7-972b-d7a8a8b81da9 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.86 time: 0.316533 Jul 20 04:15:35.384602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 152/336] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:15:35 2022] POST /compute/v2.1/flavors => generated 464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:35.521017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:35.536879 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-820d6997-140b-4099-9692-e980f999bf63 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1390 microversion: 2.1 time: 0.220794 Jul 20 04:15:35.537469 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 185/337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.541803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c6bbce9c-aaa2-4945-b239-f721d7275db0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.543101 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.543101 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:35.544300 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c6bbce9c-aaa2-4945-b239-f721d7275db0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.553724 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c6bbce9c-aaa2-4945-b239-f721d7275db0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.554632 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c6bbce9c-aaa2-4945-b239-f721d7275db0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.555081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c6bbce9c-aaa2-4945-b239-f721d7275db0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.594882 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c6bbce9c-aaa2-4945-b239-f721d7275db0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056192 Jul 20 04:15:35.601111 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 186/338] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:35.601111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2c3ff21e-3723-45f8-8279-dc18131ed9d8 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] Calling method '.version_select at 0x7f839868c9d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.672755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f99db387-e2e4-41d8-b76d-d27f61889e54 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.673540 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.673540 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:35.675682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f99db387-e2e4-41d8-b76d-d27f61889e54 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f99db387-e2e4-41d8-b76d-d27f61889e54 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin] Request method failure captured: Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FmYUtetfiAkK6yVIa4zQgNWu_XBssA0_6ab1P2zcXTdjSD2oGrQwuP6tXhtoLK-gZ1RgJCzg_VbsvtvL3rO9ZAjoArhERSo5Xz1pJ6otcdIr3FS6QNItpDEBIwOEvN5zjZgA_2NdNvgzay1-vIP49WXdi_zbu7oK6kkrSfhvq5UkU Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 79410c2c08534fbd9c93654f034aebce Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:15:35.696128 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79410c2c08534fbd9c93654f034aebce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79410c2c08534fbd9c93654f034aebce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79410c2c08534fbd9c93654f034aebce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79410c2c08534fbd9c93654f034aebce", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 79410c2c08534fbd9c93654f034aebce Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 976f3db57eb1430ea50ffa272287bf61 Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:15:35.697711 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid timestamp for date invalid_time Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'invalid_time'} Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:35.698480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 20 04:15:35.699818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:15:35.707157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f99db387-e2e4-41d8-b76d-d27f61889e54 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:35.708016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f99db387-e2e4-41d8-b76d-d27f61889e54 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873 tempest-InstanceUsageAuditLogNegativeTestJSON-1041585873-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.328347 Jul 20 04:15:35.708619 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 153/339] 10.222.0.49 () {58 vars in 1223 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 329 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:15:35.717494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22d81925-bc96-475a-aeee-e3675e8a6b73 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:35.719413 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:35.719413 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:35.813881 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2c3ff21e-3723-45f8-8279-dc18131ed9d8 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.216599 Jul 20 04:15:35.822964 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 187/340] 10.222.0.49 () {58 vars in 1190 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.828643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:35.829462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:35.835962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.836899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.837947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.838527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.935935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22d81925-bc96-475a-aeee-e3675e8a6b73 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/36511372/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.225998 Jul 20 04:15:35.936589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 154/341] 10.222.0.49 () {62 vars in 1258 bytes} [Wed Jul 20 04:15:35 2022] POST /compute/v2.1/flavors/36511372/os-extra_specs => generated 62 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:35.942750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764486-11", "block_migration": true, "disk_over_commit": false}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:35.944077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:35.956617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.957067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:35.957897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:35.958502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.005304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.014816 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2f370425-d3f0-4ce0-b36b-4379a14af77a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.190314 Jul 20 04:15:36.026209 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 188/342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:35 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:36.095130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lazy-loading 'flavor' on Instance uuid 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:15:36.199057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Going to try to live migrate instance to n-h1-764486-11 {{(pid=123724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:15:36.214624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f839897b3a0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.215444 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:36.215444 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:36.216642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.217094 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.241782 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.243520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.278299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.278980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.297405 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b8eb1d2-2191-4ef6-b519-56fc4791abae tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.269369 Jul 20 04:15:36.303884 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 189/343] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:36.526675 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5acc4259-a350-4d76-a32b-9175ced4b5a1 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.527561 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:36.527561 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:36.534639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5acc4259-a350-4d76-a32b-9175ced4b5a1 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0726b0f8a79742caa30f8b3fb556a45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853bd33662934968a17eb99b7e82be96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5acc4259-a350-4d76-a32b-9175ced4b5a1 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Request method failure captured: Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FlpHD7tvQlG3FJm9EboCMPCbERHdUHzc4Eqrcy5-kYw9ktvb_S0jhCOs-Fe1zZ8-aN3nUtBxn57b9VtqT453WbwuSa0BfdD7EvzIa9taTKROEq5cgBjskP2hgXoWKxdN0qFaGDllasdLcSn1q4BNWwEji0nxE0OJLcTUVm5YIWvBA Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 853bd33662934968a17eb99b7e82be96 Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:36.536502 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/853bd33662934968a17eb99b7e82be96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853bd33662934968a17eb99b7e82be96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853bd33662934968a17eb99b7e82be96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_853bd33662934968a17eb99b7e82be96", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 853bd33662934968a17eb99b7e82be96 Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 0726b0f8a79742caa30f8b3fb556a45e Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:36.537702 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: action_args: {} Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:36.538352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.539467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5acc4259-a350-4d76-a32b-9175ced4b5a1 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:36.540461 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5acc4259-a350-4d76-a32b-9175ced4b5a1 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.238381 Jul 20 04:15:36.540461 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 190/344] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:36.544745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-001a2f58-ebe2-4bd8-b5da-fbf22d722139 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Calling method '.version_select at 0x7f839874d160>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.826248 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-001a2f58-ebe2-4bd8-b5da-fbf22d722139 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/e7d2942c-4675-41ab-b224-1cf2790673b6" status: 202 len: 0 microversion: 2.1 time: 0.285856 Jul 20 04:15:36.828932 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 191/345] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:36 2022] DELETE /compute/v2.1/os-security-groups/e7d2942c-4675-41ab-b224-1cf2790673b6 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:36.837790 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-57f6172d-8482-4707-a362-f09cd5b7ba17 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.838856 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:36.838856 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:36.872929 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-57f6172d-8482-4707-a362-f09cd5b7ba17 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/36511372" status: 202 len: 0 microversion: 2.86 time: 0.042628 Jul 20 04:15:36.874024 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 192/346] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Jul 20 04:15:36 2022] DELETE /compute/v2.1/flavors/36511372 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:15:36.881318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f839874d4c0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.893521 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:36.893521 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:36.895801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.896466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.930445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.934254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.954857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:36.956647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:36.965776 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7436c6ae-5c0e-46b1-abd4-390094d6fdf3 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.090063 Jul 20 04:15:36.966480 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 193/347] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:36.972619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5cda7bc7-7663-4c2b-a7f3-dff3d3c9210f tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.974073 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:36.974073 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:36.975453 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5cda7bc7-7663-4c2b-a7f3-dff3d3c9210f tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0726b0f8a79742caa30f8b3fb556a45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853bd33662934968a17eb99b7e82be96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5cda7bc7-7663-4c2b-a7f3-dff3d3c9210f tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Request method failure captured: Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004:15:36 HTTP/1.1 Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FlpHD7tvQlG3FJm9EboCMPCbERHdUHzc4Eqrcy5-kYw9ktvb_S0jhCOs-Fe1zZ8-aN3nUtBxn57b9VtqT453WbwuSa0BfdD7EvzIa9taTKROEq5cgBjskP2hgXoWKxdN0qFaGDllasdLcSn1q4BNWwEji0nxE0OJLcTUVm5YIWvBA Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 853bd33662934968a17eb99b7e82be96 Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:15:36.977306 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/853bd33662934968a17eb99b7e82be96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853bd33662934968a17eb99b7e82be96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/853bd33662934968a17eb99b7e82be96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_853bd33662934968a17eb99b7e82be96", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 853bd33662934968a17eb99b7e82be96 Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 0726b0f8a79742caa30f8b3fb556a45e Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:15:36.978473 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '2022-07-20 04:15:36'} Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:15:36.979068 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 04:15:36.980097 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:15:36.982277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5cda7bc7-7663-4c2b-a7f3-dff3d3c9210f tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:15:36.983321 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5cda7bc7-7663-4c2b-a7f3-dff3d3c9210f tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267 tempest-InstanceUsageAuditLogNegativeTestJSON-1249615267-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:15:36" status: 403 len: 128 microversion: 2.1 time: 0.015745 Jul 20 04:15:36.984877 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 194/348] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A15%3A36 => generated 128 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:15:36.990500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:36.991751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:36.998906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.000305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.001461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.002100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.175234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:37.186031 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-eb967fa1-0748-4ace-b20e-5be1771c7457 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1589 microversion: 2.1 time: 0.199919 Jul 20 04:15:37.187008 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 195/349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:36 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1589 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:37.219585 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-2f7ba5a6-1fb0-4ef3-95ae-6330f7a394c4 req-8cd8a5d9-ed91-4d9d-b341-929b5731c5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328dd8aa-9d14-40c7-8afd-05306640e26e", "name": "network-vif-plugged", "status": "completed", "tag": "89c6b692-291c-4b48-9870-10b30c95d138"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:37.241340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2f7ba5a6-1fb0-4ef3-95ae-6330f7a394c4 req-8cd8a5d9-ed91-4d9d-b341-929b5731c5e3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.247438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2f7ba5a6-1fb0-4ef3-95ae-6330f7a394c4 req-8cd8a5d9-ed91-4d9d-b341-929b5731c5e3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.275901 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-2f7ba5a6-1fb0-4ef3-95ae-6330f7a394c4 req-8cd8a5d9-ed91-4d9d-b341-929b5731c5e3 service nova] Creating event network-vif-plugged:89c6b692-291c-4b48-9870-10b30c95d138 for instance 328dd8aa-9d14-40c7-8afd-05306640e26e on n-h1-764486-11 Jul 20 04:15:37.295924 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-2f7ba5a6-1fb0-4ef3-95ae-6330f7a394c4 req-8cd8a5d9-ed91-4d9d-b341-929b5731c5e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097270 Jul 20 04:15:37.299253 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 196/350] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:37.309210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b6c41bd9-a8e9-481e-93a3-55850047f967 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] Calling method '.version_select at 0x7f839868cc10>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.680607 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b6c41bd9-a8e9-481e-93a3-55850047f967 tempest-SecurityGroupsTestAdminJSON-150485221 tempest-SecurityGroupsTestAdminJSON-150485221-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/77c4d8a7-b8d6-45ed-8bc0-4248ae5ef2da" status: 202 len: 0 microversion: 2.1 time: 0.378196 Jul 20 04:15:37.681440 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 197/351] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:37 2022] DELETE /compute/v2.1/os-security-groups/77c4d8a7-b8d6-45ed-8bc0-4248ae5ef2da => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:37.692556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2a90a8f1-be24-4087-bacc-c7c3c9ddd679 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.713892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:37.741047 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2a90a8f1-be24-4087-bacc-c7c3c9ddd679 tempest-FlavorMetadataValidation-1609565174 tempest-FlavorMetadataValidation-1609565174-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.058291 Jul 20 04:15:37.754469 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 198/352] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:37.760197 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f8398613c10>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.762141 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:37.762141 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:37.763819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.764599 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.799473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.802295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.852590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.854028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.861804 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ad1b56d3-0cc5-4485-865f-7975ad9b18fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105832 Jul 20 04:15:37.867991 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 199/353] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:37.873641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:37.875565 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:37.884480 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.885172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:37.886323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:37.887026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.068898 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:38.077201 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e58a163f-f565-494f-8ed4-cd070f65b67c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1313 microversion: 2.1 time: 0.207831 Jul 20 04:15:38.079627 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 200/354] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:37 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:38.084575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:38.085064 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:38.102684 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.103184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.104019 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:38.104510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:38.505694 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1ad46ce2-f7a9-43bd-ade8-0e35165ac707 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.424955 Jul 20 04:15:38.506924 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 201/355] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:15:38 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87/os-interface => generated 285 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:38.512803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8dd3bcd8-fd39-45e3-aece-be18a6d6d1d3 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] Calling method '.version_select at 0x7f83986c3f70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.541221 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8dd3bcd8-fd39-45e3-aece-be18a6d6d1d3 tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/23324744-9dbf-48e5-a117-6efe6b942873" status: 202 len: 0 microversion: 2.1 time: 1.024853 Jul 20 04:15:39.543350 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 202/356] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:38 2022] DELETE /compute/v2.1/os-security-groups/23324744-9dbf-48e5-a117-6efe6b942873 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:39.550808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d160e697-76cc-4b86-a901-7345a4e298fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f83986c3280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.554313 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:39.554313 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:39.559153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d160e697-76cc-4b86-a901-7345a4e298fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.561005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d160e697-76cc-4b86-a901-7345a4e298fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.601215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d160e697-76cc-4b86-a901-7345a4e298fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.602554 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d160e697-76cc-4b86-a901-7345a4e298fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.611206 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d160e697-76cc-4b86-a901-7345a4e298fc tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.066376 Jul 20 04:15:39.612251 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 203/357] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:39.617081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:39.617690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:39.623914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.625151 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.626099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:39.626686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:39.697810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c87774a0-e186-4147-888f-5dec8052e899 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd/action" status: 202 len: 0 microversion: 2.1 time: 3.759609 Jul 20 04:15:39.699065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 155/358] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:35 2022] POST /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd/action => generated 0 bytes in 3762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:39.707232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e94049e-1b60-438e-861f-1475b3e9102a tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] Calling method '.version_select at 0x7f8398331b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.116255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e94049e-1b60-438e-861f-1475b3e9102a tempest-SecurityGroupsTestAdminJSON-2110364021 tempest-SecurityGroupsTestAdminJSON-2110364021-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/0b478748-d95f-4b07-a55f-c6d5cf700f11" status: 202 len: 0 microversion: 2.1 time: 0.412719 Jul 20 04:15:40.117390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 156/359] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:15:39 2022] DELETE /compute/v2.1/os-security-groups/0b478748-d95f-4b07-a55f-c6d5cf700f11 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:40.126699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4360493-580f-41db-9822-19d2570af673 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f8398331f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.128035 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:40.128035 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:40.129590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4360493-580f-41db-9822-19d2570af673 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.131751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4360493-580f-41db-9822-19d2570af673 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.138261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:40.151284 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a69059ed-d9cc-4f59-abcd-60b7485196c4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1463 microversion: 2.1 time: 0.537771 Jul 20 04:15:40.151867 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 204/360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:39 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1463 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:40.164619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.165443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.171519 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4360493-580f-41db-9822-19d2570af673 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.044752 Jul 20 04:15:40.182933 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 157/361] 10.222.0.49 () {58 vars in 1178 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:40.184389 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.185068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.186178 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.187303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.745956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:40.746573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:40.761916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.763787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:40.766503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:40.768265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.102657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:41.117794 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c95e67e3-0ae8-4e3b-b20e-63317ea252ce tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.964859 Jul 20 04:15:41.121289 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 205/362] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.132644 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f83988c5f70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.136223 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:41.136223 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:41.137871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.138443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.174439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.175881 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.204184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.205008 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.215595 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-085840a5-23de-4009-a13a-206cda06f85d tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.092990 Jul 20 04:15:41.219710 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 206/363] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:41.231013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dfac3d31-8914-4240-aeeb-325a58110fac tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f83988c5700>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.234720 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:41.234720 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:41.238523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfac3d31-8914-4240-aeeb-325a58110fac tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.240293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfac3d31-8914-4240-aeeb-325a58110fac tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.269127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfac3d31-8914-4240-aeeb-325a58110fac tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.271007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dfac3d31-8914-4240-aeeb-325a58110fac tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.283520 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dfac3d31-8914-4240-aeeb-325a58110fac tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.057500 Jul 20 04:15:41.286589 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 207/364] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:41.299162 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-760c2e64-559e-45ff-a97e-54eca2789fb7 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f83986130d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.301879 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:41.301879 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:41.309139 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-760c2e64-559e-45ff-a97e-54eca2789fb7 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.311061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-760c2e64-559e-45ff-a97e-54eca2789fb7 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.330309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-760c2e64-559e-45ff-a97e-54eca2789fb7 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.331119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-760c2e64-559e-45ff-a97e-54eca2789fb7 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.349149 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-760c2e64-559e-45ff-a97e-54eca2789fb7 tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.054139 Jul 20 04:15:41.350284 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 208/365] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:41.363439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Calling method '.version_select at 0x7f83988c51f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:41.364523 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:41.364523 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:41.366127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.366858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.384260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.385646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.398585 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.400007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.447374 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-45245035-cb7f-4468-8519-5eb7e4ef2bcd tempest-HypervisorAdminTestJSON-1059406762 tempest-HypervisorAdminTestJSON-1059406762-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.089125 Jul 20 04:15:41.450860 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 209/366] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Jul 20 04:15:41 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:15:41.506187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e566d8d-82bd-44bd-9ee3-2606638c1d8b tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1616 microversion: 2.1 time: 1.323515 Jul 20 04:15:41.507652 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 158/367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:40 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1616 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:41.531518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:41.533278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:41.566891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.568843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:41.571286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:41.572829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.138123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.140904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.154406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.156125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.160768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.165032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.567955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.578104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e72a09ef-9699-4a99-8fbb-7df102e84a0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.443213 Jul 20 04:15:42.580514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 159/368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:42.587880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:42.588774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:42.599395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.600266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.601528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.602613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.852221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:42.862385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c65ba96-72a5-449b-b506-b7b3eaa8f700 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 200 len: 1589 microversion: 2.1 time: 0.278140 Jul 20 04:15:42.862980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 160/369] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:42 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 1589 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:42.875829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-475bf4d0-1646-410b-88cd-3f1b87086817 req-ce8fa470-7d4e-408f-bb61-add07f1b991a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0842d27-0ea4-4e23-8321-c75d8126da87", "tag": "f319198d-e04b-46c7-95ef-23ee0048fe7f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:42.902090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-475bf4d0-1646-410b-88cd-3f1b87086817 req-ce8fa470-7d4e-408f-bb61-add07f1b991a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:42.903536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-475bf4d0-1646-410b-88cd-3f1b87086817 req-ce8fa470-7d4e-408f-bb61-add07f1b991a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:42.935562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-475bf4d0-1646-410b-88cd-3f1b87086817 req-ce8fa470-7d4e-408f-bb61-add07f1b991a service nova] Creating event network-changed:f319198d-e04b-46c7-95ef-23ee0048fe7f for instance a0842d27-0ea4-4e23-8321-c75d8126da87 on n-h1-764486-11 Jul 20 04:15:42.950572 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-475bf4d0-1646-410b-88cd-3f1b87086817 req-ce8fa470-7d4e-408f-bb61-add07f1b991a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083006 Jul 20 04:15:42.956186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 161/370] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:43.394978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '46f6ec98db4f47ff8fc204535ebda46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d24145bb42e47f690aebce383d0a065', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:43.395711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] flavor_id is None. Assuming migration. {{(pid=123723) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:15:43.396795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:15:43.423749 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:43.598317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:43.598963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:43.613434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.616301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:43.617686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:43.619970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.289609 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2119d69b-0853-4a92-9e14-6e9ddad9007e tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e/action" status: 202 len: 0 microversion: 2.1 time: 2.766429 Jul 20 04:15:44.295081 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 210/371] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:15:41 2022] POST /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e/action => generated 0 bytes in 2774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:15:44.336966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:44.338068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:44.354328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:44.366513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c09a7eb-1def-476c-801e-e3517bbf28c1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.773213 Jul 20 04:15:44.399457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.400096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.400643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:44.401114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 162/372] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:43 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:44.417727 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:44.963780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53f03884-13fe-4654-8816-97a6c22462d8 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Action: 'update', calling method: .version_select at 0x7f8398331dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:45.524005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:45.533266 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-36f0b428-5684-43a1-8665-257873e9c226 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1472 microversion: 2.1 time: 1.233716 Jul 20 04:15:45.533595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53f03884-13fe-4654-8816-97a6c22462d8 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.534055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53f03884-13fe-4654-8816-97a6c22462d8 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.534863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53f03884-13fe-4654-8816-97a6c22462d8 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.535390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53f03884-13fe-4654-8816-97a6c22462d8 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.535658 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 211/373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:44 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1472 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:45.545822 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:45.548832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:45.574540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.575438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.579532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.580083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.580818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:45.662943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53f03884-13fe-4654-8816-97a6c22462d8 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c" status: 200 len: 148 microversion: 2.57 time: 1.097939 Jul 20 04:15:45.668986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 163/374] 10.222.0.49 () {62 vars in 1302 bytes} [Wed Jul 20 04:15:44 2022] PUT /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c => generated 148 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:45.674891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-742179fe-9e39-4a52-b80b-a91b96ae91af req-6814a949-2509-4c9e-a82b-4048955bee80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a97a688-e2f9-48fe-8a35-cac05b5a9dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "8778c0bb-598f-42c2-9839-926c9d7f74e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:45.690358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-742179fe-9e39-4a52-b80b-a91b96ae91af req-6814a949-2509-4c9e-a82b-4048955bee80 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:45.692595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-742179fe-9e39-4a52-b80b-a91b96ae91af req-6814a949-2509-4c9e-a82b-4048955bee80 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:45.714643 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-742179fe-9e39-4a52-b80b-a91b96ae91af req-6814a949-2509-4c9e-a82b-4048955bee80 service nova] Creating event network-vif-unplugged:8778c0bb-598f-42c2-9839-926c9d7f74e1 for instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd on n-h2-764486-11 Jul 20 04:15:45.720397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-742179fe-9e39-4a52-b80b-a91b96ae91af req-6814a949-2509-4c9e-a82b-4048955bee80 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049920 Jul 20 04:15:45.721585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 164/375] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:45.727132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a0b6075-c41d-4ed1-a2f8-6bcf520a4a4a tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Calling method '.version_select at 0x7f83983311f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:45.915474 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:45.923264 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3f27649d-1b2c-4675-84e2-5c26ca6a5354 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.384060 Jul 20 04:15:45.929585 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 212/376] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:45 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:46.497429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fd8bdf0c-dc29-4058-ad3b-8e83b0142ac4 tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-494313868", "id": 1123797151, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:46.500510 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:46.500510 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:46.547390 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fd8bdf0c-dc29-4058-ad3b-8e83b0142ac4 tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.605733 Jul 20 04:15:46.548958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0b6075-c41d-4ed1-a2f8-6bcf520a4a4a tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.552487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0b6075-c41d-4ed1-a2f8-6bcf520a4a4a tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.553961 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 213/377] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:15:45 2022] POST /compute/v2.1/flavors => generated 448 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:46.555834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0b6075-c41d-4ed1-a2f8-6bcf520a4a4a tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.560547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0b6075-c41d-4ed1-a2f8-6bcf520a4a4a tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.570851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.576395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.593547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.594007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.602593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.603054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.646623 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a0b6075-c41d-4ed1-a2f8-6bcf520a4a4a tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c/detail" status: 200 len: 463 microversion: 2.57 time: 0.921878 Jul 20 04:15:46.647979 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 165/378] 10.222.0.49 () {60 vars in 1303 bytes} [Wed Jul 20 04:15:45 2022] GET /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c/detail => generated 463 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:46.785695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:46.796278 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-12ada071-cf09-4b61-8db2-9b8767f583ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1472 microversion: 2.1 time: 0.240170 Jul 20 04:15:46.807623 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 214/379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:46.940918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.941880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:46.953988 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.954647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.957611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:46.958226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:46.981939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-778fe5bd-212b-4f85-a808-4054ad483b0a tempest-FlavorsV255TestJSON-1038170400 tempest-FlavorsV255TestJSON-1038170400-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:46.999659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-778fe5bd-212b-4f85-a808-4054ad483b0a tempest-FlavorsV255TestJSON-1038170400 tempest-FlavorsV255TestJSON-1038170400-project] 10.222.0.49 "GET /compute/v2.1/flavors/1123797151" status: 200 len: 448 microversion: 2.55 time: 0.348675 Jul 20 04:15:47.001115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 166/380] 10.222.0.49 () {60 vars in 1198 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/flavors/1123797151 => generated 448 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:47.012414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1c60f38-09dd-4ce5-8e0b-9f879a0e03ee tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] Action: 'update', calling method: .version_select at 0x7f839a9d2b80>, body: {"flavor": {"description": "new"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:47.031755 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:47.031755 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:47.047938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:47.103233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1c60f38-09dd-4ce5-8e0b-9f879a0e03ee tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1123797151" status: 200 len: 449 microversion: 2.55 time: 0.094321 Jul 20 04:15:47.105732 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 167/381] 10.222.0.49 () {62 vars in 1218 bytes} [Wed Jul 20 04:15:47 2022] PUT /compute/v2.1/flavors/1123797151 => generated 449 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:15:47.117746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d6000fb-f058-4038-9f07-473c0318591b tempest-FlavorsV255TestJSON-1038170400 tempest-FlavorsV255TestJSON-1038170400-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.176326 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d6000fb-f058-4038-9f07-473c0318591b tempest-FlavorsV255TestJSON-1038170400 tempest-FlavorsV255TestJSON-1038170400-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6594 microversion: 2.55 time: 0.063113 Jul 20 04:15:47.176976 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 168/382] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/flavors/detail => generated 6594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:47.193519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce79029e-d057-46d2-8dc7-d3d9127815e7 tempest-FlavorsV255TestJSON-1038170400 tempest-FlavorsV255TestJSON-1038170400-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.222423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce79029e-d057-46d2-8dc7-d3d9127815e7 tempest-FlavorsV255TestJSON-1038170400 tempest-FlavorsV255TestJSON-1038170400-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.55 time: 0.032973 Jul 20 04:15:47.223551 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 169/383] 10.222.0.49 () {60 vars in 1165 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:47.240257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0810b98b-7329-424e-84aa-04f595293199 tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.241625 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:47.241625 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:47.267958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0810b98b-7329-424e-84aa-04f595293199 tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1123797151" status: 202 len: 0 microversion: 2.55 time: 0.032551 Jul 20 04:15:47.269219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 170/384] 10.222.0.49 () {60 vars in 1201 bytes} [Wed Jul 20 04:15:47 2022] DELETE /compute/v2.1/flavors/1123797151 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:15:47.287037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abe27d31-08b6-4678-af31-3b60256584fa tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:47.321391 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abe27d31-08b6-4678-af31-3b60256584fa tempest-FlavorsV255TestJSON-1399128770 tempest-FlavorsV255TestJSON-1399128770-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.048075 Jul 20 04:15:47.323582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 171/385] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:47.349811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:47.361448 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-19e61787-b315-4316-bc05-b7b93b7a8f3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.424316 Jul 20 04:15:47.362467 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 215/386] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:46 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:47.520211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Action: 'update', calling method: .version_select at 0x7f83985c78b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:48.183685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.184804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.185930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.192320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.260203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2c70d6af-f358-4b02-a4cc-febc02c07058 tempest-ListImagesTestJSON-1647305174 tempest-ListImagesTestJSON-1647305174-project] Calling method '.version_select at 0x7f83984eb280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.291811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.292506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.294666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.295411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.356122 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2c70d6af-f358-4b02-a4cc-febc02c07058 tempest-ListImagesTestJSON-1647305174 tempest-ListImagesTestJSON-1647305174-project] 10.222.0.49 "GET /compute/v2.1/images/015a4084-97ff-4146-83ba-116b77f93e6a" status: 200 len: 784 microversion: 2.1 time: 0.651063 Jul 20 04:15:48.361051 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 216/387] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:15:47 2022] GET /compute/v2.1/images/015a4084-97ff-4146-83ba-116b77f93e6a => generated 784 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:48.371413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-3295c6e5-816f-4043-8f91-c8f5cf697c4d req-aa02a67d-2798-4727-b0b9-6125d07fe172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a97a688-e2f9-48fe-8a35-cac05b5a9dfd", "tag": "8778c0bb-598f-42c2-9839-926c9d7f74e1"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:48.398656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3295c6e5-816f-4043-8f91-c8f5cf697c4d req-aa02a67d-2798-4727-b0b9-6125d07fe172 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.399096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3295c6e5-816f-4043-8f91-c8f5cf697c4d req-aa02a67d-2798-4727-b0b9-6125d07fe172 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.451958 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3295c6e5-816f-4043-8f91-c8f5cf697c4d req-aa02a67d-2798-4727-b0b9-6125d07fe172 service nova] Creating event network-changed:8778c0bb-598f-42c2-9839-926c9d7f74e1 for instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd on n-h2-764486-11 Jul 20 04:15:48.469555 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-3295c6e5-816f-4043-8f91-c8f5cf697c4d req-aa02a67d-2798-4727-b0b9-6125d07fe172 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106938 Jul 20 04:15:48.470352 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 217/388] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:48.480082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.480818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.485458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7453d95-d3ed-4843-bfbc-1fd79a080420 tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c?user_id=928d8e40e63b4aeb81e73838b2964ba1" status: 200 len: 148 microversion: 2.57 time: 0.970134 Jul 20 04:15:48.488470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 172/389] 10.222.0.49 () {62 vars in 1383 bytes} [Wed Jul 20 04:15:47 2022] PUT /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c?user_id=928d8e40e63b4aeb81e73838b2964ba1 => generated 148 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:15:48.495325 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.497407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.508404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0f7d9e9-0e97-4b1e-ad33-cb4fb182c52e tempest-ListImagesTestJSON-1647305174 tempest-ListImagesTestJSON-1647305174-project] Calling method '.version_select at 0x7f839832c0d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.519025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.520676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.657367 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0f7d9e9-0e97-4b1e-ad33-cb4fb182c52e tempest-ListImagesTestJSON-1647305174 tempest-ListImagesTestJSON-1647305174-project] 10.222.0.49 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.166253 Jul 20 04:15:48.657944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 173/390] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/images => generated 445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:48.671455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:48.672124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:48.695729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.696243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:48.697311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:48.699754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:49.103334 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.117215 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d9159354-5862-4a0a-b39f-d45931507434 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1472 microversion: 2.1 time: 0.642935 Jul 20 04:15:49.130090 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 218/391] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1472 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.132018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:49.135842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4c68912f-a737-4c29-afdc-dc4808626c0f tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] Calling method '.version_select at 0x7f83986131f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.140240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4285160b-8ce0-47b1-b06d-e67f06a8bb65 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.480735 Jul 20 04:15:49.140840 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 174/392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:48 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:49.154048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef0590d7-f711-4399-8875-93c9cdf9b9f1 tempest-ListImagesTestJSON-1647305174 tempest-ListImagesTestJSON-1647305174-project] Calling method '.version_select at 0x7f8398299af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:49.257693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef0590d7-f711-4399-8875-93c9cdf9b9f1 tempest-ListImagesTestJSON-1647305174 tempest-ListImagesTestJSON-1647305174-project] 10.222.0.49 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.112219 Jul 20 04:15:49.266394 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 175/393] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:49.604089 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4c68912f-a737-4c29-afdc-dc4808626c0f tempest-QuotasAdminTestV257-436692302 tempest-QuotasAdminTestV257-436692302-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c?user_id=928d8e40e63b4aeb81e73838b2964ba1" status: 200 len: 190 microversion: 2.57 time: 0.471637 Jul 20 04:15:49.605744 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 219/394] 10.222.0.49 () {60 vars in 1363 bytes} [Wed Jul 20 04:15:49 2022] GET /compute/v2.1/os-quota-sets/f891be0b0bd94e1eab52f2827662eb7c?user_id=928d8e40e63b4aeb81e73838b2964ba1 => generated 190 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:50.135730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.136323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.150529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.152270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.152270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.152270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.159543 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:50.160508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:50.182745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.183200 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.183983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:50.184431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:50.681248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.691631 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b641cbc6-bada-4fe3-b53e-684701e6a4f1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.537935 Jul 20 04:15:50.695598 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 220/395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:50.889135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:50.901443 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87a73153-0daa-43c2-85ca-63fd73259d6d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1472 microversion: 2.1 time: 0.769720 Jul 20 04:15:50.905472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 176/396] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:50 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1472 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:51.713595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.714193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:51.724463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.726593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.727544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.728127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.848021 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Calling method '.version_select at 0x7f839862a0d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:51.849423 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:51.849423 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:51.851201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.851649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.887610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.888263 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.948391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.948892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.961808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.962458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:51.987678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:51.988769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.003794 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1b03da84-e3ff-4a8c-a22f-4b1160f1c774 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.438594 Jul 20 04:15:52.007796 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 221/397] 10.222.0.49 () {60 vars in 1242 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:52.013634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.015254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:52.024675 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:52.026488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.027290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.028809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.029414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.126860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.133265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:52.139782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ef69b68-fb4e-4c57-9866-19184c9f1847 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.427136 Jul 20 04:15:52.150630 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 177/398] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:51 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:52.158445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Calling method '.version_select at 0x7f839832c040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.159994 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:52.159994 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:52.161466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.162097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.186687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.187429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.223042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.223945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.239226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:52.250037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.250687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.255727 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-45d52a92-2c2a-4c32-b97c-70828217d9fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.245696 Jul 20 04:15:52.271748 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 222/399] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:52.286486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.286962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.293756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40d65e55-9b13-44ff-aac3-674ffba5dc28 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.141555 Jul 20 04:15:52.294362 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 178/400] 10.222.0.49 () {60 vars in 1221 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:52.317746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2cf2a65a-16bf-4b30-9ca4-d68df2a043a2 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Calling method '.version_select at 0x7f83984a5670>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:52.320479 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:52.320479 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:52.323933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cf2a65a-16bf-4b30-9ca4-d68df2a043a2 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.330305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cf2a65a-16bf-4b30-9ca4-d68df2a043a2 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.378969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cf2a65a-16bf-4b30-9ca4-d68df2a043a2 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.379341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cf2a65a-16bf-4b30-9ca4-d68df2a043a2 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.391060 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2cf2a65a-16bf-4b30-9ca4-d68df2a043a2 tempest-HypervisorAdminV253TestBase-1253682925 tempest-HypervisorAdminV253TestBase-1253682925-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/b31430f1-c63d-47dd-a1c8-16bcb332e659" status: 200 len: 794 microversion: 2.53 time: 0.087312 Jul 20 04:15:52.391996 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 223/401] 10.222.0.49 () {60 vars in 1297 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/os-hypervisors/b31430f1-c63d-47dd-a1c8-16bcb332e659 => generated 794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:52.523374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-19e174d5-09de-4953-b712-f5c1b3178d45 req-d6db8689-1a26-4cc1-8a99-d1e0bc208b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a97a688-e2f9-48fe-8a35-cac05b5a9dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "8778c0bb-598f-42c2-9839-926c9d7f74e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:52.537451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19e174d5-09de-4953-b712-f5c1b3178d45 req-d6db8689-1a26-4cc1-8a99-d1e0bc208b3a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:52.537894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19e174d5-09de-4953-b712-f5c1b3178d45 req-d6db8689-1a26-4cc1-8a99-d1e0bc208b3a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:52.565718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-19e174d5-09de-4953-b712-f5c1b3178d45 req-d6db8689-1a26-4cc1-8a99-d1e0bc208b3a service nova] Creating event network-vif-unplugged:8778c0bb-598f-42c2-9839-926c9d7f74e1 for instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd on n-h2-764486-11 Jul 20 04:15:52.586032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-19e174d5-09de-4953-b712-f5c1b3178d45 req-d6db8689-1a26-4cc1-8a99-d1e0bc208b3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057363 Jul 20 04:15:52.586686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 179/402] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.159677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.160560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.172745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.173205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.173994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.177303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.501133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9460c435-000a-4fec-8807-78598f8fa552 tempest-AbsoluteLimitsTestJSON-2136492226 tempest-AbsoluteLimitsTestJSON-2136492226-project] Calling method '.version_select at 0x7f83984a5f70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.512299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9460c435-000a-4fec-8807-78598f8fa552 tempest-AbsoluteLimitsTestJSON-2136492226 tempest-AbsoluteLimitsTestJSON-2136492226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.513136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9460c435-000a-4fec-8807-78598f8fa552 tempest-AbsoluteLimitsTestJSON-2136492226 tempest-AbsoluteLimitsTestJSON-2136492226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.514205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9460c435-000a-4fec-8807-78598f8fa552 tempest-AbsoluteLimitsTestJSON-2136492226 tempest-AbsoluteLimitsTestJSON-2136492226-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.514881 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9460c435-000a-4fec-8807-78598f8fa552 tempest-AbsoluteLimitsTestJSON-2136492226 tempest-AbsoluteLimitsTestJSON-2136492226-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.542667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.547208 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9460c435-000a-4fec-8807-78598f8fa552 tempest-AbsoluteLimitsTestJSON-2136492226 tempest-AbsoluteLimitsTestJSON-2136492226-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.661199 Jul 20 04:15:53.549053 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 224/403] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 20 04:15:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:53.554637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:53.555988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ecf008d4-4222-4076-9e44-46eaa321f2d1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1502 microversion: 2.1 time: 0.402048 Jul 20 04:15:53.556795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:53.568482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 180/404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:53.573683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.574564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.575597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:53.586265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:53.948985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:53.961337 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-12a06a3b-ed79-420b-abdf-4b348071714b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.410569 Jul 20 04:15:53.961933 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 225/405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:53 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:54.578008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:54.579165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:54.594379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.597073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:54.598322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:54.598997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.044043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.055322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b065a35e-d6fa-4682-9986-151c96cb09b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1492 microversion: 2.1 time: 0.483102 Jul 20 04:15:55.056582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 181/406] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:54 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1492 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.061581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.069970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.085247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.086893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.087955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.088608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.307954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6297cbcc-c3c8-40b7-ae99-7a62cb28702a tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-43066816", "id": 57749567, "os-flavor-access:is_public": "True"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:55.313833 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:55.313833 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:15:55.353237 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6297cbcc-c3c8-40b7-ae99-7a62cb28702a tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 460 microversion: 2.61 time: 0.640830 Jul 20 04:15:55.355229 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 226/407] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:15:54 2022] POST /compute/v2.1/flavors => generated 460 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:15:55.367213 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-69f672cb-fe4e-49f4-974f-802fda8b9d32 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '.version_select at 0x7f83984730d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.374943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69f672cb-fe4e-49f4-974f-802fda8b9d32 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.376903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69f672cb-fe4e-49f4-974f-802fda8b9d32 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.424821 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-69f672cb-fe4e-49f4-974f-802fda8b9d32 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 799 microversion: 2.1 time: 0.064143 Jul 20 04:15:55.426169 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 227/408] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/os-migrations => generated 799 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:15:55.523006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:55.536088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72fa9f09-3dbc-42ed-ae4b-2728e825d00d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.478046 Jul 20 04:15:55.537902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 182/409] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:55.549883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:55.550658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:55.567057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.567799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.570018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:55.572175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:55.866573 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4fa6775-d2c5-4d9a-934b-8c0fee7eb7bd tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1645 microversion: 2.1 time: 0.327157 Jul 20 04:15:55.878917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 183/410] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1645 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.019443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ba0f82ed-eaae-4d22-b86b-19402b4a19b1 tempest-FlavorsV261TestJSON-46725262 tempest-FlavorsV261TestJSON-46725262-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.032333 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ba0f82ed-eaae-4d22-b86b-19402b4a19b1 tempest-FlavorsV261TestJSON-46725262 tempest-FlavorsV261TestJSON-46725262-project] 10.222.0.49 "GET /compute/v2.1/flavors/57749567" status: 200 len: 460 microversion: 2.61 time: 0.604260 Jul 20 04:15:56.033921 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 228/411] 10.222.0.49 () {60 vars in 1192 bytes} [Wed Jul 20 04:15:55 2022] GET /compute/v2.1/flavors/57749567 => generated 460 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:56.046520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-921e2aba-207d-4bb5-a605-21cb021dce07 tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:56.048282 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:56.048282 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:56.094058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-921e2aba-207d-4bb5-a605-21cb021dce07 tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/57749567" status: 200 len: 461 microversion: 2.61 time: 0.052485 Jul 20 04:15:56.100607 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 184/412] 10.222.0.49 () {62 vars in 1212 bytes} [Wed Jul 20 04:15:56 2022] PUT /compute/v2.1/flavors/57749567 => generated 461 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:15:56.107446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16b6fcb8-5a16-47c9-bc33-55a9ddcb9866 tempest-FlavorsV261TestJSON-46725262 tempest-FlavorsV261TestJSON-46725262-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.140654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-16b6fcb8-5a16-47c9-bc33-55a9ddcb9866 tempest-FlavorsV261TestJSON-46725262 tempest-FlavorsV261TestJSON-46725262-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 7150 microversion: 2.61 time: 0.037318 Jul 20 04:15:56.154575 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 229/413] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/flavors/detail => generated 7150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:56.159927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4cf9f74-c270-485d-b3f6-f81af662dff6 tempest-FlavorsV261TestJSON-46725262 tempest-FlavorsV261TestJSON-46725262-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.187353 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4cf9f74-c270-485d-b3f6-f81af662dff6 tempest-FlavorsV261TestJSON-46725262 tempest-FlavorsV261TestJSON-46725262-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3677 microversion: 2.61 time: 0.031545 Jul 20 04:15:56.188482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 185/414] 10.222.0.49 () {60 vars in 1165 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/flavors => generated 3677 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:15:56.204997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1397704699", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "7e6d563b-6d30-4058-9507-057aaaf62886"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:15:56.213217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a372daf-1a6a-4fff-bf83-ec10c4976f47 tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.214022 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:15:56.214022 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:15:56.243768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a372daf-1a6a-4fff-bf83-ec10c4976f47 tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/57749567" status: 202 len: 0 microversion: 2.61 time: 0.044199 Jul 20 04:15:56.246272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 186/415] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Jul 20 04:15:56 2022] DELETE /compute/v2.1/flavors/57749567 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:15:56.258000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2df43a8d-604e-4c81-93fc-ca13b5f6a9c6 tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.291432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] validate_networks() for [('7e6d563b-6d30-4058-9507-057aaaf62886', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:15:56.300798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2df43a8d-604e-4c81-93fc-ca13b5f6a9c6 tempest-FlavorsV261TestJSON-282503503 tempest-FlavorsV261TestJSON-282503503-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6699 microversion: 2.61 time: 0.050369 Jul 20 04:15:56.301737 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 187/416] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/flavors/detail => generated 6699 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:15:56.555579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:56.557261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:56.568002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.568707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.569999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.570435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.814933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:56.829970 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58b17af3-df71-48c7-95cb-f265e6b8df77 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.279472 Jul 20 04:15:56.830836 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 188/417] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:56 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:56.887103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:15:56.887581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:15:56.888115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:15:56.888610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:15:56.889665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:15:56.906414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.907081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.907964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:56.908280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:56.928848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:15:56.933900 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for user ab72bd0852ad4f72a0c96a7ddf1bdd63 and project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:15:56.953930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:15:56.957094 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:15:57.021368 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-73fbd3d0-a9a3-4480-a32c-bf8ac2156a14 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820644 Jul 20 04:15:57.022790 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 230/418] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:15:57.034351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b42c7f80-a66b-4151-af47-dbb2c1736278 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.035010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b42c7f80-a66b-4151-af47-dbb2c1736278 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.113495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b42c7f80-a66b-4151-af47-dbb2c1736278 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:57.121230 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b42c7f80-a66b-4151-af47-dbb2c1736278 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1211 microversion: 2.1 time: 0.092137 Jul 20 04:15:57.124585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 189/419] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:57.847925 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:57.848571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:57.855408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.856073 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:57.857021 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:57.857732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.032624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.043146 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-24e2b5e8-1c86-4600-a81b-b4ac6f88c615 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.198707 Jul 20 04:15:58.044670 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 231/420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:57 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:58.141857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:58.143082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:58.158618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.161469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.162516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:58.162966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:58.257709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:58.269835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05d603cf-4b1b-471f-a865-60b1243c4904 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1271 microversion: 2.1 time: 0.133379 Jul 20 04:15:58.271053 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 190/421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:58 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:15:59.061417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.062897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.072506 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.076074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.079134 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.079580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.287690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:15:59.288311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:15:59.290403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:59.303135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=6,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:15:59.309200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.309814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.310765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:15:59.311348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:15:59.522317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.532628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ea3f91d-5a00-4e53-84d4-be68d192b04a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.249097 Jul 20 04:15:59.534059 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 191/422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:15:59.561058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:15:59.572457 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8bb01c92-c37b-4a48-ac78-efdad02afb3b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.514488 Jul 20 04:15:59.583281 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 232/423] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:15:59 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:00.011994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1635644619", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:00.124740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:00.467865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:00.468439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:00.468918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:00.469322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:00.469885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:00.491219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.491856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.493690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.496557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.553191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Getting quotas for project 3e8fd4a2e38a49f0b5cfee6b05fbc839. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:00.559610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Getting quotas for user dbadb724dcf54d1c8f00f6752b86ab1f and project 3e8fd4a2e38a49f0b5cfee6b05fbc839. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:00.577428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:00.581202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:00.630392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6622d57d-e1e4-4c06-bc86-0c27c7c1f3ef tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] Calling method '.version_select at 0x7f83984a5670>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.631206 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:00.631206 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:16:00.653794 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6622d57d-e1e4-4c06-bc86-0c27c7c1f3ef tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.229644 Jul 20 04:16:00.660760 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 233/424] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:00.665620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.666238 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.679678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-159434b9-e38a-4d64-a498-91e02c1a96ba tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143760 Jul 20 04:16:00.682362 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 192/425] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:00.691071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.691620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.692208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:00.692431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.692858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:00.693344 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.712109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.712616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.713493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:00.713932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:00.735265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:01.045065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.056195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd4f3d76-bef0-4b91-86cb-89eb6031717e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.372699 Jul 20 04:16:01.058080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 193/426] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.063572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a507ccd9-5cdc-4911-b96c-fc461766b66e tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] Action: 'update', calling method: .version_select at 0x7f8398331940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.065869 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:01.065869 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:16:01.218915 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.233090 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-396020fb-6d36-4231-b229-60e6b435ee7c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.569544 Jul 20 04:16:01.236391 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 234/427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:00 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.253332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fbe6a8f5-b688-4994-a968-3b99323d3540 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.260510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fbe6a8f5-b688-4994-a968-3b99323d3540 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:01.481513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fbe6a8f5-b688-4994-a968-3b99323d3540 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:01.503836 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fbe6a8f5-b688-4994-a968-3b99323d3540 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1223 microversion: 2.1 time: 0.261474 Jul 20 04:16:01.506933 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 235/428] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:01.526175 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-2b3c99ac-d57a-4faa-9361-02f20c678cda req-66d5a3e9-c783-4849-8548-c2dfe509e416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2215a044-6be8-4af3-810e-76862c594dd2", "tag": "dd47674e-ff11-45c0-9804-2c6b2eb82b22"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.578000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2b3c99ac-d57a-4faa-9361-02f20c678cda req-66d5a3e9-c783-4849-8548-c2dfe509e416 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:01.580476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a507ccd9-5cdc-4911-b96c-fc461766b66e tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.520955 Jul 20 04:16:01.583896 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2b3c99ac-d57a-4faa-9361-02f20c678cda req-66d5a3e9-c783-4849-8548-c2dfe509e416 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:01.585263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 194/429] 10.222.0.49 () {60 vars in 1205 bytes} [Wed Jul 20 04:16:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.597245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acf0115d-8323-41de-91a0-10577ef376aa tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] Calling method '.version_select at 0x7f8398299550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:01.600189 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:01.600189 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:16:01.622054 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-2b3c99ac-d57a-4faa-9361-02f20c678cda req-66d5a3e9-c783-4849-8548-c2dfe509e416 service nova] Creating event network-changed:dd47674e-ff11-45c0-9804-2c6b2eb82b22 for instance 2215a044-6be8-4af3-810e-76862c594dd2 on n-h2-764486-11 Jul 20 04:16:01.640193 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-2b3c99ac-d57a-4faa-9361-02f20c678cda req-66d5a3e9-c783-4849-8548-c2dfe509e416 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131498 Jul 20 04:16:01.640843 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 236/430] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.641322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acf0115d-8323-41de-91a0-10577ef376aa tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.049399 Jul 20 04:16:01.642210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 195/431] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:16:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:01.663491 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e6fbab51-0b8c-4880-b89d-e9a968560ea1 tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] Action: 'update', calling method: .version_select at 0x7f8398473ca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:01.665333 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:01.665333 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:16:01.917421 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e6fbab51-0b8c-4880-b89d-e9a968560ea1 tempest-QuotaClassesAdminTestJSON-324303844 tempest-QuotaClassesAdminTestJSON-324303844-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.266853 Jul 20 04:16:01.918328 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 237/432] 10.222.0.49 () {60 vars in 1205 bytes} [Wed Jul 20 04:16:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:02.187382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd06c98e-0a1f-4446-abd2-811a6bc71424 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Action: 'create', calling method: .version_select at 0x7f8398283c10>, body: {"keypair": {"name": "tempest-keypair-436953955", "type": "ssh", "user_id": "854eae12d619464eb1d21a0816c0be0e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKan9nJvhuQB79JzfKiaqM+TkzpdJf1zfMeW4l3U4di2zmZc/sfpu1tsEJ/HidZ5o+F7f+VBZeyUmX3bx8i7Z4Py8WphIRngAvZJGjxZUOaC8oItBrtuwP3KlIuoIyGMpA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:02.212145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cd06c98e-0a1f-4446-abd2-811a6bc71424 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Getting quotas for project d9a2c4f98f3647be98c9f7e29be4e2df. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:02.221586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cd06c98e-0a1f-4446-abd2-811a6bc71424 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Getting quotas for user ebebeee1e7a4475f8b7fd0ac055ff0f9 and project d9a2c4f98f3647be98c9f7e29be4e2df. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:02.237490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1740095356", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": "none"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:02.255949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd06c98e-0a1f-4446-abd2-811a6bc71424 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.268099 Jul 20 04:16:02.257584 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 196/433] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:16:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:16:02.262836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.264262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.271401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.271858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.272805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.273241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.314754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:02.315643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:02.316217 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:02.316888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:02.317773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:02.328755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.329534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.330938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.333596 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.359251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Getting quotas for project 18b7891fdfc746169e65b26e1e704be5. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:02.365899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Getting quotas for user f9e1e6781fa647a6bdff4b890f021774 and project 18b7891fdfc746169e65b26e1e704be5. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:02.399567 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:02.409369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:02.518940 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-af755238-a20d-4024-a558-172367b2fa00 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.501014 Jul 20 04:16:02.519884 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 238/434] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:16:02.525913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.527233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.536238 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.537528 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.538737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.539386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.575387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.591172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6c6ec62-a425-4ea4-b8a5-7b10001a0c57 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.332103 Jul 20 04:16:02.592934 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 197/435] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:02.598839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb48795e-c6bc-41c1-aa4d-0d48d8a4f9a5 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Action: 'create', calling method: .version_select at 0x7f83985c7310>, body: {"keypair": {"name": "tempest-keypair-1306508810", "type": "ssh", "user_id": "854eae12d619464eb1d21a0816c0be0e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7V2Ik32idhwoaUJBU72oryTeXs3Qc33wsFweTUqduTYv3BdIluAUa4ewjjMNMmh/Ca+7ZbRxloUhRmXENOJT7QdE7mzzkeAJ1tKa6vRrVlBOH5pDOVVY/0+/gF/zU99Q=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:02.616061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fb48795e-c6bc-41c1-aa4d-0d48d8a4f9a5 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Getting quotas for project d9a2c4f98f3647be98c9f7e29be4e2df. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:02.622679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fb48795e-c6bc-41c1-aa4d-0d48d8a4f9a5 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Getting quotas for user ebebeee1e7a4475f8b7fd0ac055ff0f9 and project d9a2c4f98f3647be98c9f7e29be4e2df. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:02.657531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb48795e-c6bc-41c1-aa4d-0d48d8a4f9a5 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.062450 Jul 20 04:16:02.658789 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 198/436] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:16:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:16:02.665088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:02.666306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.688583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.689034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.689827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:02.690435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:02.851749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:02.863668 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91517270-38cf-4069-b4af-37d77d2de78a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1293 microversion: 2.1 time: 0.203364 Jul 20 04:16:02.864628 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 199/437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:02.875889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-101838e1-55f8-451f-ad8b-3686114f4cd7 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:02.883232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-101838e1-55f8-451f-ad8b-3686114f4cd7 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:02.909344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=12,nova_api:UPDATE=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:03.007477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-101838e1-55f8-451f-ad8b-3686114f4cd7 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.019677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-101838e1-55f8-451f-ad8b-3686114f4cd7 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.021376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-101838e1-55f8-451f-ad8b-3686114f4cd7 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.037788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-101838e1-55f8-451f-ad8b-3686114f4cd7 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "PUT /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1359 microversion: 2.75 time: 0.167170 Jul 20 04:16:03.058416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 200/438] 10.222.0.49 () {62 vars in 1296 bytes} [Wed Jul 20 04:16:02 2022] PUT /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:03.068026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eda79e29-694d-4283-b766-c76bbf1c64a1 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Calling method '.version_select at 0x7f8398247ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.088287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eda79e29-694d-4283-b766-c76bbf1c64a1 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-436953955?user_id=854eae12d619464eb1d21a0816c0be0e" status: 200 len: 511 microversion: 2.10 time: 0.027888 Jul 20 04:16:03.098754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 201/439] 10.222.0.49 () {60 vars in 1336 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-436953955?user_id=854eae12d619464eb1d21a0816c0be0e => generated 511 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:03.098754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f971825-2d6d-462c-91ce-b0ba171da844 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.098754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f971825-2d6d-462c-91ce-b0ba171da844 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.215989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f971825-2d6d-462c-91ce-b0ba171da844 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.228156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f971825-2d6d-462c-91ce-b0ba171da844 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.229909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f971825-2d6d-462c-91ce-b0ba171da844 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.237585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f971825-2d6d-462c-91ce-b0ba171da844 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1359 microversion: 2.75 time: 0.147499 Jul 20 04:16:03.239707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 202/440] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:03.246059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd652593-7872-4e1b-a87b-7d8572571199 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Action: 'create', calling method: .version_select at 0x7f839826cf70>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1948773", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtcoL8z+IyiMYcMKibSc5VIlgTaY50StIbNq76UAJmMQm2N+VwM/mk6ZpsT8o42amkNkP5gGclPaxt34io8E1chjPYOxDzgrb9/EMm42IRraWVUcAsKiBxvEypmU2d7hQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:03.266571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-dd652593-7872-4e1b-a87b-7d8572571199 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Getting quotas for project d9a2c4f98f3647be98c9f7e29be4e2df. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:03.273785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-dd652593-7872-4e1b-a87b-7d8572571199 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Getting quotas for user ebebeee1e7a4475f8b7fd0ac055ff0f9 and project d9a2c4f98f3647be98c9f7e29be4e2df. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:03.289763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.298990 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-da4d5614-42f2-40ef-af84-3436c7f43f9d tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.777739 Jul 20 04:16:03.303994 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 239/441] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:02 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:03.311075 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd652593-7872-4e1b-a87b-7d8572571199 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.10 time: 0.069316 Jul 20 04:16:03.322332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e5208521-9118-4089-b864-2698f6bad309 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Calling method '.version_select at 0x7f83984180d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.325084 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 203/442] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:16:03 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:16:03.326631 n-d-764486-11 devstack@n-api.service[123723]: WARNING oslo_db.sqlalchemy.utils [None req-e5208521-9118-4089-b864-2698f6bad309 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:16:03.345244 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e5208521-9118-4089-b864-2698f6bad309 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs?user_id=854eae12d619464eb1d21a0816c0be0e" status: 200 len: 725 microversion: 2.10 time: 0.026832 Jul 20 04:16:03.346430 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 240/443] 10.222.0.49 () {60 vars in 1258 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/os-keypairs?user_id=854eae12d619464eb1d21a0816c0be0e => generated 725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:16:03.359186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18111eeb-1c7a-480f-a2c2-8f2d1276ab94 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Calling method '.version_select at 0x7f839826e940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.398867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18111eeb-1c7a-480f-a2c2-8f2d1276ab94 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1948773" status: 204 len: 0 microversion: 2.10 time: 0.045279 Jul 20 04:16:03.400803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 204/444] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1948773 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:16:03.421193 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d7e599a5-7357-40d8-b9d7-4ce725181543 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Calling method '.version_select at 0x7f8398473c10>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.478500 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d7e599a5-7357-40d8-b9d7-4ce725181543 tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306508810?user_id=854eae12d619464eb1d21a0816c0be0e" status: 204 len: 0 microversion: 2.10 time: 0.068683 Jul 20 04:16:03.485766 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 241/445] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306508810?user_id=854eae12d619464eb1d21a0816c0be0e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:16:03.490826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e92d903b-4b76-40b4-97a7-45626d0a92ef tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] Calling method '.version_select at 0x7f8398331160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.532977 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e92d903b-4b76-40b4-97a7-45626d0a92ef tempest-KeyPairsV210TestJSON-218175240 tempest-KeyPairsV210TestJSON-218175240-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436953955?user_id=854eae12d619464eb1d21a0816c0be0e" status: 204 len: 0 microversion: 2.10 time: 0.046120 Jul 20 04:16:03.534005 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 205/446] 10.222.0.49 () {60 vars in 1339 bytes} [Wed Jul 20 04:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436953955?user_id=854eae12d619464eb1d21a0816c0be0e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:16:03.610425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.611176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.618635 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:UPDATE=12,nova_api:DELETE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:03.633933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.634566 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.635110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.635548 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.882240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:03.882855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:03.891304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.897048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.898035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:03.898633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:03.988772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:03.999729 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ff68a74-c0c4-491d-b1a4-e687d35eddd3 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1281 microversion: 2.1 time: 0.121561 Jul 20 04:16:04.009718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 206/447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1281 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.167304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.182892 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-27195c44-c8ff-4f29-8768-0da82589b1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.577576 Jul 20 04:16:04.194178 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 242/448] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:03 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:04.259668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.260679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.271172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.271618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.272443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.273119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.322055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:04.323530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:04.336791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.337266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.338225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:04.338815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:04.478696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.492683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.494208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:04.512956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e15e42c-be2f-4897-9785-bbcab071ea8f tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1417 microversion: 2.75 time: 0.257638 Jul 20 04:16:04.515575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 207/449] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:04 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1417 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:05.005369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.016653 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9f1ea675-b3c4-438b-a974-a7bf0e557f0e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.696470 Jul 20 04:16:05.016653 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 243/450] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:04 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:05.022061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.022667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.033891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.035121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.036557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.037327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.117197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.124715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d495c85-92b9-43a7-8a17-0da727aa77a9 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1281 microversion: 2.1 time: 0.106515 Jul 20 04:16:05.135403 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 208/451] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:05.206111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.207218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.220156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.222568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.224772 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.225901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.537224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:05.538047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:05.561296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.563255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.567793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:05.568875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:05.614219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:05.637402 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.674153 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-105f673d-4815-4d81-8223-0c02ececd982 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.474551 Jul 20 04:16:05.684812 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 244/452] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:05.740774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.750190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.758574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:05.772119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb330c37-11bb-44f2-a002-f21c5e14098a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1417 microversion: 2.75 time: 0.240644 Jul 20 04:16:05.773281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 209/453] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:05 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1417 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:06.031932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.033698 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.051815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.052625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.053652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.054443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.143082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.143865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.153994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.155847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.160140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.160749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.470257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.494091 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d380ca2f-03f9-49cc-8b1f-befb3f678352 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.466794 Jul 20 04:16:06.503900 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 245/454] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:06.692077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.693564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.708651 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.716849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.717807 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.718475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.883734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:06.896507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27d5bcd2-7b4d-4bb7-b161-801975d1e63b tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.757450 Jul 20 04:16:06.899531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 210/455] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:06.918079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:06.919082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:06.939796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.941858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:06.945027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:06.946935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.406518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.419776 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c2115062-03c4-4d0f-8843-57ee819445d0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.731824 Jul 20 04:16:07.421010 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 246/456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:07.428248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-26d5ed6b-c1a9-4019-b7c4-05429993378f req-4121f4ba-931a-481d-a46a-2ae44462a558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be142e6-534b-4e0e-8aee-b5191b1486b5", "tag": "4f0089b6-cf70-4641-9240-d6bbe273b277"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:07.465637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-26d5ed6b-c1a9-4019-b7c4-05429993378f req-4121f4ba-931a-481d-a46a-2ae44462a558 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.466087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-26d5ed6b-c1a9-4019-b7c4-05429993378f req-4121f4ba-931a-481d-a46a-2ae44462a558 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.509863 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-26d5ed6b-c1a9-4019-b7c4-05429993378f req-4121f4ba-931a-481d-a46a-2ae44462a558 service nova] Creating event network-changed:4f0089b6-cf70-4641-9240-d6bbe273b277 for instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 on n-h2-764486-11 Jul 20 04:16:07.521765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.525612 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-26d5ed6b-c1a9-4019-b7c4-05429993378f req-4121f4ba-931a-481d-a46a-2ae44462a558 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103003 Jul 20 04:16:07.532498 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 247/457] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:07.540292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.546492 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:07.547258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:07.551931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.562814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.567045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.567414 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4277947b-db24-4518-8fde-9d250a95ae2e tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1438 microversion: 2.75 time: 0.661819 Jul 20 04:16:07.568522 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 211/458] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:06 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1438 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:07.568978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.572779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.589980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:07.592430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:07.615334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.615713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.616736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:07.617181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:07.775236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:07.779728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:07.780446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:07.781043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:07.781617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:07.876490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:07.887051 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1ddd68f3-72bd-405a-999e-afc4b5dcfd7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.350564 Jul 20 04:16:07.890543 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 248/459] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:07 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:08.016456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.029853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.031484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.033173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.033917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.193639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.211146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.213027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.221948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ca13316-fcdb-4229-bd75-363ba9c2692c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "POST /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66/action" status: 202 len: 1495 microversion: 2.75 time: 0.636986 Jul 20 04:16:08.225748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 212/460] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:16:07 2022] POST /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66/action => generated 1495 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:16:08.232626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:08.233574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.255164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.255925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.256991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.257773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.569384 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d57bd133-8777-4179-9cbe-8ce7fafc648a tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Action: 'update', calling method: .version_select at 0x7f83984fd160>, body: {"quota_set": {"ram": "5120"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:08.659294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d57bd133-8777-4179-9cbe-8ce7fafc648a tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.659746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d57bd133-8777-4179-9cbe-8ce7fafc648a tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.660621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d57bd133-8777-4179-9cbe-8ce7fafc648a tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.661054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d57bd133-8777-4179-9cbe-8ce7fafc648a tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.715425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.743077 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-616340fc-c8d0-494d-9ea6-bc9051a2f57c tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.516036 Jul 20 04:16:08.759228 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d57bd133-8777-4179-9cbe-8ce7fafc648a tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8" status: 200 len: 240 microversion: 2.36 time: 0.866964 Jul 20 04:16:08.763812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 213/461] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:08.765404 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 249/462] 10.222.0.49 () {62 vars in 1302 bytes} [Wed Jul 20 04:16:07 2022] PUT /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8 => generated 240 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:08.769950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:08.770264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:08.770884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.771745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:08.779847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.780634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.783276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.783767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.784767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.787735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.788953 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.789410 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.898073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.925723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.929355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:08.936985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a36ba777-8453-4d84-b93f-098ed2134a3c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.171717 Jul 20 04:16:08.938227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 214/463] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:08.944948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2acb5b49-0003-4645-a881-6eaae5386b47 req-2e4f5f5e-831d-4644-aa91-272cf2edb1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2215a044-6be8-4af3-810e-76862c594dd2", "name": "network-vif-plugged", "status": "completed", "tag": "dd47674e-ff11-45c0-9804-2c6b2eb82b22"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:08.958793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2acb5b49-0003-4645-a881-6eaae5386b47 req-2e4f5f5e-831d-4644-aa91-272cf2edb1ed service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:08.959801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2acb5b49-0003-4645-a881-6eaae5386b47 req-2e4f5f5e-831d-4644-aa91-272cf2edb1ed service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:08.975039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2acb5b49-0003-4645-a881-6eaae5386b47 req-2e4f5f5e-831d-4644-aa91-272cf2edb1ed service nova] Creating event network-vif-plugged:dd47674e-ff11-45c0-9804-2c6b2eb82b22 for instance 2215a044-6be8-4af3-810e-76862c594dd2 on n-h2-764486-11 Jul 20 04:16:08.986517 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2acb5b49-0003-4645-a881-6eaae5386b47 req-2e4f5f5e-831d-4644-aa91-272cf2edb1ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045213 Jul 20 04:16:08.989397 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 215/464] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:08.998160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71a35897-e5f2-4341-90a2-c5b8beb5a18d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Calling method '.version_select at 0x7f8398263f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.034280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.048274 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b866da66-a6ce-4aea-b5a0-72fb6fac9834 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.279822 Jul 20 04:16:09.048924 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 250/465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.058115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.058935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.070686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.071126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.072507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.073139 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.119410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71a35897-e5f2-4341-90a2-c5b8beb5a18d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.119853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71a35897-e5f2-4341-90a2-c5b8beb5a18d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.120902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71a35897-e5f2-4341-90a2-c5b8beb5a18d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.121487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71a35897-e5f2-4341-90a2-c5b8beb5a18d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.151874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71a35897-e5f2-4341-90a2-c5b8beb5a18d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8/detail" status: 200 len: 672 microversion: 2.36 time: 0.160958 Jul 20 04:16:09.152904 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 216/466] 10.222.0.49 () {60 vars in 1303 bytes} [Wed Jul 20 04:16:08 2022] GET /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8/detail => generated 672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:09.379552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Action: 'update', calling method: .version_select at 0x7f83985b5e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:09.387955 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:09.396695 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a444ddec-5e51-40ed-8656-f23fbbce92ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.346369 Jul 20 04:16:09.409795 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 251/467] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:09.476675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.477370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.478526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.479187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.530800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.531497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.532707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.533074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.607066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92af88b7-445b-4cb9-b2a7-1c82f98507cb tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8?user_id=57d00964ecf94e2c83a3226f382d7906" status: 200 len: 240 microversion: 2.36 time: 0.231204 Jul 20 04:16:09.608561 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 217/468] 10.222.0.49 () {62 vars in 1383 bytes} [Wed Jul 20 04:16:09 2022] PUT /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8?user_id=57d00964ecf94e2c83a3226f382d7906 => generated 240 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:16:09.618627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a27ef43c-7c59-46ec-826d-98b5f686923d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] Calling method '.version_select at 0x7f83983f5af0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.718373 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a27ef43c-7c59-46ec-826d-98b5f686923d tempest-QuotasAdminTestV236-1451312329 tempest-QuotasAdminTestV236-1451312329-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8?user_id=57d00964ecf94e2c83a3226f382d7906" status: 200 len: 282 microversion: 2.36 time: 0.103779 Jul 20 04:16:09.719775 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 252/469] 10.222.0.49 () {60 vars in 1363 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/os-quota-sets/cacc01ec771847f89a30f1cce7e37cb8?user_id=57d00964ecf94e2c83a3226f382d7906 => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:16:09.769358 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:09.770569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:09.785542 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.786519 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.788434 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:09.789426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:09.870901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-589cb938-0564-4e8b-a460-765410841a6c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Action: 'create', calling method: .version_select at 0x7f8398123f70>, body: {"keypair": {"name": "tempest-keypair-947426186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb9ml/Bavl3iK2Ei1KitdzGrGGLtLJwobFvD+HAbOnsRNF3opBbGnlt8DRI+WlD2sc+4mDznc6p22zV2S4ZgcsaMg2kPzJMwobioZoa0jgLpkL2qhNeKX0Nqvwog0eybA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:09.891427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:09.908290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-589cb938-0564-4e8b-a460-765410841a6c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Getting quotas for project c72212a06a744e5bb3eddaec92a56255. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:09.930268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-589cb938-0564-4e8b-a460-765410841a6c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Getting quotas for user 8882e2ce8b524494968786da168b01de and project c72212a06a744e5bb3eddaec92a56255. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:09.979177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-589cb938-0564-4e8b-a460-765410841a6c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238989 Jul 20 04:16:09.981504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 218/470] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:10.000131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.003860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.018778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.021523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.025128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.025772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.109855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.121917 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8a0a0573-2c40-49b3-ac37-856121771033 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.357023 Jul 20 04:16:10.122548 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 253/471] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:10.136179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.136825 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.148650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.149100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.149883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.157701 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.183449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.198640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.203233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.216011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78ea0731-c7f5-4c52-b12c-f4f811e2f7ea tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.230783 Jul 20 04:16:10.220041 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 219/472] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:09 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:10.416839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:10.417838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:10.429053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.429648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.431169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:10.431868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:10.580488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.590627 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e3e09815-b0ee-4a61-9188-893f531da20a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.458206 Jul 20 04:16:10.606915 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 254/473] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:10.883309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:10.894757 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab881d50-ed21-4b76-8326-04ae0318c3fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1311 microversion: 2.1 time: 0.483376 Jul 20 04:16:10.898418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 220/474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:10 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1311 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:11.140294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.140999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.151890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.161086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.162630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.163283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.242451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.243215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.256212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.257348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.261122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.262071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.412858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.420629 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bc6820e5-db22-42c0-92c4-e3f76dbdbc30 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.285563 Jul 20 04:16:11.421401 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 255/475] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:11.483159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.502012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.503927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.530523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f329ad6e-d776-449b-b069-ed945825c2f2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.290929 Jul 20 04:16:11.533053 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 221/476] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:11.613460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.615172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.623224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.624119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.625717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.626476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.822110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:11.832334 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0ec7ac83-ce34-4243-8ed0-bb62ca0cd45c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.223873 Jul 20 04:16:11.833896 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 256/477] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:11.913536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:11.914553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:11.927681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.928217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:11.929231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:11.929673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.442052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.443324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.453105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.453740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.475878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.476340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.482534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:12.493076 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f23d5f9e-f30f-4d8f-b406-216de2812b0f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1493 microversion: 2.1 time: 0.583297 Jul 20 04:16:12.500707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 222/478] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:11 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1493 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.511069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.511685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.526286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.526711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.527443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.528398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.952172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6cf04dd-8992-4f68-9d84-7f855da2bfcc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1646 microversion: 2.1 time: 0.444653 Jul 20 04:16:12.954279 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 223/479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1646 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:12.959161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:12.960281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:12.982445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.983201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.984371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:12.985022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:12.996457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.005738 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d478b69a-cc57-45bd-b5d0-369f3ff30ad6 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.570915 Jul 20 04:16:13.017912 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 257/480] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:13.025426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.048433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.077232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.079569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.083561 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.088890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.305921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.323457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.325219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.340731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7586c869-f13c-4a22-98f6-d6195d5dd09d tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.384197 Jul 20 04:16:13.371264 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 224/481] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:12 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:13.380948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.381924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.395534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.397906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.401209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.401947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.427940 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:13.430468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:13.439350 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fd2b0ab8-c9b9-41b3-8f45-493410ea3b6f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1477 microversion: 2.1 time: 0.419894 Jul 20 04:16:13.451127 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 258/482] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1477 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:13.829975 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93bbe301-d8ce-40fd-b2ad-124af3ed09e1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1646 microversion: 2.1 time: 0.456464 Jul 20 04:16:13.830831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 225/483] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1646 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:13.846769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-772f2437-5698-4cd3-b1fe-5cff46ac554d tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:13.848344 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:16:13.848344 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:16:13.849580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772f2437-5698-4cd3-b1fe-5cff46ac554d tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.850039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772f2437-5698-4cd3-b1fe-5cff46ac554d tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.851232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772f2437-5698-4cd3-b1fe-5cff46ac554d tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.851668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-772f2437-5698-4cd3-b1fe-5cff46ac554d tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.895432 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-772f2437-5698-4cd3-b1fe-5cff46ac554d tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.052221 Jul 20 04:16:13.896051 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 259/484] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:16:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:13.907304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:13.907751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:13.914279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.914963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.915895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:13.916522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:13.933550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:14.013993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02c7426d-f083-40f2-be91-28f5364b5f98 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.110301 Jul 20 04:16:14.016112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 226/485] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:13 2022] POST /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:14.024963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.025626 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.035210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.036524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.037612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.039852 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.043837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.047347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.048036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.049827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.051098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.054340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.469634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:14.486843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9fe4bfb9-3282-4266-8726-e183d5d77bae tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.452630 Jul 20 04:16:14.490344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 227/486] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:14.510351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.512863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.540219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.541224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.542198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.547320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.798458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:14.811596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:14.813243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:14.833658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39a5d849-8ed0-4c84-be8c-08ad628ea8d4 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.341760 Jul 20 04:16:14.836634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 228/487] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:14.851304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:14.859234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:14.873248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.880260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:14.881859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:14.882303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.166735 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f85e7297-a6e2-4ae7-9bdb-9719ce9c67f5 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1651 microversion: 2.1 time: 1.146045 Jul 20 04:16:15.171075 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 260/488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1651 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:15.176335 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-9a95a7ab-4694-485d-9058-7d14668ae207 req-3d05c96a-f758-408e-9172-079b7650b3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328dd8aa-9d14-40c7-8afd-05306640e26e", "name": "network-vif-unplugged", "status": "completed", "tag": "89c6b692-291c-4b48-9870-10b30c95d138"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:15.198510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-9a95a7ab-4694-485d-9058-7d14668ae207 req-3d05c96a-f758-408e-9172-079b7650b3ad service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.198970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-9a95a7ab-4694-485d-9058-7d14668ae207 req-3d05c96a-f758-408e-9172-079b7650b3ad service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.228682 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-9a95a7ab-4694-485d-9058-7d14668ae207 req-3d05c96a-f758-408e-9172-079b7650b3ad service nova] Creating event network-vif-unplugged:89c6b692-291c-4b48-9870-10b30c95d138 for instance 328dd8aa-9d14-40c7-8afd-05306640e26e on n-h2-764486-11 Jul 20 04:16:15.237813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-9a95a7ab-4694-485d-9058-7d14668ae207 req-3d05c96a-f758-408e-9172-079b7650b3ad service nova] Instance 328dd8aa-9d14-40c7-8afd-05306640e26e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:15.266358 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-9a95a7ab-4694-485d-9058-7d14668ae207 req-3d05c96a-f758-408e-9172-079b7650b3ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093725 Jul 20 04:16:15.267418 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 261/489] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:15.513777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.515972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.539276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.543504 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.548966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.549530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.690917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:15.740475 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3602fa4-0c30-475a-a639-4caef0156fb3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1476 microversion: 2.1 time: 0.886423 Jul 20 04:16:15.740475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 229/490] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:14 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1476 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:15.857661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:15.858982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:15.869258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.869710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:15.874215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:15.874653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.013212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.029070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.030995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.037215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d995c4d3-226f-4c0b-9169-6d5bb58305a2 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.185942 Jul 20 04:16:16.038451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 230/491] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:16.044966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "62ec807e-33f7-407d-9231-0acedac0f31b"}], "security_groups": [{"name": "tempest-securitygroup--5374666"}], "key_name": "tempest-keypair-947426186", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:16.189494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] validate_networks() for [('62ec807e-33f7-407d-9231-0acedac0f31b', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:16.502292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:16.514112 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4f1d7915-c516-454d-8476-f4eb7b968d35 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 1.008595 Jul 20 04:16:16.515263 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 262/492] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:15 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:16.528500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:16.529698 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:16.544755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.545983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.547948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.550641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.660201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:16.849319 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d9270aac-b81a-4ec6-9cbd-be839325c948 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 204 len: 0 microversion: 2.1 time: 0.332093 Jul 20 04:16:16.850385 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 263/493] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:16 2022] DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:16.856231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:16.857961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:16.876944 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.877606 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.878583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.879073 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:16.964008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:16.965209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:16.966264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:16.967700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:16.968312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:16.985410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=90,nova_cell0:UPDATE=7 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:16.995274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:16.998238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.001180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.001854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.060782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Getting quotas for project c72212a06a744e5bb3eddaec92a56255. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:17.067371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Getting quotas for user 8882e2ce8b524494968786da168b01de and project c72212a06a744e5bb3eddaec92a56255. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:17.084092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:17.090528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:17.173930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79d537bb-eba7-445b-926f-22b3bb04023e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.134179 Jul 20 04:16:17.189452 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 231/494] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:17.196286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3acaf7f0-bcce-4c0c-ae50-4f504b225f0f req-60bf1424-7964-4246-9957-3fe8147954f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be142e6-534b-4e0e-8aee-b5191b1486b5", "name": "network-vif-plugged", "status": "completed", "tag": "4f0089b6-cf70-4641-9240-d6bbe273b277"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:17.230504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3acaf7f0-bcce-4c0c-ae50-4f504b225f0f req-60bf1424-7964-4246-9957-3fe8147954f6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.230829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3acaf7f0-bcce-4c0c-ae50-4f504b225f0f req-60bf1424-7964-4246-9957-3fe8147954f6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.243539 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3acaf7f0-bcce-4c0c-ae50-4f504b225f0f req-60bf1424-7964-4246-9957-3fe8147954f6 service nova] Creating event network-vif-plugged:4f0089b6-cf70-4641-9240-d6bbe273b277 for instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 on n-h2-764486-11 Jul 20 04:16:17.249806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3acaf7f0-bcce-4c0c-ae50-4f504b225f0f req-60bf1424-7964-4246-9957-3fe8147954f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057378 Jul 20 04:16:17.251109 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 232/495] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:17.258642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.259348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.268319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.269139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.270128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.270705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.498290 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2367b822-29db-49a8-a5de-7473a7ed1f8a tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1631 microversion: 2.1 time: 0.645495 Jul 20 04:16:17.498900 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 264/496] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:16 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1631 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.515170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.518665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1427974520", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "1254793648", "adminPass": "***", "networks": [{"uuid": "02851ba5-6671-4a40-a0b6-12252ce9120c"}], "security_groups": [{"name": "tempest-securitygroup--1419117801"}], "key_name": "tempest-keypair-1830281682", "user_data": "}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:17.528941 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81099d51-ffe1-4470-9b21-d3b308f34d14 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1476 microversion: 2.1 time: 0.275445 Jul 20 04:16:17.530660 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 233/497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.543760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.545246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.562227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.563295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.579593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.581546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.715513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.726353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.728007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.751462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b9b5fcc-e395-4a83-81fb-881b705edfbe tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.218162 Jul 20 04:16:17.756414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 234/498] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:17.756974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7d7d5c7-f7c3-4f39-9979-02fe7cab77e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:17.758337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7d7d5c7-f7c3-4f39-9979-02fe7cab77e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.877609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7d7d5c7-f7c3-4f39-9979-02fe7cab77e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:17.889861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7d7d5c7-f7c3-4f39-9979-02fe7cab77e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1225 microversion: 2.1 time: 0.136304 Jul 20 04:16:17.890625 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 235/499] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:17 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:17.895203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4f067051-ac2c-48d5-a9c5-b4d1459d44c2 req-9aea097b-b457-4297-9cba-eef88723ec0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328dd8aa-9d14-40c7-8afd-05306640e26e", "tag": "89c6b692-291c-4b48-9870-10b30c95d138"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:17.908415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f067051-ac2c-48d5-a9c5-b4d1459d44c2 req-9aea097b-b457-4297-9cba-eef88723ec0b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.909303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f067051-ac2c-48d5-a9c5-b4d1459d44c2 req-9aea097b-b457-4297-9cba-eef88723ec0b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.937186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4f067051-ac2c-48d5-a9c5-b4d1459d44c2 req-9aea097b-b457-4297-9cba-eef88723ec0b service nova] Creating event network-changed:89c6b692-291c-4b48-9870-10b30c95d138 for instance 328dd8aa-9d14-40c7-8afd-05306640e26e on n-h2-764486-11 Jul 20 04:16:17.952514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] validate_networks() for [('02851ba5-6671-4a40-a0b6-12252ce9120c', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:17.954629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-4f067051-ac2c-48d5-a9c5-b4d1459d44c2 req-9aea097b-b457-4297-9cba-eef88723ec0b service nova] Instance 328dd8aa-9d14-40c7-8afd-05306640e26e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:17.967967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4f067051-ac2c-48d5-a9c5-b4d1459d44c2 req-9aea097b-b457-4297-9cba-eef88723ec0b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076167 Jul 20 04:16:17.969633 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 236/500] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:17.977441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764486-11", "block_migration": true, "disk_over_commit": false}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:17.979848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:17.991282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.992176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:17.994175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:17.998015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:18.054141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lazy-loading 'flavor' on Instance uuid 2215a044-6be8-4af3-810e-76862c594dd2 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:18.069875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Going to try to live migrate instance to n-h1-764486-11 {{(pid=123724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:16:19.663463 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:19.664000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:19.664563 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:19.665068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:19.665591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:19.680485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=37 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:19.684280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.690575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.692439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.693908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.724690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=11 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:19.762523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Getting quotas for project 4fbc880ec5e14aafa307eb780a1cd051. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:19.782628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Getting quotas for user 5c2ac596c69843009cfd28dd0e90d56e and project 4fbc880ec5e14aafa307eb780a1cd051. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:19.830171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:19.838615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:19.951555 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5e39d9aa-0883-4d5e-8284-b5a6f747f736 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.451393 Jul 20 04:16:19.953353 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 265/501] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:19.960781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:19.961818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:19.971009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.971817 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:19.972910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:19.975070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.848538 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:20.863021 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-379bf176-7df9-43ba-b746-c558679605a1 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1323 microversion: 2.1 time: 0.906535 Jul 20 04:16:20.875356 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 266/502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:19 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1323 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:20.883570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:20.888933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:20.903921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.905620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:20.908524 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:20.909164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.538101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:21.555235 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f291de1a-4096-42e6-8b01-ecbabe36b4e7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1474 microversion: 2.1 time: 0.678368 Jul 20 04:16:21.564248 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 267/503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:20 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1474 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:21.579630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:21.586095 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:21.610025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.612910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:21.615852 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:21.618358 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.085288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.098436 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.100216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.116147 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ad8c800b-59bd-48b9-a87a-b962882a4b8c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.550325 Jul 20 04:16:22.117353 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 268/504] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:21 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:22.136149 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.140807 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.157660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.158422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.159602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.163385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.510738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:22.519377 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5eb07306-6e3f-425a-82db-204fa74c1dea tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1283 microversion: 2.1 time: 0.400772 Jul 20 04:16:22.524984 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 269/505] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1283 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:22.529811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-8cc289ab-f42b-43ef-bd4c-a48e71f8bda9 req-3cb6a90f-d6ad-4e10-bac2-efd78a4a3649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0842d27-0ea4-4e23-8321-c75d8126da87", "name": "network-vif-deleted", "tag": "f319198d-e04b-46c7-95ef-23ee0048fe7f"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:22.576117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8cc289ab-f42b-43ef-bd4c-a48e71f8bda9 req-3cb6a90f-d6ad-4e10-bac2-efd78a4a3649 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.581279 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8cc289ab-f42b-43ef-bd4c-a48e71f8bda9 req-3cb6a90f-d6ad-4e10-bac2-efd78a4a3649 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.645741 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-8cc289ab-f42b-43ef-bd4c-a48e71f8bda9 req-3cb6a90f-d6ad-4e10-bac2-efd78a4a3649 service nova] Creating event network-vif-deleted:f319198d-e04b-46c7-95ef-23ee0048fe7f for instance a0842d27-0ea4-4e23-8321-c75d8126da87 on n-h1-764486-11 Jul 20 04:16:22.671757 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-8cc289ab-f42b-43ef-bd4c-a48e71f8bda9 req-3cb6a90f-d6ad-4e10-bac2-efd78a4a3649 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145316 Jul 20 04:16:22.674866 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 270/506] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:22.695657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:22.697490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:22.716664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:22.730683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.745044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:22.749391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:22.753527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.225756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cfd6993c-c45a-4310-a195-4935f234ab42 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2/action" status: 202 len: 0 microversion: 2.1 time: 5.254515 Jul 20 04:16:23.226721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.236533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 237/507] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:17 2022] POST /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2/action => generated 0 bytes in 5266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:16:23.242779 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3b5f0b49-2b69-4caa-9b78-c27aa1fd4597 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1335 microversion: 2.1 time: 0.566331 Jul 20 04:16:23.243592 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 271/508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:22 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1335 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:23.250512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.253593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.260648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.269581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.271733 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.272387 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.273548 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.274140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.322449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.331285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.332242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.339994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.758984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:23.772822 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5dc965bc-dacd-4670-ae27-147bfa2ddff4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1471 microversion: 2.1 time: 0.523810 Jul 20 04:16:23.773995 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 272/509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:23.789367 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:23.790264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:23.804110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.805220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:23.806224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:23.807266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.042932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.060672 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.062557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.077042 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ab9fa483-cfa8-4066-91d2-8cf91034a761 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.301770 Jul 20 04:16:24.079877 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 273/510] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:24.103635 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.104867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.111985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.112821 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.113814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.114439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.435727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.444998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b84fcf5-cbd6-4bf9-94b8-797117890b7e tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1473 microversion: 2.1 time: 1.206233 Jul 20 04:16:24.448167 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 238/511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:23 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1473 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.463473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.464091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.480488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.483410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.484381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.486276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.740911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:24.759845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2e14776-0ad2-4b8a-a777-1f42740a992c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1283 microversion: 2.1 time: 0.310324 Jul 20 04:16:24.760469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 239/512] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1283 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:24.775286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:24.775826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.794906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.795361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.798233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.798781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.943260 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae975a49-69e2-4f26-bc39-81d9fa14302c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e/action" status: 204 len: 0 microversion: 2.1 time: 0.179832 Jul 20 04:16:24.943922 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 240/513] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:24 2022] POST /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e/action => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:24.954083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:24.954793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:24.968707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.969164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:24.969963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:24.970400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.018257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:25.150910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.160676 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-61953d7b-deb7-47fd-9de4-ae140de15849 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 1.069314 Jul 20 04:16:25.174393 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 274/514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:25.180610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.181294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.188146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.188847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.189805 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.190390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.224546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.233682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1dd01505-6dd4-4f1d-bf00-251c314b2d11 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1323 microversion: 2.1 time: 0.288151 Jul 20 04:16:25.234512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 241/515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:24 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:25.243346 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Request method failure captured: Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5/diagnostics HTTP/1.1 Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14F9mQUdPCA76IV3G7cDeQuC_LjE5gpHL1KyUCZl4G9f7-r6laz7WG5yHLcpBTXY7R-o4oN9eFX_i8qKrh841mHwC_3aQEEm6vQQIvgzlJUMp2FhHt0gieGhEnuWnb01_he1U8hqp7d2GS_ODEKOHr9SipR4YXCB05P3ggEuuPi15Wk Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3e8fd4a2e38a49f0b5cfee6b05fbc839 Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-655465057 Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:16:25.245536 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3e8fd4a2e38a49f0b5cfee6b05fbc839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e8fd4a2e38a49f0b5cfee6b05fbc839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e8fd4a2e38a49f0b5cfee6b05fbc839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3e8fd4a2e38a49f0b5cfee6b05fbc839", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-655465057 Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3e8fd4a2e38a49f0b5cfee6b05fbc839 Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-655465057 Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServerDiagnosticsNegativeTest-655465057-project Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: dbadb724dcf54d1c8f00f6752b86ab1f Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-655465057-project Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:16:25.247099 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'server_id': '5be142e6-534b-4e0e-8aee-b5191b1486b5'} Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:16:25.247794 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 04:16:25.249013 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:16:25.252248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-60ad1245-b2fb-49bc-8bfc-aadfcca5fc11 req-b042291a-dc0e-4790-8065-019b0b747f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328dd8aa-9d14-40c7-8afd-05306640e26e", "name": "network-vif-plugged", "status": "completed", "tag": "89c6b692-291c-4b48-9870-10b30c95d138"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:25.253184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:25.254239 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c43cb5b8-58b4-439a-8162-b70272b27fd0 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.078516 Jul 20 04:16:25.258634 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 275/516] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5/diagnostics => generated 117 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:25.268382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.270579 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.275643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-60ad1245-b2fb-49bc-8bfc-aadfcca5fc11 req-b042291a-dc0e-4790-8065-019b0b747f57 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.278395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-60ad1245-b2fb-49bc-8bfc-aadfcca5fc11 req-b042291a-dc0e-4790-8065-019b0b747f57 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.287859 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.288303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.290660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.292009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.304519 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-60ad1245-b2fb-49bc-8bfc-aadfcca5fc11 req-b042291a-dc0e-4790-8065-019b0b747f57 service nova] Creating event network-vif-plugged:89c6b692-291c-4b48-9870-10b30c95d138 for instance 328dd8aa-9d14-40c7-8afd-05306640e26e on n-h2-764486-11 Jul 20 04:16:25.317523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-60ad1245-b2fb-49bc-8bfc-aadfcca5fc11 req-b042291a-dc0e-4790-8065-019b0b747f57 service nova] Instance 328dd8aa-9d14-40c7-8afd-05306640e26e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:16:25.330122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-60ad1245-b2fb-49bc-8bfc-aadfcca5fc11 req-b042291a-dc0e-4790-8065-019b0b747f57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090175 Jul 20 04:16:25.335126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 242/517] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:25.335499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:25.341204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.341971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.349406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.350161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.350701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.351134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.486624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.495556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.497752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:25.503282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-329fa8f2-7f1e-48a9-b103-b81d3511371b tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.166911 Jul 20 04:16:25.503926 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 243/518] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:25.508693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.509599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.516571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.517320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.518288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.518911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.551657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:25.728518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:25.757847 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c598de6-d1c7-4209-8618-d9281ac06745 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 204 len: 0 microversion: 2.1 time: 0.237005 Jul 20 04:16:25.762355 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 244/519] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:25 2022] DELETE /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:16:25.773743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:25.774484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:25.784930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.785381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:25.786160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:25.786600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.111516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.127040 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-59cd1e34-42d4-4d27-a78b-1bc9581a3e82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1471 microversion: 2.1 time: 0.866663 Jul 20 04:16:26.129057 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 276/520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1471 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.133927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.141962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.170299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.170958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.176782 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.181839 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.530000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.537899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cfabf1d1-7832-425d-8812-092d9d0657a4 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1479 microversion: 2.1 time: 0.774018 Jul 20 04:16:26.538513 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 245/521] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:25 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1479 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.554305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.555211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.569793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.573400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.575143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.575943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.802882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:26.814317 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4fd5119c-755d-4a6f-95d8-b4bf44a0610d tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.683443 Jul 20 04:16:26.816201 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 277/522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:26.822080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:26.822993 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:26.833854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.834569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:26.835857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:26.836304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.038614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=11 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:27.351941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.366686 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5c7dc83a-ebfd-45b4-9ed4-75d40f4f207b tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.549029 Jul 20 04:16:27.369291 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 278/523] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:27.393388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.397643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.421174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.424315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.425394 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.426469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.514634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.523702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60bcbd70-92fb-464f-bd15-94199d92e875 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.982115 Jul 20 04:16:27.524287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 246/524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:26 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:27.540005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.540774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.569977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.578734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.580329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.581925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.696969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.728040 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.729902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:27.758143 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-16173049-830d-49bf-962c-bf8e74fec742 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.370063 Jul 20 04:16:27.759167 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 279/525] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:27.781507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-952b5f5c-388f-4447-b8d5-ee18d4a5dc3e req-a84a6b39-14dd-40de-89d5-e2f74ef6edc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2215a044-6be8-4af3-810e-76862c594dd2", "name": "network-vif-unplugged", "status": "completed", "tag": "dd47674e-ff11-45c0-9804-2c6b2eb82b22"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:27.814427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-952b5f5c-388f-4447-b8d5-ee18d4a5dc3e req-a84a6b39-14dd-40de-89d5-e2f74ef6edc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.815166 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-952b5f5c-388f-4447-b8d5-ee18d4a5dc3e req-a84a6b39-14dd-40de-89d5-e2f74ef6edc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.829439 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-952b5f5c-388f-4447-b8d5-ee18d4a5dc3e req-a84a6b39-14dd-40de-89d5-e2f74ef6edc8 service nova] Creating event network-vif-unplugged:dd47674e-ff11-45c0-9804-2c6b2eb82b22 for instance 2215a044-6be8-4af3-810e-76862c594dd2 on n-h2-764486-11 Jul 20 04:16:27.838105 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-952b5f5c-388f-4447-b8d5-ee18d4a5dc3e req-a84a6b39-14dd-40de-89d5-e2f74ef6edc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074121 Jul 20 04:16:27.839604 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 280/526] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:27.845777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:27.846716 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:27.854425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.855106 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.859206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:27.859840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:27.882333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=7 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:28.181236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:28.190398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ecc5869-1fd7-41b6-b57d-af81de040bab tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1471 microversion: 2.1 time: 0.664968 Jul 20 04:16:28.191310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 247/527] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1471 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.196977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.197887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.211182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.211965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.213057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.213637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.665313 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:28.694949 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-75fd5909-31e9-44e0-8490-0fba838ef887 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1479 microversion: 2.1 time: 0.843116 Jul 20 04:16:28.697882 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 281/528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:27 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1479 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.705908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.708025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.722838 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.723379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.724114 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.724620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.741751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:28.758194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5c481b9-2063-43fb-97c6-8105e0b5a05c tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.563040 Jul 20 04:16:28.767827 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 248/529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:28.769643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:28.771678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:28.788172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.788801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:28.793031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:28.794893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.384540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.400954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d03599f-be4e-45c9-8266-3a9451939591 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.640452 Jul 20 04:16:29.410784 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 249/530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:29.415080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.415689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.423790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.424240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.425041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.425466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.592081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.612515 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b8f269a4-cfdd-4ad7-ae00-92e1a838a129 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.910686 Jul 20 04:16:29.614978 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 282/531] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:28 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:29.633680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.636892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.643936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.671358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.671977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.674369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.677875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.678846 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.682026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.696500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-136775f0-d23b-4dcc-9256-d2c0095e4ddc tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.293398 Jul 20 04:16:29.697111 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 250/532] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:29.718157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.718865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.740306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.740794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.741663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.742101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.778060 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:29.807941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=5 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:29.819915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.820804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.828804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lazy-loading 'fault' on Instance uuid 5be142e6-534b-4e0e-8aee-b5191b1486b5 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:29.947753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbadb724dcf54d1c8f00f6752b86ab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8fd4a2e38a49f0b5cfee6b05fbc839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:29.956856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-508480f3-3346-4949-be8c-2974c20fef9a tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 200 len: 1313 microversion: 2.1 time: 0.246841 Jul 20 04:16:29.959860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 251/533] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:29.971914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:29.972800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:29.979602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.980261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:29.981243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:29.981812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.119315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.139624 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-89d8c433-36a8-4f86-ad8e-1b29a8c635a4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1463 microversion: 2.1 time: 0.519804 Jul 20 04:16:30.143453 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 283/534] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1463 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.153603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-3b78aab5-7fcf-4d9d-9bae-1b8e9eefbe0e req-d7fd7b0d-2ed4-4eba-a9e8-c3ce203fd5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2215a044-6be8-4af3-810e-76862c594dd2", "tag": "dd47674e-ff11-45c0-9804-2c6b2eb82b22"}, {"server_uuid": "5be142e6-534b-4e0e-8aee-b5191b1486b5", "name": "network-vif-deleted", "tag": "4f0089b6-cf70-4641-9240-d6bbe273b277"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:30.206114 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3b78aab5-7fcf-4d9d-9bae-1b8e9eefbe0e req-d7fd7b0d-2ed4-4eba-a9e8-c3ce203fd5c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.208911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3b78aab5-7fcf-4d9d-9bae-1b8e9eefbe0e req-d7fd7b0d-2ed4-4eba-a9e8-c3ce203fd5c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.249394 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3b78aab5-7fcf-4d9d-9bae-1b8e9eefbe0e req-d7fd7b0d-2ed4-4eba-a9e8-c3ce203fd5c1 service nova] Creating event network-changed:dd47674e-ff11-45c0-9804-2c6b2eb82b22 for instance 2215a044-6be8-4af3-810e-76862c594dd2 on n-h2-764486-11 Jul 20 04:16:30.250227 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3b78aab5-7fcf-4d9d-9bae-1b8e9eefbe0e req-d7fd7b0d-2ed4-4eba-a9e8-c3ce203fd5c1 service nova] Creating event network-vif-deleted:4f0089b6-cf70-4641-9240-d6bbe273b277 for instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 on n-h2-764486-11 Jul 20 04:16:30.290399 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-3b78aab5-7fcf-4d9d-9bae-1b8e9eefbe0e req-d7fd7b0d-2ed4-4eba-a9e8-c3ce203fd5c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.141154 Jul 20 04:16:30.292259 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 284/535] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:30.327505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.329830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.347737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.349073 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.352911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.353560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.460697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:30.484597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3379c44-9714-4392-a8cd-9325982f55d3 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.523401 Jul 20 04:16:30.491299 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 252/536] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:29 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:30.501796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bf46c2b7-9607-4530-b8d4-f3e0579d0d45 req-7f8ad4bf-ccd8-409b-b529-8ade92b16cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e5887a-3217-4bd1-b7b7-04a5c224f8df", "tag": "60cc2fec-7a55-4946-871a-28543ded0ee8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:30.526827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf46c2b7-9607-4530-b8d4-f3e0579d0d45 req-7f8ad4bf-ccd8-409b-b529-8ade92b16cfb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.527922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf46c2b7-9607-4530-b8d4-f3e0579d0d45 req-7f8ad4bf-ccd8-409b-b529-8ade92b16cfb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.561250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bf46c2b7-9607-4530-b8d4-f3e0579d0d45 req-7f8ad4bf-ccd8-409b-b529-8ade92b16cfb service nova] Creating event network-changed:60cc2fec-7a55-4946-871a-28543ded0ee8 for instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df on n-h2-764486-11 Jul 20 04:16:30.575225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bf46c2b7-9607-4530-b8d4-f3e0579d0d45 req-7f8ad4bf-ccd8-409b-b529-8ade92b16cfb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082525 Jul 20 04:16:30.576399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 253/537] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:30.587839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:30.589082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:30.601799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.602252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:30.603040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:30.603477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.151795 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c401eb0e-ddab-4113-9211-ab040e652dbd tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1616 microversion: 2.1 time: 0.845993 Jul 20 04:16:31.159547 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 285/538] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1616 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.164628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.169840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.179988 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.180697 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.181623 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.182711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.428886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.443123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1943183-e7ac-4922-a935-9b0d1ef58398 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.865333 Jul 20 04:16:31.443958 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 254/539] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:30 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.469030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.469822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.486521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.489774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.492791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.493442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.659081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.689298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.694108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.701155 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-585a34c7-96c1-4fac-93be-106799b1420c tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.244413 Jul 20 04:16:31.713819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 255/540] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:31.721456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.722307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] [instance: 5be142e6-534b-4e0e-8aee-b5191b1486b5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.730117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.730939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.731976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.732704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.759205 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] HTTP exception thrown: Instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 could not be found. Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Request method failure captured: Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 HTTP/1.1 Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14F9mQUdPCA76IV3G7cDeQuC_LjE5gpHL1KyUCZl4G9f7-r6laz7WG5yHLcpBTXY7R-o4oN9eFX_i8qKrh841mHwC_3aQEEm6vQQIvgzlJUMp2FhHt0gieGhEnuWnb01_he1U8hqp7d2GS_ODEKOHr9SipR4YXCB05P3ggEuuPi15Wk Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3e8fd4a2e38a49f0b5cfee6b05fbc839 Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-655465057 Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:16:31.774413 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3e8fd4a2e38a49f0b5cfee6b05fbc839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e8fd4a2e38a49f0b5cfee6b05fbc839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e8fd4a2e38a49f0b5cfee6b05fbc839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3e8fd4a2e38a49f0b5cfee6b05fbc839", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-655465057 Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3e8fd4a2e38a49f0b5cfee6b05fbc839 Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-655465057 Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiagnosticsNegativeTest-655465057-project Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dbadb724dcf54d1c8f00f6752b86ab1f Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-655465057-project Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 could not be found. Jul 20 04:16:31.775738 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5be142e6-534b-4e0e-8aee-b5191b1486b5'} Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 could not be found. Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:16:31.776608 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 could not be found. Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 could not be found. Jul 20 04:16:31.778060 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:16:31.781167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] Returning 404 to user: Instance 5be142e6-534b-4e0e-8aee-b5191b1486b5 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:16:31.781167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81136090-87cd-4e8b-8df2-46f06c296f34 tempest-ServerDiagnosticsNegativeTest-655465057 tempest-ServerDiagnosticsNegativeTest-655465057-project] 10.222.0.49 "GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5" status: 404 len: 111 microversion: 2.1 time: 0.061265 Jul 20 04:16:31.781167 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 256/541] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/5be142e6-534b-4e0e-8aee-b5191b1486b5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:16:31.787867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d26fd5f3-a0d3-4a33-913a-d9de37958720 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '.version_select at 0x7f839805e430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.795564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26fd5f3-a0d3-4a33-913a-d9de37958720 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.803736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26fd5f3-a0d3-4a33-913a-d9de37958720 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.821624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d26fd5f3-a0d3-4a33-913a-d9de37958720 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1187 microversion: 2.1 time: 0.040609 Jul 20 04:16:31.823985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 257/542] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/os-migrations => generated 1187 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:31.836912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:31.838026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:31.843759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.844211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.845281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:31.845928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:31.870164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:31.878038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:31.884751 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1c19ca82-2484-4d69-9e63-20e1e9f525cd tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.721768 Jul 20 04:16:31.887430 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 286/543] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:32.118140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-554838108", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:32.210351 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:32.262194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.275101 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c3c8b6a-4cfe-4c2e-83a4-49998eff5f30 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.447829 Jul 20 04:16:32.275686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 258/544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:31 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:32.460984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.461606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.473263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.473713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.474558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.475946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.826445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:32.844532 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e77c088-9f85-4db1-9228-ad0dd3ee6fca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.387100 Jul 20 04:16:32.845567 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 259/545] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:32.854726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-51f3d8e2-dd4a-4ccf-a832-238d63accc69 req-7ad22d28-b2b6-4113-a2cd-4fec65a0cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c4546d-29d4-471e-83d3-08cfd8e4971f", "tag": "08df78b6-24f9-424a-aa1d-3f52bfb9aa5b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:32.883387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-51f3d8e2-dd4a-4ccf-a832-238d63accc69 req-7ad22d28-b2b6-4113-a2cd-4fec65a0cc0b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.883833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-51f3d8e2-dd4a-4ccf-a832-238d63accc69 req-7ad22d28-b2b6-4113-a2cd-4fec65a0cc0b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.897710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-51f3d8e2-dd4a-4ccf-a832-238d63accc69 req-7ad22d28-b2b6-4113-a2cd-4fec65a0cc0b service nova] Creating event network-changed:08df78b6-24f9-424a-aa1d-3f52bfb9aa5b for instance 92c4546d-29d4-471e-83d3-08cfd8e4971f on n-h1-764486-11 Jul 20 04:16:32.903032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-51f3d8e2-dd4a-4ccf-a832-238d63accc69 req-7ad22d28-b2b6-4113-a2cd-4fec65a0cc0b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055596 Jul 20 04:16:32.904165 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 260/546] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:32.910049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:32.910929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:32.917754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.918765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:32.919385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:32.919909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.054465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.062171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:33.062592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:33.063057 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:33.063461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:33.063858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:33.064325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.070648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.083057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ce64eac-0a21-4660-a8ed-20509c74235a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.176936 Jul 20 04:16:33.083666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 261/547] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:32 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:33.086330 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.086775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.093270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.093740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.103967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.104592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.123119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.123781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.125721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.126142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.171283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:33.185044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for user 3e8f4a044b904befbddb93375b6e213a and project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:33.232935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:33.235252 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:33.344547 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4b74736a-0b81-49a0-880c-dc0f42956a8f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232676 Jul 20 04:16:33.345196 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 287/548] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:33.361814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.362425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.391816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.393739 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.395251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.396861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.476301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.491696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9bfa4e9b-82f3-4e04-a96b-94ca151ca9c0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.389628 Jul 20 04:16:33.492699 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 262/549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.511278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d00de55-916a-4e17-b81c-2d6341274d0e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.517734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d00de55-916a-4e17-b81c-2d6341274d0e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.688400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d00de55-916a-4e17-b81c-2d6341274d0e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.696642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d00de55-916a-4e17-b81c-2d6341274d0e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1212 microversion: 2.1 time: 0.192568 Jul 20 04:16:33.697226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 263/550] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1212 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:33.863354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:33.864253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:33.879331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.880119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.881130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:33.881752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:33.894374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:33.904744 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5a489be7-b744-4202-9dc3-f0d73066012b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.558449 Jul 20 04:16:33.918757 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 288/551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.106567 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.107673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.115689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.116383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.117986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.118640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.368575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.387237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.389052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.409940 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f70403f3-be19-4c2e-84ac-36b27cfc0304 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1447 microversion: 2.75 time: 0.310333 Jul 20 04:16:34.411203 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 289/552] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1447 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:34.424558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.439772 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d91dfaee-565b-4ae6-9c3c-8efec9cf14fc tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.579752 Jul 20 04:16:34.441671 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 264/553] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:33 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.512343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.513377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.528010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.528488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.529258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.541681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.713981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.714700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:34.727609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.728821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.732673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:34.733250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:34.957171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:34.979653 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-36312b4c-7843-4206-be51-7457a92e3af6 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.473833 Jul 20 04:16:34.981637 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 290/554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:34.986655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:34.987258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.004180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.004911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.005877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.006452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.345737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.355843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21c4a152-f5b4-47d3-8a79-4a57de76ba2f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1264 microversion: 2.1 time: 0.645844 Jul 20 04:16:35.358280 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 265/555] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1264 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:35.376145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0df9c3b1-b725-4bd7-9c32-5b5f13a50c47 req-4959aa60-9e57-4599-956d-e7a6527cae73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2215a044-6be8-4af3-810e-76862c594dd2", "name": "network-vif-unplugged", "status": "completed", "tag": "dd47674e-ff11-45c0-9804-2c6b2eb82b22"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:35.392289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0df9c3b1-b725-4bd7-9c32-5b5f13a50c47 req-4959aa60-9e57-4599-956d-e7a6527cae73 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.392787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0df9c3b1-b725-4bd7-9c32-5b5f13a50c47 req-4959aa60-9e57-4599-956d-e7a6527cae73 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.425074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0df9c3b1-b725-4bd7-9c32-5b5f13a50c47 req-4959aa60-9e57-4599-956d-e7a6527cae73 service nova] Creating event network-vif-unplugged:dd47674e-ff11-45c0-9804-2c6b2eb82b22 for instance 2215a044-6be8-4af3-810e-76862c594dd2 on n-h2-764486-11 Jul 20 04:16:35.431817 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0df9c3b1-b725-4bd7-9c32-5b5f13a50c47 req-4959aa60-9e57-4599-956d-e7a6527cae73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072166 Jul 20 04:16:35.433145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 266/556] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:35.440934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.441904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.451670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.452512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.453642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.454293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.619645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.627459 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.643814 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f891a029-b78e-4eac-8bf2-dbe40949f087 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.660768 Jul 20 04:16:35.658333 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 291/557] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:34 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:35.660907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.664579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:35.673582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:35.677335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51569845-d1b5-4ff1-9f7f-2bbd47f77891 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1453 microversion: 2.75 time: 0.241259 Jul 20 04:16:35.678067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:35.682767 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 267/558] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1453 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:35.686392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.686941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:35.687804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:35.688331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.001033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.001701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.015880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.016935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.018960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.020539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.073800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.098743 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ef84802c-fd48-44a2-be50-cfe40a90af21 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.438994 Jul 20 04:16:36.100009 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 292/559] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:36.377916 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:36.378856 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:36.397047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.397494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.398273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:36.398704 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:36.982473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:36.989930 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d17c6a2f-47dd-4627-a20d-cd334b16f980 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1270 microversion: 2.1 time: 0.618913 Jul 20 04:16:36.994063 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 293/560] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1270 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:37.006120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.006738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.018144 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.018913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.021143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.024212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.049884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.060129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5ffe80f-b6d4-477c-9e44-777ee306040f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 1.066175 Jul 20 04:16:37.065066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 268/561] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:35 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:37.075690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.076597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.091797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.094784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.098929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.099823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.280469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.295430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.302451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.316301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65468e07-6b9a-446d-bac5-e47681501888 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1453 microversion: 2.75 time: 0.249837 Jul 20 04:16:37.318876 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 269/562] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:37 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:37.331187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:37.332024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:37.349959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.357261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.358141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:37.358679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:37.616806 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:37.639749 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ca33262c-a8f9-4843-a4f8-95de5dae8929 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.642655 Jul 20 04:16:37.641343 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 294/563] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:36 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.008694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.009311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.027234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.029871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.034604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.035419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.044612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:38.278061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.291390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e5269e8-fdaa-4caf-bbfe-1d8bc7c942e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1503 microversion: 2.1 time: 0.967735 Jul 20 04:16:38.301744 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 270/564] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:37 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1503 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.301744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.301744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.319985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.320504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.321281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.321710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.524638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.559669 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-781d06cc-4f64-417c-abbc-89b9d4660c28 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.556354 Jul 20 04:16:38.561528 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 295/565] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.570494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:38.577234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:38.606508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.607120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.608242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:38.608810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:38.673580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:38.686873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0a492d2-7232-4584-9593-333a9b5d77ce tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.391608 Jul 20 04:16:38.688036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 271/566] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:38.955797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1357065894", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "3e4182e1-3b84-49f1-9a99-386772005d20"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:39.002802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.025352 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.035736 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:39.039019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] validate_networks() for [('3e4182e1-3b84-49f1-9a99-386772005d20', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:39.054919 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7a98ee7e-ecfd-445c-968b-57fb88dd0c6a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1438 microversion: 2.75 time: 0.492066 Jul 20 04:16:39.069501 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 296/567] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:38 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1438 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:39.228050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-702036684", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:39.318686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:39.628646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:39.629683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:39.630511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:39.631935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:39.632558 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:39.653540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.654288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.655408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.656011 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.686936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:39.693223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:39.716781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:39.719395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:39.793199 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f7a7182d-35d0-4f87-8d0e-89d66bffee86 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721748 Jul 20 04:16:39.799423 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 297/568] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:39.811134 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:39.812042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:39.818789 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.821001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:39.822081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:39.822680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.116496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:40.127854 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b37a1667-1f6b-4151-9f69-36d9cac799e1 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.326958 Jul 20 04:16:40.128440 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 298/569] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:39 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:40.418158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:40.420264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.433812 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.434272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.437407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.437873 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.604110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:40.604808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:40.606013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:40.606665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:40.607273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:40.821713 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:40.835181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.835634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.838448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.838912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.956082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:40.957662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:40.958296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:40.959196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:40.959770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:40.979403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.979917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:40.980664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:40.990070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.048079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:41.067295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:41.076854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for user c21b3bf3ba4d4558950d7337a651587f and project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:41.132666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:41.135366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:41.186063 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-09722616-dafe-4605-a525-c267798f7963 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66/action" status: 202 len: 1944 microversion: 2.75 time: 1.051737 Jul 20 04:16:41.191011 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 299/570] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:16:40 2022] POST /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66/action => generated 1944 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:16:41.200449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-0d9dbdb0-c7d2-4077-8209-61b1b05c7f5a req-734a41b6-38c6-4cdf-aa3c-efee3ef68037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e5887a-3217-4bd1-b7b7-04a5c224f8df", "name": "network-vif-plugged", "status": "completed", "tag": "60cc2fec-7a55-4946-871a-28543ded0ee8"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:41.226652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:41.236454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-0d9dbdb0-c7d2-4077-8209-61b1b05c7f5a req-734a41b6-38c6-4cdf-aa3c-efee3ef68037 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.236888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-0d9dbdb0-c7d2-4077-8209-61b1b05c7f5a req-734a41b6-38c6-4cdf-aa3c-efee3ef68037 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.255635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f15dfbc1-0acf-4796-a04a-e2e4e7e66ee0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.563990 Jul 20 04:16:41.262681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 272/571] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:16:41.281539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.282767 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-0d9dbdb0-c7d2-4077-8209-61b1b05c7f5a req-734a41b6-38c6-4cdf-aa3c-efee3ef68037 service nova] Creating event network-vif-plugged:60cc2fec-7a55-4946-871a-28543ded0ee8 for instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df on n-h2-764486-11 Jul 20 04:16:41.286085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.314350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.315223 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-0d9dbdb0-c7d2-4077-8209-61b1b05c7f5a req-734a41b6-38c6-4cdf-aa3c-efee3ef68037 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122129 Jul 20 04:16:41.316147 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 300/572] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:41.326758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.328094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.328778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.493669 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1238039354", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "68bd39f8-08a9-4dc1-99aa-d99e70ad6756"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:41.609101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] validate_networks() for [('68bd39f8-08a9-4dc1-99aa-d99e70ad6756', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:41.837148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:41.851715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-896ff20a-7bb0-41ec-a6f2-0c4ac6e3dd3b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1478 microversion: 2.1 time: 0.583956 Jul 20 04:16:41.853571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 273/573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1478 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:41.872467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:41.875488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:41.893852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.894612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:41.896595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:41.897575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.197116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.206844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54016aeb-5928-4c0a-a604-7fa1303c07a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.348788 Jul 20 04:16:42.211623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 274/574] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:41 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.217968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.218981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.231797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.232409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.233503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.234053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.314694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:42.315282 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:42.315839 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:42.316421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:42.317002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:42.328204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.329092 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.330061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.330651 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.351847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Getting quotas for project febcd6e5655a4c848ce695c1eba2b3dc. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:42.359246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Getting quotas for user 33f94c39cd424c44b3757c877544541d and project febcd6e5655a4c848ce695c1eba2b3dc. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:42.373322 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:42.376138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:42.409056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.421198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62bc9671-ef5a-4f71-a3d1-06be1c98c2a2 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.204341 Jul 20 04:16:42.422292 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 275/575] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.427635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.428751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.436734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.437480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.438457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.438896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.442546 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e5f92c65-e11d-46e0-8fc1-2bcd5fc8172e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125111 Jul 20 04:16:42.443193 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 301/576] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:42.453097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.453706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.487904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.497781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.499024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.499477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.522580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.545755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e566492-66ad-4794-bfa6-88b72f71738a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1276 microversion: 2.1 time: 0.111921 Jul 20 04:16:42.547460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 276/577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.566716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.567533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:42.590591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.594510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.595550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:42.603896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:42.895753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:42.959377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:42.973573 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2522a35e-0a51-43ee-ab50-d927fc4b5a2b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1348 microversion: 2.1 time: 0.528344 Jul 20 04:16:42.986175 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 302/578] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1348 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:42.994457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:42.996307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.008304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.009293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.010812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:43.012694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.013472 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.037805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7e2e419-0cc7-4364-a7d8-39933a132b89 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.488887 Jul 20 04:16:43.051540 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 277/579] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:43.068149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5a3c4452-a1b2-4ddb-b98f-0a0ab79dca76 req-3d4ff983-dfdb-4970-b908-58ee74f54ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3", "tag": "1ed64614-8410-4160-97d3-350c62fdb902"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:43.084869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a3c4452-a1b2-4ddb-b98f-0a0ab79dca76 req-3d4ff983-dfdb-4970-b908-58ee74f54ae9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.085313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a3c4452-a1b2-4ddb-b98f-0a0ab79dca76 req-3d4ff983-dfdb-4970-b908-58ee74f54ae9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.114038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5a3c4452-a1b2-4ddb-b98f-0a0ab79dca76 req-3d4ff983-dfdb-4970-b908-58ee74f54ae9 service nova] Creating event network-changed:1ed64614-8410-4160-97d3-350c62fdb902 for instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 on n-h2-764486-11 Jul 20 04:16:43.114222 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.123485 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5a3c4452-a1b2-4ddb-b98f-0a0ab79dca76 req-3d4ff983-dfdb-4970-b908-58ee74f54ae9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079000 Jul 20 04:16:43.123774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.126963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.128611 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-88b833c0-f18a-4d25-9747-cbd1254c7370 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1258 microversion: 2.25 time: 0.140539 Jul 20 04:16:43.129408 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 303/580] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:42 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:43.130837 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 278/581] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:43.134385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1b19ba59-31b0-4c4c-b767-5651159386bc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '.version_select at 0x7f8398332820>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.137365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b19ba59-31b0-4c4c-b767-5651159386bc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.138074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b19ba59-31b0-4c4c-b767-5651159386bc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.144279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71c8f3a3-61b6-48d3-a517-a26e891ad32a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.145648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71c8f3a3-61b6-48d3-a517-a26e891ad32a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.147863 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1b19ba59-31b0-4c4c-b767-5651159386bc tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.017125 Jul 20 04:16:43.148864 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 304/582] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.162045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.162660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:43.177093 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.200270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.201666 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.202854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.207502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.285456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71c8f3a3-61b6-48d3-a517-a26e891ad32a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.299445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71c8f3a3-61b6-48d3-a517-a26e891ad32a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1216 microversion: 2.1 time: 0.166046 Jul 20 04:16:43.302166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 279/583] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.318819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.322163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.347140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.347602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.360299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.361265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.685969 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ca378663-c4c5-4119-8804-d24df0a01c26 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1631 microversion: 2.1 time: 0.528111 Jul 20 04:16:43.688825 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 305/584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1631 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.694372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-c65f9a8a-52fe-440f-ad1f-12db2547c92b req-e95b21e6-7422-4865-975d-b2dd8ce426d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c4546d-29d4-471e-83d3-08cfd8e4971f", "name": "network-vif-plugged", "status": "completed", "tag": "08df78b6-24f9-424a-aa1d-3f52bfb9aa5b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:43.722909 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c65f9a8a-52fe-440f-ad1f-12db2547c92b req-e95b21e6-7422-4865-975d-b2dd8ce426d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.723531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c65f9a8a-52fe-440f-ad1f-12db2547c92b req-e95b21e6-7422-4865-975d-b2dd8ce426d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.752684 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-c65f9a8a-52fe-440f-ad1f-12db2547c92b req-e95b21e6-7422-4865-975d-b2dd8ce426d4 service nova] Creating event network-vif-plugged:08df78b6-24f9-424a-aa1d-3f52bfb9aa5b for instance 92c4546d-29d4-471e-83d3-08cfd8e4971f on n-h1-764486-11 Jul 20 04:16:43.759233 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-c65f9a8a-52fe-440f-ad1f-12db2547c92b req-e95b21e6-7422-4865-975d-b2dd8ce426d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068338 Jul 20 04:16:43.761584 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 306/585] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:43.781686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.783593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.795535 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.796302 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.797872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.798559 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.811726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:43.821800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c258ce3e-b843-4143-bc7d-eb79786c86b1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.516405 Jul 20 04:16:43.825286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 280/586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:43.830604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:43.831976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:43.850672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.851407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:43.852847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:43.853496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.093025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.101819 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27453df1-ae01-4106-846f-61b3801ccb41 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1274 microversion: 2.1 time: 0.275441 Jul 20 04:16:44.106103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 281/587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.116237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76c502f5-b9b9-449e-be5a-fb379db5b0fa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Action: 'create', calling method: .version_select at 0x7f8398261280>, body: {"keypair": {"name": "tempest-keypair-523111020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKOo6cJ56384L+etuEcrmCT2koY4f7tfPBxboBJ0MAgEeT0uMhrz0Jle3tRXR4tHkS7/mP+kOFa8pHD7lUL4x++M3JrAIB0U/vpKHaUjfyBGzqE/efMYCuXJ/vG4ZWifA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:44.156175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-76c502f5-b9b9-449e-be5a-fb379db5b0fa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:44.162269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-76c502f5-b9b9-449e-be5a-fb379db5b0fa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for user ab72bd0852ad4f72a0c96a7ddf1bdd63 and project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:44.200922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76c502f5-b9b9-449e-be5a-fb379db5b0fa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088558 Jul 20 04:16:44.201891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 282/588] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:16:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:44.219961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.222308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.233292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.234137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.235326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.235963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.326208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.337327 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-18595008-62ce-4a8d-bf55-81d573f9323e tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.574274 Jul 20 04:16:44.348729 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 307/589] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:43 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.354603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.355537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.369305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.369969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.370961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.371593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.504639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:44.532900 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3d1effb1-4f00-4e0c-ae2d-c1c2dbe86ef5 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.182278 Jul 20 04:16:44.534433 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 308/590] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:44.543573 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.544473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.556176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.556922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.557964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.558603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.575504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.590850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37cd5df6-2551-4ebe-823b-fc256decf28b tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1537 microversion: 2.1 time: 0.381062 Jul 20 04:16:44.592306 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 283/591] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1537 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.600381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.605519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.634039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.634763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.635634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.636900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.702415 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.717847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.719803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.721202 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-be22ac89-08a9-4b1a-b2c4-7db8829f8a50 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1320 microversion: 2.25 time: 0.185578 Jul 20 04:16:44.734399 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 309/592] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:44.741745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.742435 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.751014 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.751720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.755721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.758580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.804915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:44.815084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a5c33505-6cf1-4392-945b-bf231599393a tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1286 microversion: 2.1 time: 0.221021 Jul 20 04:16:44.815746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 284/593] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:44.842954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:44.843540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:44.854857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.855813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:44.859084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:44.859884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.032090 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7920a746-7773-44fa-b685-b8f1969fb8d4 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295716 Jul 20 04:16:45.033951 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 310/594] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:45.122921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.123515 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.129924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.130124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.130452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.131374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.131690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.142051 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4fc5ff5-fc34-4582-8d2b-baa63c747f6a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.300875 Jul 20 04:16:45.152385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 285/595] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:44 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:45.355867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.363311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.371084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.371901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.373488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.374138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.571385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.592475 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8117cf69-3446-4c3d-b2b5-ea4cb4c43d97 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.473686 Jul 20 04:16:45.597414 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 311/596] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:45.602547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.603409 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.610443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.611203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.612818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.613455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.633111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:45.869050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:45.878483 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96e361bc-eba6-4093-a3fa-91856ebdffda tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1391 microversion: 2.1 time: 0.526988 Jul 20 04:16:45.890158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 286/597] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1391 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:45.895443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:45.896477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:45.904264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.905107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:45.906111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:45.906766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.022157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.035992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.038930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.045426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6fef3dfb-b94b-4c57-836c-d50a0b60d9d6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1320 microversion: 2.25 time: 0.153762 Jul 20 04:16:46.046428 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 287/598] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:46.058296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.059991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.068479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.069218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.070209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.071737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.101399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:46.125769 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bf06561c-b67e-4693-8c19-40600242f47c tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.525609 Jul 20 04:16:46.126678 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 312/599] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:45 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:46.162551 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.163624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.173490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.173490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.174435 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.174882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.446166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.462516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-372f9a76-5795-4192-8ccb-999ebc8c57b0 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1274 microversion: 2.1 time: 0.413667 Jul 20 04:16:46.464844 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 288/600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:46.610469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.611324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.618009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.618736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.620011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.621288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.706235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:46.714604 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ca536427-21ee-45e9-8136-5829027d62c9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.559114 Jul 20 04:16:46.715734 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 313/601] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:46.897408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:46.898920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:46.911754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.912897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:46.916368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:46.917013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.109081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.121972 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93b94fef-221b-42d3-bad5-250c7ce8924b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.512555 Jul 20 04:16:47.123158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 289/602] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.128005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.128842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.142984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.144420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.145549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.146137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.488871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.498208 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-20e25e15-05a6-4cba-ab20-f90dc196b8cb tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1589 microversion: 2.1 time: 0.605347 Jul 20 04:16:47.501456 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 314/603] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:46 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1589 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:47.518556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.519482 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.527475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.528117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.530526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.531174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.592131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.600903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.602804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:47.604215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6690942-1465-4950-9a29-3e8c4c0bdb7a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.480034 Jul 20 04:16:47.605383 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 290/604] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:47.610754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.611512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.620040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.622469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.625471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.626026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.686092 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:47.716678 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f2ac29d9-af18-4c9b-b331-a6ea296ebbe7 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.212370 Jul 20 04:16:47.717560 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 315/605] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:47.722716 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.723533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.740695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.741957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.749273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.750009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.907329 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0d147444-a3a2-4102-9340-b941bf8adee0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188452 Jul 20 04:16:47.907984 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 316/606] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:47.913766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:47.914614 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:47.923029 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.923573 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:47.924530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:47.925258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.206310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.236769 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07f97478-b492-4c58-8157-b0e3c0073849 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.628134 Jul 20 04:16:48.240543 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 291/607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.256984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4fb64b9b-5e44-4468-9274-d4e9308098ca req-f2114849-5b8f-4c70-82e9-991c5792ab31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933fbdd2-8589-43a1-a99a-8f22c47fcb69", "tag": "a9a4c985-7a16-4d2c-97b2-f09bb8e7f8f9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:48.267761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4fb64b9b-5e44-4468-9274-d4e9308098ca req-f2114849-5b8f-4c70-82e9-991c5792ab31 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.268556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4fb64b9b-5e44-4468-9274-d4e9308098ca req-f2114849-5b8f-4c70-82e9-991c5792ab31 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.302095 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4fb64b9b-5e44-4468-9274-d4e9308098ca req-f2114849-5b8f-4c70-82e9-991c5792ab31 service nova] Creating event network-changed:a9a4c985-7a16-4d2c-97b2-f09bb8e7f8f9 for instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 on n-h2-764486-11 Jul 20 04:16:48.308907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:48.310503 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4fb64b9b-5e44-4468-9274-d4e9308098ca req-f2114849-5b8f-4c70-82e9-991c5792ab31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065941 Jul 20 04:16:48.311621 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 292/608] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:48.318162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.320239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.322398 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cb116882-1325-40f7-ad44-174e38e60698 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.412879 Jul 20 04:16:48.324071 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 317/609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:47 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:48.343069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.343514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.344289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.344745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.622723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:48.623574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:48.642693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.643155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:48.643965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:48.644416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.275102 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.291165 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.294974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.300390 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8c74093f-27df-4205-b246-1e80c939ae6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.677941 Jul 20 04:16:49.301406 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 318/610] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:49.310882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.311499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.334732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.335213 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.336030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.336587 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.365297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.377209 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7174c67-10e4-4424-bf02-01616d3a1eb9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 1.064126 Jul 20 04:16:49.377830 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 293/611] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:48 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:49.392114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-105e47d7-2ba2-4566-a2f7-493a2c5bbcc1 req-23ba463e-d34b-475d-b50f-01c3d62cb2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c3cf9e-13ba-4c3f-98fa-fba6accc810f", "tag": "e35f7348-43b5-42a3-b76e-56dd49b8b2e4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:49.414548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-105e47d7-2ba2-4566-a2f7-493a2c5bbcc1 req-23ba463e-d34b-475d-b50f-01c3d62cb2f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.418100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-105e47d7-2ba2-4566-a2f7-493a2c5bbcc1 req-23ba463e-d34b-475d-b50f-01c3d62cb2f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.454968 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-105e47d7-2ba2-4566-a2f7-493a2c5bbcc1 req-23ba463e-d34b-475d-b50f-01c3d62cb2f8 service nova] Creating event network-changed:e35f7348-43b5-42a3-b76e-56dd49b8b2e4 for instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f on n-h1-764486-11 Jul 20 04:16:49.466377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-105e47d7-2ba2-4566-a2f7-493a2c5bbcc1 req-23ba463e-d34b-475d-b50f-01c3d62cb2f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080298 Jul 20 04:16:49.472073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 294/612] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:49.477661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.481228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.503790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.504650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.505685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.506346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.612569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:49.648622 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8e8a2780-26f3-45e0-9a3d-3cdc36d9b733 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.341841 Jul 20 04:16:49.650568 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 319/613] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:49.658419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:49.659230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:49.667801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.668540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.669473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:49.671302 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:49.962122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:49.971918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3ccbcdb-0f62-4a78-baf9-e5f7a005896c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.498290 Jul 20 04:16:49.982491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 295/614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.266317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.274540 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-95328c76-e06c-454e-bb16-e139c99ab1f0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.620764 Jul 20 04:16:50.275288 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 320/615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:49 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.319357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.320073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.328600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.329141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.330106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.330862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.373068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-dbf33c14-146c-4789-b700-49800f5494bd req-3988282b-3868-4599-b863-2de397dd6cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e5887a-3217-4bd1-b7b7-04a5c224f8df", "tag": "60cc2fec-7a55-4946-871a-28543ded0ee8"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:50.393586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-dbf33c14-146c-4789-b700-49800f5494bd req-3988282b-3868-4599-b863-2de397dd6cf4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.394043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-dbf33c14-146c-4789-b700-49800f5494bd req-3988282b-3868-4599-b863-2de397dd6cf4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.408562 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-dbf33c14-146c-4789-b700-49800f5494bd req-3988282b-3868-4599-b863-2de397dd6cf4 service nova] Creating event network-changed:60cc2fec-7a55-4946-871a-28543ded0ee8 for instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df on n-h2-764486-11 Jul 20 04:16:50.421664 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-dbf33c14-146c-4789-b700-49800f5494bd req-3988282b-3868-4599-b863-2de397dd6cf4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054289 Jul 20 04:16:50.422895 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 321/616] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:50.428621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.429383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.436016 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.436487 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.437250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.437676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.579389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.588094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.589812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.591244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6d64cc8-9c6e-4ae2-ba27-e9a7f782d178 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.276317 Jul 20 04:16:50.598254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:50.602629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 296/617] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:50.608218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-458615970", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "7e6d563b-6d30-4058-9507-057aaaf62886"}], "security_groups": [{"name": "tempest-securitygroup--19172920"}], "key_name": "tempest-keypair-523111020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:50.608443 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e85c33eb-8b46-4a03-85e9-2e1f8fd27acb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.183845 Jul 20 04:16:50.617452 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 322/618] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:50.675409 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.676116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.684508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.685037 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.685905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.686406 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.769470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] validate_networks() for [('7e6d563b-6d30-4058-9507-057aaaf62886', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:50.772426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:50.795994 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dc513274-58fd-4d73-87bb-5b8c7106a556 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.125762 Jul 20 04:16:50.800492 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 323/619] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:50.810083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-79874089-49d0-483c-b511-cc021b2b1ae3 req-d3ca2dbb-7bbe-4d4d-a816-09e24ec670b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3", "name": "network-vif-plugged", "status": "completed", "tag": "1ed64614-8410-4160-97d3-350c62fdb902"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:50.824968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-79874089-49d0-483c-b511-cc021b2b1ae3 req-d3ca2dbb-7bbe-4d4d-a816-09e24ec670b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.825668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-79874089-49d0-483c-b511-cc021b2b1ae3 req-d3ca2dbb-7bbe-4d4d-a816-09e24ec670b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.844119 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-79874089-49d0-483c-b511-cc021b2b1ae3 req-d3ca2dbb-7bbe-4d4d-a816-09e24ec670b4 service nova] Creating event network-vif-plugged:1ed64614-8410-4160-97d3-350c62fdb902 for instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 on n-h2-764486-11 Jul 20 04:16:50.854134 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-79874089-49d0-483c-b511-cc021b2b1ae3 req-d3ca2dbb-7bbe-4d4d-a816-09e24ec670b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055609 Jul 20 04:16:50.856342 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 324/620] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:50.865245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:50.866208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:50.873763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.874510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:50.875511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:50.876097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.018033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:51.047323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.056621 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3f07b910-0ce4-4e8c-8aaa-40e46358c844 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1589 microversion: 2.1 time: 0.198806 Jul 20 04:16:51.057861 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 325/621] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:50 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1589 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.076508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.079012 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.087055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.087728 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.089386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.090000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.467352 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.480184 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-62b2f278-4922-45f6-a956-fa7c79d46710 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.420716 Jul 20 04:16:51.482123 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 326/622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.489089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.490954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.499983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.500965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.501991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.502772 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.674190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:51.674798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:51.675243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:51.675712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:51.676187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:51.686086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.686671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.687690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.688343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.707405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:51.713099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for user ab72bd0852ad4f72a0c96a7ddf1bdd63 and project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:51.730556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:51.732971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:51.787125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54b9e736-bd9f-466f-a62f-45529958bba7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.183345 Jul 20 04:16:51.787778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 297/623] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:16:51.798636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f92c303a-c4c4-4520-b6a5-270c01a4fedd req-e2188f14-4d26-488a-b514-72a99012ef30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2848d05-a6b8-4a72-9774-0f49ec9cf583", "tag": "3f22db6d-7095-4a4b-8c65-fec308924fc4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:51.809342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f92c303a-c4c4-4520-b6a5-270c01a4fedd req-e2188f14-4d26-488a-b514-72a99012ef30 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.810698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f92c303a-c4c4-4520-b6a5-270c01a4fedd req-e2188f14-4d26-488a-b514-72a99012ef30 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.822669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f92c303a-c4c4-4520-b6a5-270c01a4fedd req-e2188f14-4d26-488a-b514-72a99012ef30 service nova] Creating event network-changed:3f22db6d-7095-4a4b-8c65-fec308924fc4 for instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 on n-h2-764486-11 Jul 20 04:16:51.829521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f92c303a-c4c4-4520-b6a5-270c01a4fedd req-e2188f14-4d26-488a-b514-72a99012ef30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034901 Jul 20 04:16:51.830127 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 298/624] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:51.835584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.836616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.843940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.844590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.845510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.846116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.848777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:51.858060 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-484cea44-7184-42bf-acdd-51b0baa56cef tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.374639 Jul 20 04:16:51.859240 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 327/625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:51.864578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:51.865297 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:51.872535 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.873101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:51.874110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:51.874646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.012946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.017261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:52.032170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.033895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.035107 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d911966-84d5-4b5a-86a3-ecaf968cfe85 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.203720 Jul 20 04:16:52.038438 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 299/626] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:52.050126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc413cce-087e-459a-b1fd-3c42702ac5de tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.050869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc413cce-087e-459a-b1fd-3c42702ac5de tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.119591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc413cce-087e-459a-b1fd-3c42702ac5de tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.127764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc413cce-087e-459a-b1fd-3c42702ac5de tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1233 microversion: 2.1 time: 0.088281 Jul 20 04:16:52.128734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 300/627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.133142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.133932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.141793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.142283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.143063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.143573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.155639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.164096 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-38406212-0834-40f4-9eed-181fa390a43e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.303164 Jul 20 04:16:52.164918 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 328/628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:51 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.236132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:52.254545 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9348d04c-b23b-4b5e-8781-4bf93b43c90f tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.124736 Jul 20 04:16:52.255123 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 301/629] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:52.437088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-94533c10-ef50-413c-a2aa-1a56f100da55 req-d7184a63-3ecc-42e0-95e6-a96e35a92043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c4546d-29d4-471e-83d3-08cfd8e4971f", "tag": "08df78b6-24f9-424a-aa1d-3f52bfb9aa5b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:52.440695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:52.441369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=18 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:52.449250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-94533c10-ef50-413c-a2aa-1a56f100da55 req-d7184a63-3ecc-42e0-95e6-a96e35a92043 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.449250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-94533c10-ef50-413c-a2aa-1a56f100da55 req-d7184a63-3ecc-42e0-95e6-a96e35a92043 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.460870 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-94533c10-ef50-413c-a2aa-1a56f100da55 req-d7184a63-3ecc-42e0-95e6-a96e35a92043 service nova] Creating event network-changed:08df78b6-24f9-424a-aa1d-3f52bfb9aa5b for instance 92c4546d-29d4-471e-83d3-08cfd8e4971f on n-h1-764486-11 Jul 20 04:16:52.465620 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-94533c10-ef50-413c-a2aa-1a56f100da55 req-d7184a63-3ecc-42e0-95e6-a96e35a92043 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032726 Jul 20 04:16:52.466209 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 329/630] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:52.498176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.498791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.505844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.506097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.506765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.507203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.712947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:52.720158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6a6e5d5-55e7-4f85-881f-6d03c0156728 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.226685 Jul 20 04:16:52.723134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 302/631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:52.877231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:52.878865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:52.887613 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.893110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.901597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:52.902242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:52.908067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:53.057238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.057348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.065121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.065767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.066525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.066963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.112777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.121283 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-94ccfeec-24fd-4c88-8c0c-24f65b37dfc5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1312 microversion: 2.1 time: 0.249717 Jul 20 04:16:53.133015 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 330/632] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:52 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:53.146140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.146861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.157246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.157801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.158653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.159291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.281706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.291266 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c67f64ab-560d-4d68-9aaa-84068a526eaa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1291 microversion: 2.1 time: 0.148753 Jul 20 04:16:53.302332 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 331/633] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1291 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:53.306787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.307963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.315172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.315628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.316430 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.316871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.471339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.496477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.498431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.499938 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35d75af5-b43e-45d6-8b7c-d86c26a8b09a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.446935 Jul 20 04:16:53.511146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 303/634] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:53.516203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.516882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.525705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.526681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.527468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.527903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.572382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.581125 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f2771227-466e-4361-bc57-662b73659d3d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.277991 Jul 20 04:16:53.581895 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 332/635] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:53.656472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:53.687420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-052ec255-5f8a-490e-bd17-a3635fde6f6b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.174616 Jul 20 04:16:53.688402 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 304/636] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:53.737824 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:53.738433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:53.750800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.751256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.752030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:53.752671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:53.903886 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:53.911491 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dba8bf72-a1fe-4d5d-bfc0-816d384fd181 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.177521 Jul 20 04:16:53.911993 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 333/637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:53 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.140752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.141360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.147414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.147850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.148629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.149056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.308743 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.309482 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.315618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.316064 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.316865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.317297 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.348530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.356763 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec6cd1fb-c170-408d-a14c-c069969cccd0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1462 microversion: 2.1 time: 0.219937 Jul 20 04:16:54.361073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 305/638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1462 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.372891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:54.374417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.380895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.381340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.382111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.382539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.474547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.485805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:16:54.492550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:54.492975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:54.493445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:54.493846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:54.494034 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.494251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:54.505802 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2e246a25-6409-4a82-959e-16e97452396b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.200684 Jul 20 04:16:54.517574 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 334/639] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:54.523311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.523916 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.531350 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.532035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.533133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.533721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.678069 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05caa597-d0dc-4b25-806e-68820094fc81 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.308890 Jul 20 04:16:54.678609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 306/640] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:16:54 2022] POST /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:16:54.687452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.688394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.695505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.706079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.706995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.707389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.707877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.708450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.708888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.711713 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1a5e1468-27f7-431c-8dec-58ee1dd4da53 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.192219 Jul 20 04:16:54.713013 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 335/641] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:54.718257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.718949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.725216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.725813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.726586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.727017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.892573 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.900550 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e3cd3e3c-54f4-469e-8f26-3b1b255309e3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1471 microversion: 2.1 time: 0.186144 Jul 20 04:16:54.902336 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 336/642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.907230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.908589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:54.917333 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.918135 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.919134 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:54.919780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:54.965097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:54.976666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0b767e2-5c29-442b-b258-acf277010e91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.292878 Jul 20 04:16:54.977609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 307/643] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:54.987441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:54.988051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.007785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.008613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.009391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.009824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.033843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:55.080097 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-29f15a84-bdf7-4451-aa35-a76423c1bb50 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.175095 Jul 20 04:16:55.081950 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 337/644] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:55.095518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-fc91b7ce-c208-4924-a7ae-c50ce60a46a4 req-467626c5-e0a4-47d8-8ac1-e761bd0386cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933fbdd2-8589-43a1-a99a-8f22c47fcb69", "name": "network-vif-plugged", "status": "completed", "tag": "a9a4c985-7a16-4d2c-97b2-f09bb8e7f8f9"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:55.103731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:55.107082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-fc91b7ce-c208-4924-a7ae-c50ce60a46a4 req-467626c5-e0a4-47d8-8ac1-e761bd0386cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.107717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-fc91b7ce-c208-4924-a7ae-c50ce60a46a4 req-467626c5-e0a4-47d8-8ac1-e761bd0386cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.122974 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-fc91b7ce-c208-4924-a7ae-c50ce60a46a4 req-467626c5-e0a4-47d8-8ac1-e761bd0386cf service nova] Creating event network-vif-plugged:a9a4c985-7a16-4d2c-97b2-f09bb8e7f8f9 for instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 on n-h2-764486-11 Jul 20 04:16:55.130413 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-fc91b7ce-c208-4924-a7ae-c50ce60a46a4 req-467626c5-e0a4-47d8-8ac1-e761bd0386cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038199 Jul 20 04:16:55.132242 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 338/645] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:55.397560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.409176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77f028f9-76b8-41ce-a217-d1922c64decb tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.430482 Jul 20 04:16:55.410371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 308/646] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:54 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:55.524829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.526456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.533516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.533955 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.534699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.535124 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.614825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3e0c24b2-4863-4b09-b680-749132f1d486 req-5e7c3c07-d0e9-466d-aa74-8b0546ff6a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:55.637076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3e0c24b2-4863-4b09-b680-749132f1d486 req-5e7c3c07-d0e9-466d-aa74-8b0546ff6a5a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.637634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3e0c24b2-4863-4b09-b680-749132f1d486 req-5e7c3c07-d0e9-466d-aa74-8b0546ff6a5a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.669806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3e0c24b2-4863-4b09-b680-749132f1d486 req-5e7c3c07-d0e9-466d-aa74-8b0546ff6a5a service nova] Creating event network-changed:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h1-764486-11 Jul 20 04:16:55.675481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3e0c24b2-4863-4b09-b680-749132f1d486 req-5e7c3c07-d0e9-466d-aa74-8b0546ff6a5a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064893 Jul 20 04:16:55.676705 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 309/647] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:55.751109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.752013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.766002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.766445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.766880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.767214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.767645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.775264 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c42291ae-7d6e-44a4-983f-ae1eca2056ff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.254559 Jul 20 04:16:55.779268 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 339/648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:55.919102 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:55.919717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:55.926493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.926946 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.927716 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:55.928150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:55.986512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.997678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:55.999187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.000289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b1678ec-2af8-4669-94f2-f2be9f8feec0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.273798 Jul 20 04:16:56.013372 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 310/649] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:56.019381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.020175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.027842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:56.031828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.032275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.033103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.033537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.113958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.122315 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2b0c9860-39e7-4bdf-992b-2e4446b99476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1471 microversion: 2.1 time: 0.207124 Jul 20 04:16:56.123199 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 340/650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:55 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:56.127710 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.128314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.134416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.134864 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.136257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.136719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.206996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:56.224913 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e31f83de-7de7-4840-bbd0-b6c415db19a9 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.100638 Jul 20 04:16:56.225496 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 341/651] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:56.243129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.250991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fcac3382-eee3-46fd-be49-04da36e893d4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1316 microversion: 2.1 time: 0.236337 Jul 20 04:16:56.251778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 311/652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.426434 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.427131 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.433286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.433736 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.434494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.434932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.572625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:56.581582 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bcad6b6d-c4c4-40e3-9186-6e0fb6eb8a17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.159081 Jul 20 04:16:56.582298 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 342/653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:56.796742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:56.797294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:56.804010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.804525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:56.805298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:56.805733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.030967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.031516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.040107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.040886 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.041770 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.042206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.143806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.151997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d69de13-aaae-439f-a408-033b5b3b17a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.360130 Jul 20 04:16:57.152601 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 312/654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:56 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:57.157228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.158003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.164710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.165156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.165913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.166364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.186246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.197209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.199429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.200768 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8de0f6b1-c8aa-48b3-870e-1b9c861de009 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.174462 Jul 20 04:16:57.201429 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 343/655] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:57.206165 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-1941af57-384c-4216-8033-5b6f614b0786 req-06f1a795-40f7-4978-b32f-711502f2cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c3cf9e-13ba-4c3f-98fa-fba6accc810f", "name": "network-vif-plugged", "status": "completed", "tag": "e35f7348-43b5-42a3-b76e-56dd49b8b2e4"}, {"server_uuid": "e2848d05-a6b8-4a72-9774-0f49ec9cf583", "name": "network-vif-plugged", "status": "completed", "tag": "3f22db6d-7095-4a4b-8c65-fec308924fc4"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:57.216086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-1941af57-384c-4216-8033-5b6f614b0786 req-06f1a795-40f7-4978-b32f-711502f2cfb1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.216686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-1941af57-384c-4216-8033-5b6f614b0786 req-06f1a795-40f7-4978-b32f-711502f2cfb1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.229675 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-1941af57-384c-4216-8033-5b6f614b0786 req-06f1a795-40f7-4978-b32f-711502f2cfb1 service nova] Creating event network-vif-plugged:e35f7348-43b5-42a3-b76e-56dd49b8b2e4 for instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f on n-h1-764486-11 Jul 20 04:16:57.230272 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-1941af57-384c-4216-8033-5b6f614b0786 req-06f1a795-40f7-4978-b32f-711502f2cfb1 service nova] Creating event network-vif-plugged:3f22db6d-7095-4a4b-8c65-fec308924fc4 for instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 on n-h2-764486-11 Jul 20 04:16:57.238632 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-1941af57-384c-4216-8033-5b6f614b0786 req-06f1a795-40f7-4978-b32f-711502f2cfb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035783 Jul 20 04:16:57.239497 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 344/656] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:16:57.246426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.247265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.254001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.254445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.255207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.255637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.336891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:57.354336 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bd77a2b7-a2c7-4d4b-85fc-31565fce660e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.112557 Jul 20 04:16:57.355100 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 345/657] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:57.370658 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.371283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.378654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.379096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.380007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.380471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.520378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.528438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83e11472-4d46-4cac-8430-2c6819a7fad1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1471 microversion: 2.1 time: 0.374576 Jul 20 04:16:57.528605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.529336 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 313/658] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:57.536846 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1d81454c-2026-49b0-9da2-f3e9bbd0b168 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1465 microversion: 2.1 time: 0.174812 Jul 20 04:16:57.537431 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 346/659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1465 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:57.599280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.599997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.602612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:57.603239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:57.606778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.607373 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.608422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.608929 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.609507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.609958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.610733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:57.611166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:57.612320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:57.750058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:57.758378 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8a79315f-8df7-41b9-90c5-58346e7ed4aa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1316 microversion: 2.1 time: 0.163194 Jul 20 04:16:57.758970 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 347/660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:58.071292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c33cfa2-1b87-4c01-90fa-eb93a9c10c8b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1618 microversion: 2.1 time: 0.521980 Jul 20 04:16:58.072211 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 314/661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:57 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1618 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.088381 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b53bfbcb-c491-4db0-bedd-0874267039d6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: .version_select at 0x7f839848d820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-598634354", "policies": ["affinity"]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:58.107272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-b53bfbcb-c491-4db0-bedd-0874267039d6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.112418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-b53bfbcb-c491-4db0-bedd-0874267039d6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:58.161459 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-b53bfbcb-c491-4db0-bedd-0874267039d6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.166966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-b53bfbcb-c491-4db0-bedd-0874267039d6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:58.172274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.173270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.180965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.181675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.182949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.183387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.183949 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b53bfbcb-c491-4db0-bedd-0874267039d6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.098676 Jul 20 04:16:58.185011 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 348/662] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Jul 20 04:16:58 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:16:58.219749 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.220923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.227532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.228125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.229112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.229640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.360284 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.368392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.370637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.371770 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a0964a8a-b477-422d-acea-0c269fd223a2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1362 microversion: 2.25 time: 0.156304 Jul 20 04:16:58.372316 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 349/663] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:58.376818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1108406323", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ce6451e7-fe61-43e9-abe0-b4063e45e1ec"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:16:58.428592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:16:58.471133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.478605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f34b6cd-6a27-4afe-b1a2-89fca83e78b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.313211 Jul 20 04:16:58.479683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 315/664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.487168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.487894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.493927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.494379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.495715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.496145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.500254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:58.598216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:58.621400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-927b1a73-e2c6-46bd-bc86-99644b90c790 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.137633 Jul 20 04:16:58.621893 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 316/665] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:58.626370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.626967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.632863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.633309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.634070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.634504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.657569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:16:58.657997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:16:58.658468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:16:58.659042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:16:58.659650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:16:58.686225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.686673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.687471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.688118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.705959 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.711610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:58.724551 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Going to run 2 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:16:58.727139 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:58.771147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123723) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:16:58.790136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.796558 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:58.839366 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.846224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:58.862709 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=42964081-bbee-49b1-bd89-d66aebcabecf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:16:58.881376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:58.890773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c78d077-333c-4abb-9850-d8d8e532ac4f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1471 microversion: 2.1 time: 0.267694 Jul 20 04:16:58.891951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 317/666] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:58.895652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:16:58.896883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:58.897647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:58.904924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.905379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.906933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:58.907373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:58.918119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.923708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:58.961537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:16:58.967883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:16:59.005159 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bead4121-2530-40c2-8b16-5bfcab5dbbd5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.631794 Jul 20 04:16:59.006285 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 350/667] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:16:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:16:59.013477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.018161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.019033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Searching by: {'deleted': False, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08'} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:16:59.039026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.039565 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.040458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.040971 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.067919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.076636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f784ef4-9a5f-40cc-9b45-69d5ee513140 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1503 microversion: 2.1 time: 0.183362 Jul 20 04:16:59.078012 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 318/668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:58 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.094759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.095260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.101769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.102394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.104006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.104679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.152835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.multi_cell_list [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:16:59.153623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:16:59.268413 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6891c07b-2683-486d-9ff6-1f84be1a4000 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.258445 Jul 20 04:16:59.270373 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 351/669] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers => generated 1003 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:16:59.283534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f7a720f-4e32-4334-b3c6-6710e777b47e tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 204 len: 0 microversion: 2.1 time: 0.192782 Jul 20 04:16:59.284132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 319/670] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:16:59 2022] DELETE /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:16:59.285452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ef8f63c2-6a0f-4bf4-bf3f-ea543649337f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.286800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ef8f63c2-6a0f-4bf4-bf3f-ea543649337f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.294537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.295231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.302357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.303385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.304230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.304927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.348391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ef8f63c2-6a0f-4bf4-bf3f-ea543649337f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.359310 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ef8f63c2-6a0f-4bf4-bf3f-ea543649337f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1219 microversion: 2.1 time: 0.081500 Jul 20 04:16:59.364454 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 352/671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.391009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.392111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.406045 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.406818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.407772 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.408385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.476301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.484016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b80eb9b2-4d38-47c1-9f82-339f0134db17 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1509 microversion: 2.1 time: 0.194135 Jul 20 04:16:59.484812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 320/672] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.500318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.501056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.506875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.507319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.508084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.508540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.573760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.582038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.583797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.585181 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-617c3e57-0a3b-4e0a-83f3-9ccfcfd3dfc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1558 microversion: 2.25 time: 0.199919 Jul 20 04:16:59.585918 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 353/673] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1558 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:59.661774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.662617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.668692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:16:59.668856 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.669176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.670096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.670540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.677115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47f87923-26a1-4f85-a791-6bac96192fef tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.181223 Jul 20 04:16:59.678113 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 321/674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:16:59.683292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.684147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.690609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.691184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.692062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.692651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.781923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:59.819081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5beca5ce-754d-4a4e-952e-a6ad3a5a501d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.139740 Jul 20 04:16:59.820098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 322/675] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:16:59.847341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid e2848d05-a6b8-4a72-9774-0f49ec9cf583 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:16:59.866559 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0a03dc54-e8e9-4bf6-9bdc-6e79a8de77d0 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 2053 microversion: 2.25 time: 0.266561 Jul 20 04:16:59.879886 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 354/676] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 2053 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:16:59.887109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.887457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.894239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.894686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.895449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.895880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.910062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:16:59.910922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:16:59.918423 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.918872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:16:59.919792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:16:59.920230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.060110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid e2848d05-a6b8-4a72-9774-0f49ec9cf583 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:00.079537 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62f653cb-48c8-48aa-96d4-9f79057e148f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 2053 microversion: 2.25 time: 0.197549 Jul 20 04:17:00.081569 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 323/677] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 2053 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:00.082454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.090611 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-86a0b515-c051-404d-bf49-a05fcfb351b9 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.185863 Jul 20 04:17:00.091316 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 355/678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:16:59 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:00.102046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c380d21f-04bb-4057-8985-458de0147ed1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.103462 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:00.103462 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:00.105275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c380d21f-04bb-4057-8985-458de0147ed1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.105750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c380d21f-04bb-4057-8985-458de0147ed1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.106591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c380d21f-04bb-4057-8985-458de0147ed1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.107020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c380d21f-04bb-4057-8985-458de0147ed1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.135315 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c380d21f-04bb-4057-8985-458de0147ed1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037105 Jul 20 04:17:00.135905 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 324/679] 10.222.0.49 () {60 vars in 1216 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:17:00.146908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764486-11", "block_migration": "auto"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:00.149310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.155890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.156534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.157239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.157740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.376555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.377495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.383869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.384418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.385440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.385945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.393525 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'flavor' on Instance uuid e2848d05-a6b8-4a72-9774-0f49ec9cf583 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:00.439905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Going to try to live migrate instance to n-h1-764486-11 {{(pid=123723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:17:00.452367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.460974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b3b2e6d-3cda-4fdb-8908-0d0689bb6644 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1271 microversion: 2.1 time: 0.088311 Jul 20 04:17:00.461900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 325/680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:00.501656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.502260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.508674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.509115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.509898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.510329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.664664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:00.680781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbf55ba6-5c1f-485c-b2e7-0f1ebce3f7cc tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1509 microversion: 2.1 time: 0.179487 Jul 20 04:17:00.681641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 326/681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:00.694713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:00.695320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:00.702136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.702562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:00.703338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:00.703900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.173063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.183421 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05a12150-36ec-4b32-9c0b-69cfaa4abce1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.492878 Jul 20 04:17:01.193157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 327/682] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:00 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:01.199381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.200256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.209079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.209722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.210665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.211139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.426538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:01.443831 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5517d91b-60ed-463c-8f13-0d6162f74997 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.249208 Jul 20 04:17:01.444697 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 328/683] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:01.449003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.449595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.455773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.455930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.456674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.457102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.929219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:01.937469 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1ddfdcc-490e-480e-9b4b-19ee70329ab3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.491998 Jul 20 04:17:01.938070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 329/684] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:01.951259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-42a646e7-ec36-45dd-a02b-7c83ae5b778a req-8e97f059-f5b6-42b9-b6b6-41d60f05bb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "name": "network-vif-plugged", "status": "completed", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:01.959590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-42a646e7-ec36-45dd-a02b-7c83ae5b778a req-8e97f059-f5b6-42b9-b6b6-41d60f05bb56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.960123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-42a646e7-ec36-45dd-a02b-7c83ae5b778a req-8e97f059-f5b6-42b9-b6b6-41d60f05bb56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.971181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-42a646e7-ec36-45dd-a02b-7c83ae5b778a req-8e97f059-f5b6-42b9-b6b6-41d60f05bb56 service nova] Creating event network-vif-plugged:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h1-764486-11 Jul 20 04:17:01.976108 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-42a646e7-ec36-45dd-a02b-7c83ae5b778a req-8e97f059-f5b6-42b9-b6b6-41d60f05bb56 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Jul 20 04:17:01.977005 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 330/685] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:01.981716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:01.982404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:01.988621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.989072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.989838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:01.990265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:01.995475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:02.125410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=22 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:02.357390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.365723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc5e939d-e466-4d80-9c3b-5f27a24e9034 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1277 microversion: 2.1 time: 0.387826 Jul 20 04:17:02.366301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 331/686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:01 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.372399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.372399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.378811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.379205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.379994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.380475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.482133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.489628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8c566b4-f228-4fa2-b0f6-bbeee3fe2e67 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1467 microversion: 2.1 time: 0.122379 Jul 20 04:17:02.490200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 332/687] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1467 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.495242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.495837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.501860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.502309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.503077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.503705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.633875 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bed06b45-70d8-4d7d-9743-8100748aa4df tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583/action" status: 202 len: 0 microversion: 2.25 time: 2.490654 Jul 20 04:17:02.634513 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 356/688] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:00 2022] POST /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583/action => generated 0 bytes in 2492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:17:02.639640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.640277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.654214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.660822 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.665991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.667468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.763320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:02.783257 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-28e1bb5b-757f-42df-9916-0c4988cd54c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.147629 Jul 20 04:17:02.783847 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 357/689] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:02.788473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.789080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.794890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.795925 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.796402 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.797174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.797779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.803515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ddf0179-950a-452e-a2ac-d6c976229694 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1357 microversion: 2.1 time: 0.312176 Jul 20 04:17:02.804218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 333/690] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:02.808989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b6db7fd1-2a03-48f6-998a-3390885fd645 req-6e5c3fdd-692c-4496-83f7-5682e395cbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c3cf9e-13ba-4c3f-98fa-fba6accc810f", "name": "network-vif-deleted", "tag": "e35f7348-43b5-42a3-b76e-56dd49b8b2e4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:02.817560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b6db7fd1-2a03-48f6-998a-3390885fd645 req-6e5c3fdd-692c-4496-83f7-5682e395cbb0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.818220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b6db7fd1-2a03-48f6-998a-3390885fd645 req-6e5c3fdd-692c-4496-83f7-5682e395cbb0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.830853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b6db7fd1-2a03-48f6-998a-3390885fd645 req-6e5c3fdd-692c-4496-83f7-5682e395cbb0 service nova] Creating event network-vif-deleted:e35f7348-43b5-42a3-b76e-56dd49b8b2e4 for instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f on n-h1-764486-11 Jul 20 04:17:02.836973 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b6db7fd1-2a03-48f6-998a-3390885fd645 req-6e5c3fdd-692c-4496-83f7-5682e395cbb0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Jul 20 04:17:02.837786 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 334/691] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:02.954537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:02.958642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:02.959420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:02.969005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.969985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.971149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:02.971903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:02.991143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.000312 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.005804 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-54a27b38-b6a9-4838-8f6e-d3a55da954b0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.220859 Jul 20 04:17:03.009369 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 358/692] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:03.352146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.360339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c52859db-33d1-45ec-9f40-ce72038e4006 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.409593 Jul 20 04:17:03.361003 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 335/693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:02 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.388303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.388870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.395618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.396070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.396863 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.397308 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.460215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.468202 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0d6d22d6-63aa-4d81-8607-f79f99ab8aac tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1277 microversion: 2.1 time: 0.083875 Jul 20 04:17:03.469106 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 359/694] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:03.507246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.507911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.514348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.514793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.516341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.517101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.557901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.558349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.558794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lazy-loading 'fault' on Instance uuid 89c3cf9e-13ba-4c3f-98fa-fba6accc810f {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:03.732188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f94c39cd424c44b3757c877544541d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febcd6e5655a4c848ce695c1eba2b3dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:03.745425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42b691a1-2aab-4e9f-bd3e-9c2e904fbc97 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 200 len: 1306 microversion: 2.1 time: 0.242153 Jul 20 04:17:03.746039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 336/695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 1306 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:03.807333 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.808088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.821325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:03.822783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:03.823760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.824262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.827997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.830324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.842423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.842542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.844715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:03.845957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:03.916689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:03.936324 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-94c7c47b-a795-4683-bb3f-9dbb38cfb02d tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.136724 Jul 20 04:17:03.936931 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 360/696] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:04.027768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.028326 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.040739 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.042676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.043717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.044172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.205599 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.214552 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.216149 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.217385 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-07562595-bc6a-4145-890d-84da6031c54f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.194296 Jul 20 04:17:04.217956 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 361/697] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:04.259446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.267607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-268467aa-6d02-4d09-afa7-08b4c5b1891e tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1539 microversion: 2.1 time: 0.451156 Jul 20 04:17:04.268194 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 337/698] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:03 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1539 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:04.284501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.285267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.292501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.293206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.294111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.294722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.378618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.379927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.384509 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0e941510-15f9-447a-9e4a-953f5f0e4a15 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103889 Jul 20 04:17:04.385776 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 362/699] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:04.396568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.397218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.398176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.398840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.485583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.486508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.493167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.493937 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.495561 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.496169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.526153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:04.835898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.847633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bcd908c8-bfe2-4123-be5b-3e41291547d5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.474262 Jul 20 04:17:04.849221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 338/700] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:04.856223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.857323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.865868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.866558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.867711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.868309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.885022 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f HTTP/1.1 Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:04.886983 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.888610 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '89c3cf9e-13ba-4c3f-98fa-fba6accc810f'} Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:04.889561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.891028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.893994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:04.895125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34759e2a-e69e-49c3-8d87-6ecc722c57fa tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 404 len: 111 microversion: 2.1 time: 0.044814 Jul 20 04:17:04.899540 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 339/701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:04.905887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-413273397", "metadata": {"image_type": "test"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.907768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.915112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.915546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.916998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.917624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.932433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f/action HTTP/1.1 Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 111 Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:04.934181 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-413273397", "metadata": {"image_type": "test"}}} Jul 20 04:17:04.935780 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '89c3cf9e-13ba-4c3f-98fa-fba6accc810f', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-413273397', 'metadata': {'image_type': 'test'}}}} Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.936650 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.939161 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-800ea919-4a20-4812-94f2-f119833b8eff tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "POST /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f/action" status: 404 len: 111 microversion: 2.1 time: 0.034235 Jul 20 04:17:04.940653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 340/702] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:04.946158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df8ba90d-d2cd-4b4c-8df0-4a55f694b010 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1521794096", "metadata": {"image_type": "test"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.947295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df8ba90d-d2cd-4b4c-8df0-4a55f694b010 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Failed to fetch instance by id tempest-invalid-1941062268 {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:17:04.947799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-df8ba90d-d2cd-4b4c-8df0-4a55f694b010 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance tempest-invalid-1941062268 could not be found. Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df8ba90d-d2cd-4b4c-8df0-4a55f694b010 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/tempest-invalid-1941062268/action HTTP/1.1 Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 112 Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:04.949615 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1521794096", "metadata": {"image_type": "test"}}} Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:04.951171 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance tempest-invalid-1941062268 could not be found. Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'tempest-invalid-1941062268', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1521794096', 'metadata': {'image_type': 'test'}}}} Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1941062268 could not be found. Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:04.952131 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1941062268 could not be found. Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1941062268 could not be found. Jul 20 04:17:04.953690 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.955851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df8ba90d-d2cd-4b4c-8df0-4a55f694b010 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance tempest-invalid-1941062268 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:04.956793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df8ba90d-d2cd-4b4c-8df0-4a55f694b010 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "POST /compute/v2.1/servers/tempest-invalid-1941062268/action" status: 404 len: 101 microversion: 2.1 time: 0.014433 Jul 20 04:17:04.957838 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:04.958315 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 341/703] 10.222.0.49 () {60 vars in 1248 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/servers/tempest-invalid-1941062268/action => generated 101 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:04.965771 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c0703c1a-f927-44aa-9b3f-9354fe2ec5fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.484504 Jul 20 04:17:04.971896 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 363/704] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:04.972222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:04.972222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:04.978099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.979271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.980073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:04.980543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:04.981717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a7f9e0ce-c389-494f-b717-639596e90056 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-424462070"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.984755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a7f9e0ce-c389-494f-b717-639596e90056 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:17:04.985474 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-a7f9e0ce-c389-494f-b717-639596e90056 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a7f9e0ce-c389-494f-b717-639596e90056 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 56 Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:04.987681 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: {"createImage": {"name": "tempest-test-snap-424462070"}} Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:04.989260 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-424462070'}}} Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:04.990204 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:04.991684 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:04.992853 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a7f9e0ce-c389-494f-b717-639596e90056 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:04.992853 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a7f9e0ce-c389-494f-b717-639596e90056 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019180 Jul 20 04:17:04.993889 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 364/705] 10.222.0.49 () {60 vars in 1274 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:04.998989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-65898972-c8c7-4851-9422-b87cef317a76 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1928330183"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:04.999989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-65898972-c8c7-4851-9422-b87cef317a76 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:17:05.000533 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-65898972-c8c7-4851-9422-b87cef317a76 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-65898972-c8c7-4851-9422-b87cef317a76 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 57 Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:05.002015 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: {"createImage": {"name": "tempest-test-snap-1928330183"}} Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:05.003506 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1928330183'}}} Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:05.004416 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 04:17:05.005924 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.007042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-65898972-c8c7-4851-9422-b87cef317a76 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:05.007042 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-65898972-c8c7-4851-9422-b87cef317a76 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.008552 Jul 20 04:17:05.007042 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 365/706] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Jul 20 04:17:04 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:05.013942 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.014446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.021533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.021979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.022762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.023195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.038727 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f HTTP/1.1 Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:05.040455 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.042519 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '89c3cf9e-13ba-4c3f-98fa-fba6accc810f'} Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:05.046836 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.048267 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.051012 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:05.051012 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-53870c4b-b1bf-4604-9f2f-96717947d37c tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 404 len: 111 microversion: 2.1 time: 0.033921 Jul 20 04:17:05.051012 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 366/707] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:05 2022] DELETE /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:05.051012 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.052086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] [instance: 89c3cf9e-13ba-4c3f-98fa-fba6accc810f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.057979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.058432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.059273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.059710 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.075761 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] HTTP exception thrown: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Request method failure captured: Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f HTTP/1.1 Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Gnzo7OL1ViRhh2MoqInBSSUybJmUohUiWbN2uJpSccmXO6mgn6hvkrzYsB_LxptNumJNlCrjig0P0zSfLprSlIOaxqnZpA4T8LIBHnrDWe7xxWXGlv14KTl04OKymzertdimA06y9u3TjE8p4Kw9xMtvjbpt2u9hw6OGbV6FdlyF0 Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:05.077929 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/febcd6e5655a4c848ce695c1eba2b3dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_febcd6e5655a4c848ce695c1eba2b3dc", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: febcd6e5655a4c848ce695c1eba2b3dc Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1863122469 Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 33f94c39cd424c44b3757c877544541d Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesNegativeTestJSON-1863122469-project Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.079228 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '89c3cf9e-13ba-4c3f-98fa-fba6accc810f'} Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:05.080063 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. Jul 20 04:17:05.082926 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:05.084375 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] Returning 404 to user: Instance 89c3cf9e-13ba-4c3f-98fa-fba6accc810f could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:05.084375 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-34157c8d-5ee3-44e8-bd11-52ac057b8879 tempest-ImagesNegativeTestJSON-1863122469 tempest-ImagesNegativeTestJSON-1863122469-project] 10.222.0.49 "GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f" status: 404 len: 111 microversion: 2.1 time: 0.032097 Jul 20 04:17:05.084375 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 367/708] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/89c3cf9e-13ba-4c3f-98fa-fba6accc810f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:05.112736 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-e84a9774-30fb-4122-9487-41c38fa5ff04 req-6bbb2b25-2df9-4e93-994e-802eb4b4337c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42964081-bbee-49b1-bd89-d66aebcabecf", "tag": "c06c0ed0-6ff0-4663-b251-be8d2061def7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:05.121872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-e84a9774-30fb-4122-9487-41c38fa5ff04 req-6bbb2b25-2df9-4e93-994e-802eb4b4337c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.122411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-e84a9774-30fb-4122-9487-41c38fa5ff04 req-6bbb2b25-2df9-4e93-994e-802eb4b4337c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.134275 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-e84a9774-30fb-4122-9487-41c38fa5ff04 req-6bbb2b25-2df9-4e93-994e-802eb4b4337c service nova] Creating event network-changed:c06c0ed0-6ff0-4663-b251-be8d2061def7 for instance 42964081-bbee-49b1-bd89-d66aebcabecf on n-h2-764486-11 Jul 20 04:17:05.140066 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-e84a9774-30fb-4122-9487-41c38fa5ff04 req-6bbb2b25-2df9-4e93-994e-802eb4b4337c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031360 Jul 20 04:17:05.140890 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 368/709] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:05.235997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.238315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.248890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.249846 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.251084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.251770 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.456772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:05.475313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-381e77be-2e42-43c8-bdf8-4b96c566d8b4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.513510 Jul 20 04:17:05.476149 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 342/710] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:04 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:05.563642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.582997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.585068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:05.586531 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fe1db366-cefb-4231-bb45-7cbdb34ad1b4 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.354988 Jul 20 04:17:05.588875 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 369/711] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:05.868638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.869533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.876116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.876588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.877348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.877780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.982640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:05.983412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:05.990248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.990851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:05.991714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:05.993027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.274571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.274878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:06.290241 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cdf1d827-9f98-4261-903b-d80a474f1785 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.311831 Jul 20 04:17:06.293115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50eaa3b9-4b14-459b-be4e-e8dc720bc86e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.426384 Jul 20 04:17:06.293858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 343/712] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:06.302279 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 370/713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:05 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:06.498686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.500060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.513999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.519523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.520879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.521478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.547273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-7e86e4a5-3ff5-429e-8794-7d6fc81cda2e req-0a99d3b4-8429-422b-bdbf-95741ccc53c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:06.571679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-7e86e4a5-3ff5-429e-8794-7d6fc81cda2e req-0a99d3b4-8429-422b-bdbf-95741ccc53c7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.579473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-7e86e4a5-3ff5-429e-8794-7d6fc81cda2e req-0a99d3b4-8429-422b-bdbf-95741ccc53c7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.610322 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-7e86e4a5-3ff5-429e-8794-7d6fc81cda2e req-0a99d3b4-8429-422b-bdbf-95741ccc53c7 service nova] Creating event network-changed:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h1-764486-11 Jul 20 04:17:06.624702 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-7e86e4a5-3ff5-429e-8794-7d6fc81cda2e req-0a99d3b4-8429-422b-bdbf-95741ccc53c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083000 Jul 20 04:17:06.625467 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 371/714] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:06.647240 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:06.647740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:06.662278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.662978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.663992 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:06.664814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:06.749468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:06.782984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d103fe90-b55c-40c2-9b4c-2c74603e5f3e tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.291445 Jul 20 04:17:06.783879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 344/715] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:07.008304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.022654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.024498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.025870 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c5a6aafa-c67f-4592-928d-fcc1cdfb9cde tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.383847 Jul 20 04:17:07.030046 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 372/716] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:06 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:07.308666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.309581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.318148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.319191 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.330109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.332588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.333306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.334391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.335132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.335797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.337150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.341008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.532766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.544001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6064cbb-1a69-490b-82a6-6b536521adc2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.239508 Jul 20 04:17:07.544999 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 345/717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.550157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40670f12-c948-46ba-b762-0cb0d2bf024a", "tag": "0794223d-8781-4dd5-b99f-c05dd7046e91"}, {"server_uuid": "e2848d05-a6b8-4a72-9774-0f49ec9cf583", "name": "network-vif-unplugged", "status": "completed", "tag": "3f22db6d-7095-4a4b-8c65-fec308924fc4"}, {"name": "network-changed", "server_uuid": "e2848d05-a6b8-4a72-9774-0f49ec9cf583", "tag": "3f22db6d-7095-4a4b-8c65-fec308924fc4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:07.562515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.564125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.583029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] Creating event network-changed:0794223d-8781-4dd5-b99f-c05dd7046e91 for instance 40670f12-c948-46ba-b762-0cb0d2bf024a on n-h2-764486-11 Jul 20 04:17:07.588799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] Creating event network-vif-unplugged:3f22db6d-7095-4a4b-8c65-fec308924fc4 for instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 on n-h2-764486-11 Jul 20 04:17:07.590019 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] Creating event network-changed:3f22db6d-7095-4a4b-8c65-fec308924fc4 for instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 on n-h2-764486-11 Jul 20 04:17:07.599298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3eb55c9a-4545-4583-af69-464ef5b784eb req-64f030f3-e21b-493e-81b5-5e20514e04c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.052822 Jul 20 04:17:07.600259 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 346/718] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:07.665174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:07.678226 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-70ed298a-75f3-42a6-86b9-7af33feab76a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.361217 Jul 20 04:17:07.680332 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 373/719] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:07.805865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:07.807490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:07.815191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.815868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.816887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:07.817525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:07.914479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:07.932687 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9462a078-a93b-4cdd-9f2d-86cef2240d04 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1931 microversion: 2.75 time: 0.131392 Jul 20 04:17:07.944564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 347/720] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:07 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1931 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:08.043416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.044110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.070042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.070503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.071303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.071740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.414442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.427035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.429560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.431317 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-094ac046-18ea-4520-b503-357c7ee65717 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.391962 Jul 20 04:17:08.433070 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 374/721] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:08.564465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.566439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.578079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.578518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.584930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.585809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.697429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.698267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.706186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.707815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.708812 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.709929 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.726959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.740501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c532362-c08b-4470-9b9a-883db8d0b572 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.181932 Jul 20 04:17:08.741754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 348/722] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:08.908315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:08.916879 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fdfca8ba-f3b1-4abc-ba81-df9ab512f734 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.223315 Jul 20 04:17:08.917466 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 375/723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:08.953989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:08.954498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:08.961418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.961872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:08.963268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:08.963705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.040576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:09.043931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:09.058377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc7bbcc5-526e-4fd4-b06e-0aeab83ca02b tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1937 microversion: 2.75 time: 0.109149 Jul 20 04:17:09.059009 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 349/724] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:08 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1937 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:09.449957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.450581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.454359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:09.455281 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=32 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:09.460020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.460605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.461755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.462256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.749791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.757781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.758997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.759910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.761466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:09.765765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:09.766768 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b8460077-53e5-4220-9b73-f6ff5534cf70 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.320790 Jul 20 04:17:09.767788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.768097 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 376/725] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:09.769016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.770750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.771180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.934094 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:09.953900 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:09.975999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.976595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:09.977456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:09.977967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.099940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:10.110465 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ff2d258-4557-4385-a339-2b7482086eec tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.356526 Jul 20 04:17:10.121318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 350/726] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:10.128017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.129026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:10.132093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:10.138349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.138804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.139589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.140028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.153446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:10.160063 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4a460a8c-faa2-43d7-8fdf-15c845c2fbf4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.229979 Jul 20 04:17:10.160701 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 377/727] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:09 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:10.266201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:10.283510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a706015-4c87-4d9f-86a9-ed0da2cb42a4 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1937 microversion: 2.75 time: 0.160712 Jul 20 04:17:10.284103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 351/728] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:10 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1937 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:10.784745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:10.786112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:10.796325 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.797400 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:10.798400 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:10.799001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.003000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.013417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.014938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.016762 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-73c2d72b-f709-4d92-94fd-ae978244b7f7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.235749 Jul 20 04:17:11.017350 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 378/729] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:10 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:11.128527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.129956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.137800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.138248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.139225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.139664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.176483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.177096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.186612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.187061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.187842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.188274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.403214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.413710 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d9031c1d-3c9f-4639-957d-a60bdca93835 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.240976 Jul 20 04:17:11.414528 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 379/730] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.431162 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.432717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.433046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.442226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.442586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-258c7107-d12b-47e0-8a67-859a75de321a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.318207 Jul 20 04:17:11.451660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.451839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 352/731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:11.456880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.456880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.585322 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] Lazy-loading 'services' on Instance uuid 04567d9b-93b2-4908-805c-66af120cec66 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:11.611505 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-26afce29-d095-4f92-883c-2dd827b730c3 tempest-ServersAdmin275Test-1997656080 tempest-ServersAdmin275Test-1997656080-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1922 microversion: 2.75 time: 0.185508 Jul 20 04:17:11.612496 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 380/732] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1922 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:11.639044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.639987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.646546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.647593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.649070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.650317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.686530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:11.812029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b762a6b3-4122-4ee0-9f33-64f8ce5e470a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 204 len: 0 microversion: 2.75 time: 0.177667 Jul 20 04:17:11.812697 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 353/733] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:17:11 2022] DELETE /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:17:11.828961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:11.830101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:11.840198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.841170 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.842308 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:11.846862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:11.941598 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.951260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.953298 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:11.961286 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2d8fcd52-506f-4154-b1cc-770235871d44 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1444 microversion: 2.75 time: 0.144377 Jul 20 04:17:11.963310 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 381/734] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:11 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:12.035917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.036679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.043823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.044196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.045205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.045982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.174991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-67203e8a-a2ca-4be6-bde4-e5bfc8509db3 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Action: 'create', calling method: .version_select at 0x7f8398332f70>, body: {"keypair": {"name": "tempest-keypair-1462513106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSGbM1KrfscbWwygtKWFbYbkjfMZi1NEV1F2QYUJ6obM8eBm0uGw2ESD48/M6+Aj3BshpkYqHOMjhcvKdLb9VlZWLTH/DtNX6mQsNo+RdC0FvtXTFqdOn+mzgrAagU5Yw=="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.195761 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-67203e8a-a2ca-4be6-bde4-e5bfc8509db3 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:12.202399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-67203e8a-a2ca-4be6-bde4-e5bfc8509db3 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for user e164ba13d38c4c778fce9a2b5dfb50d4 and project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:12.203061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.204374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:12.213164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.214878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.216421 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f05c7c8-0704-4536-b612-104f3715c2ba tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.184981 Jul 20 04:17:12.216991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 354/735] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:12.235582 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-67203e8a-a2ca-4be6-bde4-e5bfc8509db3 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192700 Jul 20 04:17:12.236279 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 382/736] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.246816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba98b5ce-3950-4bd5-ae35-a8ebb51044a5 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f8398142310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.254282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba98b5ce-3950-4bd5-ae35-a8ebb51044a5 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1462513106" status: 200 len: 497 microversion: 2.1 time: 0.011948 Jul 20 04:17:12.254845 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 355/737] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1462513106 => generated 497 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:12.265706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b435e91f-734c-468f-af95-2e381e5cc91f tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f83984a5790>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.282419 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b435e91f-734c-468f-af95-2e381e5cc91f tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462513106" status: 202 len: 0 microversion: 2.1 time: 0.020576 Jul 20 04:17:12.283139 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 383/738] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462513106 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:12.294709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01c1aa0e-7793-49f4-a3b3-33b566bc1a4b tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Action: 'create', calling method: .version_select at 0x7f8398261820>, body: {"keypair": {"name": "tempest-keypair-2091403312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvVGcaXpRQ7XAjzHfLpQvVSI0R0HHu6velV4DQMv6GtYNUCXbBKHuPwMHSP/3P6fjTZjRE184iTA+JwpyohnGfq1DlJhkm8smPKzjV3UcopkFHvqvxYDCANgVcflWh8uA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.309190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-01c1aa0e-7793-49f4-a3b3-33b566bc1a4b tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:12.314355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-01c1aa0e-7793-49f4-a3b3-33b566bc1a4b tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for user e164ba13d38c4c778fce9a2b5dfb50d4 and project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:12.338723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01c1aa0e-7793-49f4-a3b3-33b566bc1a4b tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048051 Jul 20 04:17:12.339324 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 356/739] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.349203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bb9f42f1-9d06-49eb-9918-31d4a1ecfeea tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f839800f5e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.366078 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bb9f42f1-9d06-49eb-9918-31d4a1ecfeea tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091403312" status: 202 len: 0 microversion: 2.1 time: 0.020719 Jul 20 04:17:12.366649 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 384/740] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091403312 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:12.376675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-092e4c17-3206-4393-a7dd-42b389bcbfb1 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Action: 'create', calling method: .version_select at 0x7f8398247160>, body: {"keypair": {"name": "tempest-keypair-437627239", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.391723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-092e4c17-3206-4393-a7dd-42b389bcbfb1 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:12.396953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-092e4c17-3206-4393-a7dd-42b389bcbfb1 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for user e164ba13d38c4c778fce9a2b5dfb50d4 and project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:12.421153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-092e4c17-3206-4393-a7dd-42b389bcbfb1 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.048561 Jul 20 04:17:12.421788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 357/741] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.431827 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.432473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.433450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdb7fb6a-9b30-4bda-951a-6811d92484f4 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f8398247670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.439307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.439961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.440902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.441516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.451420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdb7fb6a-9b30-4bda-951a-6811d92484f4 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437627239" status: 202 len: 0 microversion: 2.1 time: 0.021863 Jul 20 04:17:12.458936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 358/742] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437627239 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:12.465992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.467180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.473821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.474270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.475038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.475469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.605292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.614012 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6fc485d9-461c-45c7-a159-f342f597a623 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.186615 Jul 20 04:17:12.623447 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 385/743] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.623447 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-56a66f8d-2869-492a-a91e-89de829df934 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Action: 'create', calling method: .version_select at 0x7f83983db160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1708399076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHkk9WQDk2/kRnlW8WDlmNMynUDa5gMwDM1G2nOHXnJzwJWNRIgz3I8pFBCBj+MRz4Q/qI78+pHOmOpgPjzQP4IfCz/6VSCU/I+Njydy7oilPP+GeOOIKHzcdurE9yPJg=="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.642958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-56a66f8d-2869-492a-a91e-89de829df934 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:12.649000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-56a66f8d-2869-492a-a91e-89de829df934 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for user e164ba13d38c4c778fce9a2b5dfb50d4 and project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:12.682186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:12.685108 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-56a66f8d-2869-492a-a91e-89de829df934 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069099 Jul 20 04:17:12.685965 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 386/744] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.693264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2552adbc-d048-4f92-8968-9b702ba23df9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.230217 Jul 20 04:17:12.702445 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 359/745] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.706274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f294949b-bb8c-461f-9269-36ae7ebdf95c tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Action: 'create', calling method: .version_select at 0x7f83986c39d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-434197754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT2+OuMV9ZiNMkZKEprBzbs0g7Nh+yA3duMIONCesRjoZt0pHYX/Q4xTqreC3MTRUF9uRQfetHjXZD52Pha/Lyh05ssoBZSzZsRlzV2H7Km53syp/ibrJsEUrS6wm9iAA=="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.721535 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f294949b-bb8c-461f-9269-36ae7ebdf95c tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:12.737330 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f294949b-bb8c-461f-9269-36ae7ebdf95c tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for user e164ba13d38c4c778fce9a2b5dfb50d4 and project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:12.769779 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f294949b-bb8c-461f-9269-36ae7ebdf95c tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.074481 Jul 20 04:17:12.770653 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 387/746] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.783193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e6b73fd-f193-461c-8dbc-409b75608b53 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Action: 'create', calling method: .version_select at 0x7f83980c6940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1392491042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiTmZh8uEwYM3ZfUpYqNHuPi2puxTOOD1Eiw6TrsHDF4xdnailwl/q+EnpzKdv97m8eMEHW4p2FndUWdv/HEFBZ4iPKL9f7x9Vgxvi4oZ2Kj9fcOyKAMlV34kzm4XF9+A=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.798967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5e6b73fd-f193-461c-8dbc-409b75608b53 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:12.804272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5e6b73fd-f193-461c-8dbc-409b75608b53 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Getting quotas for user e164ba13d38c4c778fce9a2b5dfb50d4 and project 5db900d1663c40c99740996140a73d72. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:12.849007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e6b73fd-f193-461c-8dbc-409b75608b53 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069754 Jul 20 04:17:12.855080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 360/747] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.869801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f10c6228-07a8-43a2-aaf4-9ef79ca11b91 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f83983f5280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.874123 n-d-764486-11 devstack@n-api.service[123723]: WARNING oslo_db.sqlalchemy.utils [None req-f10c6228-07a8-43a2-aaf4-9ef79ca11b91 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:17:12.881634 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f10c6228-07a8-43a2-aaf4-9ef79ca11b91 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.017801 Jul 20 04:17:12.890114 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 388/748] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:12.896461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-276b5fed-8f0a-430a-9d08-8c1ebbda40f0 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f839805e820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.916678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-276b5fed-8f0a-430a-9d08-8c1ebbda40f0 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1392491042" status: 202 len: 0 microversion: 2.1 time: 0.025338 Jul 20 04:17:12.917476 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 361/749] 10.222.0.49 () {58 vars in 1277 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1392491042 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:17:12.926884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ed5bab28-f222-44cf-a0f9-8baf4bd42b90 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f8398418310>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.935069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9870ba03-6a37-43df-8f6a-1027ed399c0b req-ffbffdb8-1293-4483-9305-a23eb1e80ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2848d05-a6b8-4a72-9774-0f49ec9cf583", "name": "network-vif-unplugged", "status": "completed", "tag": "3f22db6d-7095-4a4b-8c65-fec308924fc4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:12.945003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9870ba03-6a37-43df-8f6a-1027ed399c0b req-ffbffdb8-1293-4483-9305-a23eb1e80ced service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:12.945444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9870ba03-6a37-43df-8f6a-1027ed399c0b req-ffbffdb8-1293-4483-9305-a23eb1e80ced service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:12.957878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9870ba03-6a37-43df-8f6a-1027ed399c0b req-ffbffdb8-1293-4483-9305-a23eb1e80ced service nova] Creating event network-vif-unplugged:3f22db6d-7095-4a4b-8c65-fec308924fc4 for instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 on n-h2-764486-11 Jul 20 04:17:12.960065 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ed5bab28-f222-44cf-a0f9-8baf4bd42b90 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-434197754" status: 202 len: 0 microversion: 2.1 time: 0.037551 Jul 20 04:17:12.966040 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9870ba03-6a37-43df-8f6a-1027ed399c0b req-ffbffdb8-1293-4483-9305-a23eb1e80ced service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033810 Jul 20 04:17:12.966040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 362/750] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:12.967850 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 389/751] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-434197754 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:12.973703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a885721-6000-41ea-a54f-ac9c54703994 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] Calling method '.version_select at 0x7f8398142040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.990155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:12.991551 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:12.999183 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a885721-6000-41ea-a54f-ac9c54703994 tempest-KeyPairsV2TestJSON-1634501369 tempest-KeyPairsV2TestJSON-1634501369-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1708399076" status: 202 len: 0 microversion: 2.1 time: 0.031428 Jul 20 04:17:13.002187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.002883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.004624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.008393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 363/752] 10.222.0.49 () {58 vars in 1277 bytes} [Wed Jul 20 04:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1708399076 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:13.009176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.094935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7b56df29-9db1-407d-9e66-aac8ded62cb9 req-3a0322ac-6f07-4d0d-aa59-ef2e5b70650c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42964081-bbee-49b1-bd89-d66aebcabecf", "name": "network-vif-plugged", "status": "completed", "tag": "c06c0ed0-6ff0-4663-b251-be8d2061def7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:13.123585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7b56df29-9db1-407d-9e66-aac8ded62cb9 req-3a0322ac-6f07-4d0d-aa59-ef2e5b70650c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.124029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7b56df29-9db1-407d-9e66-aac8ded62cb9 req-3a0322ac-6f07-4d0d-aa59-ef2e5b70650c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.133381 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.150759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.158454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9e1e6781fa647a6bdff4b890f021774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b7891fdfc746169e65b26e1e704be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.172504 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cef65baa-32da-46f9-bb56-00d6bbc18a27 tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 200 len: 1444 microversion: 2.75 time: 0.192833 Jul 20 04:17:13.175549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7b56df29-9db1-407d-9e66-aac8ded62cb9 req-3a0322ac-6f07-4d0d-aa59-ef2e5b70650c service nova] Creating event network-vif-plugged:c06c0ed0-6ff0-4663-b251-be8d2061def7 for instance 42964081-bbee-49b1-bd89-d66aebcabecf on n-h2-764486-11 Jul 20 04:17:13.185267 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 390/753] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:12 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 1444 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:13.193261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7b56df29-9db1-407d-9e66-aac8ded62cb9 req-3a0322ac-6f07-4d0d-aa59-ef2e5b70650c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102979 Jul 20 04:17:13.194458 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 364/754] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:13.236481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.237142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.245267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.245672 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.247479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.247914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.276708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:13.453843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.465529 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.467050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.468239 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d1f7b005-eacf-4846-8eb9-1062cb6ed9d2 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.236914 Jul 20 04:17:13.473646 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 391/755] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:13.631835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.632495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.639909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.640630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.641563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.642177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.709274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:13.710223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:13.716920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.717370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.718206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:13.718645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:13.845908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.855315 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0bee0c1a-d20b-4ed1-8760-3f3956815e7e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.227726 Jul 20 04:17:13.856033 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 365/756] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:13.891532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:13.899001 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fcaca0ed-356a-4202-853b-177487b42606 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.194231 Jul 20 04:17:13.899571 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 392/757] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:13 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:14.207932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.210809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] [instance: 04567d9b-93b2-4908-805c-66af120cec66] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.223447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.223806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.224611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.225291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.241209 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] HTTP exception thrown: Instance 04567d9b-93b2-4908-805c-66af120cec66 could not be found. Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Request method failure captured: Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 HTTP/1.1 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GAgdUqVrXYoXbHtU8wySEuMYelyMoN4tf5e_bgtCPv_HQYcmc_mnkVT-Ba6MuAlvWt2XNS1I-ptVeN8yrp2A3znVFLSky4SkUYaJ9x1abtsCzikOlyk1FTEvQ-GSlOUBdUYOnsqw-QwXYpaujQkVow484Xl6aLLhyxYgS7CriOCI8 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.75 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 18b7891fdfc746169e65b26e1e704be5 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdmin275Test-440054656 Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:14.244194 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/18b7891fdfc746169e65b26e1e704be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/18b7891fdfc746169e65b26e1e704be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/18b7891fdfc746169e65b26e1e704be5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_18b7891fdfc746169e65b26e1e704be5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdmin275Test-440054656 Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 18b7891fdfc746169e65b26e1e704be5 Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdmin275Test-440054656 Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdmin275Test-440054656-project Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f9e1e6781fa647a6bdff4b890f021774 Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdmin275Test-440054656-project Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 04567d9b-93b2-4908-805c-66af120cec66 could not be found. Jul 20 04:17:14.245694 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '04567d9b-93b2-4908-805c-66af120cec66'} Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04567d9b-93b2-4908-805c-66af120cec66 could not be found. Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:14.246581 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04567d9b-93b2-4908-805c-66af120cec66 could not be found. Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04567d9b-93b2-4908-805c-66af120cec66 could not be found. Jul 20 04:17:14.247817 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:14.249220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] Returning 404 to user: Instance 04567d9b-93b2-4908-805c-66af120cec66 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:14.249220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7278b6ac-e5e4-40db-aa3e-f814de69bf1a tempest-ServersAdmin275Test-440054656 tempest-ServersAdmin275Test-440054656-project] 10.222.0.49 "GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66" status: 404 len: 111 microversion: 2.75 time: 0.049901 Jul 20 04:17:14.250656 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 366/758] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/04567d9b-93b2-4908-805c-66af120cec66 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:14.498184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.498791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.508247 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.508948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.510276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.510879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.778348 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.787472 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.789744 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:14.791745 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bb4ee796-6a0e-4005-bc90-59dcb9e7ea6a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1568 microversion: 2.25 time: 0.298219 Jul 20 04:17:14.792909 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 393/759] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:14.873544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.874745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.882043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.882898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.883837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.885015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.917787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:14.918571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:14.934148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.934879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:14.941974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:14.942961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.114690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.123584 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a5000c7d-d027-4433-8593-0b72ba8215af tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.210762 Jul 20 04:17:15.124256 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 394/760] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:15.138990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.146378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5dc5907-033d-4867-bb56-aeb3792b960d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.277913 Jul 20 04:17:15.147117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 367/761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:14 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:15.227361 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-87a8fabc-c0c7-4e82-8598-70f21f40957c req-318d85b7-aef5-4e56-be19-4fb8e3e6b294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40670f12-c948-46ba-b762-0cb0d2bf024a", "name": "network-vif-plugged", "status": "completed", "tag": "0794223d-8781-4dd5-b99f-c05dd7046e91"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:15.245581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-87a8fabc-c0c7-4e82-8598-70f21f40957c req-318d85b7-aef5-4e56-be19-4fb8e3e6b294 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.246031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-87a8fabc-c0c7-4e82-8598-70f21f40957c req-318d85b7-aef5-4e56-be19-4fb8e3e6b294 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.268750 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-87a8fabc-c0c7-4e82-8598-70f21f40957c req-318d85b7-aef5-4e56-be19-4fb8e3e6b294 service nova] Creating event network-vif-plugged:0794223d-8781-4dd5-b99f-c05dd7046e91 for instance 40670f12-c948-46ba-b762-0cb0d2bf024a on n-h2-764486-11 Jul 20 04:17:15.282300 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-87a8fabc-c0c7-4e82-8598-70f21f40957c req-318d85b7-aef5-4e56-be19-4fb8e3e6b294 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058146 Jul 20 04:17:15.284249 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 395/762] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:15.812190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:15.813160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:15.820493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.822152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.823295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:15.823744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:15.966656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.976156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.978263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:15.979423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46084f16-36e0-4575-9a55-1c172a1f3988 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1558 microversion: 2.25 time: 0.173921 Jul 20 04:17:15.979981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 368/763] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:15.999054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e72aa87e-5c0f-41e8-9643-c99951476e62 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '.version_select at 0x7f839800f5e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.001507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e72aa87e-5c0f-41e8-9643-c99951476e62 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.001903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e72aa87e-5c0f-41e8-9643-c99951476e62 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.011639 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e72aa87e-5c0f-41e8-9643-c99951476e62 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2141 microversion: 2.25 time: 0.018122 Jul 20 04:17:16.012573 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 396/764] 10.222.0.49 () {60 vars in 1183 bytes} [Wed Jul 20 04:17:15 2022] GET /compute/v2.1/os-migrations => generated 2141 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:16.033561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.034509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.042701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.043585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.044831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.046108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.142323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.143529 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.154219 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.154673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.155487 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.156136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.291988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid e2848d05-a6b8-4a72-9774-0f49ec9cf583 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:16.308274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77e67edd-f05c-4652-a627-8c2b8f14f239 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 2053 microversion: 2.25 time: 0.283795 Jul 20 04:17:16.309213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 369/765] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 2053 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:16.313968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:16.314801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:16.321574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.322796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.323743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:16.324334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:16.569985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.578800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77cb3b00-9e09-491d-9f44-fa3c6e4b5fe1 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.268408 Jul 20 04:17:16.589555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 370/766] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:16.595146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-134567600", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "3e4182e1-3b84-49f1-9a99-386772005d20"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:16.663490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] validate_networks() for [('3e4182e1-3b84-49f1-9a99-386772005d20', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:16.875592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:16.891448 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7d5ae7bd-1765-4d3f-a42a-e31bdc22b398 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1319 microversion: 2.1 time: 0.754431 Jul 20 04:17:16.893772 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 397/767] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:16 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1319 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:17.198670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:17.199215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:17.199876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:17.200399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:17.200983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:17.214282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.215634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.224070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.224720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.255459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:17.264542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for user c21b3bf3ba4d4558950d7337a651587f and project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:17.293188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:17.302680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:17.339211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:17.365007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a615ef4a-60bd-4c62-a12c-743ced884295 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.774193 Jul 20 04:17:17.365980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 371/768] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:17:17.377044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c4aa3f1a-f6c3-4662-9ace-dbee2cf6f851 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.377802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c4aa3f1a-f6c3-4662-9ace-dbee2cf6f851 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.483570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c4aa3f1a-f6c3-4662-9ace-dbee2cf6f851 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.491764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c4aa3f1a-f6c3-4662-9ace-dbee2cf6f851 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.494084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c4aa3f1a-f6c3-4662-9ace-dbee2cf6f851 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.495468 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c4aa3f1a-f6c3-4662-9ace-dbee2cf6f851 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1261 microversion: 2.25 time: 0.123016 Jul 20 04:17:17.496738 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 398/769] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:17.596926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.597732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.605741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.606673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.607416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.608050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.786671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:17.796743 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46c80128-0f83-42b4-aa52-f42be0082085 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.204198 Jul 20 04:17:17.797521 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 372/770] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:17.909618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:17.910227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:17.919559 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.920477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:17.921690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:17.922765 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.163416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.175117 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dc69abc4-aee1-4d1f-b6fb-f191dc08288a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1469 microversion: 2.1 time: 0.268060 Jul 20 04:17:18.177187 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 399/771] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:17 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:18.198377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19106781-efa0-4d17-b733-04235a05bf03 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.199185 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.200314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.202961 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:18.202961 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:18.205266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19106781-efa0-4d17-b733-04235a05bf03 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.205882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19106781-efa0-4d17-b733-04235a05bf03 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.207135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19106781-efa0-4d17-b733-04235a05bf03 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.207260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.207714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.208193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19106781-efa0-4d17-b733-04235a05bf03 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.208527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.209020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.247636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19106781-efa0-4d17-b733-04235a05bf03 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.236903 Jul 20 04:17:18.252172 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 373/772] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:18.259146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ec734f7-8f12-40fa-b2ac-747a2257c304 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.260650 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:18.260650 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:18.262260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec734f7-8f12-40fa-b2ac-747a2257c304 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.262714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec734f7-8f12-40fa-b2ac-747a2257c304 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.263636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec734f7-8f12-40fa-b2ac-747a2257c304 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.264331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec734f7-8f12-40fa-b2ac-747a2257c304 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.294330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ec734f7-8f12-40fa-b2ac-747a2257c304 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-764486-11" status: 200 len: 581 microversion: 2.1 time: 0.038832 Jul 20 04:17:18.294989 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 374/773] 10.222.0.49 () {58 vars in 1173 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/os-services?host=n-d-764486-11 => generated 581 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:18.306673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50d20379-cb43-4236-a5e6-8821baeb9daf tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.307924 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:18.307924 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:18.310059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d20379-cb43-4236-a5e6-8821baeb9daf tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.310518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d20379-cb43-4236-a5e6-8821baeb9daf tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.311505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d20379-cb43-4236-a5e6-8821baeb9daf tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.311941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d20379-cb43-4236-a5e6-8821baeb9daf tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.319091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:18.341300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50d20379-cb43-4236-a5e6-8821baeb9daf tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038819 Jul 20 04:17:18.341921 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 375/774] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:18.354163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b11c211-40a6-437d-b97d-49b2fbb465b3 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.355666 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:18.355666 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:18.357059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b11c211-40a6-437d-b97d-49b2fbb465b3 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.357584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b11c211-40a6-437d-b97d-49b2fbb465b3 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.358457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b11c211-40a6-437d-b97d-49b2fbb465b3 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.358969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b11c211-40a6-437d-b97d-49b2fbb465b3 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.384936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b11c211-40a6-437d-b97d-49b2fbb465b3 tempest-ServicesAdminTestJSON-1977506593 tempest-ServicesAdminTestJSON-1977506593-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.035383 Jul 20 04:17:18.385827 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 376/775] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:18.423109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.438426 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6761013b-18f4-4974-9617-417a86e9a90b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 200 len: 1469 microversion: 2.1 time: 0.249185 Jul 20 04:17:18.439676 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 400/776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:18.456630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.461159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.462327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Searching by: {'reservation_id': 'r-u1jdj5ys', 'deleted': False, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:18.472861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.473735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.474710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.476219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.515432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.516047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.531518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.534329 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.536262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.538370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.734140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.754883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:18.764272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.774029 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:18.783165 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-df083977-af8f-4d4e-b35b-ab7fe6a077aa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1313 microversion: 2.25 time: 0.271521 Jul 20 04:17:18.787668 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 401/777] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:18.816932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:18.818540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:18.835101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.838243 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.839207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:18.840578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:18.986310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.010577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.011386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.125292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:19.133632 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f47a9055-6200-423e-a897-48e4139b8cd3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.322529 Jul 20 04:17:19.144011 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 402/778] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:19.340147 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6bde6a1-887b-4f1f-930e-1e13ae789be0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-u1jdj5ys" status: 200 len: 2931 microversion: 2.1 time: 0.887741 Jul 20 04:17:19.343620 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 377/779] 10.222.0.49 () {58 vars in 1196 bytes} [Wed Jul 20 04:17:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-u1jdj5ys => generated 2931 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.358920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d50c6c2d-8333-4b26-bdb8-8c9452b32f7e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.380933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.compute.server_groups [None req-d50c6c2d-8333-4b26-bdb8-8c9452b32f7e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Querying cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) for 2 instances {{(pid=123723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:17:19.385702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d50c6c2d-8333-4b26-bdb8-8c9452b32f7e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.387039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d50c6c2d-8333-4b26-bdb8-8c9452b32f7e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.435351 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d50c6c2d-8333-4b26-bdb8-8c9452b32f7e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/ce6451e7-fe61-43e9-abe0-b4063e45e1ec" status: 200 len: 265 microversion: 2.1 time: 0.080181 Jul 20 04:17:19.437712 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 403/780] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/os-server-groups/ce6451e7-fe61-43e9-abe0-b4063e45e1ec => generated 265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:19.447790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.448701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.455220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.456125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.457990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.458582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.717679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f157ddd-98d8-4b26-a9a1-49dc1428c322 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 200 len: 1622 microversion: 2.1 time: 0.272905 Jul 20 04:17:19.730624 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 378/781] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 1622 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:19.737512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.738182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.747379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.747862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.748640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.749217 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.803961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:19.805081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:19.834064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.834744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:19.835977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:19.841733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.063911 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-972fe8a9-8d40-449b-bcdb-3cb3aaad7c5b tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 200 len: 1622 microversion: 2.1 time: 0.331158 Jul 20 04:17:20.064950 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 404/782] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 1622 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.084449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-96e387b6-6a27-43dd-a7f3-dd77f134d986 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: .version_select at 0x7f839862a940>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1801629568", "policies": ["anti-affinity"]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:20.118368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-96e387b6-6a27-43dd-a7f3-dd77f134d986 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:20.128069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-96e387b6-6a27-43dd-a7f3-dd77f134d986 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:20.189393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.199584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.201784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.202140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:20.203474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a7798a6-e30d-463c-9b51-16f2b37a2feb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.404069 Jul 20 04:17:20.207349 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 379/783] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:19 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:20.213624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:20.214495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:20.218062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-96e387b6-6a27-43dd-a7f3-dd77f134d986 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:20.232432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.237074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-96e387b6-6a27-43dd-a7f3-dd77f134d986 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_groups'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:20.237515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.238583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:20.239248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:20.256181 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-96e387b6-6a27-43dd-a7f3-dd77f134d986 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.176062 Jul 20 04:17:20.257690 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 405/784] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Jul 20 04:17:20 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:20.460595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1025989504", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0c5f17c8-317b-483e-b02f-b2db3fe962bb"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:20.521467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:20.533013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0092bec-ebe8-41f6-9519-685a098d1791 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.320682 Jul 20 04:17:20.534681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 380/785] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:20 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:20.587349 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:21.129963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:21.130756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:21.131562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:21.132195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:21.134503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:21.172482 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.173793 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.177433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.178369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.214186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:21.226933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:21.235634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.236515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.249827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.250278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.251063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.251496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.276731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Going to run 2 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:21.281432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:21.413223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:21.420575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:21.510305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:21.530555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:21.552828 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=d5361b9d-6974-4eb0-aee8-2ef8b3910e03,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:21.569660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.582161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.590144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.591665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca1ea4b4-f4c6-4506-b382-d0f96f4f915b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.370389 Jul 20 04:17:21.595459 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 381/786] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:21.610971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-901040c8-af0f-457b-8db6-278783e8ede6 req-464f7d8b-ad1b-421b-9d33-1e953cffd708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5f0b31-a570-467c-9fa5-0b6f31db53ad", "tag": "89488716-dcfe-4e5a-99e2-bb2b8ce560a4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:21.628313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-901040c8-af0f-457b-8db6-278783e8ede6 req-464f7d8b-ad1b-421b-9d33-1e953cffd708 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.630516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-901040c8-af0f-457b-8db6-278783e8ede6 req-464f7d8b-ad1b-421b-9d33-1e953cffd708 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.666884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-901040c8-af0f-457b-8db6-278783e8ede6 req-464f7d8b-ad1b-421b-9d33-1e953cffd708 service nova] Creating event network-changed:89488716-dcfe-4e5a-99e2-bb2b8ce560a4 for instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad on n-h1-764486-11 Jul 20 04:17:21.667694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:21.677134 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:21.678913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-901040c8-af0f-457b-8db6-278783e8ede6 req-464f7d8b-ad1b-421b-9d33-1e953cffd708 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079832 Jul 20 04:17:21.680773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 382/787] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:21.698437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.699254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:21.719291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.720271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.721241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:21.721830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:21.766695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:21.781883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'server_group_members'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:21.887709 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-62222230-4167-46fe-8d26-23c65d3ae979 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.432261 Jul 20 04:17:21.897396 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 406/788] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 1444 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jul 20 04:17:21.914190 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:21.924586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:21.925979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Searching by: {'deleted': False, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08'} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:22.013467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.014186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.015247 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.015845 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.091860 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.multi_cell_list [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=123723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:22.125153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.152390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9deab21-f72e-4cb0-9cac-bfc771e73f03 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.470294 Jul 20 04:17:22.153377 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 383/789] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.181189 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b7c2334f-80a4-44cc-bbad-d73cc72daa1c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.279153 Jul 20 04:17:22.190045 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 407/790] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:17:21 2022] GET /compute/v2.1/servers => generated 1665 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:22.199515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87e3aca9-b42c-40a9-b955-7fa9dc6c6818 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.201966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87e3aca9-b42c-40a9-b955-7fa9dc6c6818 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.813933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87e3aca9-b42c-40a9-b955-7fa9dc6c6818 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:22.826013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87e3aca9-b42c-40a9-b955-7fa9dc6c6818 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1219 microversion: 2.1 time: 0.633074 Jul 20 04:17:22.836890 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 384/791] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1219 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:22.843169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:22.844059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:22.850665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.851912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.853054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:22.853686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:22.862195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-eb0842a9-10de-44dc-919d-33bb2e18b683 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f839841e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-235292679", "description": "tempest-description-118502667"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:23.062999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.077991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.080024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.082445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27282f83-f693-4ea9-a7c1-e145652fae9b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.243522 Jul 20 04:17:23.083974 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 385/792] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:22 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:23.171517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.172285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.181051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.181829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.182805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.184057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.273209 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-eb0842a9-10de-44dc-919d-33bb2e18b683 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.696953 Jul 20 04:17:23.284722 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 408/793] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:22 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:23.290599 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34a10618-9c75-4164-bd64-ff1cdaf34d94 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f8398613ca0>, body: {"security_group_rule": {"parent_group_id": "84ea8d5e-8158-4643-9f0f-2d841ea6fe85", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:23.442961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.455600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16277650-607f-45db-8736-b29c1f5cc360 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.288928 Jul 20 04:17:23.457088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 386/794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:23.664281 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-34a10618-9c75-4164-bd64-ff1cdaf34d94 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.378176 Jul 20 04:17:23.664993 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 409/795] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:23.677198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d578e6af-22b4-491a-a300-7ab90cae305f tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f839805e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1545802258", "description": "tempest-description-578822221"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:23.834326 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d578e6af-22b4-491a-a300-7ab90cae305f tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.161694 Jul 20 04:17:23.837337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 387/796] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:23.843804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:23.848706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:23.850673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52a5be6c-9a77-49c8-86db-a0f471fff145 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f839826c940>, body: {"security_group_rule": {"parent_group_id": "3f740312-ea71-4afc-a1f1-6976c1e4dd5b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:23.863151 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.863639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.864262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:23.864943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:23.933754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:23.942034 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-80885bc3-89b1-4973-8843-4f0803276fce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1223 microversion: 2.1 time: 0.102273 Jul 20 04:17:23.942837 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 410/797] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:24.070238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52a5be6c-9a77-49c8-86db-a0f471fff145 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.224670 Jul 20 04:17:24.071390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 388/798] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:24.082612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-590d0388-9f76-469e-9ac0-15ffd5bfa7aa tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83982633a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1119333544", "description": "tempest-description-1500073435"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:24.129085 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bd4b093f-1c38-481d-b28a-085f3b9a4c5f tempest-TenantUsagesNegativeTestJSON-1111127574 tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A17%3A23.980266&end=2022-07-21T04%3A17%3A23.980266" status: 404 len: 112 microversion: - time: 0.145056 Jul 20 04:17:24.136510 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 411/799] 10.222.0.49 () {58 vars in 1315 bytes} [Wed Jul 20 04:17:23 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T04%3A17%3A23.980266&end=2022-07-21T04%3A17%3A23.980266 => generated 112 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:17:24.142477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.143795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.154578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.155620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.156839 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.157916 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.303954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-590d0388-9f76-469e-9ac0-15ffd5bfa7aa tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.225343 Jul 20 04:17:24.304834 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 389/800] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:24.316949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8395d2b-bc31-4053-90ab-d3e9f430e41e tempest-TenantUsagesNegativeTestJSON-1111127574 tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin] Calling method '.version_select at 0x7f8398142310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.332738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c8395d2b-bc31-4053-90ab-d3e9f430e41e tempest-TenantUsagesNegativeTestJSON-1111127574 tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8395d2b-bc31-4053-90ab-d3e9f430e41e tempest-TenantUsagesNegativeTestJSON-1111127574 tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin] Request method failure captured: Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-simple-tenant-usage/8cbef2af50924c339330bd50713e4941?start=2022-07-21T04%3A17%3A23.980266&end=2022-07-19T04%3A17%3A23.980266 HTTP/1.1 Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14HTZHMq_8AWKtMiiUE9qWVibCT_wgzaOAtl6jy0-RIwouMxahDLzJbpgUSQPMNCDM8vU4_X6XRnhSpe8fXxFot4xucCMIBa4FtT_guPYBC_yMdyiNKNoFA6u1uWZ5FSqP_r9uRIbRXhLn1Lxuu6-iO9bVwU1GIxJaOk3ox6mWJDPEA Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: da29bbbcbf944613ade37a560fbfc052 Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1111127574 Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:17:24.335894 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da29bbbcbf944613ade37a560fbfc052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da29bbbcbf944613ade37a560fbfc052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da29bbbcbf944613ade37a560fbfc052"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da29bbbcbf944613ade37a560fbfc052", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1111127574 Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: da29bbbcbf944613ade37a560fbfc052 Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1111127574 Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8ef495cac5e045c7aac1de5e4642bf9e Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid start time. The start time cannot occur after the end time. Jul 20 04:17:24.337297 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8cbef2af50924c339330bd50713e4941'} Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:17:24.338051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 20 04:17:24.339166 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.342933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8395d2b-bc31-4053-90ab-d3e9f430e41e tempest-TenantUsagesNegativeTestJSON-1111127574 tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:24.344028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8395d2b-bc31-4053-90ab-d3e9f430e41e tempest-TenantUsagesNegativeTestJSON-1111127574 tempest-TenantUsagesNegativeTestJSON-1111127574-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/8cbef2af50924c339330bd50713e4941?start=2022-07-21T04%3A17%3A23.980266&end=2022-07-19T04%3A17%3A23.980266" status: 400 len: 111 microversion: 2.1 time: 0.030859 Jul 20 04:17:24.344832 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 390/801] 10.222.0.49 () {58 vars in 1411 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/os-simple-tenant-usage/8cbef2af50924c339330bd50713e4941?start=2022-07-21T04%3A17%3A23.980266&end=2022-07-19T04%3A17%3A23.980266 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:17:24.356548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85c318f7-2392-47f1-8daf-4ff44b5526a6 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f838bebee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1778213899", "description": "tempest-description-1394250786"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:24.475202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.489773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.501307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.502597 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d7552644-605e-442d-a2e4-570bc94fb6e5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.364757 Jul 20 04:17:24.503192 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 412/802] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:24.660903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0b06a898-a204-4ee5-8bdc-c55028eccbcc tempest-TenantUsagesNegativeTestJSON-345381031 tempest-TenantUsagesNegativeTestJSON-345381031-project] Calling method '.version_select at 0x7f83986135e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.664112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0b06a898-a204-4ee5-8bdc-c55028eccbcc tempest-TenantUsagesNegativeTestJSON-345381031 tempest-TenantUsagesNegativeTestJSON-345381031-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'a152831265f74bdcb31bb3cd30aeb2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbef2af50924c339330bd50713e4941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0b06a898-a204-4ee5-8bdc-c55028eccbcc tempest-TenantUsagesNegativeTestJSON-345381031 tempest-TenantUsagesNegativeTestJSON-345381031-project] Request method failure captured: Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A17%3A23.980266&end=2022-07-21T04%3A17%3A23.980266&detailed=1 HTTP/1.1 Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14HSGk6OScdUo5f6yffoFUA9-2rxEqQGyzicgNxpmQO9Y3SLJ7riszNuf_Lda0bNGRdO8am7r7nNkf70WtaekfPrHe3771GRhi079WaY_Pgr5g_9EgTJb1W-pm4BlPFTxdezPMU1z-PtCTKguvY-z7nC5lY3tw_IQ9C5f6vYuOl4HaQ Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 8cbef2af50924c339330bd50713e4941 Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-345381031 Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:24.667068 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8cbef2af50924c339330bd50713e4941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8cbef2af50924c339330bd50713e4941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8cbef2af50924c339330bd50713e4941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8cbef2af50924c339330bd50713e4941", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-345381031 Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 8cbef2af50924c339330bd50713e4941 Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-345381031 Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-TenantUsagesNegativeTestJSON-345381031-project Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: a152831265f74bdcb31bb3cd30aeb2c2 Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-345381031-project Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: action_args: {} Jul 20 04:17:24.668573 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:17:24.669334 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:17:24.670632 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:17:24.673735 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 04:17:24.673735 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:24.676719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0b06a898-a204-4ee5-8bdc-c55028eccbcc tempest-TenantUsagesNegativeTestJSON-345381031 tempest-TenantUsagesNegativeTestJSON-345381031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:24.678498 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0b06a898-a204-4ee5-8bdc-c55028eccbcc tempest-TenantUsagesNegativeTestJSON-345381031 tempest-TenantUsagesNegativeTestJSON-345381031-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A17%3A23.980266&end=2022-07-21T04%3A17%3A23.980266&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.164352 Jul 20 04:17:24.679336 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 413/803] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A17%3A23.980266&end=2022-07-21T04%3A17%3A23.980266&detailed=1 => generated 123 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:24.691904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:24.692832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:24.701605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.702244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.703115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:24.703646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:24.990286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85c318f7-2392-47f1-8daf-4ff44b5526a6 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.637954 Jul 20 04:17:24.992364 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 391/804] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:25.029139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.031010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.065120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.065836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.066825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.067598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.211047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.223573 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4e6e6600-4013-4a84-ad41-568cdaebac71 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.541738 Jul 20 04:17:25.227313 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 414/805] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:25.239125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-db36257a-bedf-464b-9c11-38982a45b34e tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83986133a0>, body: {"security_group_rule": {"parent_group_id": "aca31185-e6ac-46ce-a1b4-24bf0d28e088", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "270def73-1547-4ad1-96cf-25ee1559e3c9"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:25.272273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.290641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e0a2889-95a7-4692-9760-f6909cc0b8c7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1271 microversion: 2.1 time: 0.290004 Jul 20 04:17:25.294376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 392/806] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:24 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:25.521466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:25.522085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:25.537246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.538250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.540995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:25.541803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:25.847544 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-db36257a-bedf-464b-9c11-38982a45b34e tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.618849 Jul 20 04:17:25.848142 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 415/807] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:25.861943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-31eceb0f-17a4-47ab-be9c-8a2ec65e46d6 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83980a2040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1494064466", "description": "tempest-description-1736577766"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:25.939340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.949423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.960030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:25.962027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15acde5b-c0be-4cf3-9242-1921cefdbfdd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.444309 Jul 20 04:17:25.972484 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 393/808] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:25 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:26.127379 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-31eceb0f-17a4-47ab-be9c-8a2ec65e46d6 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.270644 Jul 20 04:17:26.128171 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 416/809] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:26.141396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9f48cda-9647-4567-8fa5-8f0e94dbd296 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83980c6790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1420514069", "description": "tempest-description-1889255299"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:26.243031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.243650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.251738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.252264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.261323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.262060 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.457226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.468274 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c3709d62-fcd9-4fbd-8abf-5bb8acf65a17 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.227964 Jul 20 04:17:26.471146 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 417/810] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:26.482239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.484606 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:26.501362 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.503830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.506353 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:26.507652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:26.564058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:26.647518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:26.659929 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-33257de2-92c5-4006-a70a-d3865501e62b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1277 microversion: 2.1 time: 0.186834 Jul 20 04:17:26.672121 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 418/811] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:26.727793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9f48cda-9647-4567-8fa5-8f0e94dbd296 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.591373 Jul 20 04:17:26.742348 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 394/812] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:26.744604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-449d1cfa-c390-4ab8-bcd9-b5ba7f4f924a tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f839851fb80>, body: {"security_group_rule": {"parent_group_id": "93f9c4a1-632a-40f5-9515-d2ef8deced8d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "839f1296-dc6a-4104-8097-0e9374011091"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:26.979989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:26.980821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:27.000294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.004087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.006495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.010498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.395319 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-449d1cfa-c390-4ab8-bcd9-b5ba7f4f924a tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.659328 Jul 20 04:17:27.396665 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 419/813] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:26 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:27.403318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.404645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:27.414872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.416158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.418684 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.419461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.429787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.459734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.461906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:27.468306 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cadb8e76-7a93-42c8-8fc0-aee181045554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.487669 Jul 20 04:17:27.468966 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 395/814] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:26 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:17:27.493953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a7253903-3ba2-4925-9a3b-76762e48b221 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f839805edc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.525332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:27.693904 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c9bf6aa0-9db6-4140-8e60-098c3b93c51f tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 204 len: 0 microversion: 2.1 time: 0.295100 Jul 20 04:17:27.694704 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 420/815] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:27 2022] DELETE /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:27.708292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:27.709403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:27.717664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.718533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:27.719700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:27.720918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.009475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.018722 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d779d9bc-1463-4f96-b744-b9b5f6fbee6b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.318064 Jul 20 04:17:28.019958 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 421/816] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:27 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.025943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.028118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.035372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:28.040645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.041298 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.045854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.046878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.153716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a7253903-3ba2-4925-9a3b-76762e48b221 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/839f1296-dc6a-4104-8097-0e9374011091" status: 202 len: 0 microversion: 2.1 time: 0.668985 Jul 20 04:17:28.154315 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 396/817] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:27 2022] DELETE /compute/v2.1/os-security-groups/839f1296-dc6a-4104-8097-0e9374011091 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:28.159582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.160197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.178036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.178488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.179285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.179717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.269747 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.278907 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5a1d3229-4fbe-4fa9-88bb-c5a017a17ea7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.257724 Jul 20 04:17:28.285945 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 422/818] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.294580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.295080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.302245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.303687 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.305123 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.306007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.350793 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:17:28.528089 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9decb282-3769-4a22-800d-5cbc602fab3e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "DELETE /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 204 len: 0 microversion: 2.1 time: 0.239779 Jul 20 04:17:28.531900 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 423/819] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:28 2022] DELETE /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:28.532514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.535960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6a6b7963-1a05-45e0-bcc9-2bcb1649060e tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f8398151430>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.562286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8017c57e-3d5c-4337-93e5-247f0aad1b6c tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1714 microversion: 2.1 time: 0.401626 Jul 20 04:17:28.564642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 397/820] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1714 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.582048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.582664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.592664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.598734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.602770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.603636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.604826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:28.615335 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6a6b7963-1a05-45e0-bcc9-2bcb1649060e tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/93f9c4a1-632a-40f5-9515-d2ef8deced8d" status: 200 len: 248 microversion: 2.1 time: 0.084704 Jul 20 04:17:28.622470 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 424/821] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/os-security-groups/93f9c4a1-632a-40f5-9515-d2ef8deced8d => generated 248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:28.622470 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:28.622773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:28.646038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.646761 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.647756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.649927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.843648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.854367 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9e9f52f5-0ae2-4fa5-afeb-114820b813bd tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1661 microversion: 2.1 time: 0.236819 Jul 20 04:17:28.855432 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 425/822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1661 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:28.865740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.870611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6a6f30c-2d2e-4a2a-9eb4-cc879007347f tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83983f5310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1077805429", "description": "tempest-description-1782860014"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:28.886356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.888936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:28.890434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e86a8edb-6b5c-47b6-a794-2ff9e97eb7b8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.320720 Jul 20 04:17:28.891348 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 398/823] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:28 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:28.898007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6b0e017f-3dbd-40eb-b768-51aaf8a6814e req-6d62edde-5d27-4763-a4cc-97966eec5c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5361b9d-6974-4eb0-aee8-2ef8b3910e03", "tag": "527a1f9c-89bf-45d8-9e19-eb8f629318c0"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:28.914009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6b0e017f-3dbd-40eb-b768-51aaf8a6814e req-6d62edde-5d27-4763-a4cc-97966eec5c5c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:28.915431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6b0e017f-3dbd-40eb-b768-51aaf8a6814e req-6d62edde-5d27-4763-a4cc-97966eec5c5c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:28.931470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6b0e017f-3dbd-40eb-b768-51aaf8a6814e req-6d62edde-5d27-4763-a4cc-97966eec5c5c service nova] Creating event network-changed:527a1f9c-89bf-45d8-9e19-eb8f629318c0 for instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 on n-h2-764486-11 Jul 20 04:17:28.936712 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6b0e017f-3dbd-40eb-b768-51aaf8a6814e req-6d62edde-5d27-4763-a4cc-97966eec5c5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043998 Jul 20 04:17:28.938344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 399/824] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:29.038335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.040341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.048518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.049244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.049490 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a6a6f30c-2d2e-4a2a-9eb4-cc879007347f tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.182781 Jul 20 04:17:29.050541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.050930 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 426/825] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:17:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:29.051626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.065841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9bee0a1d-95cd-41bd-98de-2af3744cc412 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83982cf3a0>, body: {"security_group_rule": {"parent_group_id": "9dffaa40-101e-400a-be34-e602102f7a57", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:29.255129 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9bee0a1d-95cd-41bd-98de-2af3744cc412 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.195744 Jul 20 04:17:29.255805 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 427/826] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:29.266656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0adb3bdf-2bb1-437a-8e48-5ebb9811b37d tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Action: 'create', calling method: .version_select at 0x7f83983248b0>, body: {"security_group_rule": {"parent_group_id": "9dffaa40-101e-400a-be34-e602102f7a57", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:29.376486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.388644 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ac342d7-7dc9-457e-9405-964860fb044b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.356689 Jul 20 04:17:29.389944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 400/827] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:29.396867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.397787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.406212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.406999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.408209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.408877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.500099 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0adb3bdf-2bb1-437a-8e48-5ebb9811b37d tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.236733 Jul 20 04:17:29.500812 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 428/828] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:17:29 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:29.513382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-48ca7aaa-8120-4557-a4db-39bd51eb010d tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f839800f550>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.582463 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-48ca7aaa-8120-4557-a4db-39bd51eb010d tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/9dffaa40-101e-400a-be34-e602102f7a57" status: 200 len: 665 microversion: 2.1 time: 0.073247 Jul 20 04:17:29.589588 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 429/829] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/os-security-groups/9dffaa40-101e-400a-be34-e602102f7a57 => generated 665 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:29.595216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-8690a914-2f38-4fdd-b5fb-a8607bd15350 req-17aeeb74-eace-4b4e-8c7f-dcdb52f65e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5f0b31-a570-467c-9fa5-0b6f31db53ad", "name": "network-vif-plugged", "status": "completed", "tag": "89488716-dcfe-4e5a-99e2-bb2b8ce560a4"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:29.631987 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8690a914-2f38-4fdd-b5fb-a8607bd15350 req-17aeeb74-eace-4b4e-8c7f-dcdb52f65e17 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.633303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8690a914-2f38-4fdd-b5fb-a8607bd15350 req-17aeeb74-eace-4b4e-8c7f-dcdb52f65e17 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.661771 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-8690a914-2f38-4fdd-b5fb-a8607bd15350 req-17aeeb74-eace-4b4e-8c7f-dcdb52f65e17 service nova] Creating event network-vif-plugged:89488716-dcfe-4e5a-99e2-bb2b8ce560a4 for instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad on n-h1-764486-11 Jul 20 04:17:29.669426 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-8690a914-2f38-4fdd-b5fb-a8607bd15350 req-17aeeb74-eace-4b4e-8c7f-dcdb52f65e17 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077877 Jul 20 04:17:29.671716 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 430/830] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:29.679153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:29.682118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:29.703292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.704933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.706142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:29.708758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:29.725392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:29.729923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:29.737459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f375954-d2bd-4b44-a824-4ec7b175024c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.345640 Jul 20 04:17:29.741470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 401/831] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:29.755661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f3fd7e9-c854-447a-8dba-43b0cd75ad45 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f838be8e5e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.082377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.097802 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1fc36a79-bf71-48d0-9be8-c97c34d64c17 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1714 microversion: 2.1 time: 0.422740 Jul 20 04:17:30.099123 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 431/832] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:29 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1714 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:30.104517 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.105256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.115914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.116722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.118703 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.120558 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.334524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f3fd7e9-c854-447a-8dba-43b0cd75ad45 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/b85e0fb2-a6f2-490b-9881-b0f05a831111" status: 202 len: 0 microversion: 2.1 time: 0.582517 Jul 20 04:17:30.335847 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 402/833] 10.222.0.49 () {58 vars in 1286 bytes} [Wed Jul 20 04:17:29 2022] DELETE /compute/v2.1/os-security-group-rules/b85e0fb2-a6f2-490b-9881-b0f05a831111 => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:30.342146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.343114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.353036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.354195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.355432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.356091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.548843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.576198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.584592 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d04dcd93-b97b-4d75-b97b-5d74223f8bd6 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1661 microversion: 2.1 time: 0.483874 Jul 20 04:17:30.586535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.589143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.590403 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f1f794e-ca5b-4b26-bca1-7ddc6aac0a03 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1361 microversion: 2.25 time: 0.252516 Jul 20 04:17:30.590833 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 432/834] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1661 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:30.591476 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 403/835] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:30.596447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.597345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e383b21f-a4cc-4e3e-8681-21328e8e22ea tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f83983f5280>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.597493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.605259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.605997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.606971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.607743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.758652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:30.766640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3eec906a-03e9-4568-a305-60ceed0f1b2e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1476 microversion: 2.1 time: 0.174078 Jul 20 04:17:30.767219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 404/836] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:30.771873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:30.772504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:30.778391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.778840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:30.779607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:30.780038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.064952 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e383b21f-a4cc-4e3e-8681-21328e8e22ea tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/9dffaa40-101e-400a-be34-e602102f7a57" status: 202 len: 0 microversion: 2.1 time: 0.472466 Jul 20 04:17:31.066384 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 433/837] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:30 2022] DELETE /compute/v2.1/os-security-groups/9dffaa40-101e-400a-be34-e602102f7a57 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:31.076277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f8398151820>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.134248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:31.135297 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Neutron security group 839f1296-dc6a-4104-8097-0e9374011091 not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:17:31.137400 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] HTTP exception thrown: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.137400 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Request method failure captured: Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-security-groups/839f1296-dc6a-4104-8097-0e9374011091 HTTP/1.1 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14HSmDV32_qr8i5R2zmsObziSo7CrOzhUhWad6_oECYR82JkhrJwCkcmJPITx_NRR2ukl_9RSKBsX28SsXiMLJkpFRZY4aTKpTeNbZlGiFgyAkzcHRW9URJP5hW_tlbKOqt39doq7UbTJti00iWqFVu3J_oBt_PjB7e1MZVNkWZwi20 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: b5b6f6b7de504cf0845341be7cb77ff5 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-105919833 Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:31.153814 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5b6f6b7de504cf0845341be7cb77ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b6f6b7de504cf0845341be7cb77ff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b6f6b7de504cf0845341be7cb77ff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5b6f6b7de504cf0845341be7cb77ff5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupRulesTestJSON-105919833 Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: b5b6f6b7de504cf0845341be7cb77ff5 Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-105919833 Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupRulesTestJSON-105919833-project Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 846143e3b10946a3bb4e02935f34bb98 Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupRulesTestJSON-105919833-project Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: exception: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] Jul 20 04:17:31.155434 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '839f1296-dc6a-4104-8097-0e9374011091'} Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:31.156526 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:17:31.157882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.159211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Returning 404 to user: Security group 839f1296-dc6a-4104-8097-0e9374011091 does not exist Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-7d9d6ae4-9cf0-45f8-9422-41ff7fa9cf77'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-14058198-01ff-4f4e-99b3-528d222e1660 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/839f1296-dc6a-4104-8097-0e9374011091" status: 404 len: 194 microversion: 2.1 time: 0.085970 Jul 20 04:17:31.160673 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 434/838] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:31 2022] DELETE /compute/v2.1/os-security-groups/839f1296-dc6a-4104-8097-0e9374011091 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:17:31.163268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.168444 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.180682 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.181141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.181933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.187365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.287373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.328039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-45146071-18fc-40d3-86e5-04efd762f107 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.559552 Jul 20 04:17:31.330901 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 405/839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:30 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.350033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f0bcb568-7056-48ad-b464-f0360def8d65 req-ed418be9-b296-4b6b-9e5a-6322e2669f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e24f9a1-ba2a-427a-9fa3-df2948e4423e", "tag": "1f15e670-bfff-4216-8b34-a8d7f5ce6c5d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:31.362515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0bcb568-7056-48ad-b464-f0360def8d65 req-ed418be9-b296-4b6b-9e5a-6322e2669f42 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.362962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0bcb568-7056-48ad-b464-f0360def8d65 req-ed418be9-b296-4b6b-9e5a-6322e2669f42 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.386547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f0bcb568-7056-48ad-b464-f0360def8d65 req-ed418be9-b296-4b6b-9e5a-6322e2669f42 service nova] Creating event network-changed:1f15e670-bfff-4216-8b34-a8d7f5ce6c5d for instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e on n-h1-764486-11 Jul 20 04:17:31.393645 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f0bcb568-7056-48ad-b464-f0360def8d65 req-ed418be9-b296-4b6b-9e5a-6322e2669f42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058732 Jul 20 04:17:31.394519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 406/840] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:31.399945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd005db2-3e4b-4260-99d0-760893f9d1c2 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f8398283040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.700025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2ac596c69843009cfd28dd0e90d56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbc880ec5e14aafa307eb780a1cd051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.711668 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a5981871-6837-471b-b920-bfee3ac81922 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 200 len: 1646 microversion: 2.1 time: 0.553647 Jul 20 04:17:31.715217 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 435/841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 1646 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.720233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.725224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.739871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.740337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.743552 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.744245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.796948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=44 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:31.937568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:31.955640 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-56ea3f71-305f-4810-826a-805c5c47d649 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1661 microversion: 2.1 time: 0.238548 Jul 20 04:17:31.957413 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 436/842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1661 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:31.966461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:31.967432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:31.977151 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.977896 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:31.979061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:31.983355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.045372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:32.303128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.315090 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.317354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.321795 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7c5ffbc8-7192-4f1e-b35c-a5da27df7675 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1558 microversion: 2.25 time: 0.363001 Jul 20 04:17:32.332405 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 437/843] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:31 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1558 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:32.332405 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-32c8473e-93a0-4a6a-9ac9-c73d59bb1f97 req-94306dc7-0635-47c3-836d-c4759b9a6c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c4546d-29d4-471e-83d3-08cfd8e4971f", "name": "network-vif-deleted", "tag": "08df78b6-24f9-424a-aa1d-3f52bfb9aa5b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:32.358103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-32c8473e-93a0-4a6a-9ac9-c73d59bb1f97 req-94306dc7-0635-47c3-836d-c4759b9a6c72 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.358556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-32c8473e-93a0-4a6a-9ac9-c73d59bb1f97 req-94306dc7-0635-47c3-836d-c4759b9a6c72 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.378120 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-32c8473e-93a0-4a6a-9ac9-c73d59bb1f97 req-94306dc7-0635-47c3-836d-c4759b9a6c72 service nova] Creating event network-vif-deleted:08df78b6-24f9-424a-aa1d-3f52bfb9aa5b for instance 92c4546d-29d4-471e-83d3-08cfd8e4971f on n-h1-764486-11 Jul 20 04:17:32.386116 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-32c8473e-93a0-4a6a-9ac9-c73d59bb1f97 req-94306dc7-0635-47c3-836d-c4759b9a6c72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060926 Jul 20 04:17:32.389620 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 438/844] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:32.397691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.400786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.412662 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.419407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.421888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.423446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.707633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd005db2-3e4b-4260-99d0-760893f9d1c2 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/93f9c4a1-632a-40f5-9515-d2ef8deced8d" status: 202 len: 0 microversion: 2.1 time: 1.311676 Jul 20 04:17:32.710210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 407/845] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:31 2022] DELETE /compute/v2.1/os-security-groups/93f9c4a1-632a-40f5-9515-d2ef8deced8d => generated 0 bytes in 1315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:32.723501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.724602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.750699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.753325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.754364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.754966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.782214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:32.792958 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6beb23b6-f6c8-4bb8-8f1e-c50b3acdac64 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1475 microversion: 2.1 time: 0.399438 Jul 20 04:17:32.802584 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 439/846] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1475 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:32.802584 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:32.804481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:32.818328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.818777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.819898 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:32.821159 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:32.823621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=22 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:33.036513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.045077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:33.053150 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8ec5923d-2ffa-4ebf-9a63-a7d31c3296ef tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.257590 Jul 20 04:17:33.054010 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 440/847] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:33.059933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-89b4940d-c289-459b-89bd-21b3faee460a tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f83986c38b0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.459382 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-89b4940d-c289-459b-89bd-21b3faee460a tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/270def73-1547-4ad1-96cf-25ee1559e3c9" status: 202 len: 0 microversion: 2.1 time: 0.403738 Jul 20 04:17:33.460167 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 441/848] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:33 2022] DELETE /compute/v2.1/os-security-groups/270def73-1547-4ad1-96cf-25ee1559e3c9 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:33.467474 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.468460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.486696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.487714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.493873 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.494495 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.550272 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f HTTP/1.1 Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:33.554116 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:33.558066 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '92c4546d-29d4-471e-83d3-08cfd8e4971f'} Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:33.558882 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:33.561676 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.563952 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:33.563952 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e47602f9-db0b-4a3d-96d3-9c1b86d78cf0 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 404 len: 111 microversion: 2.1 time: 0.096506 Jul 20 04:17:33.563952 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 442/849] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:33.566926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.567843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.576028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.576981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.577967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.578732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.727985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:33.763064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52fa2a38-b6d0-443b-99de-eef6573f80f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 2052 microversion: 2.25 time: 1.049223 Jul 20 04:17:33.768491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 408/850] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:32 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 2052 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:33.776265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-401c7630-2545-4646-b5e4-84d883e5b89f tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f839826c5e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.815679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:33.826043 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0512d7be-bdda-4d91-9417-eda0df24a055 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1661 microversion: 2.1 time: 0.264264 Jul 20 04:17:33.835232 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 443/851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1661 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:33.842002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.842606 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.849494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.850039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.850893 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.854186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.882018 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 HTTP/1.1 Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:33.883643 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:33.885030 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'a0842d27-0ea4-4e23-8321-c75d8126da87'} Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:33.885945 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:33.887103 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:33.888436 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:33.888436 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dce9d3e6-2c3a-4a65-9435-0f3b2044ce75 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 404 len: 111 microversion: 2.1 time: 0.047684 Jul 20 04:17:33.888436 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 444/852] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:33 2022] DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:33.892087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:33.893478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:33.902636 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.903084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:33.903872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:33.904903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.059142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:34.073751 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1714af22-5a52-4ea8-9ba8-ccec55b54311 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 2052 microversion: 2.25 time: 0.186002 Jul 20 04:17:34.074326 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 445/853] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:33 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 2052 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:34.087692 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.088445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.094630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.095254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.096129 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.096732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.250152 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.257703 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ebafb364-88c2-419e-8b93-99fc1ba86823 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1473 microversion: 2.1 time: 0.175958 Jul 20 04:17:34.258296 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 446/854] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.263522 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.264240 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.270266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.270829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.271597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.272030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.288089 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 HTTP/1.1 Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:34.290359 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:34.291863 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'a0842d27-0ea4-4e23-8321-c75d8126da87'} Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:34.292699 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:34.294113 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:34.295137 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:34.295137 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4744beba-b3b5-4bc6-ab28-c352e45b3cbe tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 404 len: 111 microversion: 2.1 time: 0.031855 Jul 20 04:17:34.295137 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 447/855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:34.297597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.298205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.304093 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.304581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.305407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.305844 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.446368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:34.449853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-401c7630-2545-4646-b5e4-84d883e5b89f tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/aca31185-e6ac-46ce-a1b4-24bf0d28e088" status: 202 len: 0 microversion: 2.1 time: 0.680013 Jul 20 04:17:34.450660 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 409/856] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:33 2022] DELETE /compute/v2.1/os-security-groups/aca31185-e6ac-46ce-a1b4-24bf0d28e088 => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:34.454654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8e04e91b-0f0f-41e8-a06e-e1fc91797f93 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.160927 Jul 20 04:17:34.456624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f92be799-ea04-46bc-a9ff-93ab108c5328 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.456780 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 448/857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:34.458297 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:34.458297 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:34.459902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f92be799-ea04-46bc-a9ff-93ab108c5328 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.460524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f92be799-ea04-46bc-a9ff-93ab108c5328 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.462017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f92be799-ea04-46bc-a9ff-93ab108c5328 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.462520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f92be799-ea04-46bc-a9ff-93ab108c5328 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.471465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-10fc7e0b-354d-4f55-b377-4d99d6bd8a78 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '.version_select at 0x7f838befaf70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.491249 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f92be799-ea04-46bc-a9ff-93ab108c5328 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038988 Jul 20 04:17:34.492050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 410/858] 10.222.0.49 () {60 vars in 1216 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:17:34.497711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee87571f-8be9-4f9d-b88a-6dbad5c179fa tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f83983311f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.502273 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-10fc7e0b-354d-4f55-b377-4d99d6bd8a78 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830281682" status: 202 len: 0 microversion: 2.1 time: 0.034688 Jul 20 04:17:34.502854 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 449/859] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:17:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830281682 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:34.510129 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:34.510930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.520245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.521288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.522368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.522817 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.709744 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-93e227fd-3d74-4e59-97cf-017b1ed4bfe5 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad/action" status: 202 len: 0 microversion: 2.25 time: 0.203495 Jul 20 04:17:34.711716 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 450/860] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:34 2022] POST /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:34.720665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:34.721960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:34.744814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.745837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:34.746834 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:34.747414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.012661 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:35.028640 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ea714b36-5e69-41be-afbc-a4fa11da5256 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 2057 microversion: 2.25 time: 0.312377 Jul 20 04:17:35.029433 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 451/861] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:34 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 2057 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:35.033886 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.034505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.044598 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.045077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.045956 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.046273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.145040 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.156766 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-727b4ea5-7495-4057-b370-30e8d1f3ff9e tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1596 microversion: 2.1 time: 0.126318 Jul 20 04:17:35.167162 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 452/862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1596 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.275310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.275966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.291191 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.291918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.292904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.293486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.503698 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.522611 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5ba15486-61fa-4793-8627-61d170af2421 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1470 microversion: 2.1 time: 0.251537 Jul 20 04:17:35.524459 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 453/863] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:35.529547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-947b38f3-e428-4398-8534-6c3e2bdf819e req-71a6ed14-92ca-41ae-bdb7-17e07b7c8b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e5887a-3217-4bd1-b7b7-04a5c224f8df", "name": "network-vif-deleted", "tag": "60cc2fec-7a55-4946-871a-28543ded0ee8"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.542318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-947b38f3-e428-4398-8534-6c3e2bdf819e req-71a6ed14-92ca-41ae-bdb7-17e07b7c8b26 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.542833 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-947b38f3-e428-4398-8534-6c3e2bdf819e req-71a6ed14-92ca-41ae-bdb7-17e07b7c8b26 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.558111 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-947b38f3-e428-4398-8534-6c3e2bdf819e req-71a6ed14-92ca-41ae-bdb7-17e07b7c8b26 service nova] Creating event network-vif-deleted:60cc2fec-7a55-4946-871a-28543ded0ee8 for instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df on n-h2-764486-11 Jul 20 04:17:35.563433 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-947b38f3-e428-4398-8534-6c3e2bdf819e req-71a6ed14-92ca-41ae-bdb7-17e07b7c8b26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037588 Jul 20 04:17:35.564593 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 454/864] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:35.569442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d024dd25-8352-4b69-b2dd-590072f3ef97 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.570297 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:35.570297 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:17:35.589402 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d024dd25-8352-4b69-b2dd-590072f3ef97 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1197451265" status: 202 len: 0 microversion: 2.1 time: 0.023544 Jul 20 04:17:35.590022 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 455/865] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:17:35 2022] DELETE /compute/v2.1/flavors/1197451265 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:35.595681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.596450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.603753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.604211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.605024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.605546 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.777313 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:35.785596 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cb79f6d5-b550-4dc5-867a-d43225ac8866 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.194407 Jul 20 04:17:35.793374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee87571f-8be9-4f9d-b88a-6dbad5c179fa tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3f740312-ea71-4afc-a1f1-6976c1e4dd5b" status: 202 len: 0 microversion: 2.1 time: 1.299974 Jul 20 04:17:35.799629 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 456/866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.801448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 411/867] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:34 2022] DELETE /compute/v2.1/os-security-groups/3f740312-ea71-4afc-a1f1-6976c1e4dd5b => generated 0 bytes in 1308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:35.801569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:35.802026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.808820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79936c49-10be-4dfb-a17d-10bed6b2cd67 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.810169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.811027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.811601 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.812138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.841241 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79936c49-10be-4dfb-a17d-10bed6b2cd67 tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.037628 Jul 20 04:17:35.842716 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 412/868] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:35.858421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aafac595-a8a8-47ce-bb76-8bcd3ac99760 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] Calling method '.version_select at 0x7f83982610d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.901225 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-05fcc1b6-bc8b-45ac-9286-80688bf3a956 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3/action" status: 204 len: 0 microversion: 2.1 time: 0.103752 Jul 20 04:17:35.902231 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 457/869] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:17:35 2022] POST /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3/action => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:35.907633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-617f28c5-096f-4f75-9c11-415f9211acfb tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.908846 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:35.908846 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:17:35.930666 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-617f28c5-096f-4f75-9c11-415f9211acfb tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1254793648" status: 202 len: 0 microversion: 2.1 time: 0.026239 Jul 20 04:17:35.931694 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 458/870] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:17:35 2022] DELETE /compute/v2.1/flavors/1254793648 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:35.937066 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:35.938204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:35.946003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.946938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:35.948633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:35.949330 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.118469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.127038 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5326a638-d7e2-4b04-813f-80ff74c126e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1470 microversion: 2.1 time: 0.193981 Jul 20 04:17:36.127884 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 459/871] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:35 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.141771 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-770b1655-2427-473f-aa73-86a9b3af0ade tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.161600 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-770b1655-2427-473f-aa73-86a9b3af0ade tempest-ServersWithSpecificFlavorTestJSON-1674294925 tempest-ServersWithSpecificFlavorTestJSON-1674294925-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023650 Jul 20 04:17:36.162498 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 460/872] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.173601 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.174483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.186909 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.187471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.188879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.189131 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.338316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:36.347212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:36.360551 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8348cb0f-4d63-4dc6-99fb-f83c6f8495a9 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 2037 microversion: 2.25 time: 0.194285 Jul 20 04:17:36.361144 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 461/873] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 2037 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:36.369027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.370072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.395118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.396457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.397484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.398136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.435079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.439023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.439841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lazy-loading 'fault' on Instance uuid 71e5887a-3217-4bd1-b7b7-04a5c224f8df {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:36.517735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8882e2ce8b524494968786da168b01de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72212a06a744e5bb3eddaec92a56255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:36.527198 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cef37dab-9436-4637-a209-ed6c4a60d9de tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 200 len: 1315 microversion: 2.1 time: 0.164737 Jul 20 04:17:36.533060 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 462/874] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:36.534869 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.535673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.547952 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.548751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.550007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.550680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.601189 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f HTTP/1.1 Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:36.604877 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.606280 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '92c4546d-29d4-471e-83d3-08cfd8e4971f'} Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:36.606997 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.608136 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.609308 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:36.609308 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-20f7d198-116f-4096-a23d-577396ec2b31 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "DELETE /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 404 len: 111 microversion: 2.1 time: 0.075329 Jul 20 04:17:36.609308 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 463/875] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:36 2022] DELETE /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:36.626089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764486-11", "block_migration": "auto"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:36.627389 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.639927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.641408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.644521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.645166 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.682710 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'flavor' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:17:36.696625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Going to try to live migrate instance to n-h2-764486-11 {{(pid=123723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:17:36.882535 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aafac595-a8a8-47ce-bb76-8bcd3ac99760 tempest-SecurityGroupRulesTestJSON-105919833 tempest-SecurityGroupRulesTestJSON-105919833-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/84ea8d5e-8158-4643-9f0f-2d841ea6fe85" status: 202 len: 0 microversion: 2.1 time: 1.032476 Jul 20 04:17:36.883287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 413/876] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:17:35 2022] DELETE /compute/v2.1/os-security-groups/84ea8d5e-8158-4643-9f0f-2d841ea6fe85 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:36.888466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.889310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: 92c4546d-29d4-471e-83d3-08cfd8e4971f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.908262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.909009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.910287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.911192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.929391 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f HTTP/1.1 Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:36.932337 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.933863 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '92c4546d-29d4-471e-83d3-08cfd8e4971f'} Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:36.934576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. Jul 20 04:17:36.935751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:36.939080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance 92c4546d-29d4-471e-83d3-08cfd8e4971f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:36.940801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de94bf79-7b26-48a4-b9f9-091311dbc530 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f" status: 404 len: 111 microversion: 2.1 time: 0.056308 Jul 20 04:17:36.942398 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 414/877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/92c4546d-29d4-471e-83d3-08cfd8e4971f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:36.948508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:36.949597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:36.958739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.961608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:36.962723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:36.964563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.543082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.551632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-636fb5fe-9650-4b79-9c26-7bca9a664909 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.607780 Jul 20 04:17:37.562117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 415/878] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:36 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:37.568692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.569588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.581416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.582251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.583285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.583911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.615767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 HTTP/1.1 Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:37.618196 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:37.619509 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a0842d27-0ea4-4e23-8321-c75d8126da87'} Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:37.620206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:37.621393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:37.624257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:37.625533 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d3b6228a-3199-4659-aa39-f789f57243ef tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 404 len: 111 microversion: 2.1 time: 0.061989 Jul 20 04:17:37.626603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 416/879] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:17:37 2022] DELETE /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:37.631741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:37.633342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:37.641779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.642489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.643593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:37.644206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:37.967445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:37.997594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f584e4d-3861-4810-8530-c33e1c5c8299 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1470 microversion: 2.1 time: 0.369578 Jul 20 04:17:38.018937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 417/880] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:37 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:38.027941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.028965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] [instance: 71e5887a-3217-4bd1-b7b7-04a5c224f8df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.040653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.041592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.042697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.043395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.072458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] HTTP exception thrown: Instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df could not be found. Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Request method failure captured: Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df HTTP/1.1 Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GJoNqmfOatQGZf6WE9eq7213-zeJeGAX4EzHk2GD9reXE2Z-tERQ8s-pFEZDAemndniGjh_Ei3D_A8nFbvjM52WrC8_fIR2MdfBWjDBXD9BgCLnyaeJI8ovn3yQbZm7-mSUXsXkUMboscf1xzp6DhVpqYh0oD4w3rjT2vwJeuiCIg Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c72212a06a744e5bb3eddaec92a56255 Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestFqdnHostnames-354441079 Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:38.076139 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c72212a06a744e5bb3eddaec92a56255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c72212a06a744e5bb3eddaec92a56255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c72212a06a744e5bb3eddaec92a56255"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c72212a06a744e5bb3eddaec92a56255", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestFqdnHostnames-354441079 Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c72212a06a744e5bb3eddaec92a56255 Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-354441079 Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestFqdnHostnames-354441079-project Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8882e2ce8b524494968786da168b01de Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestFqdnHostnames-354441079-project Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df could not be found. Jul 20 04:17:38.077752 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '71e5887a-3217-4bd1-b7b7-04a5c224f8df'} Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df could not be found. Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:38.078675 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df could not be found. Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df could not be found. Jul 20 04:17:38.080075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.084089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Returning 404 to user: Instance 71e5887a-3217-4bd1-b7b7-04a5c224f8df could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:38.086855 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d26cbcee-8967-440c-b355-93a193a04ff0 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df" status: 404 len: 111 microversion: 2.1 time: 0.065423 Jul 20 04:17:38.087945 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 418/881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/71e5887a-3217-4bd1-b7b7-04a5c224f8df => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:38.094065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.095879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] [instance: a0842d27-0ea4-4e23-8321-c75d8126da87] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.108095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.109925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.111460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.112130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.134425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] HTTP exception thrown: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Request method failure captured: Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 HTTP/1.1 Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14EugAFcgj9Lex30vbTMlHgSliMp9BwhEyKcltuYCLBY2dYBjrBfq_kQrDDQJVeAsNKfrrJVrQataedMGfkapvwAVI9mZ4fVnK0ESxAi0heXc9WAENGgpibTeuBIfRrtMljePbICbCUk4yEV-SLKZvFC2oGJw3yTUvYlxpwtxVUgp4A Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:38.137412 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4fbc880ec5e14aafa307eb780a1cd051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4fbc880ec5e14aafa307eb780a1cd051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4fbc880ec5e14aafa307eb780a1cd051 Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715 Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5c2ac596c69843009cfd28dd0e90d56e Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1341231715-project Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:38.138945 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a0842d27-0ea4-4e23-8321-c75d8126da87'} Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:38.139811 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. Jul 20 04:17:38.142289 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:38.146426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] Returning 404 to user: Instance a0842d27-0ea4-4e23-8321-c75d8126da87 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:38.147296 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-148db4c0-22af-4433-90f4-a25e9d78c672 tempest-ServersWithSpecificFlavorTestJSON-1341231715 tempest-ServersWithSpecificFlavorTestJSON-1341231715-project] 10.222.0.49 "GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87" status: 404 len: 111 microversion: 2.1 time: 0.058060 Jul 20 04:17:38.148062 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 419/882] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/a0842d27-0ea4-4e23-8321-c75d8126da87 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:38.156492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e57e417-de44-4dab-8fdb-f25b68440b20 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] Calling method '.version_select at 0x7f839826c700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.189102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e57e417-de44-4dab-8fdb-f25b68440b20 tempest-ServersTestFqdnHostnames-354441079 tempest-ServersTestFqdnHostnames-354441079-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947426186" status: 202 len: 0 microversion: 2.1 time: 0.039229 Jul 20 04:17:38.193509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 420/883] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:17:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947426186 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:38.499852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4f97e9d9-4643-449e-9c84-02e2a732635c req-6f60c805-ea04-434d-b5d6-b7332db02803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3", "name": "network-vif-plugged", "status": "completed", "tag": "1ed64614-8410-4160-97d3-350c62fdb902"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:38.514934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f97e9d9-4643-449e-9c84-02e2a732635c req-6f60c805-ea04-434d-b5d6-b7332db02803 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.515409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f97e9d9-4643-449e-9c84-02e2a732635c req-6f60c805-ea04-434d-b5d6-b7332db02803 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.544725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4f97e9d9-4643-449e-9c84-02e2a732635c req-6f60c805-ea04-434d-b5d6-b7332db02803 service nova] Creating event network-vif-plugged:1ed64614-8410-4160-97d3-350c62fdb902 for instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 on n-h2-764486-11 Jul 20 04:17:38.556942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-4f97e9d9-4643-449e-9c84-02e2a732635c req-6f60c805-ea04-434d-b5d6-b7332db02803 service nova] Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:17:38.577743 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4f97e9d9-4643-449e-9c84-02e2a732635c req-6f60c805-ea04-434d-b5d6-b7332db02803 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077290 Jul 20 04:17:38.578691 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 421/884] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:38.584984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:38.585715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:38.594378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.594998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:38.596109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:38.596734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.202773 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-43d46c76-99cf-4d66-a0f1-8d52fe03cdbe tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad/action" status: 202 len: 0 microversion: 2.25 time: 2.589700 Jul 20 04:17:39.205067 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 464/885] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:17:36 2022] POST /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad/action => generated 0 bytes in 2598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:17:39.217874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.225120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.225654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09228b63-bab6-44b5-9654-6540c8b214a4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.645503 Jul 20 04:17:39.226331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.226446 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 422/886] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:38 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:39.243442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.244500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.245555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:39.245840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.246173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:39.246710 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.252520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.260177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.261202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:39.261792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:39.630267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:39.644025 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-91ec0778-605b-4928-a41b-c3dd425425aa tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1470 microversion: 2.1 time: 0.435724 Jul 20 04:17:39.646018 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 465/887] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:40.011959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.034902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.037063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:40.038687 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-397b0d5f-6912-4c1c-b6f2-40eb04bc370a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.811093 Jul 20 04:17:40.039975 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 423/888] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:39 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:40.071835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-18d0d50a-b6ef-48a2-ab0a-f8064abebb54 tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Action: 'create', calling method: .version_select at 0x7f838bea4550>, body: {"pool": null} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:40.242718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:40.243923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:40.250676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.251400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:40.252342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:40.259771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.060769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.069922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc73638f-2615-4ca6-9c0d-d6bac029c39e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.830598 Jul 20 04:17:41.081945 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 424/889] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:40 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:41.087756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-65ce3e6c-6a56-4621-bd2c-ffdb4e6f545a req-f34a5643-587d-4543-81c3-9d1cf3cb3faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5361b9d-6974-4eb0-aee8-2ef8b3910e03", "name": "network-vif-plugged", "status": "completed", "tag": "527a1f9c-89bf-45d8-9e19-eb8f629318c0"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:41.096848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:41.099020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65ce3e6c-6a56-4621-bd2c-ffdb4e6f545a req-f34a5643-587d-4543-81c3-9d1cf3cb3faa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.099787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65ce3e6c-6a56-4621-bd2c-ffdb4e6f545a req-f34a5643-587d-4543-81c3-9d1cf3cb3faa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.113330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-65ce3e6c-6a56-4621-bd2c-ffdb4e6f545a req-f34a5643-587d-4543-81c3-9d1cf3cb3faa service nova] Creating event network-vif-plugged:527a1f9c-89bf-45d8-9e19-eb8f629318c0 for instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 on n-h2-764486-11 Jul 20 04:17:41.119410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-65ce3e6c-6a56-4621-bd2c-ffdb4e6f545a req-f34a5643-587d-4543-81c3-9d1cf3cb3faa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035822 Jul 20 04:17:41.120435 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 425/890] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:41.127147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.129271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.138160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.138971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.139936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.140564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.597999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:41.613462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d429838c-e278-48de-82b5-d7b95ae0d6e2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1462 microversion: 2.1 time: 0.491173 Jul 20 04:17:41.614383 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 426/891] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1462 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:41.619122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:41.623960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:41.636553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.637209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:41.638569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:41.639154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.269263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.282072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.283997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.285744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d496a8bd-d4bb-40f9-b2c7-6b552efa38bb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.670265 Jul 20 04:17:42.286707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 427/892] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:41 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:42.293154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.294056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.302426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.302949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.303820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.304403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.926544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:42.939661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6943c9d5-9d8f-4f95-afa6-3d36e6cf433b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1462 microversion: 2.1 time: 0.651307 Jul 20 04:17:42.955859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 428/893] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1462 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:42.966920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:42.967543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:42.986898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.988171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:42.989084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:42.989719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.100484 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-18d0d50a-b6ef-48a2-ab0a-f8064abebb54 tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.222274 Jul 20 04:17:43.103329 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 466/894] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:17:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:17:43.109794 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f3ba44e2-bc7c-4dbe-95df-54863385fb1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'create', calling method: .version_select at 0x7f838be9f4c0>, body: {"keypair": {"name": "tempest-keypair-1209689036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3LfRuIGjITV3DFIwIdL/mAEvSAeoY4c78/9hFtJSXmUxgFobfUm9mVkWSkpMypUWdJACWY6Djnw1LqHmz9ciD9AR6mIgFxcRw+cFKnWQiBuFTlpg3ikR8HtFbj+3ggRA=="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:43.145938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f3ba44e2-bc7c-4dbe-95df-54863385fb1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for project 3180da7c29d64983854c1235b108c7e7. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:43.154206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f3ba44e2-bc7c-4dbe-95df-54863385fb1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for user 3e8f4a044b904befbddb93375b6e213a and project 3180da7c29d64983854c1235b108c7e7. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:43.159006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:43.194086 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f3ba44e2-bc7c-4dbe-95df-54863385fb1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089385 Jul 20 04:17:43.197579 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 467/895] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:17:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:43.206214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.213015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.225459 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.228173 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.229918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.233485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.626095 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5e2e93ce-2cd3-4a97-8397-0fc838c66715 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1811 microversion: 2.1 time: 0.427043 Jul 20 04:17:43.640385 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 468/896] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1811 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.650713 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d5364c09-0aa9-4bda-891f-c8ee6d4e774e tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Calling method '.version_select at 0x7f838bea45e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.844305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:43.856250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e122b9b3-0b61-467a-b094-8c5eb8c74555 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.898990 Jul 20 04:17:43.869903 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 429/897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:42 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:43.880202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5a48a3e8-38c7-4ab8-bd3b-3cf751141c2d req-43ecdb92-aee3-4b1e-a3b1-38429e7c5fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e24f9a1-ba2a-427a-9fa3-df2948e4423e", "name": "network-vif-plugged", "status": "completed", "tag": "1f15e670-bfff-4216-8b34-a8d7f5ce6c5d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:43.906542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a48a3e8-38c7-4ab8-bd3b-3cf751141c2d req-43ecdb92-aee3-4b1e-a3b1-38429e7c5fce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:43.907510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a48a3e8-38c7-4ab8-bd3b-3cf751141c2d req-43ecdb92-aee3-4b1e-a3b1-38429e7c5fce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:43.918760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:43.946612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5a48a3e8-38c7-4ab8-bd3b-3cf751141c2d req-43ecdb92-aee3-4b1e-a3b1-38429e7c5fce service nova] Creating event network-vif-plugged:1f15e670-bfff-4216-8b34-a8d7f5ce6c5d for instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e on n-h1-764486-11 Jul 20 04:17:43.957737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5a48a3e8-38c7-4ab8-bd3b-3cf751141c2d req-43ecdb92-aee3-4b1e-a3b1-38429e7c5fce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086425 Jul 20 04:17:43.962143 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 430/898] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:43.979391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:43.985477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:43.999433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.000148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.005844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.008100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.217068 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d5364c09-0aa9-4bda-891f-c8ee6d4e774e tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/06828f32-88cf-43d4-94e5-2bb314dd3b8e" status: 200 len: 141 microversion: 2.1 time: 0.575083 Jul 20 04:17:44.218428 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 469/899] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/os-floating-ips/06828f32-88cf-43d4-94e5-2bb314dd3b8e => generated 141 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:44.227817 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21056583-0226-437f-9c7e-2115f63ecf47 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.230618 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:44.230618 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:17:44.236277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21056583-0226-437f-9c7e-2115f63ecf47 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.236841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21056583-0226-437f-9c7e-2115f63ecf47 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.239069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21056583-0226-437f-9c7e-2115f63ecf47 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.242326 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21056583-0226-437f-9c7e-2115f63ecf47 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.299156 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-21056583-0226-437f-9c7e-2115f63ecf47 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.078498 Jul 20 04:17:44.308597 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 470/900] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:44.313597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-bf343343-bb09-400d-83a7-7c1c2178b623 req-595815d8-b8a6-455f-b8ca-676a1b548ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5f0b31-a570-467c-9fa5-0b6f31db53ad", "name": "network-vif-unplugged", "status": "completed", "tag": "89488716-dcfe-4e5a-99e2-bb2b8ce560a4"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:44.349083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-bf343343-bb09-400d-83a7-7c1c2178b623 req-595815d8-b8a6-455f-b8ca-676a1b548ce6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:44.350084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-bf343343-bb09-400d-83a7-7c1c2178b623 req-595815d8-b8a6-455f-b8ca-676a1b548ce6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:44.385709 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-bf343343-bb09-400d-83a7-7c1c2178b623 req-595815d8-b8a6-455f-b8ca-676a1b548ce6 service nova] Creating event network-vif-unplugged:89488716-dcfe-4e5a-99e2-bb2b8ce560a4 for instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad on n-h1-764486-11 Jul 20 04:17:44.399286 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-bf343343-bb09-400d-83a7-7c1c2178b623 req-595815d8-b8a6-455f-b8ca-676a1b548ce6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089309 Jul 20 04:17:44.400549 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 471/901] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:44.414066 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c3171758-c83e-4a6d-a6ee-8b4b694dd4aa tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Calling method '.version_select at 0x7f838be81040>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:44.474516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:45.266181 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c3171758-c83e-4a6d-a6ee-8b4b694dd4aa tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.864203 Jul 20 04:17:45.267434 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 472/902] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:17:44 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:45.281489 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:45.290640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:45.308047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.310783 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.313554 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:45.317880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:45.402545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.420675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.423159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:45.433011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f4a7382-ad03-468a-a8a9-7af3b6db6bf0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 1.465799 Jul 20 04:17:45.433640 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 431/903] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:43 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:45.462617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e10a47d5-c0d4-4cf5-926c-455ad5e12947 tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Calling method '.version_select at 0x7f83982610d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.162347 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:46.174542 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bba56087-8eaa-4cc6-93df-3be6052e2c15 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1319 microversion: 2.1 time: 0.905725 Jul 20 04:17:46.175139 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 473/904] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:45 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1319 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:46.452175 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:46.452875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:46.469568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.470295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:46.475075 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:46.476293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.116620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.125969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.127484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:47.128710 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2f1a780b-5cd6-40f7-b163-50cecdfa3d6c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.681369 Jul 20 04:17:47.140620 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 474/905] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:46 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:47.192987 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:47.193602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:47.217309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.217758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:47.225318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:47.226206 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.115977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:48.127199 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5e540e52-f406-42fd-840d-b426a84a7522 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1469 microversion: 2.1 time: 0.934568 Jul 20 04:17:48.127964 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 475/906] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:47 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1469 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:48.143461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-36c4ab5b-af20-40f6-ac63-bc05b8e14a28 req-dd483f9f-fa5b-4e03-a8ec-0b1ff0951dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5f0b31-a570-467c-9fa5-0b6f31db53ad", "tag": "89488716-dcfe-4e5a-99e2-bb2b8ce560a4"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:48.167106 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-36c4ab5b-af20-40f6-ac63-bc05b8e14a28 req-dd483f9f-fa5b-4e03-a8ec-0b1ff0951dcb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.167792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-36c4ab5b-af20-40f6-ac63-bc05b8e14a28 req-dd483f9f-fa5b-4e03-a8ec-0b1ff0951dcb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.196961 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-36c4ab5b-af20-40f6-ac63-bc05b8e14a28 req-dd483f9f-fa5b-4e03-a8ec-0b1ff0951dcb service nova] Creating event network-changed:89488716-dcfe-4e5a-99e2-bb2b8ce560a4 for instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad on n-h1-764486-11 Jul 20 04:17:48.206833 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-36c4ab5b-af20-40f6-ac63-bc05b8e14a28 req-dd483f9f-fa5b-4e03-a8ec-0b1ff0951dcb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076239 Jul 20 04:17:48.207884 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 476/907] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:48.214555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:48.231718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:48.248951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.249585 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.250516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:48.251116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:48.981195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e10a47d5-c0d4-4cf5-926c-455ad5e12947 tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/06828f32-88cf-43d4-94e5-2bb314dd3b8e" status: 202 len: 0 microversion: 2.1 time: 3.537101 Jul 20 04:17:48.989438 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 432/908] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:17:45 2022] DELETE /compute/v2.1/os-floating-ips/06828f32-88cf-43d4-94e5-2bb314dd3b8e => generated 0 bytes in 3555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:49.027514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.029442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.037288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.037288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.037962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.038618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.151929 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.169718 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8c345bf3-dcbe-4996-90dc-169558670efd tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 200 len: 1469 microversion: 2.1 time: 0.959722 Jul 20 04:17:49.170617 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 477/909] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 1469 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.176574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-975a6e13-4d82-4f7a-acd1-9a51cf934fc1 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '.version_select at 0x7f838befa8b0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:49.183660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-975a6e13-4d82-4f7a-acd1-9a51cf934fc1 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.184498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-975a6e13-4d82-4f7a-acd1-9a51cf934fc1 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.201073 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-975a6e13-4d82-4f7a-acd1-9a51cf934fc1 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.1 time: 0.028739 Jul 20 04:17:49.202843 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 478/910] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:17:49 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:49.213263 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b0c7db4b-8918-49a6-bc01-399ccc47960e tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Action: 'create', calling method: .version_select at 0x7f838beb13a0>, body: {"pool": null} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:49.425412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.438745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.442319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:49.445843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f871005-2036-44a5-9999-66ee956109e3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.450100 Jul 20 04:17:49.448548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 433/911] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:48 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:49.459393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ac69bcd-1142-4f96-97c4-e2c5153c5504", "device": "/dev/xvdb"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:49.461871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:49.470042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.470717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:49.471699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:49.472339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.039245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2cb1d5b6-c8f8-4399-8ea6-1cf17f6264fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "POST /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588397 Jul 20 04:17:50.040588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 434/912] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:17:49 2022] POST /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:50.050200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:50.063451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.064398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Searching by: {'reservation_id': 'r-ecfvmln0', 'deleted': False, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:17:50.078703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.079155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.088547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.089008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:50.260639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:17:50.407095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:50.425626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:50.425626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.090934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf7794fa-fec0-4ac8-b808-e5ba03697312 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-ecfvmln0" status: 200 len: 2931 microversion: 2.1 time: 1.048848 Jul 20 04:17:51.093283 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 435/913] 10.222.0.49 () {58 vars in 1196 bytes} [Wed Jul 20 04:17:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ecfvmln0 => generated 2931 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:51.099223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05219150-90a3-4f77-b77e-bdb9db4647a7 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.106989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05219150-90a3-4f77-b77e-bdb9db4647a7 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011309 Jul 20 04:17:51.108235 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 436/914] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:51.114198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.115819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.123877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.124649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.125779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.126448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.584060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.599673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.602745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:51.603920 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5700240a-04e3-4c48-b2d9-13e6027af00e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.494485 Jul 20 04:17:51.614379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 437/915] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:51.614379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79d2c333-c842-4ea0-b148-f4fcb5c7347e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.653354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_groups [None req-79d2c333-c842-4ea0-b148-f4fcb5c7347e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Querying cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) for 2 instances {{(pid=123724) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:17:51.654156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79d2c333-c842-4ea0-b148-f4fcb5c7347e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.654601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79d2c333-c842-4ea0-b148-f4fcb5c7347e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.718093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79d2c333-c842-4ea0-b148-f4fcb5c7347e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/0c5f17c8-317b-483e-b02f-b2db3fe962bb" status: 200 len: 271 microversion: 2.1 time: 0.112119 Jul 20 04:17:51.719039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 438/916] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/os-server-groups/0c5f17c8-317b-483e-b02f-b2db3fe962bb => generated 271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:51.723946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12dcf5f8-ede9-47ed-affc-99aeb2edbeae tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1864418215", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:51.728834 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:17:51.728834 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:17:51.760052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12dcf5f8-ede9-47ed-affc-99aeb2edbeae tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.039706 Jul 20 04:17:51.772449 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 439/917] 10.222.0.49 () {60 vars in 1145 bytes} [Wed Jul 20 04:17:51 2022] POST /compute/v2.1/flavors => generated 499 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:51.773482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.774096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:51.790574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.791094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.792245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:51.793591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:51.922939 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b0c7db4b-8918-49a6-bc01-399ccc47960e tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.718528 Jul 20 04:17:51.923417 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 479/918] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:17:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:51.934770 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8e3aa5a6-c8a8-46a9-a988-9854fb64a52a tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:51.945052 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8e3aa5a6-c8a8-46a9-a988-9854fb64a52a tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014078 Jul 20 04:17:51.946153 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 480/919] 10.222.0.49 () {58 vars in 1181 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:17:51.951091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c1cc0ab4-8b70-4f37-a581-9de03bf96ab9 tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Calling method '.version_select at 0x7f838be81dc0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:52.241968 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4d94517-5663-44fb-8a30-2609d6343072 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 200 len: 1622 microversion: 2.1 time: 0.472811 Jul 20 04:17:52.251474 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 440/920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:51 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 1622 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:52.256677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-97898874", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "e86b69bc-9e21-4174-be9f-cf947c469924"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:52.336771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:52.796662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:52.798206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:52.798977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:52.799542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:52.801374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:52.819668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.820896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.822263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:52.823137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:52.869775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:52.883325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for user 3e8f4a044b904befbddb93375b6e213a and project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:52.920066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:52.922350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:52.993889 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae138e4c-29e2-42f3-b9f1-a6a9d1536689 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740663 Jul 20 04:17:52.994860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 441/921] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:53.006711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.007532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.018055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.018634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.019708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.024454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.164098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:53.436572 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6bbb5b75-c371-4621-bdba-909eb00cc44e tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 200 len: 1622 microversion: 2.1 time: 0.440509 Jul 20 04:17:53.441526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 442/922] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:52 2022] GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 1622 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.461467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.462532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.494297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.494754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.495683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.496168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.689865 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c1cc0ab4-8b70-4f37-a581-9de03bf96ab9 tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed" status: 202 len: 0 microversion: 2.1 time: 1.742184 Jul 20 04:17:53.693396 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 481/923] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:17:51 2022] DELETE /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed => generated 0 bytes in 1744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:17:53.696337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-326b4876-3a59-4024-b7f5-2be18d9013c2 req-a73c4ce4-58f0-4723-a198-57f0e777c0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5f0b31-a570-467c-9fa5-0b6f31db53ad", "name": "network-vif-unplugged", "status": "completed", "tag": "89488716-dcfe-4e5a-99e2-bb2b8ce560a4"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:53.727319 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-326b4876-3a59-4024-b7f5-2be18d9013c2 req-a73c4ce4-58f0-4723-a198-57f0e777c0ba service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:53.750522 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-326b4876-3a59-4024-b7f5-2be18d9013c2 req-a73c4ce4-58f0-4723-a198-57f0e777c0ba service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:53.773218 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-326b4876-3a59-4024-b7f5-2be18d9013c2 req-a73c4ce4-58f0-4723-a198-57f0e777c0ba service nova] Creating event network-vif-unplugged:89488716-dcfe-4e5a-99e2-bb2b8ce560a4 for instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad on n-h1-764486-11 Jul 20 04:17:53.791718 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-326b4876-3a59-4024-b7f5-2be18d9013c2 req-a73c4ce4-58f0-4723-a198-57f0e777c0ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098936 Jul 20 04:17:53.793203 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 482/924] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:17:53.798711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1134b563-a72c-4cad-8f77-23f9d18de641 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:53.799763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1134b563-a72c-4cad-8f77-23f9d18de641 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:53.891309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1134b563-a72c-4cad-8f77-23f9d18de641 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:53.901795 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1134b563-a72c-4cad-8f77-23f9d18de641 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1277 microversion: 2.1 time: 0.107093 Jul 20 04:17:53.906010 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 483/925] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:53.916611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d2e42838-fb54-4b07-ab94-48aa4c46a20f tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Calling method '.version_select at 0x7f838be5a8b0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.020059 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-d2e42838-fb54-4b07-ab94-48aa4c46a20f tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 16b1a15a-0df9-4998-b352-66ca8f90afed could not be found", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:54.021559 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-d2e42838-fb54-4b07-ab94-48aa4c46a20f tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] HTTP exception thrown: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d2e42838-fb54-4b07-ab94-48aa4c46a20f tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Request method failure captured: Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed HTTP/1.1 Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14HjENNqpEFndKu19MMV0wkUTZS_KeDjnkpOXNMI61kSO7JGegyMnUZ2QYkbg7cwqg6rWWuYUCS4H4ZBjLIb7SD5BiP3AidyC8vVqaJsM-yKpREyhQpiXxP-eWr8SstuNbWfTzyk4SwNPmRGccxGogzN3xoDYHzpYelbIyFPWmO4Tyo Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: fc8f236375e44941a8e78f749f3a865a Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FloatingIPsTestJSON-1985989619 Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:17:54.024528 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc8f236375e44941a8e78f749f3a865a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc8f236375e44941a8e78f749f3a865a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc8f236375e44941a8e78f749f3a865a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc8f236375e44941a8e78f749f3a865a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FloatingIPsTestJSON-1985989619 Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: fc8f236375e44941a8e78f749f3a865a Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1985989619 Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FloatingIPsTestJSON-1985989619-project Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 63a6c7a1c18d41f993d7055d79292c63 Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FloatingIPsTestJSON-1985989619-project Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: exception: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '16b1a15a-0df9-4998-b352-66ca8f90afed'} Jul 20 04:17:54.026134 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:54.026995 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 16b1a15a-0df9-4998-b352-66ca8f90afed could not be found Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-149c241f-80c0-4aca-b051-e91aa9217179'] Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed. Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.028141 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:54.029555 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:54.031130 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.031130 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.031904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d2e42838-fb54-4b07-ab94-48aa4c46a20f tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Returning 404 to user: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:54.033472 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d2e42838-fb54-4b07-ab94-48aa4c46a20f tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed" status: 404 len: 111 microversion: 2.1 time: 0.125862 Jul 20 04:17:54.034677 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 484/926] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:54.043795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-635145987", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "933fbdd2-8589-43a1-a99a-8f22c47fcb69"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:17:54.128030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:17:54.170217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.179337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.181088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:54.182267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4848d6ce-3528-457f-8e26-1c0eca6c0ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.738588 Jul 20 04:17:54.183254 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 443/927] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:53 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:54.197371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73994838-3a5e-4626-92fb-b31872e5e34c tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Calling method '.version_select at 0x7f838bd38280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.261981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:54.324944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-73994838-3a5e-4626-92fb-b31872e5e34c tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 16b1a15a-0df9-4998-b352-66ca8f90afed could not be found", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:17:54.325826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-73994838-3a5e-4626-92fb-b31872e5e34c tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] HTTP exception thrown: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73994838-3a5e-4626-92fb-b31872e5e34c tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Request method failure captured: Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed HTTP/1.1 Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14HjENNqpEFndKu19MMV0wkUTZS_KeDjnkpOXNMI61kSO7JGegyMnUZ2QYkbg7cwqg6rWWuYUCS4H4ZBjLIb7SD5BiP3AidyC8vVqaJsM-yKpREyhQpiXxP-eWr8SstuNbWfTzyk4SwNPmRGccxGogzN3xoDYHzpYelbIyFPWmO4Tyo Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc8f236375e44941a8e78f749f3a865a Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsTestJSON-1985989619 Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:17:54.330524 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc8f236375e44941a8e78f749f3a865a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc8f236375e44941a8e78f749f3a865a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc8f236375e44941a8e78f749f3a865a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc8f236375e44941a8e78f749f3a865a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsTestJSON-1985989619 Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc8f236375e44941a8e78f749f3a865a Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1985989619 Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsTestJSON-1985989619-project Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 63a6c7a1c18d41f993d7055d79292c63 Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsTestJSON-1985989619-project Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: exception: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '16b1a15a-0df9-4998-b352-66ca8f90afed'} Jul 20 04:17:54.332110 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:17:54.333041 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 16b1a15a-0df9-4998-b352-66ca8f90afed could not be found Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5075220e-bc46-4556-b856-934d5f98db2d'] Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed. Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.334377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:17:54.335765 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:17:54.337162 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed Jul 20 04:17:54.337162 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:17:54.338111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73994838-3a5e-4626-92fb-b31872e5e34c tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] Returning 404 to user: Floating IP not found for ID 16b1a15a-0df9-4998-b352-66ca8f90afed {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:17:54.339110 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73994838-3a5e-4626-92fb-b31872e5e34c tempest-FloatingIPsTestJSON-1985989619 tempest-FloatingIPsTestJSON-1985989619-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed" status: 404 len: 111 microversion: 2.1 time: 0.154578 Jul 20 04:17:54.344712 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 444/928] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:17:54 2022] DELETE /compute/v2.1/os-floating-ips/16b1a15a-0df9-4998-b352-66ca8f90afed => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:17:54.628297 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:17:54.628775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:17:54.629520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:17:54.630453 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:17:54.632927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:17:54.656171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.658282 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.659741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.665184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.739930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:17:54.762718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:17:54.801531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:17:54.811780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:17:54.910284 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bc5e5cbe-9c7f-4590-8f22-8cd9f172071a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874175 Jul 20 04:17:54.910934 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 485/929] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:17:54.930468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28243c3b-c70f-492b-bfed-446bbdcd23db tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.931160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28243c3b-c70f-492b-bfed-446bbdcd23db tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.940858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:54.941863 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:54.992096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.995923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:54.997143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:54.999622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.124626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28243c3b-c70f-492b-bfed-446bbdcd23db tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.137507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28243c3b-c70f-492b-bfed-446bbdcd23db tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1216 microversion: 2.1 time: 0.215017 Jul 20 04:17:55.138274 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 445/930] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:55.201403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:55.202265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:55.212404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.215568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.216692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:55.219287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:55.786870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.801921 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-eb3ec041-9312-42c5-b3ac-4052d4e949eb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1347 microversion: 2.1 time: 0.873198 Jul 20 04:17:55.811333 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 486/931] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:54 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1347 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:55.815575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.825723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.841381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:55.842600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f757c3ea-b6ea-4959-918d-d4aea09859d3 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.646083 Jul 20 04:17:55.843174 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 446/932] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:55 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:56.155215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.155837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.170065 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.171791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.174712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.176484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.369981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:56.380119 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2844e2ed-0567-40e4-938f-497975441759 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1268 microversion: 2.1 time: 0.229100 Jul 20 04:17:56.389498 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 487/933] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1268 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:56.820579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.821806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.841706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.842326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.843826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.844267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.865449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:56.866776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:56.879756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.880216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:56.881121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:56.889031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.174327 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.217846 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.219759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.223864 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d720314c-3ffb-4400-9b55-0b2b402d8b23 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 0.363206 Jul 20 04:17:57.242421 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 488/934] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:57.333458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.342780 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83444a28-f7f9-4295-bf8e-94827c35cea0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1335 microversion: 2.1 time: 0.527414 Jul 20 04:17:57.348247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 447/935] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:56 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1335 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:57.415487 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:57.416578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:57.432156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.433173 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.434613 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:57.435570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:57.606342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:57.614679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:17:57.691319 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-79364b7d-78ec-4f6c-a6c9-eef2701389e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1274 microversion: 2.1 time: 0.279340 Jul 20 04:17:57.692145 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 489/936] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:57 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:58.243289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.244194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.265627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.266539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.267323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.267768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.365964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.366475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.375560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.376275 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.378637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.378637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.702309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.715182 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dd743e15-8be9-4044-90f6-1434f55c5582 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1335 microversion: 2.1 time: 0.353906 Jul 20 04:17:58.718171 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 490/937] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1335 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:17:58.728728 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:58.729913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:58.736580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.737292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.738372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:58.739554 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:58.908101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:58.918711 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7eae2e46-94fc-4bcd-8e7e-2a1baa811865 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1274 microversion: 2.1 time: 0.199202 Jul 20 04:17:58.919299 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 491/938] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:17:59.247971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.267611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.276732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:17:59.279776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e2b06f2-8c14-43bc-8278-98d32e1d7478 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1568 microversion: 2.25 time: 1.040245 Jul 20 04:17:59.281932 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 448/939] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:17:58 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1568 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:17:59.740283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.741604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.765005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.765751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.766688 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.767270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.935793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:17:59.936885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:17:59.943907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.944380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:17:59.949768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:17:59.950233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.202273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.214417 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8088fc4e-bfb6-40ee-8115-6f9e6ec4c7be tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1274 microversion: 2.1 time: 0.282636 Jul 20 04:18:00.220230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 449/940] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1274 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:00.298005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:00.299508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:00.307065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.307921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.308985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:00.309606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:00.440309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:00.448672 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fd09f6d5-7b33-4419-afde-4100f41d07c5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 0.717962 Jul 20 04:18:00.453115 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 492/941] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:17:59 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:01.038752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.047460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.063025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.064768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14a21ee7-dccf-46a1-8ea9-e9448b6ac992 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1543 microversion: 2.25 time: 0.770727 Jul 20 04:18:01.065641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 450/942] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:00 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1543 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:01.087397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6e70f02-50b1-4fb2-a25e-379245429f4a tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '.version_select at 0x7f838be07700>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.093043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6e70f02-50b1-4fb2-a25e-379245429f4a tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.095828 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6e70f02-50b1-4fb2-a25e-379245429f4a tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.141018 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6e70f02-50b1-4fb2-a25e-379245429f4a tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2565 microversion: 2.25 time: 0.058403 Jul 20 04:18:01.141673 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 493/943] 10.222.0.49 () {60 vars in 1183 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/os-migrations => generated 2565 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:01.156153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.157291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.170108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.170684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.175386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.175386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.223268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:01.231515 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.232284 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.244719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.245259 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.258052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.259191 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.459811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:01.499471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bec7d4cb-9ad0-4e25-83e8-87c01a5160f7 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 2037 microversion: 2.25 time: 0.347599 Jul 20 04:18:01.502614 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 451/944] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 2037 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:01.509192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:01.514317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:01.527180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.532514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.534016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:01.534570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:01.766401 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:01.780910 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a5e67daa-a82d-40b7-a55e-ac76a2d596b0 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 0.550856 Jul 20 04:18:01.782708 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 494/945] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:01.796700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-48659bd1-ec92-4963-8a69-ba1d48335fc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Action: 'create', calling method: .version_select at 0x7f838be7f9d0>, body: {"keypair": {"name": "tempest-keypair-1869364950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSNN1b4cFVNHQiFaO70LCYlRCId9xxnQhMo5zmwZBSiq17ZM8/2mpVo78DA2hMkNqlWG+5Ns+n5mlGWwOSF4UomiNQdUlJsezIij/IioRO239EhRJtsqOuI8WrJMv/3Kg=="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:01.828794 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-48659bd1-ec92-4963-8a69-ba1d48335fc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:01.840902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-48659bd1-ec92-4963-8a69-ba1d48335fc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for user c21b3bf3ba4d4558950d7337a651587f and project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:01.908922 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-48659bd1-ec92-4963-8a69-ba1d48335fc7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.124705 Jul 20 04:18:01.916302 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 495/946] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:18:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:18:02.802657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:02.803874 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:02.814879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.815529 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.817038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:02.817641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:02.858390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:03.260761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.270444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be148c74-3219-475e-bc79-72ba79615daf tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 1.766579 Jul 20 04:18:03.271042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 452/947] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:01 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:03.538153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:03.551530 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c1e47be6-898a-405e-8105-e6cd035762b8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 0.753987 Jul 20 04:18:03.553424 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 496/948] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:02 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:04.287301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.288041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.301039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.301685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.302583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.309058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.574701 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:04.579468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:04.587762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.589141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.590094 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:04.590849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:04.710568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:05.113880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.131562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:05.147886 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2da30870-46f7-4765-8954-f97f5ac7668a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 0.567920 Jul 20 04:18:05.150639 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 497/949] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.166746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-fd67047b-74c5-4498-a272-ad6a38d4d5d0 req-cc91f539-a05c-42ab-a4e2-831321cf082b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:05.188001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-fd67047b-74c5-4498-a272-ad6a38d4d5d0 req-cc91f539-a05c-42ab-a4e2-831321cf082b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.190375 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-fd67047b-74c5-4498-a272-ad6a38d4d5d0 req-cc91f539-a05c-42ab-a4e2-831321cf082b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.234650 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-fd67047b-74c5-4498-a272-ad6a38d4d5d0 req-cc91f539-a05c-42ab-a4e2-831321cf082b service nova] Creating event network-changed:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:18:05.247203 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-fd67047b-74c5-4498-a272-ad6a38d4d5d0 req-cc91f539-a05c-42ab-a4e2-831321cf082b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094985 Jul 20 04:18:05.252645 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 498/950] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:05.465902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:05.481997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b43852f3-3a9a-4aee-85c9-81d4afbd9709 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 1.198639 Jul 20 04:18:05.485101 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 453/951] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:04 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:05.785038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:05.786383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:05.796397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.797196 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:05.798425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:05.799017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.167314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:06.168286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.191935 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b3d2f773-717c-4171-af15-6c52c2b25cb3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1857 microversion: 2.1 time: 0.412654 Jul 20 04:18:06.211006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.211459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.212309 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 499/952] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:05 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1857 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:06.215652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.218653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.223776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764486-11", "block_migration": true, "disk_over_commit": false}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:06.225816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:06.243309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.263671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.265264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:06.265933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:06.333382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lazy-loading 'flavor' on Instance uuid 24a4b61b-c809-46e8-b128-1fcf432a32df {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:06.356652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Going to try to live migrate instance to n-h2-764486-11 {{(pid=123723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:18:07.499680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:07.511330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29209316-32b2-4291-8b19-89265eba0aae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 1.348207 Jul 20 04:18:07.517193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 454/953] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:06 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:07.777524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef5d13d4-c7ed-47be-9a1f-a6b79412a834 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Action: 'create', calling method: .version_select at 0x7f838bb24160>, body: {"keypair": {"name": "tempest-keypair-74145650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFisJFr8C2K1p7hj20etJF4MjESvvBRojw/Rcgwg2NY1jg+s9eNjAgEE62QM4p2nNvcMSihK5wFZeg4FrO3c3MBPPDpF9Qm80ZlZjskO7bZ7UfDdpTKl7SJe4vSXl808g=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:07.798550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ef5d13d4-c7ed-47be-9a1f-a6b79412a834 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Getting quotas for project 8c8f959211104019a29f2773235609a1. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:07.806671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ef5d13d4-c7ed-47be-9a1f-a6b79412a834 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Getting quotas for user 70cc4532e47c42fcba8496e5a6c191d8 and project 8c8f959211104019a29f2773235609a1. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:07.868780 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef5d13d4-c7ed-47be-9a1f-a6b79412a834 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.349997 Jul 20 04:18:07.873718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 455/954] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:18:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:07.880650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:07.881485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:07.894115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.894242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:07.894943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:07.895565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.495033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:08.513013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f044f85-2206-4b72-931d-a1e32aa824fe tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 0.636270 Jul 20 04:18:08.514718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 456/955] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:07 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:08.519499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-abb83e56-cf0b-4a41-a6c9-c024778fa235 req-0ef8f5f7-1e6f-48a9-bf83-ced001152b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1023d9-1301-426e-8209-382ca96c7524", "tag": "90c230c3-c2da-47c3-ae26-a85d36beb40a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.534976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-abb83e56-cf0b-4a41-a6c9-c024778fa235 req-0ef8f5f7-1e6f-48a9-bf83-ced001152b48 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:08.539739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-abb83e56-cf0b-4a41-a6c9-c024778fa235 req-0ef8f5f7-1e6f-48a9-bf83-ced001152b48 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:08.563106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-abb83e56-cf0b-4a41-a6c9-c024778fa235 req-0ef8f5f7-1e6f-48a9-bf83-ced001152b48 service nova] Creating event network-changed:90c230c3-c2da-47c3-ae26-a85d36beb40a for instance 1d1023d9-1301-426e-8209-382ca96c7524 on n-h1-764486-11 Jul 20 04:18:08.574744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-abb83e56-cf0b-4a41-a6c9-c024778fa235 req-0ef8f5f7-1e6f-48a9-bf83-ced001152b48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058581 Jul 20 04:18:08.575673 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 457/956] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:08.707606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-903284496", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:08.809757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:11.150829 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b0cc7d00-cb95-4f53-a362-cb36f621fcbf tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/action" status: 202 len: 0 microversion: 2.1 time: 4.937058 Jul 20 04:18:11.152125 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 500/957] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:06 2022] POST /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/action => generated 0 bytes in 4939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:11.186884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1439798031", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "3e4182e1-3b84-49f1-9a99-386772005d20"}], "security_groups": [{"name": "tempest-securitygroup--581872283"}], "key_name": "tempest-keypair-1869364950", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:11.264161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:11.265801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:11.266569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:11.272376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:11.275070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:11.279839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:11.303660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.307811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.310675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.311187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.369787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:11.377564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:11.395606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:11.400244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:11.499097 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8a37727-c3e1-41dd-8d8a-d41715e138df tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.921557 Jul 20 04:18:11.499751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 458/958] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:11.513605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:11.514293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:11.526400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.526855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.527642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:11.528465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:11.581594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] validate_networks() for [('3e4182e1-3b84-49f1-9a99-386772005d20', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:11.865524 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=12 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:12.592098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:12.592816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:12.593448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:12.593845 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:12.594250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:12.610389 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.615872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.617072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.617683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.662903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:12.674420 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for user c21b3bf3ba4d4558950d7337a651587f and project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:12.703590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:12.710995 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:12.713811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:12.854566 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f5c1c324-f916-4aab-8c4e-b9b8d8c2184c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.701040 Jul 20 04:18:12.855144 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 501/959] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:18:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:18:12.868192 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:12.869055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:12.888946 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.889455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.890249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:12.897399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:12.927693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:12.942890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89807051-02db-4db0-81aa-51c5a23e992b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 1.436128 Jul 20 04:18:12.953328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 459/960] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:11 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:12.970058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1076363532", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f1bc9176-1cb0-4a91-a784-feb662271ea5"}], "security_groups": [{"name": "tempest-securitygroup--379978801"}], "key_name": "tempest-keypair-74145650", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:13.220904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.228517 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e8d10794-22f6-4b05-ae5b-dcaa30b35533 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 0.366694 Jul 20 04:18:13.232405 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 502/961] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:12 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.243015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.248199 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.259458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.261523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.264789 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.266141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.520666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] validate_networks() for [('f1bc9176-1cb0-4a91-a784-feb662271ea5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:13.651808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:13.670924 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-206df5d9-cd6e-43c6-9793-b9a0be8532ba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.437264 Jul 20 04:18:13.683105 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 503/962] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:13.696077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:13.701526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:13.714417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.716288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:13.720908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:13.721697 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.255212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.279728 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8244621b-a004-462a-919c-b9e8dc551401 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1284 microversion: 2.1 time: 0.592940 Jul 20 04:18:14.282012 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 504/963] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:13 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1284 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:14.292798 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.296087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.314213 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.314691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.316239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.317002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.455602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.468950 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.471704 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:14.473264 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8f337ed1-a09b-4c83-bb51-a3afd2033ecf tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1338 microversion: 2.25 time: 0.189954 Jul 20 04:18:14.477598 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 505/964] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:14.487392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Getting quotas for project 8c8f959211104019a29f2773235609a1. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:14.492760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.493799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.501593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Getting quotas for user 70cc4532e47c42fcba8496e5a6c191d8 and project 8c8f959211104019a29f2773235609a1. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:14.503544 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.504820 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.507231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.508451 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.531126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:14.531795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:14.535233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:14.544676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:14.545172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:14.565089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.565540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.570253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.571487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.646700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Getting quotas for project 8c8f959211104019a29f2773235609a1. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:14.661754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Getting quotas for user 70cc4532e47c42fcba8496e5a6c191d8 and project 8c8f959211104019a29f2773235609a1. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:14.700559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:14.703880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:14.819952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00800111-747d-44f6-88a9-00304472b854 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.860727 Jul 20 04:18:14.821148 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 460/965] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:14.829683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:14.830578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:14.868078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.870673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:14.875039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:14.878083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.001194 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.009271 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6f7d7154-634f-4167-9ef8-891934fd69ca tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 0.528636 Jul 20 04:18:15.024320 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 506/966] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.041072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.041702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.053386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.053838 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.054626 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.055060 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.123257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:15.447898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.449316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.462849 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5cca4e2b-0c5c-4cc2-a21c-773d1dd7b988 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.437285 Jul 20 04:18:15.463525 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 507/967] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.468251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-626f45df-34f4-4733-b229-b879a65d7ced tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 0.640239 Jul 20 04:18:15.474333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 461/968] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:14 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.482600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a921c89b-92bf-439a-af79-36801dfc6711 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.483650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a921c89b-92bf-439a-af79-36801dfc6711 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.502895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.518178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.536152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.536720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.537607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.538076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.703521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a921c89b-92bf-439a-af79-36801dfc6711 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:15.716008 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a921c89b-92bf-439a-af79-36801dfc6711 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1268 microversion: 2.1 time: 0.251220 Jul 20 04:18:15.716623 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 508/969] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:15.737990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-4c23cbed-a02c-4961-9fb6-033223978e9a req-98f0b78e-32fd-457e-a79a-58f74714c5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "name": "network-vif-plugged", "status": "completed", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:15.773150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-4c23cbed-a02c-4961-9fb6-033223978e9a req-98f0b78e-32fd-457e-a79a-58f74714c5b7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.773599 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-4c23cbed-a02c-4961-9fb6-033223978e9a req-98f0b78e-32fd-457e-a79a-58f74714c5b7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.787481 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-4c23cbed-a02c-4961-9fb6-033223978e9a req-98f0b78e-32fd-457e-a79a-58f74714c5b7 service nova] Creating event network-vif-plugged:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:18:15.802763 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-4c23cbed-a02c-4961-9fb6-033223978e9a req-98f0b78e-32fd-457e-a79a-58f74714c5b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084194 Jul 20 04:18:15.811194 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 509/970] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:15.819717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:15.821911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:15.840302 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.841050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:15.842020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:15.842618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.229176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.252802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.261278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.265179 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1e3f7f2a-4b2a-46ab-91ed-2833e148bf20 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1344 microversion: 2.25 time: 0.452210 Jul 20 04:18:16.268103 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 510/971] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1344 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:16.288753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.303303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.341940 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.345279 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.350977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.356899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.521412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.532779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed48979d-040a-45ca-b3dc-5e74a2642382 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1314 microversion: 2.1 time: 1.056263 Jul 20 04:18:16.533376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 462/972] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:15 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:16.548721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.549699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.559526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.564093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.565144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.570058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.839964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:16.851323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce117ae2-aab5-45fb-94a6-98d1107e8640 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.315511 Jul 20 04:18:16.852146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 463/973] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:16.858165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:16.861539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:16.870005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.870867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:16.871804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:16.872422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.008787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.032375 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ebfb44cd-851c-4d84-825a-69ee0eb8942f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 0.757792 Jul 20 04:18:17.034051 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 511/974] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.045289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.050957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.063222 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.064746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.066404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.069232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.189136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.203305 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-16c757a2-acde-4d9f-9216-6fc50f22b775 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1320 microversion: 2.1 time: 0.166261 Jul 20 04:18:17.205145 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 512/975] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.302206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:17.320296 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5866d88e-de4d-4acf-823c-162056be01ec tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1377 microversion: 2.1 time: 0.459759 Jul 20 04:18:17.327333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 464/976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:16 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1377 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:17.335697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:17.336557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:17.349244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.351630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.353744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:17.354758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:17.433146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1089768641", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:17.549082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:18.045521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:18.045521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:18.047602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:18.048583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:18.050467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:18.059380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.082231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.089609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.097071 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd67ed0c-2b09-4173-a2a9-0cbf233eaf61 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.768449 Jul 20 04:18:18.099755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 465/977] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:17 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:18.105381 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.109194 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.112030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.116041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.119981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.121830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.133037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.140661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.141691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.142232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.162261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Getting quotas for project 693b27c3cf8c4218a9eb4f96ebbd76b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:18.179195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Getting quotas for user 66da09d3f8a443458578128cea7a23b6 and project 693b27c3cf8c4218a9eb4f96ebbd76b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:18.215118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:18.219111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:18.290387 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-89ecb7ed-4a03-4eb8-95c1-4d7f3e14309f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082281 Jul 20 04:18:18.294190 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 513/978] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:18.303760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-b6ef4a81-52cb-4b5f-9e59-9c6df4c43496 req-9536baca-7db9-4e8e-84d7-0b417ff5c3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2c4d27-2793-4a99-b2ab-36dab046bca1", "tag": "7c5b329f-a5c0-4c40-af8f-7948b48d66cf"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:18.315909 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-b6ef4a81-52cb-4b5f-9e59-9c6df4c43496 req-9536baca-7db9-4e8e-84d7-0b417ff5c3e7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.316374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-b6ef4a81-52cb-4b5f-9e59-9c6df4c43496 req-9536baca-7db9-4e8e-84d7-0b417ff5c3e7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.330772 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-b6ef4a81-52cb-4b5f-9e59-9c6df4c43496 req-9536baca-7db9-4e8e-84d7-0b417ff5c3e7 service nova] Creating event network-changed:7c5b329f-a5c0-4c40-af8f-7948b48d66cf for instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 on n-h1-764486-11 Jul 20 04:18:18.337783 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-b6ef4a81-52cb-4b5f-9e59-9c6df4c43496 req-9536baca-7db9-4e8e-84d7-0b417ff5c3e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041814 Jul 20 04:18:18.339690 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 514/979] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:18.345513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-c777e897-57f0-4d66-a511-8ac16dc84063 req-afad2104-fd96-48f7-a2d5-55c3d387e0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1023d9-1301-426e-8209-382ca96c7524", "name": "network-vif-plugged", "status": "completed", "tag": "90c230c3-c2da-47c3-ae26-a85d36beb40a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:18.355951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c777e897-57f0-4d66-a511-8ac16dc84063 req-afad2104-fd96-48f7-a2d5-55c3d387e0b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.356413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c777e897-57f0-4d66-a511-8ac16dc84063 req-afad2104-fd96-48f7-a2d5-55c3d387e0b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.371320 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-c777e897-57f0-4d66-a511-8ac16dc84063 req-afad2104-fd96-48f7-a2d5-55c3d387e0b4 service nova] Creating event network-vif-plugged:90c230c3-c2da-47c3-ae26-a85d36beb40a for instance 1d1023d9-1301-426e-8209-382ca96c7524 on n-h1-764486-11 Jul 20 04:18:18.378201 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-c777e897-57f0-4d66-a511-8ac16dc84063 req-afad2104-fd96-48f7-a2d5-55c3d387e0b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035915 Jul 20 04:18:18.379142 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 515/980] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:18.388760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.389602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.403086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.403784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.404645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.405188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.726480 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.738048 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-21a15111-5079-4bc6-a095-d86c9d5495b2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.356704 Jul 20 04:18:18.739316 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 516/981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.754119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.754740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.762705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.763410 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.765266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.765901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.903283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.924638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3990efb-6159-42b0-87f5-e8dde8aefd16 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1314 microversion: 2.1 time: 0.819807 Jul 20 04:18:18.926484 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 466/982] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.932084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.932842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:18.941195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.949126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.950103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:18.950624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:18.961659 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:18.970689 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b283609f-9f72-4805-a9c0-829bcafa03c1 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 0.229705 Jul 20 04:18:18.971864 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 517/983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:18.978814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-581af45b-69bc-443b-a947-e149aa4cc401 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:18.979605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-581af45b-69bc-443b-a947-e149aa4cc401 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.036847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-581af45b-69bc-443b-a947-e149aa4cc401 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.044249 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-581af45b-69bc-443b-a947-e149aa4cc401 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1220 microversion: 2.1 time: 0.071095 Jul 20 04:18:19.045117 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 518/984] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1220 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.056506 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.056506 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.057418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.058225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.059105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.059602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.094737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.112485 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c4a5cc8-d85f-422a-9c29-4e205251d0e1 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1326 microversion: 2.1 time: 0.183968 Jul 20 04:18:19.122528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 467/985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:18 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1326 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.132647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.134063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.141163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.141809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.142837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.143687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.237338 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.246890 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b577bd4-6cd8-4cb2-94ad-8b67654c6ccc tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1527 microversion: 2.1 time: 0.200776 Jul 20 04:18:19.247679 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 519/986] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1527 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.264119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.265158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.272338 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.273195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.274256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.274920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.419383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.427989 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-187f8ec0-d341-488c-8c19-cf5df8750ec4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1527 microversion: 2.1 time: 0.167894 Jul 20 04:18:19.439487 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 520/987] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.445094 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bdd86aba-dea0-445c-924e-67888f0cf4d1 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.446140 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:18:19.446140 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:18:19.467398 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bdd86aba-dea0-445c-924e-67888f0cf4d1 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/e86b69bc-9e21-4174-be9f-cf947c469924" status: 202 len: 0 microversion: 2.1 time: 0.026303 Jul 20 04:18:19.468232 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 521/988] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:19 2022] DELETE /compute/v2.1/flavors/e86b69bc-9e21-4174-be9f-cf947c469924 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:18:19.477063 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e94fe751-0aef-437e-81a1-29f335757d02 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.495853 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e94fe751-0aef-437e-81a1-29f335757d02 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022622 Jul 20 04:18:19.497153 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 522/989] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:19.513843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:19.516003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.523547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.524279 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.525225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.526678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.592672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.604253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.610546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.611722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d67001d-038e-4c06-9763-0aea8f935aa0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.491711 Jul 20 04:18:19.615419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 468/990] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:19.663142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:19.672509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Old instance type tempest-test_resize_flavor_-1864418215, new instance type m1.heat {{(pid=123723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:18:19.686300 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:19.686757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:19.687283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:19.687892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:19.688478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:19.755259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.755989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.779342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.780114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.783406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.784193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.927228 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-480305a4-35e3-4066-b815-6c3fcea25ae4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371/action" status: 202 len: 0 microversion: 2.1 time: 0.417957 Jul 20 04:18:19.929025 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 523/991] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:19 2022] POST /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:18:19.937702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:19.938743 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:19.948023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.949228 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:19.950195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:19.950732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.240780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.252258 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2a04f6b9-6747-42c6-a73c-8cc1d66ef830 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1536 microversion: 2.1 time: 0.318048 Jul 20 04:18:20.253503 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 524/992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1536 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.269541 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.270461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.279281 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.279989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.280992 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.282328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.534735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.549120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b67c3190-866b-46f7-a234-f14239125b08 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.793335 Jul 20 04:18:20.554638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 469/993] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:19 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:20.564929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.570193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.582794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.584344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.589576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.591873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.640167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.653284 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9968543d-a9ae-447b-869e-ad07b0efeca0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1314 microversion: 2.1 time: 0.396583 Jul 20 04:18:20.654887 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 525/994] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.659922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.660804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.669223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.670111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.672015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.672716 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.888100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:20.899134 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fc484e19-cf0f-4934-bb08-420268028e4a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1272 microversion: 2.1 time: 0.242899 Jul 20 04:18:20.899990 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 526/995] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:20.908122 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:20.919781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:20.926363 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.927493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:20.928289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:20.928748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.419476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.435336 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-563170fc-9927-4137-9675-cc4a88181f75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.530823 Jul 20 04:18:21.436180 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 527/996] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:21.453579 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:21.455518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:21.475242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.475687 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.476618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:21.477065 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:21.951464 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.963471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.976768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:21.977978 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-afc8738c-6cdd-43df-a066-82d783935b56 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.541057 Jul 20 04:18:21.981391 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 528/997] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:21.992690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.006160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.039880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.050059 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.053509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.054265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.116054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:22.116687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.120621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:22.132240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c8c134e-d10c-4290-bce4-1b4e00938a27 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1316 microversion: 2.1 time: 1.576201 Jul 20 04:18:22.133391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 470/998] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:20 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1316 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:22.141810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-718b3cf3-9584-4c32-a0c6-ccee01aac09f req-d680fc6f-44b0-45a8-8a62-9a3c44d3ebaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:22.164312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-718b3cf3-9584-4c32-a0c6-ccee01aac09f req-d680fc6f-44b0-45a8-8a62-9a3c44d3ebaf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.164776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-718b3cf3-9584-4c32-a0c6-ccee01aac09f req-d680fc6f-44b0-45a8-8a62-9a3c44d3ebaf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.185425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-718b3cf3-9584-4c32-a0c6-ccee01aac09f req-d680fc6f-44b0-45a8-8a62-9a3c44d3ebaf service nova] Creating event network-changed:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h1-764486-11 Jul 20 04:18:22.198078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-718b3cf3-9584-4c32-a0c6-ccee01aac09f req-d680fc6f-44b0-45a8-8a62-9a3c44d3ebaf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063281 Jul 20 04:18:22.198880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 471/999] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:22.206570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.212467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.225934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.228600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.232797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.233251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.311612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.324053 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ffcd2793-a8a8-4a67-b6b4-e006f8e3dc80 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1536 microversion: 2.1 time: 0.337899 Jul 20 04:18:22.324745 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 529/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:21 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1536 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:22.334084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.336583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.343932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.344903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.347671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.348428 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.554667 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.569394 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-366fcc1c-6845-4e51-a390-0e457fa4e758 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1314 microversion: 2.1 time: 0.239483 Jul 20 04:18:22.570910 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 530/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:22.601529 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.602629 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.615012 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.615771 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.616783 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.617498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.732953 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:22.753612 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-674aa32d-78aa-4122-be33-7333500a44d8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1278 microversion: 2.1 time: 0.181110 Jul 20 04:18:22.754562 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 531/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:22.768945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:22.769605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:22.787038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.787582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.788422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:22.791098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:22.999050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.009054 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-66a6a21f-4e0b-4318-9c54-8e970bc62238 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.253017 Jul 20 04:18:23.021231 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 532/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.028696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.030417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.039399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.040924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.042089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.042705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.215609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.226048 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.232202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f458b53-48b4-402b-a2be-1361b5e54e04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 1.031918 Jul 20 04:18:23.233612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 472/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:22 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.245975 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.247981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.250065 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-51bc8fed-e865-4a89-9e8c-35c79700604a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.226935 Jul 20 04:18:23.251076 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 533/1005] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:23.263988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.264632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.272311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.272992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.273771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.274255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.341295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.342116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.353438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.354854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.355815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.356444 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.513861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.525460 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7d4160e6-66d9-4362-8c68-52f3f71d72b5 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1536 microversion: 2.1 time: 0.187867 Jul 20 04:18:23.525990 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 534/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1536 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:23.588663 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.589848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.597203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.597658 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.598476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.598914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.834384 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.842219 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ef5c9b01-7db2-464e-941e-16fee75ddece tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1314 microversion: 2.1 time: 0.259017 Jul 20 04:18:23.855289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:23.857704 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 535/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:23.862648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.864608 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.866635 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:23.872360 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.873172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.874027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.874540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.877971 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ddd1de2d-fc76-4998-a6e3-bfdf3696c1a5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1466 microversion: 2.1 time: 0.640519 Jul 20 04:18:23.879168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 473/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1466 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:23.898144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:23.898490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:23.909875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.910533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:23.912137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:23.912792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.023443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.033712 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5e277fde-fd9f-4962-9bab-9eb45e433f30 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1278 microversion: 2.1 time: 0.174803 Jul 20 04:18:24.047133 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 536/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:24.055338 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.056493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.065250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.066022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.067923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.068631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.403175 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.412228 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c2de02ef-8eef-4d9f-91a2-4e2f6d92c44a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.363364 Jul 20 04:18:24.413102 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 537/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:24.421304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.422840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.431429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.431941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.432820 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.433316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.605069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:24.658585 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.669813 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dd825c05-8c8c-4e18-8b3f-e84f80a550d3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.253994 Jul 20 04:18:24.670851 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 538/1011] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:24.677148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.678025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.683010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=20 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:24.690233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.691106 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.692723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.693370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.849679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.857569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.859437 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:24.860593 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-029531e3-b351-485c-aae0-95301afd992d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.188440 Jul 20 04:18:24.861156 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 539/1012] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:24.866202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-8322bf22-6730-47a8-8171-1d8db134695a req-b2bd4bb9-cda8-4598-abab-fd388e2deb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2c4d27-2793-4a99-b2ab-36dab046bca1", "name": "network-vif-plugged", "status": "completed", "tag": "7c5b329f-a5c0-4c40-af8f-7948b48d66cf"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:24.874355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8322bf22-6730-47a8-8171-1d8db134695a req-b2bd4bb9-cda8-4598-abab-fd388e2deb89 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.874776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8322bf22-6730-47a8-8171-1d8db134695a req-b2bd4bb9-cda8-4598-abab-fd388e2deb89 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.886890 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-8322bf22-6730-47a8-8171-1d8db134695a req-b2bd4bb9-cda8-4598-abab-fd388e2deb89 service nova] Creating event network-vif-plugged:7c5b329f-a5c0-4c40-af8f-7948b48d66cf for instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 on n-h1-764486-11 Jul 20 04:18:24.891778 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-8322bf22-6730-47a8-8171-1d8db134695a req-b2bd4bb9-cda8-4598-abab-fd388e2deb89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029447 Jul 20 04:18:24.892572 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 540/1013] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:24.898070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.898767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.905500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.905948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.906718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.907150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.913088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3dfd62f-9e0a-4d47-b9a2-5966541ba784 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1619 microversion: 2.1 time: 1.019736 Jul 20 04:18:24.914376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 474/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:23 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1619 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:24.919971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:24.920775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:24.931998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.935103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:24.935950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:24.943913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.069189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.076836 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6a30d963-4401-441a-8d4c-d4b44cb032ee tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1536 microversion: 2.1 time: 0.183275 Jul 20 04:18:25.077595 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 541/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1536 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:25.091962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.092596 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.099043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.099480 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.100261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.100712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.168093 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.177750 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-565eadae-1ccc-4b97-86d5-37934c24a7e9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1278 microversion: 2.1 time: 0.089543 Jul 20 04:18:25.178870 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 542/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:25.183757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-441206776", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["933fbdd2-8589-43a1-a99a-8f22c47fcb69"]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:25.245251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:25.543225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:25.549603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:25.550028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:25.550526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:25.550936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:25.553906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:25.561985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4bd0d7b4-4b23-45e4-9c2e-5956630f898d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1314 microversion: 2.1 time: 0.646129 Jul 20 04:18:25.563448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 475/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:24 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:25.565268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.565717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.566521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.567475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.570122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.570977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.578964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.579711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.580820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.581465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.590192 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:25.596237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:25.623120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:25.626112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:25.677569 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cec35319-a38f-40c8-8e90-e6de15456a3b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496555 Jul 20 04:18:25.679007 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 543/1018] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:25.691808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:25.692991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:25.699630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.700265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:25.701113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:25.701549 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.073621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.099092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b380b191-8426-43c0-86ab-d31d5369cf75 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.533668 Jul 20 04:18:26.110702 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 476/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.142393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfeee215-b28a-4ae6-aaa0-84f0b748df3f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.143053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfeee215-b28a-4ae6-aaa0-84f0b748df3f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.362689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.374925 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b5c22a39-5412-4b86-8c23-32f0aec712d8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.688926 Jul 20 04:18:26.387236 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 544/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:25 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.393874 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-ee62da03-227a-478a-afcc-b108b34a7214 req-d72fcf87-04e8-4002-a4ab-ac7e130dab5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f", "tag": "fb6220a9-6849-48c0-a1c5-316a5e11dac0"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:26.397212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dfeee215-b28a-4ae6-aaa0-84f0b748df3f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.405992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfeee215-b28a-4ae6-aaa0-84f0b748df3f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1216 microversion: 2.1 time: 0.283132 Jul 20 04:18:26.408478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 477/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.415902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.423468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.425208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ee62da03-227a-478a-afcc-b108b34a7214 req-d72fcf87-04e8-4002-a4ab-ac7e130dab5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.426836 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ee62da03-227a-478a-afcc-b108b34a7214 req-d72fcf87-04e8-4002-a4ab-ac7e130dab5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.435032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.435486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.436262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.436721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.441749 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-ee62da03-227a-478a-afcc-b108b34a7214 req-d72fcf87-04e8-4002-a4ab-ac7e130dab5f service nova] Creating event network-changed:fb6220a9-6849-48c0-a1c5-316a5e11dac0 for instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f on n-h2-764486-11 Jul 20 04:18:26.447902 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-ee62da03-227a-478a-afcc-b108b34a7214 req-d72fcf87-04e8-4002-a4ab-ac7e130dab5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058696 Jul 20 04:18:26.449000 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 545/1022] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:26.456136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.457079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.465337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.467801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.468871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.469457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.631983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.651734 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-52e94903-79b1-4959-85d2-83a0da98eb29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.201211 Jul 20 04:18:26.652330 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 546/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.661407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.663233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.671372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.672114 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.688966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.689751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.877061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:26.885761 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-03657514-c08f-41a9-8824-a3761b0cb09f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.228212 Jul 20 04:18:26.886274 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 547/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:26.890690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:26.891643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:26.897663 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.898254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.899088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:26.899549 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:26.903728 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:27.031708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.039841 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fb826421-5f2f-4f0e-8dd5-a82f651d2c52 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1500 microversion: 2.1 time: 0.152585 Jul 20 04:18:27.051151 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 548/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.056805 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.057307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.063492 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.063941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.064748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.065181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.096709 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:27.199606 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0497e1a1-6c05-4dc6-b3d6-78546de9fdd9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 204 len: 0 microversion: 2.1 time: 0.146347 Jul 20 04:18:27.200457 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 549/1026] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:27 2022] DELETE /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:18:27.207780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.208550 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.214801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.215253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.216029 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.216499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.249365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.259240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.261262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.263434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd43b867-178d-4e32-85dc-7ed76914181d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.853158 Jul 20 04:18:27.264081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 478/1027] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:26 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:27.269443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.270746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.277086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.277654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.278530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.279058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.369921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.377403 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b9300b17-f517-43c5-888c-8af4b478be05 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.175869 Jul 20 04:18:27.377969 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 550/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.393171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.393691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.400226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.400717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.401479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.401907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.529951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.539645 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8190acd9-99b2-405d-9913-9c8c92597c04 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.150490 Jul 20 04:18:27.540236 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 551/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:27.544969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.545594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.551929 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.552404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.553259 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.553759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.619722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.627250 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cc7459e4-1a1f-44c2-a298-fdf80d900368 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1286 microversion: 2.1 time: 0.086001 Jul 20 04:18:27.628112 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 552/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.668943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.669577 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.675553 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.675997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.676811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.677242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.708581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.718473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f31da2a-00a3-46bf-82d3-b0d857f5a4ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1506 microversion: 2.1 time: 0.452967 Jul 20 04:18:27.722823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 479/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:27.876176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:27.890728 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bb2c43e4-105f-4aa9-8e30-942fb49944fb tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.225545 Jul 20 04:18:27.903471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:27.904166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:27.913447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.913926 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 553/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:27.923896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:27.924683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:27.925116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.244888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.255093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3bd8c85-f581-435e-a356-ae1f2ab710ff tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.356006 Jul 20 04:18:28.257933 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 480/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:27 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.282979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.283869 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.295556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.298481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.299492 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.304968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.402965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.404372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.414387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.416111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.417437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.417897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.683589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.696216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.697561 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.700671 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1a868a81-5197-40c5-a6e7-bc1bdbff6621 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.422563 Jul 20 04:18:28.701249 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 554/1034] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:18:28.715210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.715699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.727927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.729782 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.736695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.751235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.777393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.793843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49c71aea-7180-4219-83a6-b41eff3a4364 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.402439 Jul 20 04:18:28.803889 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 481/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.812088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.814938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.830728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.833395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.834609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.836924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.948684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:28.956692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a14a424-ff6b-4670-8247-5c09a05d4258 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1274 microversion: 2.1 time: 0.151439 Jul 20 04:18:28.958562 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 482/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:28.963492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:28.964542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:28.971350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.972141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:28.973813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:28.974472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.092658 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.111878 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-eb73248b-36cd-4636-90ed-695119e93dd9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.409566 Jul 20 04:18:29.113143 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 555/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.119000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-31f468f4-086f-4e0b-b613-64393567305e req-10ba7faa-4565-4dd1-aad7-0ba086e6872b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0332744-15ed-4c1d-a460-29ba2333b395", "tag": "9b43c2ce-2d84-4861-90b7-c462b3f6c949"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:29.134427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-31f468f4-086f-4e0b-b613-64393567305e req-10ba7faa-4565-4dd1-aad7-0ba086e6872b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.135335 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-31f468f4-086f-4e0b-b613-64393567305e req-10ba7faa-4565-4dd1-aad7-0ba086e6872b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.151721 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-31f468f4-086f-4e0b-b613-64393567305e req-10ba7faa-4565-4dd1-aad7-0ba086e6872b service nova] Creating event network-changed:9b43c2ce-2d84-4861-90b7-c462b3f6c949 for instance a0332744-15ed-4c1d-a460-29ba2333b395 on n-h1-764486-11 Jul 20 04:18:29.158296 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-31f468f4-086f-4e0b-b613-64393567305e req-10ba7faa-4565-4dd1-aad7-0ba086e6872b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043130 Jul 20 04:18:29.159165 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 556/1038] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:29.167483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.168902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.175662 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.176195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.177023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.177847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.194989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.203835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e3748f2-fc61-4c49-aeaa-6869ad6af2fa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1506 microversion: 2.1 time: 0.243715 Jul 20 04:18:29.214196 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 483/1039] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:28 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.275684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.276602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.283158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.283860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.284982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.285577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.512014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.525052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6da08ca-df30-4325-b4a5-cf18ec52ca84 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.253397 Jul 20 04:18:29.527611 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 484/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.550136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:29.558796 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bc6f66a2-e7c2-4579-848c-bcaf43aa97e6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.398000 Jul 20 04:18:29.564393 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 557/1041] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:29.737148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.751026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.760973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.761420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.762187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.762637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.811119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:29.813133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:29.821069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.821899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:29.822916 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:29.823575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.020645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.048164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.050919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.054499 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d97d705-be99-4d81-aaa0-b3fc8fec3fc0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.336053 Jul 20 04:18:30.072573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 485/1042] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:30.081646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.083378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.097107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.097790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.098795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.099382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.195099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.203013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-625a6f46-69b6-4bed-9583-a9dff680fe7f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1274 microversion: 2.1 time: 0.128883 Jul 20 04:18:30.215060 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 486/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.221565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.222566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.229709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.230394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.231349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.231931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.418476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.435744 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-61dc7929-24b1-411f-8e49-e8d3f0992b6b tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.628358 Jul 20 04:18:30.440538 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 558/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:29 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.447294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.448704 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.456664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.457899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.460082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.460656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.570023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.581633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdf0d28c-9d29-46b4-9c41-7df494896941 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.365109 Jul 20 04:18:30.583711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 487/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.590448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1abc12a1-ab84-4816-8886-11015fce7775 req-017bc199-cc81-4fda-a372-59d40553c874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "name": "network-vif-plugged", "status": "completed", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:30.611291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1abc12a1-ab84-4816-8886-11015fce7775 req-017bc199-cc81-4fda-a372-59d40553c874 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.611433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1abc12a1-ab84-4816-8886-11015fce7775 req-017bc199-cc81-4fda-a372-59d40553c874 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.632242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:30.638557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1abc12a1-ab84-4816-8886-11015fce7775 req-017bc199-cc81-4fda-a372-59d40553c874 service nova] Creating event network-vif-plugged:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h1-764486-11 Jul 20 04:18:30.650355 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-77f607e3-ace9-4070-bd98-da3bd2ce24a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 200 len: 1464 microversion: 2.1 time: 0.208105 Jul 20 04:18:30.651340 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 559/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:30.662632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1abc12a1-ab84-4816-8886-11015fce7775 req-017bc199-cc81-4fda-a372-59d40553c874 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076257 Jul 20 04:18:30.663920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.666292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.671379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 488/1047] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:30.677577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a016251e-b7fd-4c9d-9ff2-3e4ea33f32f3 req-96dce285-3c8d-4df5-9040-ecf3caa2cb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2c4d27-2793-4a99-b2ab-36dab046bca1", "name": "network-vif-deleted", "tag": "7c5b329f-a5c0-4c40-af8f-7948b48d66cf"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:30.689470 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.689921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.692052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.692614 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.698493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:30.701311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a016251e-b7fd-4c9d-9ff2-3e4ea33f32f3 req-96dce285-3c8d-4df5-9040-ecf3caa2cb22 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.701776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a016251e-b7fd-4c9d-9ff2-3e4ea33f32f3 req-96dce285-3c8d-4df5-9040-ecf3caa2cb22 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.732119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a016251e-b7fd-4c9d-9ff2-3e4ea33f32f3 req-96dce285-3c8d-4df5-9040-ecf3caa2cb22 service nova] Creating event network-vif-deleted:7c5b329f-a5c0-4c40-af8f-7948b48d66cf for instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 on n-h1-764486-11 Jul 20 04:18:30.747887 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a016251e-b7fd-4c9d-9ff2-3e4ea33f32f3 req-96dce285-3c8d-4df5-9040-ecf3caa2cb22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074957 Jul 20 04:18:30.748834 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 489/1048] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:30.753994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:30.754939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:30.764117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.764813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.769115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:30.769802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:30.796146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:31.337347 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.348096 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0f25d36b-920a-442d-8d20-b05e030aaaca tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.694258 Jul 20 04:18:31.351598 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 560/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:31.367631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.369496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:31.388778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.389241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.391153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.391636 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.520721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.528716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1c3dbde-69d8-4245-bdcb-e361a072c5a8 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.778608 Jul 20 04:18:31.531304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 490/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:30 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:31.547734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.548620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:31.558316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.565243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.567152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.568687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.948613 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.961773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.974523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:31.975789 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9e19cdc4-d129-499b-bb11-bce76c30c9b1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1411 microversion: 2.25 time: 0.622859 Jul 20 04:18:31.976405 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 561/1051] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1411 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:31.981595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:31.982223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:31.992481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.992932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:31.993715 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:31.994154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.116584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.133630 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e14ebf82-a7d0-495f-abc5-046e04d41d8b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.599593 Jul 20 04:18:32.134219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 491/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.138907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.142408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.158610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.159875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.161918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.162525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.397714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.406118 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4922ae3-4d97-48ab-923c-02e1c1fb6f1a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.270709 Jul 20 04:18:32.416642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 492/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.422258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.423137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.430558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.431471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.432635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.433337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.457949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 HTTP/1.1 Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:18:32.461616 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:18:32.463036 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7d2c4d27-2793-4a99-b2ab-36dab046bca1'} Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:32.463822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:18:32.465141 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:32.468455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:32.470300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29553bd8-fe71-4f5f-98f6-25ad9edb2440 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 404 len: 111 microversion: 2.1 time: 0.052349 Jul 20 04:18:32.471205 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 493/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:32.476281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.477830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.484565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.484975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.486455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.487510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.626565 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.639154 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c3d92249-83e7-4ae0-9f0d-fe3622aa7550 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.661650 Jul 20 04:18:32.643366 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 562/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:31 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.648939 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-e10bcd0e-b897-43fe-8caf-d2bf9cb1ef1a req-7679e1a2-e140-47bd-950f-124c2c4fcef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "name": "network-vif-unplugged", "status": "completed", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:32.664711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-e10bcd0e-b897-43fe-8caf-d2bf9cb1ef1a req-7679e1a2-e140-47bd-950f-124c2c4fcef4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.666806 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-e10bcd0e-b897-43fe-8caf-d2bf9cb1ef1a req-7679e1a2-e140-47bd-950f-124c2c4fcef4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.691302 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-e10bcd0e-b897-43fe-8caf-d2bf9cb1ef1a req-7679e1a2-e140-47bd-950f-124c2c4fcef4 service nova] Creating event network-vif-unplugged:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h1-764486-11 Jul 20 04:18:32.700972 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-e10bcd0e-b897-43fe-8caf-d2bf9cb1ef1a req-7679e1a2-e140-47bd-950f-124c2c4fcef4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055968 Jul 20 04:18:32.701749 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 563/1056] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:32.707601 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:32.712602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:32.738169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.739700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.740922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:32.741624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:32.786128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:32.796964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:32.807685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03608be7-4429-4c10-850b-6241715f64a1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.335049 Jul 20 04:18:32.808268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 494/1057] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:32.822755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1778785506", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:32.916852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:33.415569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.431347 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8ed759e8-3f8c-4a32-a6b7-d7a2eebb40a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.728026 Jul 20 04:18:33.441214 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 564/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:32 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:33.446541 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.447180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.457718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.458415 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.459370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.461132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.661882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:33.662358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:33.662843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:33.663324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:33.663822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:33.675462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.676820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.678194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.678837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.697846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:33.704976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:33.720914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:33.724183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:33.795008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7299b0ba-c0b1-41c8-8b16-bbd3855d5fe1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976094 Jul 20 04:18:33.802264 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 495/1059] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:33.823809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.825586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.834496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.835313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.837022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.837618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.886212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.901123 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.907632 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:33.911779 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cbcd6dc1-0993-42a5-a05f-a1c9619f858a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1608 microversion: 2.25 time: 0.469130 Jul 20 04:18:33.917494 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 565/1060] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1608 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:18:33.931733 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:33.932533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:33.945845 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.947450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:33.949349 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:33.951489 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.106063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.114334 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f94867a-7f1e-4693-992c-9b79d5faf837 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.298109 Jul 20 04:18:34.114926 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 496/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.122599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.123425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.146561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.147186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.149929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.150913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.260799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.273315 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0a31c0e2-efb4-41ac-9bf7-2181c600e1d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.353011 Jul 20 04:18:34.275036 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 566/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:33 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.295159 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f41abb18-b8c3-4df5-8af4-3aa552e35b75 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.298514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f41abb18-b8c3-4df5-8af4-3aa552e35b75 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.335649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.344696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-507f6ae3-f889-4c55-a598-0d4dd4fd8cbc tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.226266 Jul 20 04:18:34.345692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 497/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.350894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.351579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.357566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.358088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.358922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.359419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.423761 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f41abb18-b8c3-4df5-8af4-3aa552e35b75 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.432499 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f41abb18-b8c3-4df5-8af4-3aa552e35b75 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1215 microversion: 2.1 time: 0.143752 Jul 20 04:18:34.433296 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 567/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.447235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-5cfb0520-9048-4970-91ec-b12938058f05 req-80da1014-c8b1-48c1-b181-55a2b49709f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92c9979-bb48-46e5-995a-43f8b494d3c6", "tag": "260b3b15-2247-492d-a81b-76fcd0560b04"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:34.485072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-5cfb0520-9048-4970-91ec-b12938058f05 req-80da1014-c8b1-48c1-b181-55a2b49709f3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.485531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-5cfb0520-9048-4970-91ec-b12938058f05 req-80da1014-c8b1-48c1-b181-55a2b49709f3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.509044 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-5cfb0520-9048-4970-91ec-b12938058f05 req-80da1014-c8b1-48c1-b181-55a2b49709f3 service nova] Creating event network-changed:260b3b15-2247-492d-a81b-76fcd0560b04 for instance f92c9979-bb48-46e5-995a-43f8b494d3c6 on n-h1-764486-11 Jul 20 04:18:34.522357 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-5cfb0520-9048-4970-91ec-b12938058f05 req-80da1014-c8b1-48c1-b181-55a2b49709f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085334 Jul 20 04:18:34.523141 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 568/1065] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:34.535715 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.536684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.539553 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.553626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a518ea7-2556-424f-be88-8322b1a64f5d tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.206434 Jul 20 04:18:34.554247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 498/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.558590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.559407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.560949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.561604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.627198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1334321160", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "3e927276-dddc-430b-8bdd-2a3597d05a48"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:34.674888 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-30873099-ea22-460b-931c-005abe507415 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.148807 Jul 20 04:18:34.676171 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 569/1067] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:18:34.692265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:34.697961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:34.717611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.720089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] validate_networks() for [('3e927276-dddc-430b-8bdd-2a3597d05a48', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:34.721289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.722276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.725104 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:34.951764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:34.964373 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-27d4e1bc-cbfd-4d9f-ba89-6353fbddb2ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.285158 Jul 20 04:18:34.964990 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 570/1068] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:34 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:34.976215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-d79d30b6-4e58-45b2-901c-62d36318b867 req-8ceeff23-d31b-4109-b2a6-e90253c067da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:34.995742 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-d79d30b6-4e58-45b2-901c-62d36318b867 req-8ceeff23-d31b-4109-b2a6-e90253c067da service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:34.996194 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-d79d30b6-4e58-45b2-901c-62d36318b867 req-8ceeff23-d31b-4109-b2a6-e90253c067da service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.010450 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-d79d30b6-4e58-45b2-901c-62d36318b867 req-8ceeff23-d31b-4109-b2a6-e90253c067da service nova] Creating event network-changed:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h1-764486-11 Jul 20 04:18:35.015428 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-d79d30b6-4e58-45b2-901c-62d36318b867 req-8ceeff23-d31b-4109-b2a6-e90253c067da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049300 Jul 20 04:18:35.016255 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 571/1069] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:35.133390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.134389 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.141399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.142079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.143320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.143907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.299022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.309686 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-69a84375-84fb-4394-8aeb-c4be8a1b97ae tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.182025 Jul 20 04:18:35.317318 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 572/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.326802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.327670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.334855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.335533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.336570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.337160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.489790 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.503053 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-17408f88-01d9-43d5-adad-87e36e2882b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.184304 Jul 20 04:18:35.504690 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 573/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.511746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.512424 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.521371 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.522077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.523013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.523630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.587181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:35.720787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.730787 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-82bb914a-90f7-4d02-9f1f-51a441eadf3c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.224828 Jul 20 04:18:35.731446 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 574/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.737052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.737907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.744766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:35.747182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.747863 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.749014 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.749665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.824830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:35.835465 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-73037176-69c3-4570-bcc6-33daa3320a3a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1273 microversion: 2.1 time: 0.102806 Jul 20 04:18:35.836757 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 575/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:35.842536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:35.843341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:35.851872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.852671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:35.853619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:35.855020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.011059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:36.011629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:36.011962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:36.012502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:36.012796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:36.030302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.030746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.031546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.031976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.046032 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.058132 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9e5e822b-8fba-49aa-985e-bae8c7b8bdc5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.219393 Jul 20 04:18:36.070368 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 576/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:35 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.072737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for project 57523abec2014cbda05b179e7b9ed761. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:36.075622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.077009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.085795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.086296 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.087179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.087581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for user 72d4d8f374fd472c9214bc3b5d9fcc3b and project 57523abec2014cbda05b179e7b9ed761. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:36.088332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.112323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:36.116893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:36.200628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-733e4583-ba80-44f3-86b8-b76d2379b7e0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644252 Jul 20 04:18:36.204133 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 499/1075] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:36.225445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a8fb58c-f195-4ff9-a00e-1d938dcdbceb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.228052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a8fb58c-f195-4ff9-a00e-1d938dcdbceb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.380272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a8fb58c-f195-4ff9-a00e-1d938dcdbceb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.395965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a8fb58c-f195-4ff9-a00e-1d938dcdbceb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1225 microversion: 2.1 time: 0.183588 Jul 20 04:18:36.403098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 500/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.407868 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.417083 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-635a771d-390d-4205-befa-e4a9b0a96f6c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.345458 Jul 20 04:18:36.422336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.423721 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 577/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.424864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.438869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.441190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.442911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.443503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.523858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.524695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.537336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.543676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.545136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.545733 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.882151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:36.892814 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffb49486-f507-4afa-9ae2-4f7c3188e1e4 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.487596 Jul 20 04:18:36.894154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 501/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:36.903088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:36.910544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:36.931677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.934806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:36.936091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:36.937706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.433973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.445978 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b1aae8b-3719-40c0-ac19-011cdb742c85 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.549921 Jul 20 04:18:37.446973 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 502/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.453886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.454790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.464738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.465601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.467926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.468570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.469466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.485068 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7c632523-1d24-4010-ac4d-4a8d7d02d3b0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.966891 Jul 20 04:18:37.506478 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 578/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:36 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:37.512798 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.514317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.522862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.523509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.524500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.525111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.648225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.659331 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ce7152e-9f10-4ad3-928e-13dcf315e29c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1273 microversion: 2.1 time: 0.210143 Jul 20 04:18:37.668771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 503/1081] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.668771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5559139f-215d-4402-909a-291a7dedae20 req-499ed9aa-4b40-49a7-8074-1a8b6c0fe918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f", "name": "network-vif-plugged", "status": "completed", "tag": "fb6220a9-6849-48c0-a1c5-316a5e11dac0"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:37.679773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5559139f-215d-4402-909a-291a7dedae20 req-499ed9aa-4b40-49a7-8074-1a8b6c0fe918 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.684853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5559139f-215d-4402-909a-291a7dedae20 req-499ed9aa-4b40-49a7-8074-1a8b6c0fe918 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.686403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.696488 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cc077b3d-d0f6-4654-a196-d271250ce910 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.187301 Jul 20 04:18:37.697411 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 579/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.703865 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5559139f-215d-4402-909a-291a7dedae20 req-499ed9aa-4b40-49a7-8074-1a8b6c0fe918 service nova] Creating event network-vif-plugged:fb6220a9-6849-48c0-a1c5-316a5e11dac0 for instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f on n-h2-764486-11 Jul 20 04:18:37.710760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5559139f-215d-4402-909a-291a7dedae20 req-499ed9aa-4b40-49a7-8074-1a8b6c0fe918 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048423 Jul 20 04:18:37.710971 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.711758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.712859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 504/1083] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:37.719446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:37.720298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:37.723233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.723680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.726736 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.727190 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.758733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.759968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.761081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:37.762162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:37.949747 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:37.970014 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3b26cc9d-db4b-494c-9803-2392befc6539 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1277 microversion: 2.1 time: 0.271487 Jul 20 04:18:37.970595 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 580/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:37.976017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-13157de8-a6a8-4eb1-b8f8-2d926b696703 req-3cbe4876-f07e-46ce-af7c-175f84a34245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:38.012143 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-13157de8-a6a8-4eb1-b8f8-2d926b696703 req-3cbe4876-f07e-46ce-af7c-175f84a34245 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.012635 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-13157de8-a6a8-4eb1-b8f8-2d926b696703 req-3cbe4876-f07e-46ce-af7c-175f84a34245 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.041408 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-13157de8-a6a8-4eb1-b8f8-2d926b696703 req-3cbe4876-f07e-46ce-af7c-175f84a34245 service nova] Creating event network-changed:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h1-764486-11 Jul 20 04:18:38.064082 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-13157de8-a6a8-4eb1-b8f8-2d926b696703 req-3cbe4876-f07e-46ce-af7c-175f84a34245 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092234 Jul 20 04:18:38.067032 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 581/1085] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:38.073437 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.074407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.084244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.084990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.085946 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.086589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.634599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.644052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7f7ff0b-1867-4d6d-bf84-2bfc61b2ebd7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.929598 Jul 20 04:18:38.657273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 505/1086] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:37 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:38.662632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.663595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.679428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.682423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.683600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.684254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.774754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:38.784187 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-10b354a9-7f44-4d14-ade4-17df33e7e273 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.715590 Jul 20 04:18:38.791917 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 582/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:38.806628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:38.810452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:38.837953 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.838701 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:38.839703 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:38.840385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.014677 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.031881 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0403c940-91a9-4417-a3c8-280e72bbed13 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.238478 Jul 20 04:18:39.032748 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 583/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.039486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.040101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.046408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.047088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.048053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.048516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.074572 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:39.197349 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.207407 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d061680e-d873-4e38-ba54-507dbad4fb7a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.173228 Jul 20 04:18:39.208181 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 584/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.227164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.227801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.239786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.240888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.242293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.242753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.368939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.378777 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f744c05-d5ce-4849-9c01-4f1e716ffbfa tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1393 microversion: 2.1 time: 0.720250 Jul 20 04:18:39.380931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 506/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:38 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1393 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.386705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.387517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.396502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.397942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.398930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.399521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.433649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.448622 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-95282962-b2ad-49a5-b990-75c5ec99fea5 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.238579 Jul 20 04:18:39.449913 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 585/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.661675 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.662630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.670130 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.670755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.671665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.672254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.814172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.847390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b294d89-9c15-4f12-96c7-cd0638e88629 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1283 microversion: 2.1 time: 0.464833 Jul 20 04:18:39.847996 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 507/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1283 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:39.860449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:39.860953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-84b1ae78-78f2-4f5b-a9b1-404058434a9b req-d8c0bcc0-a397-434a-999d-6e2e5527ae6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332744-15ed-4c1d-a460-29ba2333b395", "name": "network-vif-plugged", "status": "completed", "tag": "9b43c2ce-2d84-4861-90b7-c462b3f6c949"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:39.869921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-84b1ae78-78f2-4f5b-a9b1-404058434a9b req-d8c0bcc0-a397-434a-999d-6e2e5527ae6e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.870880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-84b1ae78-78f2-4f5b-a9b1-404058434a9b req-d8c0bcc0-a397-434a-999d-6e2e5527ae6e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.873995 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e7b2974e-bfef-4a94-9e23-b01ce110f675 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.216248 Jul 20 04:18:39.874582 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 586/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:39.885509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:39.888147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:39.893513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-84b1ae78-78f2-4f5b-a9b1-404058434a9b req-d8c0bcc0-a397-434a-999d-6e2e5527ae6e service nova] Creating event network-vif-plugged:9b43c2ce-2d84-4861-90b7-c462b3f6c949 for instance a0332744-15ed-4c1d-a460-29ba2333b395 on n-h1-764486-11 Jul 20 04:18:39.900501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.901136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.902083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:39.903253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:39.906788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-84b1ae78-78f2-4f5b-a9b1-404058434a9b req-d8c0bcc0-a397-434a-999d-6e2e5527ae6e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057552 Jul 20 04:18:39.910472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 508/1094] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:40.053405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.054931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.070603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.071676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.072816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.073362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.147101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.161808 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8b23b104-17f1-4136-8e79-969fc08ae58e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.285498 Jul 20 04:18:40.163353 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 587/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:39 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.226514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.227557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.246472 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.248067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.249303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.251053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.466523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.478568 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bf4dd59f-b89a-4a58-929c-4cf0346863ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.257243 Jul 20 04:18:40.490743 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 588/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.497154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.497987 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.505772 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.506445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.507375 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.508542 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.549922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.575654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e12743c1-d0de-413b-98e3-dba840a86468 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.523626 Jul 20 04:18:40.589777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 509/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.604834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.607472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.623605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.624053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.628275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.631293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.684509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:40.696671 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-60983801-f889-4b74-b295-ac491d40531c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1573 microversion: 2.1 time: 0.203422 Jul 20 04:18:40.697497 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 589/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:40.713667 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.714399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.723115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.723822 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.724829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.725426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.846891 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a6978e79-4164-4a2b-b7cb-ba24ed8cdeb6 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136872 Jul 20 04:18:40.848071 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 590/1099] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:40.859849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-88de9c12-2800-41ec-9b2e-d6d4958cb165 req-60b452ab-f5ee-4726-98f3-bc6ec059ba25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80919433-b6b3-4076-8757-c53e3e17e3ba", "tag": "333c4a8d-e869-438a-bd48-60a60aca7cae"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:40.891107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-88de9c12-2800-41ec-9b2e-d6d4958cb165 req-60b452ab-f5ee-4726-98f3-bc6ec059ba25 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.895809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-88de9c12-2800-41ec-9b2e-d6d4958cb165 req-60b452ab-f5ee-4726-98f3-bc6ec059ba25 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.933288 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-88de9c12-2800-41ec-9b2e-d6d4958cb165 req-60b452ab-f5ee-4726-98f3-bc6ec059ba25 service nova] Creating event network-changed:333c4a8d-e869-438a-bd48-60a60aca7cae for instance 80919433-b6b3-4076-8757-c53e3e17e3ba on n-h2-764486-11 Jul 20 04:18:40.944643 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-88de9c12-2800-41ec-9b2e-d6d4958cb165 req-60b452ab-f5ee-4726-98f3-bc6ec059ba25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088187 Jul 20 04:18:40.946279 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 591/1100] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:40.961549 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:40.962347 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:40.980927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.981344 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:40.991245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:40.991245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.295079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.314796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-971eaa15-2e21-412d-9fa9-9f4cfb6b0633 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1320 microversion: 2.1 time: 0.723736 Jul 20 04:18:41.316678 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 510/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1320 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.328023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.332826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.342590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.345412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.347779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.349091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.393322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:41.493402 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.508598 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0378c137-0a32-4c73-b055-3d8f2a7ccc20 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.559802 Jul 20 04:18:41.522133 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 592/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:40 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.528278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.529580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.538109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.538860 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.540144 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.540830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.718659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.738756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc43d47e-f16d-426c-86aa-f28fc08d2564 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.420119 Jul 20 04:18:41.739358 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 511/1103] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.744036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.744688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.787097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.787547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.788439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.789025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.940020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:41.948265 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b2b2a1b7-da53-4891-b5b4-07e06d447d71 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.424480 Jul 20 04:18:41.949412 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 593/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:41.954649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:41.955437 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:41.964753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.965750 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:41.966681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:41.967269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.048179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.057884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40521488-a269-4337-9598-6e9ca1c5fc4a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.317338 Jul 20 04:18:42.068563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 512/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.074366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b061b4a4-b5d5-4db2-9994-049f5757b04b req-4acd9a42-5fa1-498e-8c8d-63adf2179d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c9979-bb48-46e5-995a-43f8b494d3c6", "name": "network-vif-plugged", "status": "completed", "tag": "260b3b15-2247-492d-a81b-76fcd0560b04"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:42.084799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b061b4a4-b5d5-4db2-9994-049f5757b04b req-4acd9a42-5fa1-498e-8c8d-63adf2179d5b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.085722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b061b4a4-b5d5-4db2-9994-049f5757b04b req-4acd9a42-5fa1-498e-8c8d-63adf2179d5b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.100157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b061b4a4-b5d5-4db2-9994-049f5757b04b req-4acd9a42-5fa1-498e-8c8d-63adf2179d5b service nova] Creating event network-vif-plugged:260b3b15-2247-492d-a81b-76fcd0560b04 for instance f92c9979-bb48-46e5-995a-43f8b494d3c6 on n-h1-764486-11 Jul 20 04:18:42.106301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b061b4a4-b5d5-4db2-9994-049f5757b04b req-4acd9a42-5fa1-498e-8c8d-63adf2179d5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Jul 20 04:18:42.111548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 513/1106] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:42.334016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.334723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.341845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.342486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.343483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.344115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.344642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.361920 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e4580369-a095-4b5a-b21e-2649923c7183 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.411056 Jul 20 04:18:42.364230 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 594/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:41 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.443198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.444317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.454590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.455402 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.456343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.457035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.623514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.632956 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c714004b-0e08-4afb-80be-31f94a198c6c tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1573 microversion: 2.1 time: 0.195024 Jul 20 04:18:42.633879 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 595/1108] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1573 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.640321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-4ba18a48-3fa0-4486-9c1f-3b2316e1551a req-7b200050-23fb-487f-bdff-b4ceb7e48373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f", "tag": "fb6220a9-6849-48c0-a1c5-316a5e11dac0"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:42.651222 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-4ba18a48-3fa0-4486-9c1f-3b2316e1551a req-7b200050-23fb-487f-bdff-b4ceb7e48373 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.651784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-4ba18a48-3fa0-4486-9c1f-3b2316e1551a req-7b200050-23fb-487f-bdff-b4ceb7e48373 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.663919 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-4ba18a48-3fa0-4486-9c1f-3b2316e1551a req-7b200050-23fb-487f-bdff-b4ceb7e48373 service nova] Creating event network-changed:fb6220a9-6849-48c0-a1c5-316a5e11dac0 for instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f on n-h2-764486-11 Jul 20 04:18:42.671136 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-4ba18a48-3fa0-4486-9c1f-3b2316e1551a req-7b200050-23fb-487f-bdff-b4ceb7e48373 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034317 Jul 20 04:18:42.672603 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 596/1109] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:42.680164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.680381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.681465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.688925 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.689452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.690370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.691865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.697192 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea0f39d6-0631-41a1-a93a-49fdab7b54dc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1469 microversion: 2.1 time: 0.367480 Jul 20 04:18:42.700652 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 514/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.812997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.813753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.830303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.831257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.832864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.833546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.881347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:18:42.933875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:42.944667 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-44d4c041-6223-492b-943d-61823a2b6284 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.270534 Jul 20 04:18:42.946242 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 597/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:42.953205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:42.954131 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:42.964552 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.965593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:42.966676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:42.967341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.030520 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05bfa78d-2457-4682-928f-a117f672c354 tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 204 len: 0 microversion: 2.1 time: 0.318318 Jul 20 04:18:43.041451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 515/1112] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:18:42 2022] DELETE /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:18:43.047028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.047727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.054563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.055054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.056794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.056794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.161098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.169975 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cb07ff61-924b-4456-ae81-96b8d8d49b27 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.222224 Jul 20 04:18:43.170893 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 598/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:42 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.176047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-3ad708d9-9179-4707-8686-ec08fb554f4a req-ec51af11-fd99-4e03-b473-cf24f86d794c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cb9a9f-a388-448f-93d7-8be7b3e20a48", "tag": "ffa132ec-a579-4f79-9d47-d4a1bfebab18"}, {"server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "name": "network-vif-unplugged", "status": "completed", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:43.187410 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3ad708d9-9179-4707-8686-ec08fb554f4a req-ec51af11-fd99-4e03-b473-cf24f86d794c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.187999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3ad708d9-9179-4707-8686-ec08fb554f4a req-ec51af11-fd99-4e03-b473-cf24f86d794c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.205637 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3ad708d9-9179-4707-8686-ec08fb554f4a req-ec51af11-fd99-4e03-b473-cf24f86d794c service nova] Creating event network-changed:ffa132ec-a579-4f79-9d47-d4a1bfebab18 for instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 on n-h1-764486-11 Jul 20 04:18:43.206242 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3ad708d9-9179-4707-8686-ec08fb554f4a req-ec51af11-fd99-4e03-b473-cf24f86d794c service nova] Creating event network-vif-unplugged:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h1-764486-11 Jul 20 04:18:43.214124 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-3ad708d9-9179-4707-8686-ec08fb554f4a req-ec51af11-fd99-4e03-b473-cf24f86d794c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.042015 Jul 20 04:18:43.215656 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 599/1114] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:43.221389 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.222201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.230323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.230769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.231534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.231967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.395209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.408267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c425b8d-36d6-4e3c-ac26-760f0d73d47b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.361145 Jul 20 04:18:43.408980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 516/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.417519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.422581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.433947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.434400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.435180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.435611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.456117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.469880 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-60212946-9ffe-431a-84de-a87e2ac8ec2f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1475 microversion: 2.1 time: 0.252561 Jul 20 04:18:43.482501 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 600/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1475 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.496086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.496742 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.506617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.507360 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.508323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.508995 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.678049 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:43.686846 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0ad37985-7390-4e99-9fc9-8e9fae2dce74 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.202963 Jul 20 04:18:43.687638 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 601/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:43.963132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:43.964450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:43.974989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.975628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:43.976558 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:43.977098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.113002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.120654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-17883871-28ed-4d60-86be-49b17a894e2a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.162214 Jul 20 04:18:44.121238 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 602/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:44.187287 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.187986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.189364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.194954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.195507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.196377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.196823 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.197352 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea88a926-4263-4885-a09c-9c0fc2ce468e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.784770 Jul 20 04:18:44.197970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 517/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:43 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:44.216149 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:44.327403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.335963 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3584757d-b89e-4941-8272-5a5fe9a2812c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.152766 Jul 20 04:18:44.336804 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 603/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:44.426825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.427447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.438226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.438873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.439990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.441251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.487241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.488294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.490452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=24 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:44.497603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.498068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.500392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.500392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.660078 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.668877 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ed3c5164-fc42-494c-a030-980277d599bc tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1475 microversion: 2.1 time: 0.185369 Jul 20 04:18:44.673041 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 604/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:44.704754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:44.705372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:44.711910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.712388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.713173 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:44.713616 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:44.760569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.784662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d96cc25-1bb2-4982-82f0-03ae51398a69 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1316 microversion: 2.1 time: 0.356811 Jul 20 04:18:44.785666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 518/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:44.948461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:44.957225 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a0ba0059-c376-4f5d-9418-ca9a82808eff tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.256467 Jul 20 04:18:44.965592 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 605/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:44 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.138551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.139789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.148802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.150448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.152908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.153529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.215337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.215970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.226003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.226537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.227433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.227945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.428806 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.438734 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-98d41b7d-533d-4865-9b7d-3abd98c8e3e9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.227184 Jul 20 04:18:45.441619 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 606/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.452121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.453251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.456831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.462303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.463290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.464739 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.465349 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.469307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-64d12bfb-a18a-42c9-b502-a210967bd0de tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.334035 Jul 20 04:18:45.479431 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 519/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.686812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.687799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.695716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.696179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.697145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.697793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.775156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.790251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7a8a433-a7d7-4f9b-b947-e4c37b4378e1 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1433 microversion: 2.1 time: 0.107577 Jul 20 04:18:45.791717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 520/1126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1433 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:45.810733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:45.812126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:45.821479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:45.825098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.825933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.826980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:45.827736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:45.983460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:45.992706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-372f11c9-f2a0-4c51-940a-7a133d8358df tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1466 microversion: 2.1 time: 0.194373 Jul 20 04:18:45.993372 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 521/1127] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1466 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:45.998113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dd5e1eaa-9d24-472b-9712-776b138330dc req-c1203f5e-e6ab-437f-83a2-a7d65fa3bc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332744-15ed-4c1d-a460-29ba2333b395", "name": "network-vif-deleted", "tag": "9b43c2ce-2d84-4861-90b7-c462b3f6c949"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:46.000000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.006477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd5e1eaa-9d24-472b-9712-776b138330dc req-c1203f5e-e6ab-437f-83a2-a7d65fa3bc90 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.006996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd5e1eaa-9d24-472b-9712-776b138330dc req-c1203f5e-e6ab-437f-83a2-a7d65fa3bc90 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.009352 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c92e6179-8516-430c-9005-e94dcdffea3f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.563242 Jul 20 04:18:46.010145 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 607/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:45 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.014942 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.015557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.019982 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dd5e1eaa-9d24-472b-9712-776b138330dc req-c1203f5e-e6ab-437f-83a2-a7d65fa3bc90 service nova] Creating event network-vif-deleted:9b43c2ce-2d84-4861-90b7-c462b3f6c949 for instance a0332744-15ed-4c1d-a460-29ba2333b395 on n-h1-764486-11 Jul 20 04:18:46.021996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.022448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.023228 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.023670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.025381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dd5e1eaa-9d24-472b-9712-776b138330dc req-c1203f5e-e6ab-437f-83a2-a7d65fa3bc90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030844 Jul 20 04:18:46.026329 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 522/1129] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:46.035088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.035952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.043776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.044280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.045141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.045644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.063215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:46.157521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.166903 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f84e6ee8-d43e-4c52-8805-782663a92d44 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1714 microversion: 2.1 time: 0.155448 Jul 20 04:18:46.167703 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 608/1130] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.179564 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7466c5f7-140d-479f-b427-e1d12775fd0a tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1619 microversion: 2.1 time: 0.149253 Jul 20 04:18:46.180386 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 523/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1619 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.236902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1526680699", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "933fbdd2-8589-43a1-a99a-8f22c47fcb69"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:46.289076 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:46.459030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.459717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.462911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=16 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:46.466790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.467451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.468448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.469624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.611532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:46.613515 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:46.614224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:46.614872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:46.615461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:46.629465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.630028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.631095 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.632377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.634829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.642197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04262144-66c6-42a1-b74a-e91ed820625c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.187965 Jul 20 04:18:46.642772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 524/1132] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:46.651903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.653675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.658948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:46.661766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.662217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.663046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.663477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.666555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Getting quotas for user bd93bfda90414060a4d3a2f8a0d53115 and project d42cb2cc3e3e40b89c2ab0ba9bb4dc08. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:46.680214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:46.683324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:46.730508 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6d05a6ff-7bc7-47a2-850a-2f6e44d4cc33 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497238 Jul 20 04:18:46.731733 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 609/1133] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:18:46.741696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-8c5eefef-d55e-431f-838b-9286aff85484 req-2cd90bf6-93a3-4d53-b474-863997ac5106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80919433-b6b3-4076-8757-c53e3e17e3ba", "name": "network-vif-plugged", "status": "completed", "tag": "333c4a8d-e869-438a-bd48-60a60aca7cae"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:46.757303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8c5eefef-d55e-431f-838b-9286aff85484 req-2cd90bf6-93a3-4d53-b474-863997ac5106 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.757539 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8c5eefef-d55e-431f-838b-9286aff85484 req-2cd90bf6-93a3-4d53-b474-863997ac5106 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.781550 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-8c5eefef-d55e-431f-838b-9286aff85484 req-2cd90bf6-93a3-4d53-b474-863997ac5106 service nova] Creating event network-vif-plugged:333c4a8d-e869-438a-bd48-60a60aca7cae for instance 80919433-b6b3-4076-8757-c53e3e17e3ba on n-h2-764486-11 Jul 20 04:18:46.786783 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-8c5eefef-d55e-431f-838b-9286aff85484 req-2cd90bf6-93a3-4d53-b474-863997ac5106 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049554 Jul 20 04:18:46.787731 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 610/1134] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:46.793934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-223b68f7-0b6b-495f-ae8c-d1295df01160 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.794633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-223b68f7-0b6b-495f-ae8c-d1295df01160 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.803961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.812180 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf3566d9-c83c-4ef4-9af6-04b46559118a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.167393 Jul 20 04:18:46.813407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 525/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.818947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:46.819823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:46.826630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.827179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.828329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:46.829020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:46.870326 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-223b68f7-0b6b-495f-ae8c-d1295df01160 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.880623 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-223b68f7-0b6b-495f-ae8c-d1295df01160 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1217 microversion: 2.1 time: 0.091605 Jul 20 04:18:46.881558 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 611/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:46.905327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:46.923467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a90ff3d0-363b-40d5-b44d-f6472d182e6f tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 200 len: 1433 microversion: 2.1 time: 0.108743 Jul 20 04:18:46.925877 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 526/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:46 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 1433 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.030505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.031236 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.038223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.038914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.039857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.041556 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.183582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.184449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.188062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.191998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.192670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.193649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.194261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.198013 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4617e2ea-d7df-499c-9956-a63a3538f124 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.174315 Jul 20 04:18:47.210341 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 612/1138] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:47.329814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.333631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:47.341784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-965504e1-5ca4-472b-823b-012956a52b18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1704 microversion: 2.1 time: 0.162443 Jul 20 04:18:47.342902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 527/1139] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1704 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:47.359972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-76c4c411-6819-4979-9428-b0451aea07d1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '.version_select at 0x7f838bcccf70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.364126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-76c4c411-6819-4979-9428-b0451aea07d1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.364914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-76c4c411-6819-4979-9428-b0451aea07d1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.377661 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-76c4c411-6819-4979-9428-b0451aea07d1 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 3145 microversion: 2.1 time: 0.021505 Jul 20 04:18:47.378429 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 613/1140] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/os-migrations => generated 3145 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.391060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.392196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.400278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.401081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.401930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.402431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.552992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2c5474a-0d28-4c59-9a5a-5e3743312194 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1857 microversion: 2.1 time: 0.165683 Jul 20 04:18:47.553610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 528/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1857 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.569670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.570283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.577105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.577813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.578586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.579005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.658827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.659564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.665610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.666125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.666962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.667510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.710804 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-07cc0df3-a818-4c12-b579-a2f0b92f28c3 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1857 microversion: 2.1 time: 0.145522 Jul 20 04:18:47.711394 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 614/1142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1857 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:47.788882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.789277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.795935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.796560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.797809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.798499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.915557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:47.923566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5a15d72-051c-4826-9312-80c798e6e0e8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1315 microversion: 2.1 time: 0.268383 Jul 20 04:18:47.924265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 529/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:47.929133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:47.929904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:47.938371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.938987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.939937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:47.940605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:47.973494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lazy-loading 'services' on Instance uuid 24a4b61b-c809-46e8-b128-1fcf432a32df {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:18:48.075096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.083728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-915db6e4-5053-4343-aff1-3699aacce756 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.158689 Jul 20 04:18:48.084291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 530/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:47 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.089353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.089954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.096301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.096651 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-67eca316-d982-46d2-ae0b-7afaacb241b6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments/1ac69bcd-1142-4f96-97c4-e2c5153c5504" status: 202 len: 0 microversion: 2.1 time: 0.311885 Jul 20 04:18:48.097119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.097458 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 615/1145] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:18:47 2022] DELETE /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments/1ac69bcd-1142-4f96-97c4-e2c5153c5504 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:18:48.100876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.101345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.103022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.103758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.110691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.111146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.111924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.112415 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.127408 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] HTTP exception thrown: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Request method failure captured: Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 HTTP/1.1 Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IG3lNSQCRVIv857kQhjxlGUOvCA39QXWl2ufdsdkRBZrh8y5PsaONGtb4gYpgl9LGavx6Yw1rHeG8NNyKdieYprPG3X7j8kwEoGbbyVsu1jZV-06lsWDu6lJgf_odfZdsCIOc28i1dRmfn-cmK209GMdmYTfb5OYccuif3GoGphOU Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:18:48.130128 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_693b27c3cf8c4218a9eb4f96ebbd76b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 66da09d3f8a443458578128cea7a23b6 Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:18:48.131820 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'a0332744-15ed-4c1d-a460-29ba2333b395'} Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:48.133301 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:18:48.134708 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:48.135972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Returning 404 to user: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:48.135972 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-34bfe2e8-48c8-40a4-8faa-adcba883959a tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 404 len: 111 microversion: 2.1 time: 0.032846 Jul 20 04:18:48.135972 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 616/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:18:48.166809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.168041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.186246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.188210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.189078 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.191376 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.234433 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c2ff8fdb-b521-44ce-b26c-464bb8053529 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097896 Jul 20 04:18:48.235317 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 617/1147] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:48.240638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1316738649", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:48.248811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.254158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:48.257186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e942a465-d0b7-4bc2-8eb1-8b10c800ac49 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1269 microversion: 2.1 time: 0.171805 Jul 20 04:18:48.257859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 531/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.264035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.264620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.271719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.272443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.273548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.282470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.320689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:18:48.429842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.437764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea5c833c-23ae-474a-8232-9f40e6a3c7c2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.178946 Jul 20 04:18:48.438346 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 532/1149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.512650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:18:48.513077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:18:48.513551 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:18:48.513962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:18:48.514396 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:18:48.523815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.524260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.525174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.525615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.542562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Getting quotas for project 693b27c3cf8c4218a9eb4f96ebbd76b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:18:48.547784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Getting quotas for user 66da09d3f8a443458578128cea7a23b6 and project 693b27c3cf8c4218a9eb4f96ebbd76b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:18:48.562396 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:18:48.564906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:18:48.608284 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b0d2ea53-c8f5-41c6-8919-70e53265a194 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.371801 Jul 20 04:18:48.609143 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 618/1150] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:18:48.619503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bcf8bb64-d7c2-450a-8ce9-e6234956f564 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.620198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bcf8bb64-d7c2-450a-8ce9-e6234956f564 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.671939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bcf8bb64-d7c2-450a-8ce9-e6234956f564 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:48.679350 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bcf8bb64-d7c2-450a-8ce9-e6234956f564 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1220 microversion: 2.1 time: 0.063671 Jul 20 04:18:48.680156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 533/1151] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1220 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:48.941237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:48.941851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:48.947932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.948412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:48.949190 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:48.949621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.091890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.103346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.104277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.113557 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-50000149-a72b-451c-b40b-fec4b4f62442 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1502 microversion: 2.1 time: 0.176674 Jul 20 04:18:49.115011 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 619/1152] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:48 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.117830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.118287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.119100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.119532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.250803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.252107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.266746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.269214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.270535 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.270982 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.272117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.282473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b562fc8-68b9-4eeb-a7c3-4bc6e489f951 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.184408 Jul 20 04:18:49.283963 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 534/1153] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.291147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.292397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.301760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.302501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.303498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.304034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.317931 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-01caedec-a26a-4df3-89ed-9e79f2d4c32c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074429 Jul 20 04:18:49.318875 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 620/1154] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:49.371666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.379679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7846c7da-ef5e-4c02-8a5a-00b37600dc47 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1287 microversion: 2.1 time: 0.093776 Jul 20 04:18:49.380322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 535/1155] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.455439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.457081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.463865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.464397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.465182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.465685 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.600257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.608892 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8fa97204-8648-4a01-a6cd-2ab36e309f82 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.157646 Jul 20 04:18:49.609474 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 621/1156] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:49.697752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:49.698415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:49.706889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.707606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.708618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:49.709252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:49.854341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:49.868057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a1ea5b5-6a6d-4337-a5a0-bdbeb264a095 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1280 microversion: 2.1 time: 0.174739 Jul 20 04:18:49.869940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 536/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:49 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.308487 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.309189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.317633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.318584 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.319564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.320161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.331823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.333179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.340896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.341613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.342636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.343235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.388790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-127f36cf-ac3c-46d0-967c-0b22bf831276 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062453 Jul 20 04:18:50.401213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 537/1158] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:50.412224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.412918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.432695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.433271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.434682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.435135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.674148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.685616 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-af94f2d5-5204-4fd3-811b-bba71f3280c2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.388904 Jul 20 04:18:50.688697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:50.689761 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 622/1159] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.699011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37378f83-8822-45f7-b979-25fa03b0465d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.290602 Jul 20 04:18:50.699467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "280bc88a-55a8-46f9-b2e8-126aaeac37c4"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:50.709967 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 538/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:50.711323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.716070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:50.717065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:50.730786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.732715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.733524 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.734160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.734831 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.734958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:50.735373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.740890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:50.895465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:51.028774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.040176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6bc8bb22-efb8-409a-815e-9f1f33f87f2b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.328315 Jul 20 04:18:51.051520 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 539/1161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:50 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.056689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.057448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.064636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.065256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.066139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.066666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.381482 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-124a293b-dd6a-45fe-9a1e-019870fe1b59 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688498 Jul 20 04:18:51.406915 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 623/1162] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:18:50 2022] POST /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:51.430730 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.432505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.447965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.451744 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.453388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.454861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.484390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:51.510063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48b5bf5c-028b-4acc-a196-a5fe13f0a6d0 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.456231 Jul 20 04:18:51.513032 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 540/1163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:51.552466 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-44aff303-a7ab-4b4c-bf87-8a294c2cb6c9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141744 Jul 20 04:18:51.556260 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 624/1164] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:51.707843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.711269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.715617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:51.716317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:51.728625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.733816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.734621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.736314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.741068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.752427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:51.756758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:51.757468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.120630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.135746 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6a9b841a-58dd-402f-ac4c-05f609d82251 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.423796 Jul 20 04:18:52.136318 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 625/1165] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:52.161205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.163084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.180180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.180652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.181436 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.191248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.333944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.345171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-318b1d8f-44e1-4c41-8b80-3bcdafdc2040 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.644932 Jul 20 04:18:52.345971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 541/1166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:51 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.370408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ea2ecd6e-fef0-40d2-beb8-ae432e4b9688 req-bb115f3c-e0c7-4f0c-a4fd-f35059a167fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662d6ca6-f3da-4c86-94d7-62822d1428b6", "tag": "ff26d5b8-94f1-4abb-86b8-9cea60f6ecce"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:52.388523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ea2ecd6e-fef0-40d2-beb8-ae432e4b9688 req-bb115f3c-e0c7-4f0c-a4fd-f35059a167fc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.388974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ea2ecd6e-fef0-40d2-beb8-ae432e4b9688 req-bb115f3c-e0c7-4f0c-a4fd-f35059a167fc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.424274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ea2ecd6e-fef0-40d2-beb8-ae432e4b9688 req-bb115f3c-e0c7-4f0c-a4fd-f35059a167fc service nova] Creating event network-changed:ff26d5b8-94f1-4abb-86b8-9cea60f6ecce for instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 on n-h2-764486-11 Jul 20 04:18:52.436438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ea2ecd6e-fef0-40d2-beb8-ae432e4b9688 req-bb115f3c-e0c7-4f0c-a4fd-f35059a167fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072762 Jul 20 04:18:52.437078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 542/1167] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:52.530309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.531419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.543993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.553043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.554207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.554820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.662351 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.671592 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d061abe1-305b-4145-ad18-a4f9994d5e95 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.522388 Jul 20 04:18:52.684757 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 626/1168] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:52.691510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:52.696722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:52.705451 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.706258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.707214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:52.707798 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:52.750190 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8f42107e-4a7a-42f4-bb9f-8584bd475f5f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063332 Jul 20 04:18:52.754162 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 627/1169] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:52.918406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:52.934025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4c394aa-351c-4f21-a4ed-0543aeed94bf tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.407975 Jul 20 04:18:52.934988 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 543/1170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:52 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:53.155087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.156340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.165905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.166354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.167462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.167900 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.270929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c74357a0-cd14-4bdb-bcb6-112929db899f req-ca210e23-3b51-4e4b-b505-c437213e46ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b16dec-ac36-4cd6-8059-b54b6266ff74", "tag": "6418e221-7584-49c9-9158-8ca457d4b7ff"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:53.288383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c74357a0-cd14-4bdb-bcb6-112929db899f req-ca210e23-3b51-4e4b-b505-c437213e46ec service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.288902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c74357a0-cd14-4bdb-bcb6-112929db899f req-ca210e23-3b51-4e4b-b505-c437213e46ec service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.311331 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c74357a0-cd14-4bdb-bcb6-112929db899f req-ca210e23-3b51-4e4b-b505-c437213e46ec service nova] Creating event network-changed:6418e221-7584-49c9-9158-8ca457d4b7ff for instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 on n-h1-764486-11 Jul 20 04:18:53.316861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c74357a0-cd14-4bdb-bcb6-112929db899f req-ca210e23-3b51-4e4b-b505-c437213e46ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049502 Jul 20 04:18:53.318109 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 544/1171] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:53.358218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.373812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.373812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.381881 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8f802d7f-b27b-41c4-a2dc-4252e451dcce tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.232121 Jul 20 04:18:53.382498 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 628/1172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:53.383319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.384397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.385226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.385668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.611553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.626811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6747a22-a8e7-4db0-8ffa-7e97e35d9b37 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.268269 Jul 20 04:18:53.631214 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 545/1173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:53.692878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.693538 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.699832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.700188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.701192 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.701777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.760738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.762978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.771725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.772627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.774238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.774896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.814129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:53.830553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c3ead9e-b773-41b9-b9e0-25396281932b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073846 Jul 20 04:18:53.835189 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 546/1174] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:53.846129 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:53.859507 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c7ffacc2-e0d3-4b4e-9245-05f62598b38d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.171714 Jul 20 04:18:53.860198 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 629/1175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:53.951256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:53.951793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:53.958213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.958849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:53.959623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:53.960056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.089691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.097857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74d61f88-48dc-4d88-b6be-ee7cbbe02da7 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.150696 Jul 20 04:18:54.098427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 547/1176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:53 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.398699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.399309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.405881 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.406320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.407077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.407503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.539413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.546877 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2ad39d2c-3777-48f8-985a-b01720d0d98a tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.152035 Jul 20 04:18:54.547446 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 630/1177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.647541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.648332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.654915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.655362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.656126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.656583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.796789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:54.805165 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0be69a85-8111-4861-8b70-5ebd313bae6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.161775 Jul 20 04:18:54.805873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 548/1178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:54.846911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.847860 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.859886 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.860337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.861186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.861608 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.876156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:54.876799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:54.889794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.890260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.891055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:54.894681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:54.898452 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b336df05-b52f-4471-aa41-ea0228bcc950 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056759 Jul 20 04:18:54.905430 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 631/1179] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:55.046449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-319de558-49e8-4e04-b7f9-a9e075191210 req-b8c15c8e-e1ec-4f42-a1ca-8ecc6d281c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cb9a9f-a388-448f-93d7-8be7b3e20a48", "name": "network-vif-plugged", "status": "completed", "tag": "ffa132ec-a579-4f79-9d47-d4a1bfebab18"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:55.063429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-319de558-49e8-4e04-b7f9-a9e075191210 req-b8c15c8e-e1ec-4f42-a1ca-8ecc6d281c7c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.064462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-319de558-49e8-4e04-b7f9-a9e075191210 req-b8c15c8e-e1ec-4f42-a1ca-8ecc6d281c7c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.095611 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-319de558-49e8-4e04-b7f9-a9e075191210 req-b8c15c8e-e1ec-4f42-a1ca-8ecc6d281c7c service nova] Creating event network-vif-plugged:ffa132ec-a579-4f79-9d47-d4a1bfebab18 for instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 on n-h1-764486-11 Jul 20 04:18:55.103756 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-319de558-49e8-4e04-b7f9-a9e075191210 req-b8c15c8e-e1ec-4f42-a1ca-8ecc6d281c7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062309 Jul 20 04:18:55.105029 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 632/1180] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:18:55.116478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.117177 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.129665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.130121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.130924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.131359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.155806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.167603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cdaaf03-e002-4733-9307-6d79cf0f836f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.295047 Jul 20 04:18:55.171248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 549/1181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:54 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:55.296788 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.305223 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a059a27e-f71b-4244-8ab3-1a2a7fb47465 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.194193 Jul 20 04:18:55.315620 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 633/1182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:55.563746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.564385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.570804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.571189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.571968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.572432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.776473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.784818 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9323264-c936-449c-9b2f-73b20b512abf tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.225268 Jul 20 04:18:55.785556 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 550/1183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:55.822039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.822754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.831170 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.831730 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.833228 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.833772 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.912031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:55.913194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:55.919666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.920259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.921173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:55.921905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:55.961624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9a2e63e-13c7-4ecd-a41c-30f77c3cfbb7 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055241 Jul 20 04:18:55.962380 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 551/1184] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:18:55.987451 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:55.995204 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5351a102-cf89-44b6-b004-a9f86403a0f4 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1325 microversion: 2.1 time: 0.177657 Jul 20 04:18:55.995852 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 634/1185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:55 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:56.186291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.187189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.194157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.194644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.195519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.196016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.321959 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.322829 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.332015 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.332493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.333269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.333702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.390364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.399616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8fedd0b3-0ebf-4844-a7ae-01e1d139379e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.217166 Jul 20 04:18:56.402994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 552/1186] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:56.517882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:56.526955 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ace1073d-996a-46d7-82bb-44a0fb626fe8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.208705 Jul 20 04:18:56.537225 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 635/1187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:56.802493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:56.803105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:56.811491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.812111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.813959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:56.814702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:56.985804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.005526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b811fe2-0fcc-444f-ac22-8f5aceb80599 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.207246 Jul 20 04:18:57.012287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 553/1188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:56 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:57.028794 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.029989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.039479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.040429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.041392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.041826 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.229218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.241135 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e315b786-c63a-402a-9093-a822516c8f1f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.233246 Jul 20 04:18:57.243265 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 636/1189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:57.259298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.260608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.271484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.272259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.273231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.273830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.418997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.419870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.426684 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.427344 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.428307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.428926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.444989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.454061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58ca2cde-75f0-4b13-83d4-17c9ba737efb tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.198678 Jul 20 04:18:57.454648 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 554/1190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:57.472517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27c8c188-97c9-4d8d-bdaa-45a56c956a7d tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-784351093", "metadata": {"": ""}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27c8c188-97c9-4d8d-bdaa-45a56c956a7d tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action HTTP/1.1 Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 106 Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:18:57.481110 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-784351093", "metadata": {"": ""}}} Jul 20 04:18:57.482569 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-784351093', 'metadata': {'': ''}}}} Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'': ''} Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:57.483583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.485334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27c8c188-97c9-4d8d-bdaa-45a56c956a7d tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27c8c188-97c9-4d8d-bdaa-45a56c956a7d tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action" status: 400 len: 170 microversion: 2.1 time: 0.016475 Jul 20 04:18:57.488087 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 555/1191] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Jul 20 04:18:57 2022] POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action => generated 170 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:57.496479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.497106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.516857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.518172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.519223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.519837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.622186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.632090 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fa7f1bd9-f769-404c-ad55-0bda8ec49580 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1541 microversion: 2.1 time: 0.216899 Jul 20 04:18:57.633654 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 637/1192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1541 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:57.657026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.657246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.669189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.669644 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.670416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.670858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.714365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.726521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58c07455-0627-4f4d-bb9b-88a7d39276f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.236782 Jul 20 04:18:57.727997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 556/1193] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:57.753920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:57.754541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:57.763596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.764059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.765708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:57.767879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:57.975842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:57.985443 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-15a1aa9c-be14-493d-8723-f1bd69876ddb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.348667 Jul 20 04:18:57.986479 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 638/1194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:58.022711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.025670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.026689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.032326 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4861c72d-ee06-4305-b72a-c6f264aec5f9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.286667 Jul 20 04:18:58.034643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.035193 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.036064 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.036631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.044973 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 557/1195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:57 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:58.051231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13a817b1-4aea-428c-b278-6ae219612212 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1925511564", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13a817b1-4aea-428c-b278-6ae219612212 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action HTTP/1.1 Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 619 Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:18:58.054791 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:58.056872 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:18:58.057677 n-d-764486-11 devstack@n-api.service[123724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1925511564", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 20 04:18:58.057677 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:18:58.057677 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1925511564', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 04:18:58.057942 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:58.058901 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.060321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:58.061517 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:58.061517 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:58.061517 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:18:58.061517 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:18:58.061517 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:18:58.061517 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.062063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13a817b1-4aea-428c-b278-6ae219612212 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:58.062063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13a817b1-4aea-428c-b278-6ae219612212 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action" status: 400 len: 938 microversion: 2.1 time: 0.010132 Jul 20 04:18:58.062063 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 558/1196] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Jul 20 04:18:58 2022] POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action => generated 938 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:58.065832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.066447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.073323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.073873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.074557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.075024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.253123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.259167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.261432 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dbde46d5-a626-4885-a85a-4efac04064ba tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.199648 Jul 20 04:18:58.262185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 559/1197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:58.263894 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:58.268946 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a86ba97f-6e1a-4ea2-8559-cf2a6a0d1732 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.247644 Jul 20 04:18:58.270604 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 639/1198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:18:58.280100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.280734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.287995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.288723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.289933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.290535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.444783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.453361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d9e9dd7-73f9-486d-832f-bd90052cbe77 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.178401 Jul 20 04:18:58.454441 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 560/1199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:58.470001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5393e8e1-d71c-40dc-956d-03e4dd78b026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5393e8e1-d71c-40dc-956d-03e4dd78b026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action HTTP/1.1 Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 285 Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:18:58.473569 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:18:58.475210 n-d-764486-11 devstack@n-api.service[123723]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:18:58.476020 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:18:58.476721 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:18:58.478119 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:18:58.479125 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:18:58.479125 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:58.479802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5393e8e1-d71c-40dc-956d-03e4dd78b026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:58.480772 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5393e8e1-d71c-40dc-956d-03e4dd78b026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action" status: 400 len: 619 microversion: 2.1 time: 0.015133 Jul 20 04:18:58.484367 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 640/1200] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Jul 20 04:18:58 2022] POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:18:58.490909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.491547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.497706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.498141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.498910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.499344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.646639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:58.647421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=14 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:58.652837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.653455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.675957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.676403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.676988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:58.677526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.677965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.704895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:58.717415 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59d7b6a0-8b87-4eaa-b572-c4b332371dec tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.231287 Jul 20 04:18:58.736390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 561/1201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:58.758692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:58.759530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:58.773195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.777501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:58.778663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:58.779866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.063909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.068119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.072873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c5ac0d8-d023-4357-bf47-c344111a929b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.338027 Jul 20 04:18:59.074098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 562/1202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.079422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-36925bd2-be36-427b-8862-6fcfbc5d3f61 req-81844fbb-4a90-4c0c-a145-4e8ce1c2ed6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662d6ca6-f3da-4c86-94d7-62822d1428b6", "name": "network-vif-plugged", "status": "completed", "tag": "ff26d5b8-94f1-4abb-86b8-9cea60f6ecce"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:59.080069 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-53b84f19-0009-403f-9367-c0f0320f6888 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1540 microversion: 2.1 time: 0.434071 Jul 20 04:18:59.089429 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 641/1203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:58 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1540 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.089967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-36925bd2-be36-427b-8862-6fcfbc5d3f61 req-81844fbb-4a90-4c0c-a145-4e8ce1c2ed6d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.090575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-36925bd2-be36-427b-8862-6fcfbc5d3f61 req-81844fbb-4a90-4c0c-a145-4e8ce1c2ed6d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.103125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-36925bd2-be36-427b-8862-6fcfbc5d3f61 req-81844fbb-4a90-4c0c-a145-4e8ce1c2ed6d service nova] Creating event network-vif-plugged:ff26d5b8-94f1-4abb-86b8-9cea60f6ecce for instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 on n-h2-764486-11 Jul 20 04:18:59.107397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.109029 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.109290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-36925bd2-be36-427b-8862-6fcfbc5d3f61 req-81844fbb-4a90-4c0c-a145-4e8ce1c2ed6d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033598 Jul 20 04:18:59.110607 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 563/1204] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:18:59.117534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-205371329"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:59.118955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.121500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.124913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.125811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.127922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.130314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.130771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.131553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.131989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.405735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.414369 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-afb0cf20-d5e6-4a81-856e-1e406d3484e6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.323511 Jul 20 04:18:59.415299 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 642/1205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.420747 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:18:59.421536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.428334 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.429037 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.429983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.430578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.592838 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:18:59.602807 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8bd6340d-3b14-4a59-ae69-de1154ed355c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.186259 Jul 20 04:18:59.603687 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 643/1206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:18:59.612904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:18:59.628675 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d49e39b0-3711-4136-ba8a-d5f9cc279a2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action" status: 202 len: 0 microversion: 2.1 time: 0.516349 Jul 20 04:18:59.637339 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 564/1207] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:59 2022] POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:18:59.643150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1385867024"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:18:59.644558 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:18:59.661945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.662410 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.663225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:18:59.663664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:18:59.744472 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Cannot 'createImage' instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 while it is in task_state image_snapshot_pending Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action HTTP/1.1 Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 85 Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:18:59.745991 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1385867024"}} Jul 20 04:18:59.747593 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: exception: Cannot 'createImage' instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 while it is in task_state image_snapshot_pending Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1385867024'}}} Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:18:59.748435 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 while it is in task_state image_snapshot_pending Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 while it is in task_state image_snapshot_pending Jul 20 04:18:59.749948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:18:59.751368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 409 to user: Cannot 'createImage' instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 while it is in task_state image_snapshot_pending {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:18:59.751368 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3f87552e-ee9b-43f7-8980-fe4d175da028 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action" status: 409 len: 167 microversion: 2.1 time: 0.108464 Jul 20 04:18:59.751368 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 644/1208] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:18:59 2022] POST /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48/action => generated 167 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:18:59.774129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bed1932e-3512-4eb8-8b06-bda39781c097 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '.version_select at 0x7f838ba74dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.024120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bed1932e-3512-4eb8-8b06-bda39781c097 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/images/0eb71df7-1573-43c6-a025-c63358ca39e6" status: 204 len: 0 microversion: 2.1 time: 0.260618 Jul 20 04:19:00.025751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 565/1209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:18:59 2022] DELETE /compute/v2.1/images/0eb71df7-1573-43c6-a025-c63358ca39e6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:00.036154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.036877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.044795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.045485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.046419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.047002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.115280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.116146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.124594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.125416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.126358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.126959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.252779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.264923 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5297a1f0-e438-4c86-973f-0fdd002f7ea8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1535 microversion: 2.1 time: 0.234730 Jul 20 04:19:00.265917 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 645/1210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1535 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:00.318849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.327104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1363661-f542-46b0-8265-23ec6ff9068a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1472 microversion: 2.1 time: 0.221849 Jul 20 04:19:00.336442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 566/1211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:00.431130 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.431763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.438758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.439491 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.440557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.441189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.600307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.607980 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a9784570-589c-419f-848c-31c1381954f9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.180791 Jul 20 04:19:00.608579 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 646/1212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:00.621172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:00.621784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:00.628567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.629018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.630515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:00.630995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:00.771638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:00.779542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2771d701-4d89-4bf0-a0e2-ccc1bc28406c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.162728 Jul 20 04:19:00.780294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 567/1213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:00 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:01.146022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-77a7208d-bcd7-4719-a33f-3bec19976a74 req-82b53eb9-d009-44a9-912a-1381aa8e51e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b16dec-ac36-4cd6-8059-b54b6266ff74", "name": "network-vif-plugged", "status": "completed", "tag": "6418e221-7584-49c9-9158-8ca457d4b7ff"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:01.154667 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-77a7208d-bcd7-4719-a33f-3bec19976a74 req-82b53eb9-d009-44a9-912a-1381aa8e51e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.155098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-77a7208d-bcd7-4719-a33f-3bec19976a74 req-82b53eb9-d009-44a9-912a-1381aa8e51e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.166490 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-77a7208d-bcd7-4719-a33f-3bec19976a74 req-82b53eb9-d009-44a9-912a-1381aa8e51e5 service nova] Creating event network-vif-plugged:6418e221-7584-49c9-9158-8ca457d4b7ff for instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 on n-h1-764486-11 Jul 20 04:19:01.171309 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-77a7208d-bcd7-4719-a33f-3bec19976a74 req-82b53eb9-d009-44a9-912a-1381aa8e51e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028939 Jul 20 04:19:01.171879 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 647/1214] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:01.282775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.283324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.290367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.291212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.292187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.292831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.345985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.346692 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.354336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.354810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.355842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.356277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.458802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.467147 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66e489cf-c441-4fd5-9715-213cfd35dcdc tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1541 microversion: 2.1 time: 0.188423 Jul 20 04:19:01.468080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 568/1215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1541 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:01.513972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.521818 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3800b88c-16c9-4136-878b-6033148332da tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1472 microversion: 2.1 time: 0.180736 Jul 20 04:19:01.522382 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 648/1216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:01.624511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.625182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.631373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.631893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.632770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.633273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.777089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.797065 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a75d7a7e-3b34-481a-906f-7a21679b2029 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.176445 Jul 20 04:19:01.797295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:01.797825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 569/1217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:01.797966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:01.805318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.805766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.806785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:01.807221 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:01.958554 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:01.966629 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f7c44eba-361a-4438-a7b2-bbf026cd7921 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1317 microversion: 2.1 time: 0.173198 Jul 20 04:19:01.967625 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 649/1218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:01 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:02.484483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.485105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.493802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.494248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.495029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.495462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.539413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.540026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.549883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.550623 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.551737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.552366 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.671198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.681179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6f71c81-fc1b-4cb7-b281-58802ff30bd6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1541 microversion: 2.1 time: 0.200533 Jul 20 04:19:02.682281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 570/1219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:02.747809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.758925 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8a74023d-3542-4f77-991e-45073654f088 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1472 microversion: 2.1 time: 0.223541 Jul 20 04:19:02.759613 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 650/1220] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:02.815435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.816125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.822790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.823463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.824235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.824734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.988020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:02.988281 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:02.989126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:02.996264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:02.996530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87b861d8-92c0-419e-b675-966fee7f6dcb tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1320 microversion: 2.1 time: 0.185483 Jul 20 04:19:02.997311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:02.999052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 571/1221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:02.999454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.000041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.152714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.166236 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-35641cda-f77e-425c-be9a-388ef1ae2019 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1467 microversion: 2.1 time: 0.182488 Jul 20 04:19:03.167553 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 651/1222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:02 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1467 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:03.185188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.185891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.199936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-9a15ce90-70d8-445f-b097-c5abea8750f0 req-96a071b9-a0a2-4ff2-8e13-ac9c31035940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "name": "network-vif-unplugged", "status": "completed", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:03.203949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.204482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.205428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.205864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.222579 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-9a15ce90-70d8-445f-b097-c5abea8750f0 req-96a071b9-a0a2-4ff2-8e13-ac9c31035940 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.224926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-9a15ce90-70d8-445f-b097-c5abea8750f0 req-96a071b9-a0a2-4ff2-8e13-ac9c31035940 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.253414 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-9a15ce90-70d8-445f-b097-c5abea8750f0 req-96a071b9-a0a2-4ff2-8e13-ac9c31035940 service nova] Creating event network-vif-unplugged:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:19:03.275894 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-9a15ce90-70d8-445f-b097-c5abea8750f0 req-96a071b9-a0a2-4ff2-8e13-ac9c31035940 service nova] Instance 7b0a8ca8-6576-42ac-a734-29103d902371 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:19:03.282935 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-9a15ce90-70d8-445f-b097-c5abea8750f0 req-96a071b9-a0a2-4ff2-8e13-ac9c31035940 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090038 Jul 20 04:19:03.283684 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 652/1223] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:03.414516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a23cc92f-3874-47b4-9b10-0a03ee1490e9 tempest-ServersOnMultiNodesTest-2137454743 tempest-ServersOnMultiNodesTest-2137454743-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1620 microversion: 2.1 time: 0.233449 Jul 20 04:19:03.415285 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 572/1224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1620 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:03.434876 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.435467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.442793 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.443244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.444019 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.444530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.471017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:03.557567 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ab1ae73c-78be-4e8c-ae84-4fa370c28763 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 204 len: 0 microversion: 2.1 time: 0.126575 Jul 20 04:19:03.562450 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 653/1225] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:03 2022] DELETE /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:03.569477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.570430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.573685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:03.581372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.581913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.582976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.583632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.700992 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.701973 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.717527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.718017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.719171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.719618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.759107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.767518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e92efe6-57f8-4deb-9174-345271712042 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1473 microversion: 2.1 time: 0.202165 Jul 20 04:19:03.777370 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 573/1226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1473 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:03.782381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.782925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.791864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.792620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.793566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.794150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.901316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.910281 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-68557238-f2bf-42c6-a3d4-967bc3d6fc2c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1523 microversion: 2.1 time: 0.214115 Jul 20 04:19:03.911485 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 654/1227] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:03.928380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:03.929268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:03.938407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.940212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.941275 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:03.942190 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:03.972263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:03.973980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:03.980844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b03f0786-92d9-4350-a565-172d7b575464 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1469 microversion: 2.1 time: 0.202274 Jul 20 04:19:03.981531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 574/1228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:03 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:03.998186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:03.999003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.005423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.005877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.006645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.008263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.018237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:04.058253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.058965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.059967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.060709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.069241 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-061a728a-024c-4964-9b9f-9bdbf5875680 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 204 len: 0 microversion: 2.1 time: 0.145177 Jul 20 04:19:04.069946 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 655/1229] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:03 2022] DELETE /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:04.074999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.075991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.082343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:04.084826 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.085557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.086619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.087328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.090264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:04.106623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for user 3e8f4a044b904befbddb93375b6e213a and project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:04.236717 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55975d3b-2309-42b6-a82c-75781adb3840 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371/action" status: 202 len: 0 microversion: 2.1 time: 0.242413 Jul 20 04:19:04.237729 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 575/1230] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:03 2022] POST /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:19:04.243436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.244254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.250759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.251216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.252056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.252509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.266213 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.276622 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-67a9dcc7-273a-4087-97f8-90fd66578a50 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1469 microversion: 2.1 time: 0.204994 Jul 20 04:19:04.289792 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 656/1231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.296692 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.297675 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.306851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.307401 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.308317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.308832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.399977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.409682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee33717d-e742-47bd-8e69-28a36cfd38af tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1529 microversion: 2.1 time: 0.170428 Jul 20 04:19:04.410422 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 576/1232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1529 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.417802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:04.418947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.426134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.426588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.427374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.427813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.462132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.470401 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f5518273-ce4d-4570-acb6-e03706b25556 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1468 microversion: 2.1 time: 0.177997 Jul 20 04:19:04.471819 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 657/1233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1468 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.519053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ab23bce-3190-4dc9-8392-76e6d159a31a tempest-DeleteServersAdminTestJSON-1049092102 tempest-DeleteServersAdminTestJSON-1049092102-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74/action" status: 202 len: 0 microversion: 2.1 time: 0.107394 Jul 20 04:19:04.519741 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 577/1234] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:04 2022] POST /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:04.527759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.528382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.535025 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.535519 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.536273 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.536731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.572249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.573202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.573202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lazy-loading 'fault' on Instance uuid d3b16dec-ac36-4cd6-8059-b54b6266ff74 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:04.688538 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.696701 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6a6e7640-cae3-415b-8f98-0f18c63f898c tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1452 microversion: 2.1 time: 0.172659 Jul 20 04:19:04.697416 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 658/1235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:04.713269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.713759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.721249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.721696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.722458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.722889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.726978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:04.750414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:04.784961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.785574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.792252 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.792764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.793693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.794127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.833622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23b85839-6704-4cf1-af02-4a34d0cc6924 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 204 len: 0 microversion: 2.1 time: 0.123879 Jul 20 04:19:04.834465 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 578/1236] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:04 2022] DELETE /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:04.843834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:04.844673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:04.852825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.853278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.854053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.854485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.894303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:04.894754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:04.895207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lazy-loading 'fault' on Instance uuid d3b16dec-ac36-4cd6-8059-b54b6266ff74 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:04.943465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:04.957666 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0f8b33d5-556a-49b9-85e2-a82763849779 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1473 microversion: 2.1 time: 0.176416 Jul 20 04:19:04.960529 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 659/1237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:05.016451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.025005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62781643-ba9b-4886-8be7-4aed319a4fb6 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1458 microversion: 2.1 time: 0.185652 Jul 20 04:19:05.036082 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 579/1238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:04 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1458 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:05.429562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:05.430174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:05.437126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.437577 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.438350 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.438782 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.488324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:05.488976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:05.495819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.496324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.497142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.497578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.620195 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.637930 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-87b610a6-6b4d-43b7-8c7d-940d613369d8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1529 microversion: 2.1 time: 0.212128 Jul 20 04:19:05.639311 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 660/1239] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:05 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1529 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:05.645069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-61e7417f-6903-4d60-b867-cd901b16cb58 req-8541bcda-6310-463e-b012-9cf10b4bf00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "name": "network-vif-plugged", "status": "completed", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:05.658299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-61e7417f-6903-4d60-b867-cd901b16cb58 req-8541bcda-6310-463e-b012-9cf10b4bf00c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.659102 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-61e7417f-6903-4d60-b867-cd901b16cb58 req-8541bcda-6310-463e-b012-9cf10b4bf00c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.672092 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-61e7417f-6903-4d60-b867-cd901b16cb58 req-8541bcda-6310-463e-b012-9cf10b4bf00c service nova] Creating event network-vif-plugged:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:19:05.679520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-61e7417f-6903-4d60-b867-cd901b16cb58 req-8541bcda-6310-463e-b012-9cf10b4bf00c service nova] Instance 7b0a8ca8-6576-42ac-a734-29103d902371 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:19:05.686966 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-61e7417f-6903-4d60-b867-cd901b16cb58 req-8541bcda-6310-463e-b012-9cf10b4bf00c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Jul 20 04:19:05.688256 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 661/1240] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:05.793254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:05.805736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-089bbb80-822e-4a45-8f3f-a70fb08bebda tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1468 microversion: 2.1 time: 0.321627 Jul 20 04:19:05.806949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 580/1241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:05 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:05.975960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:05.977467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:05.989838 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.990545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:05.991769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:05.992495 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.043849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.045666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.052324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.053091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.056687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.057966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.099691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.100294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.101445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lazy-loading 'fault' on Instance uuid d3b16dec-ac36-4cd6-8059-b54b6266ff74 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:06.249088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.262300 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.273379 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d496c8f-862d-4f58-b3c7-f7d069a2a571 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1458 microversion: 2.1 time: 0.233629 Jul 20 04:19:06.274360 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 581/1242] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1458 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:06.274927 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d25a32ce-3e8b-463d-a24d-d75b26071b4d tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1473 microversion: 2.1 time: 0.300628 Jul 20 04:19:06.275913 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 662/1243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:05 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:06.349587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7988c196-58b8-4f89-a6d4-5a7739e2cd80 req-a1986cb4-10b8-424a-9ca0-b1f273ea6ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662d6ca6-f3da-4c86-94d7-62822d1428b6", "name": "network-vif-deleted", "tag": "ff26d5b8-94f1-4abb-86b8-9cea60f6ecce"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:06.359562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7988c196-58b8-4f89-a6d4-5a7739e2cd80 req-a1986cb4-10b8-424a-9ca0-b1f273ea6ca6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.359746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7988c196-58b8-4f89-a6d4-5a7739e2cd80 req-a1986cb4-10b8-424a-9ca0-b1f273ea6ca6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.375656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7988c196-58b8-4f89-a6d4-5a7739e2cd80 req-a1986cb4-10b8-424a-9ca0-b1f273ea6ca6 service nova] Creating event network-vif-deleted:ff26d5b8-94f1-4abb-86b8-9cea60f6ecce for instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 on n-h2-764486-11 Jul 20 04:19:06.381384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7988c196-58b8-4f89-a6d4-5a7739e2cd80 req-a1986cb4-10b8-424a-9ca0-b1f273ea6ca6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035536 Jul 20 04:19:06.382309 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 582/1244] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:06.655207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.656105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.663272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.663719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.664558 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.665004 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.824780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:06.826042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:06.832452 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:06.833975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.834419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.836024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:06.836646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:06.845292 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a4144b9c-c956-48e2-8430-076809649ae7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1529 microversion: 2.1 time: 0.193997 Jul 20 04:19:06.846872 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 663/1245] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1529 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:07.001011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:07.008620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7dba6b27-e6b5-405c-85f1-21c86b882a05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1468 microversion: 2.1 time: 0.189163 Jul 20 04:19:07.009208 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 583/1246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:06 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1468 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:07.290105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.290731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:07.293464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.294079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:07.299943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.300494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.300719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.300934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.301550 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.301732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.301989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.302113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.337323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.337881 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.338426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lazy-loading 'fault' on Instance uuid d3b16dec-ac36-4cd6-8059-b54b6266ff74 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:07.383868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:07.395479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8fb9aa22-b645-41f2-b727-94f223745463 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1431 microversion: 2.1 time: 0.105364 Jul 20 04:19:07.404769 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 584/1247] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:07 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1431 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:07.464197 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:07.473490 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3e1a1f8c-a682-4ba4-9501-0db7c5e74ab9 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1458 microversion: 2.1 time: 0.187287 Jul 20 04:19:07.482762 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 664/1248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:07 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1458 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:07.863450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:07.864096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:07.872425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.873150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:07.874260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:07.874861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.026121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:08.027473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:08.038433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.039233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.040974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.041583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.182374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.196214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-411ef9f3-95dd-4482-ae31-95d7e08995b9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1529 microversion: 2.1 time: 0.337241 Jul 20 04:19:08.197335 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 585/1249] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:07 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1529 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:08.426556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:08.426556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:08.442082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.444108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.450263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.450263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.531181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.531181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.532032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lazy-loading 'fault' on Instance uuid 662d6ca6-f3da-4c86-94d7-62822d1428b6 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:08.551062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.561282 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8404cd45-14cf-44d6-b913-d3ae9d8bcfb6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1468 microversion: 2.1 time: 0.539461 Jul 20 04:19:08.563060 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 665/1250] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:08 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1468 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:08.569315 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:08.570508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:08.585268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.587887 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.590537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.594750 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.629268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:08.648671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5f6db7c-a6d6-4ac0-b1df-0b269b4efb05 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 200 len: 1307 microversion: 2.1 time: 0.226957 Jul 20 04:19:08.658745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 586/1251] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:08 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:08.706513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-39763667-1b0a-42e7-b02d-d954dd69ec58 req-39c74e06-c0a2-4b2f-9e28-b264a449e68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cb9a9f-a388-448f-93d7-8be7b3e20a48", "name": "network-vif-deleted", "tag": "ffa132ec-a579-4f79-9d47-d4a1bfebab18"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:08.739730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-39763667-1b0a-42e7-b02d-d954dd69ec58 req-39c74e06-c0a2-4b2f-9e28-b264a449e68a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:08.757415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-39763667-1b0a-42e7-b02d-d954dd69ec58 req-39c74e06-c0a2-4b2f-9e28-b264a449e68a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:08.778955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-39763667-1b0a-42e7-b02d-d954dd69ec58 req-39c74e06-c0a2-4b2f-9e28-b264a449e68a service nova] Creating event network-vif-deleted:ffa132ec-a579-4f79-9d47-d4a1bfebab18 for instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 on n-h1-764486-11 Jul 20 04:19:08.829002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-39763667-1b0a-42e7-b02d-d954dd69ec58 req-39c74e06-c0a2-4b2f-9e28-b264a449e68a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172153 Jul 20 04:19:08.832082 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 587/1252] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:09.063511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.065885 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.066523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lazy-loading 'fault' on Instance uuid d3b16dec-ac36-4cd6-8059-b54b6266ff74 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:09.130628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66da09d3f8a443458578128cea7a23b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693b27c3cf8c4218a9eb4f96ebbd76b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.138342 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-89525b39-0b58-430d-8e88-2c4bca244fe4 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 200 len: 1416 microversion: 2.1 time: 0.573703 Jul 20 04:19:09.138925 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 666/1253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:08 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 1416 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:09.214796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.215412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.223343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.223821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.224657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.225102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.260659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.261128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.261586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lazy-loading 'fault' on Instance uuid 74cb9a9f-a388-448f-93d7-8be7b3e20a48 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:09.312403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.320745 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-239026b2-8dcc-42b1-94f1-07f0818e7c8a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 200 len: 1315 microversion: 2.1 time: 0.110212 Jul 20 04:19:09.329252 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 588/1254] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 1315 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:09.580638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.581810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.589451 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.589983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.591678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.592207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.666982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.667780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 662d6ca6-f3da-4c86-94d7-62822d1428b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.680247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.683590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.691076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.693186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.723671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 could not be found. Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 HTTP/1.1 Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:09.726391 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 could not be found. Jul 20 04:19:09.727972 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '662d6ca6-f3da-4c86-94d7-62822d1428b6'} Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 could not be found. Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:09.729148 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 could not be found. Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 could not be found. Jul 20 04:19:09.730653 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:09.733918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance 662d6ca6-f3da-4c86-94d7-62822d1428b6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:09.735312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4f34a8d-8e05-4b3d-9678-8712a8b5a554 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6" status: 404 len: 111 microversion: 2.1 time: 0.072870 Jul 20 04:19:09.737728 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 589/1255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/662d6ca6-f3da-4c86-94d7-62822d1428b6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:09.754068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.754916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.764220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.764968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.765999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.766657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.805692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:09.889441 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:09.907436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8582454-04ea-4c6a-8289-38c957ef0917 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 204 len: 0 microversion: 2.1 time: 0.160785 Jul 20 04:19:09.908492 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-60b35d0a-60ac-43c4-ac29-4e3b73e834f7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1534 microversion: 2.1 time: 0.332670 Jul 20 04:19:09.910180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 590/1256] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:09 2022] DELETE /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:09.910698 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 667/1257] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1534 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:09.920127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.921851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.925812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:09.926409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:09.929928 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.930648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.932458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.932685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.933141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.933866 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.934043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:09.934654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:09.967731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:10.016003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:10.084442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dbbad7b4-532a-489f-b2a2-0b4f802b4aea tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 204 len: 0 microversion: 2.1 time: 0.163700 Jul 20 04:19:10.085084 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 591/1258] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:09 2022] DELETE /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:10.093953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.094763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.101904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.102353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.103357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.104434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.144379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.153446 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2d4b74c8-3730-4d2f-9237-e9dce45fad98 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1472 microversion: 2.1 time: 0.239161 Jul 20 04:19:10.154014 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 668/1259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:09 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:10.169544 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.170246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.178067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.178523 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.179303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.179741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.196882 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] HTTP exception thrown: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Request method failure captured: Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 HTTP/1.1 Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IG3lNSQCRVIv857kQhjxlGUOvCA39QXWl2ufdsdkRBZrh8y5PsaONGtb4gYpgl9LGavx6Yw1rHeG8NNyKdieYprPG3X7j8kwEoGbbyVsu1jZV-06lsWDu6lJgf_odfZdsCIOc28i1dRmfn-cmK209GMdmYTfb5OYccuif3GoGphOU Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:10.198586 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_693b27c3cf8c4218a9eb4f96ebbd76b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 66da09d3f8a443458578128cea7a23b6 Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.199964 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'd3b16dec-ac36-4cd6-8059-b54b6266ff74'} Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.206803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.208072 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.210978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Returning 404 to user: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.210978 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b80bf8b1-c0d8-4e76-921d-d130fe9ea292 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 404 len: 111 microversion: 2.1 time: 0.035617 Jul 20 04:19:10.210978 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 669/1260] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:10.213983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.214555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.221456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.221911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.222695 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.223167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.238453 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] HTTP exception thrown: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Request method failure captured: Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 HTTP/1.1 Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IG3lNSQCRVIv857kQhjxlGUOvCA39QXWl2ufdsdkRBZrh8y5PsaONGtb4gYpgl9LGavx6Yw1rHeG8NNyKdieYprPG3X7j8kwEoGbbyVsu1jZV-06lsWDu6lJgf_odfZdsCIOc28i1dRmfn-cmK209GMdmYTfb5OYccuif3GoGphOU Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:10.238812 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_693b27c3cf8c4218a9eb4f96ebbd76b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 66da09d3f8a443458578128cea7a23b6 Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.240793 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'd3b16dec-ac36-4cd6-8059-b54b6266ff74'} Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.242088 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.243646 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.245215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Returning 404 to user: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.245215 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6992afce-e942-48fb-8748-bf59206b5bde tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 404 len: 111 microversion: 2.1 time: 0.030800 Jul 20 04:19:10.245215 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 670/1261] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:10 2022] DELETE /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:10.249481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.249966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: d3b16dec-ac36-4cd6-8059-b54b6266ff74] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.256298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:10.256800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.257257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.258291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.258737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.265776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-98ba6325-fa2c-4831-9619-427beb65bd21 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1554 microversion: 2.1 time: 0.176399 Jul 20 04:19:10.266362 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 592/1262] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:10.274237 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] HTTP exception thrown: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Request method failure captured: Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 HTTP/1.1 Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IG3lNSQCRVIv857kQhjxlGUOvCA39QXWl2ufdsdkRBZrh8y5PsaONGtb4gYpgl9LGavx6Yw1rHeG8NNyKdieYprPG3X7j8kwEoGbbyVsu1jZV-06lsWDu6lJgf_odfZdsCIOc28i1dRmfn-cmK209GMdmYTfb5OYccuif3GoGphOU Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:10.275840 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_693b27c3cf8c4218a9eb4f96ebbd76b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 66da09d3f8a443458578128cea7a23b6 Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.277516 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'd3b16dec-ac36-4cd6-8059-b54b6266ff74'} Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.278394 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. Jul 20 04:19:10.279852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.281392 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Returning 404 to user: Instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.281392 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e490688f-9c29-441c-9f2a-78baef070650 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74" status: 404 len: 111 microversion: 2.1 time: 0.032045 Jul 20 04:19:10.281392 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 671/1263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/d3b16dec-ac36-4cd6-8059-b54b6266ff74 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:10.286818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.287383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.293658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.294179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.295038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.295552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.309812 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] HTTP exception thrown: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Request method failure captured: Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 HTTP/1.1 Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IG3lNSQCRVIv857kQhjxlGUOvCA39QXWl2ufdsdkRBZrh8y5PsaONGtb4gYpgl9LGavx6Yw1rHeG8NNyKdieYprPG3X7j8kwEoGbbyVsu1jZV-06lsWDu6lJgf_odfZdsCIOc28i1dRmfn-cmK209GMdmYTfb5OYccuif3GoGphOU Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:10.311469 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_693b27c3cf8c4218a9eb4f96ebbd76b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 66da09d3f8a443458578128cea7a23b6 Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.313194 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a0332744-15ed-4c1d-a460-29ba2333b395'} Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.315142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.316526 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.318035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Returning 404 to user: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.318035 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9851ec0d-cee2-4b71-b9b8-2cd0297ee2b8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 404 len: 111 microversion: 2.1 time: 0.030414 Jul 20 04:19:10.318035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 593/1264] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:10 2022] DELETE /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:10.323787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.324601 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] [instance: a0332744-15ed-4c1d-a460-29ba2333b395] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.331479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.332027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.332987 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.333460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.337158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.337765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.343808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.344255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.345064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.345494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.347721 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] HTTP exception thrown: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Request method failure captured: Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 HTTP/1.1 Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IG3lNSQCRVIv857kQhjxlGUOvCA39QXWl2ufdsdkRBZrh8y5PsaONGtb4gYpgl9LGavx6Yw1rHeG8NNyKdieYprPG3X7j8kwEoGbbyVsu1jZV-06lsWDu6lJgf_odfZdsCIOc28i1dRmfn-cmK209GMdmYTfb5OYccuif3GoGphOU Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:10.349412 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/693b27c3cf8c4218a9eb4f96ebbd76b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_693b27c3cf8c4218a9eb4f96ebbd76b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 693b27c3cf8c4218a9eb4f96ebbd76b6 Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1899697868 Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 66da09d3f8a443458578128cea7a23b6 Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1899697868-project Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.351043 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'a0332744-15ed-4c1d-a460-29ba2333b395'} Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.351852 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. Jul 20 04:19:10.353352 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.354612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] Returning 404 to user: Instance a0332744-15ed-4c1d-a460-29ba2333b395 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.354612 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8662cd7a-d184-4b8a-b7f2-4c3bb922b2a8 tempest-DeleteServersAdminTestJSON-1899697868 tempest-DeleteServersAdminTestJSON-1899697868-project] 10.222.0.49 "GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395" status: 404 len: 111 microversion: 2.1 time: 0.031485 Jul 20 04:19:10.354612 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 672/1265] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/a0332744-15ed-4c1d-a460-29ba2333b395 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:10.362160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 HTTP/1.1 Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:10.363688 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:19:10.365255 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48'} Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:10.366398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:19:10.367615 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:10.368753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:10.368753 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10ad2441-3fbe-4052-82be-6e885b74e6a3 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 404 len: 111 microversion: 2.1 time: 0.031819 Jul 20 04:19:10.368753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 594/1266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:10.378290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-586f73f4-40af-4870-b0ac-e35c91f95579 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'create', calling method: .version_select at 0x7f838bcf9ee0>, body: {"keypair": {"name": "tempest-keypair-1939867002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArL05hteympwjdGh4o5m6CRHTpj+BErDBJtYkQs72GkjF5iim6DQmU+DTPCm2vb/aoUYpPcOkbEY0mX34LX2JI/AiK7GZX2wE8BzOIsxt76nULNaMQ9IDwGtinNyImWqg=="}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:10.392722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-586f73f4-40af-4870-b0ac-e35c91f95579 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for project 57523abec2014cbda05b179e7b9ed761. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:10.398134 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-586f73f4-40af-4870-b0ac-e35c91f95579 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for user 72d4d8f374fd472c9214bc3b5d9fcc3b and project 57523abec2014cbda05b179e7b9ed761. Resources: {'key_pairs'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:10.424025 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-586f73f4-40af-4870-b0ac-e35c91f95579 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049689 Jul 20 04:19:10.424956 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 673/1267] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:19:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:10.856192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b9460d14-1520-42ca-a36c-69992b8d5dbc req-b15dd327-7af8-4169-bc5a-31d2acbb68cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b16dec-ac36-4cd6-8059-b54b6266ff74", "name": "network-vif-deleted", "tag": "6418e221-7584-49c9-9158-8ca457d4b7ff"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:10.876252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b9460d14-1520-42ca-a36c-69992b8d5dbc req-b15dd327-7af8-4169-bc5a-31d2acbb68cb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.877812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b9460d14-1520-42ca-a36c-69992b8d5dbc req-b15dd327-7af8-4169-bc5a-31d2acbb68cb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.906982 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b9460d14-1520-42ca-a36c-69992b8d5dbc req-b15dd327-7af8-4169-bc5a-31d2acbb68cb service nova] Creating event network-vif-deleted:6418e221-7584-49c9-9158-8ca457d4b7ff for instance d3b16dec-ac36-4cd6-8059-b54b6266ff74 on n-h1-764486-11 Jul 20 04:19:10.918376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b9460d14-1520-42ca-a36c-69992b8d5dbc req-b15dd327-7af8-4169-bc5a-31d2acbb68cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066457 Jul 20 04:19:10.921763 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 595/1268] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:10.927956 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:10.930122 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:10.948776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.949230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:10.950022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:10.950462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.022967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-384973e0-bbf9-462b-9bdb-883888f6137f req-f800bfe3-8f90-4185-a460-3d499acca0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "name": "network-vif-unplugged", "status": "completed", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:11.032522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-384973e0-bbf9-462b-9bdb-883888f6137f req-f800bfe3-8f90-4185-a460-3d499acca0cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.033879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-384973e0-bbf9-462b-9bdb-883888f6137f req-f800bfe3-8f90-4185-a460-3d499acca0cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.047788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-384973e0-bbf9-462b-9bdb-883888f6137f req-f800bfe3-8f90-4185-a460-3d499acca0cf service nova] Creating event network-vif-unplugged:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:19:11.055709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-384973e0-bbf9-462b-9bdb-883888f6137f req-f800bfe3-8f90-4185-a460-3d499acca0cf service nova] Instance 7b0a8ca8-6576-42ac-a734-29103d902371 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:19:11.063496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-384973e0-bbf9-462b-9bdb-883888f6137f req-f800bfe3-8f90-4185-a460-3d499acca0cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049289 Jul 20 04:19:11.074599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 596/1269] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:11.175477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.176521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.186835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.188202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.189962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.190629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.246647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.250604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:11.256375 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6771746-5d54-4b8e-8da4-06432f93fa9a tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1534 microversion: 2.1 time: 0.333234 Jul 20 04:19:11.264199 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 674/1270] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:10 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1534 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:11.294269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:11.295178 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:11.307091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.307888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.310081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:11.312649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:11.375881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.390365 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fddee680-d0d9-4e31-8487-b0d1c2053589 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1472 microversion: 2.1 time: 0.218545 Jul 20 04:19:11.399908 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 597/1271] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1472 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:11.663954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:11.677339 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-62cc89fc-7092-44a4-9651-c840aca5164f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1554 microversion: 2.1 time: 0.398080 Jul 20 04:19:11.677927 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 675/1272] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:11 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1554 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:12.278833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.280022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.289728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.290506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.291704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.292419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.410427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.411738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.422786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.427603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.430668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.433584 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.672505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:12.686086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c913294-add9-489f-a93e-3cc59be785b6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1534 microversion: 2.1 time: 0.408673 Jul 20 04:19:12.686775 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 598/1273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1534 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:12.703397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:12.704027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:12.717108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.718720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.719753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:12.721054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:12.999855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.014826 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c319c075-f4e4-4391-94ce-83de06791f2f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1472 microversion: 2.1 time: 0.611442 Jul 20 04:19:13.015887 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 676/1274] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1472 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:13.102634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:13.119518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dce22141-7419-4526-bd70-7212bd18a82b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1554 microversion: 2.1 time: 0.423464 Jul 20 04:19:13.132040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 599/1275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:12 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1554 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:13.258884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-915146956", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:13.350010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] validate_networks() for [('3e927276-dddc-430b-8bdd-2a3597d05a48', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:13.434174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f5123456-de96-45b8-b773-f56dbbfde53f req-fefe40f1-bacf-4471-af78-42898b6d6c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c9979-bb48-46e5-995a-43f8b494d3c6", "name": "network-vif-deleted", "tag": "260b3b15-2247-492d-a81b-76fcd0560b04"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:13.468773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f5123456-de96-45b8-b773-f56dbbfde53f req-fefe40f1-bacf-4471-af78-42898b6d6c1d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.469782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f5123456-de96-45b8-b773-f56dbbfde53f req-fefe40f1-bacf-4471-af78-42898b6d6c1d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.500238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f5123456-de96-45b8-b773-f56dbbfde53f req-fefe40f1-bacf-4471-af78-42898b6d6c1d service nova] Creating event network-vif-deleted:260b3b15-2247-492d-a81b-76fcd0560b04 for instance f92c9979-bb48-46e5-995a-43f8b494d3c6 on n-h1-764486-11 Jul 20 04:19:13.507343 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f5123456-de96-45b8-b773-f56dbbfde53f req-fefe40f1-bacf-4471-af78-42898b6d6c1d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078814 Jul 20 04:19:13.509086 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 600/1276] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:13.717731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:13.720670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:13.738192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.746325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:13.750555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:13.752673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.031810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:14.041602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cd8ab4d-154a-4c63-bb4c-bffb288a534b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1534 microversion: 2.1 time: 0.342172 Jul 20 04:19:14.062635 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 601/1277] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:13 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1534 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:14.066054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.066628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.069846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:14.072914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:14.075051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.075485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.076606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.077055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.130843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.131300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.131761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lazy-loading 'fault' on Instance uuid f92c9979-bb48-46e5-995a-43f8b494d3c6 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:14.237171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:14.244396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee089a32-37bb-4d02-9adb-9a15781c4575 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 200 len: 1306 microversion: 2.1 time: 0.187258 Jul 20 04:19:14.244983 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 602/1278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 1306 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:14.246861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:14.247502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:14.248131 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:14.248878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:14.249377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:14.263081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.268719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.269138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.269773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.270880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.271526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.287275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.287749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.299488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:14.300580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:14.313157 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for project 57523abec2014cbda05b179e7b9ed761. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:14.331213 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for user 72d4d8f374fd472c9214bc3b5d9fcc3b and project 57523abec2014cbda05b179e7b9ed761. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:14.368661 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:14.371469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:14.388752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:14.400127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71ec9fce-c2ee-4632-8546-3698d5a505b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1512 microversion: 2.1 time: 0.151546 Jul 20 04:19:14.401080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 603/1279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:14.466169 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c607396d-2d5a-4b12-9e5c-def8aeb2f576 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.211396 Jul 20 04:19:14.473799 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 677/1280] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:14.478835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f153366-329e-4cd7-b324-072efbfccab2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:14.479669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f153366-329e-4cd7-b324-072efbfccab2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:14.571027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f153366-329e-4cd7-b324-072efbfccab2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:14.581989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f153366-329e-4cd7-b324-072efbfccab2 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1224 microversion: 2.1 time: 0.108778 Jul 20 04:19:14.583121 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 604/1281] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:14 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:15.071399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.072423 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.093750 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.094208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.099522 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.100564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.263474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.264278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: f92c9979-bb48-46e5-995a-43f8b494d3c6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.281801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.286246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.288952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.290178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.324211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance f92c9979-bb48-46e5-995a-43f8b494d3c6 could not be found. Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 HTTP/1.1 Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:15.328241 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f92c9979-bb48-46e5-995a-43f8b494d3c6 could not be found. Jul 20 04:19:15.330530 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f92c9979-bb48-46e5-995a-43f8b494d3c6'} Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92c9979-bb48-46e5-995a-43f8b494d3c6 could not be found. Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:15.331327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92c9979-bb48-46e5-995a-43f8b494d3c6 could not be found. Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92c9979-bb48-46e5-995a-43f8b494d3c6 could not be found. Jul 20 04:19:15.333452 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.341735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance f92c9979-bb48-46e5-995a-43f8b494d3c6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:15.347061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8caf77ca-6c43-4c7d-a5e3-6468755aede7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6" status: 404 len: 111 microversion: 2.1 time: 0.087170 Jul 20 04:19:15.355503 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 605/1282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/f92c9979-bb48-46e5-995a-43f8b494d3c6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:15.371695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.373524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.393807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.395274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.399672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.400384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.439254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.453937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:15.457451 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9340a01c-cf40-4a1d-8f3c-6ce6ce7af595 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1527 microversion: 2.1 time: 0.400008 Jul 20 04:19:15.458370 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 678/1283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1527 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.474575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.475205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.484450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.485503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.486518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.487342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.601428 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.611087 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1346 microversion: 2.1 time: 0.151107 Jul 20 04:19:15.612089 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 679/1284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.613293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.614416 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9c755b25-7e7c-4fae-ae80-a19cf054331d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001292 Jul 20 04:19:15.614945 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 680/1285] 10.222.0.49 () {56 vars in 885 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:19:15.620238 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.621456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.637567 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.640595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.643542 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.645185 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.649933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd326910-ecd4-4fbc-b51f-fa3195c6b15f tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 204 len: 0 microversion: 2.1 time: 0.292181 Jul 20 04:19:15.655077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 606/1286] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:15 2022] DELETE /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:15.661764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-241510e7-7aed-4158-a9a2-4c6e7d4542c4 req-268235aa-4f5b-44dd-a534-88b392ff5a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80919433-b6b3-4076-8757-c53e3e17e3ba", "name": "network-vif-deleted", "tag": "333c4a8d-e869-438a-bd48-60a60aca7cae"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:15.672312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-241510e7-7aed-4158-a9a2-4c6e7d4542c4 req-268235aa-4f5b-44dd-a534-88b392ff5a2a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.673243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-241510e7-7aed-4158-a9a2-4c6e7d4542c4 req-268235aa-4f5b-44dd-a534-88b392ff5a2a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.687209 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-241510e7-7aed-4158-a9a2-4c6e7d4542c4 req-268235aa-4f5b-44dd-a534-88b392ff5a2a service nova] Creating event network-vif-deleted:333c4a8d-e869-438a-bd48-60a60aca7cae for instance 80919433-b6b3-4076-8757-c53e3e17e3ba on n-h2-764486-11 Jul 20 04:19:15.694800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-241510e7-7aed-4158-a9a2-4c6e7d4542c4 req-268235aa-4f5b-44dd-a534-88b392ff5a2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037847 Jul 20 04:19:15.695807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 607/1287] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:15.705472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.706545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.714428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.715259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.717767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.718462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.824140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.838201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15ba22ad-f169-4a33-8130-ce5a3696ccdd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1276 microversion: 2.1 time: 0.139427 Jul 20 04:19:15.849364 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 608/1288] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.849364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.849833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:15.858278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.863011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.863011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:15.863011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:15.883613 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:15.893981 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-827ba36a-7ad0-4d64-8f23-d4a1dd4bfa05 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1527 microversion: 2.1 time: 0.277701 Jul 20 04:19:15.905008 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 681/1289] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:15.914809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-30ffb85e-e508-4e56-8e21-8d3372746ea2 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:15.916638 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:15.916638 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:19:15.933224 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-30ffb85e-e508-4e56-8e21-8d3372746ea2 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] HTTP exception thrown: Flavor e86b69bc-9e21-4174-be9f-cf947c469924 could not be found. Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-30ffb85e-e508-4e56-8e21-8d3372746ea2 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Request method failure captured: Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/flavors/e86b69bc-9e21-4174-be9f-cf947c469924 HTTP/1.1 Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FSRO43rwDe0CMJ7zxJ4s7FQ2yJfbDJPGQCp3NOyxhpLBRLvWrAf943fjYdz_-yTvx9jnrl-G6mM7aYcdcZqix5YAMTYe79-vphRB8__vFWPB46Ke-juUnUKwY-cOSoqMpREnd0V-Y_u-IywnSClaSR-H2Ima7rfdYYNSwCMoRmp1U Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 2d24145bb42e47f690aebce383d0a065 Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-MigrationsAdminTest-636726617 Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader,admin Jul 20 04:19:15.937117 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader,admin Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d24145bb42e47f690aebce383d0a065"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d24145bb42e47f690aebce383d0a065"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d24145bb42e47f690aebce383d0a065"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d24145bb42e47f690aebce383d0a065", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-MigrationsAdminTest-636726617 Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 2d24145bb42e47f690aebce383d0a065 Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-MigrationsAdminTest-636726617 Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-MigrationsAdminTest-636726617-project-admin Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 46f6ec98db4f47ff8fc204535ebda46c Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-MigrationsAdminTest-636726617-project-admin Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: exception: Flavor e86b69bc-9e21-4174-be9f-cf947c469924 could not be found. Jul 20 04:19:15.938516 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'e86b69bc-9e21-4174-be9f-cf947c469924'} Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e86b69bc-9e21-4174-be9f-cf947c469924 could not be found. Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:15.939323 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e86b69bc-9e21-4174-be9f-cf947c469924 could not be found. Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e86b69bc-9e21-4174-be9f-cf947c469924 could not be found. Jul 20 04:19:15.940585 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:15.946801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-30ffb85e-e508-4e56-8e21-8d3372746ea2 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Returning 404 to user: Flavor e86b69bc-9e21-4174-be9f-cf947c469924 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:15.946801 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-30ffb85e-e508-4e56-8e21-8d3372746ea2 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/e86b69bc-9e21-4174-be9f-cf947c469924" status: 404 len: 109 microversion: 2.1 time: 0.034101 Jul 20 04:19:15.946801 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 682/1290] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:15 2022] DELETE /compute/v2.1/flavors/e86b69bc-9e21-4174-be9f-cf947c469924 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:16.123767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.133094 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f3df2b2-a5ae-4768-bffd-2f854f25a9fc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1472 microversion: 2.1 time: 0.291535 Jul 20 04:19:16.134047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 609/1291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:15 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:16.182123 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1131051744", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:16.253365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:16.630496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.631227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.641728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.643295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.645521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.649516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.680253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:16.728570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:16.729233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:16.737799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:16.738247 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:16.738702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:16.755936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.756821 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.758821 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.760949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.794903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:16.797476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:16.806456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Getting quotas for user 3e8f4a044b904befbddb93375b6e213a and project 3180da7c29d64983854c1235b108c7e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:16.818507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d23960f6-205e-459d-a979-b5f4f42c9955 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1346 microversion: 2.1 time: 0.193424 Jul 20 04:19:16.824222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 610/1292] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1346 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:16.838027 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:16.841103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:16.871830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.872573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.887195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.888382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.891382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:16.894747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:16.934463 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0ca8f75f-3c69-406f-9d29-5f1805ee280e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757097 Jul 20 04:19:16.935529 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 683/1293] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:16.946365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff235b99-18a4-4256-91f2-29c7dabadb31 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:16.947032 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff235b99-18a4-4256-91f2-29c7dabadb31 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:16.965488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:17.104454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ff235b99-18a4-4256-91f2-29c7dabadb31 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.115037 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff235b99-18a4-4256-91f2-29c7dabadb31 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1213 microversion: 2.1 time: 0.172757 Jul 20 04:19:17.127129 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 684/1294] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:17.133077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.142158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1840d98b-ebc0-4ccc-b898-d779197dbc62 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1284 microversion: 2.1 time: 0.274773 Jul 20 04:19:17.151442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.152751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.159433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 611/1295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:16 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:17.165634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.170519 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.171722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.172384 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.495068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:17.526312 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6f833f4c-9ad2-4ab0-89e2-afe67e3b8956 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1472 microversion: 2.1 time: 0.379116 Jul 20 04:19:17.544232 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 685/1296] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:17.841849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:17.843333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:17.856389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.856983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:17.858045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:17.859663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.141113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.141720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.151888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.152336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.153171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.153609 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.211426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.222355 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-98f92541-60ba-4d2e-8976-fec06e60045a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1346 microversion: 2.1 time: 0.384445 Jul 20 04:19:18.226116 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 612/1297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:17 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1346 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:18.252977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.253991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.260319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.261004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.261936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.262522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.421219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.443567 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e7c499e5-3bdf-4f78-a521-f03dde188f56 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1282 microversion: 2.1 time: 0.215539 Jul 20 04:19:18.444575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 613/1298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:18.466932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.477002 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b37876ed-e53a-4460-b236-286d703a60a3 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1209 microversion: 2.1 time: 0.340003 Jul 20 04:19:18.477599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e4ea58a2-a9c5-4a17-a18b-d0f23e7e33d8 req-f307ebf1-f8db-4e83-8fa6-39ce211d62ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "name": "network-vif-plugged", "status": "completed", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:18.481483 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 686/1299] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1209 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:18.498621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e4ea58a2-a9c5-4a17-a18b-d0f23e7e33d8 req-f307ebf1-f8db-4e83-8fa6-39ce211d62ea service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.498621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e4ea58a2-a9c5-4a17-a18b-d0f23e7e33d8 req-f307ebf1-f8db-4e83-8fa6-39ce211d62ea service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.533074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e4ea58a2-a9c5-4a17-a18b-d0f23e7e33d8 req-f307ebf1-f8db-4e83-8fa6-39ce211d62ea service nova] Creating event network-vif-plugged:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:19:18.545443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:18.546063 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:18.555940 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.556179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e4ea58a2-a9c5-4a17-a18b-d0f23e7e33d8 req-f307ebf1-f8db-4e83-8fa6-39ce211d62ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082171 Jul 20 04:19:18.556417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.560779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:18.564164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:18.564840 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 614/1300] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:18.881526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:18.892272 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2fb1d8b6-9774-4a79-a179-f721201570c2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 200 len: 1472 microversion: 2.1 time: 0.350487 Jul 20 04:19:18.911358 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 687/1301] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:18 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 1472 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:19.217822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ed97704d-79df-4381-9fea-a83446579d4a req-072913b0-35ed-446b-b836-9a6829c0b6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1023d9-1301-426e-8209-382ca96c7524", "name": "network-vif-deleted", "tag": "90c230c3-c2da-47c3-ae26-a85d36beb40a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:19.230364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed97704d-79df-4381-9fea-a83446579d4a req-072913b0-35ed-446b-b836-9a6829c0b6a6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.231188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed97704d-79df-4381-9fea-a83446579d4a req-072913b0-35ed-446b-b836-9a6829c0b6a6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.250211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:19.252180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:19.291017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.291742 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.298306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.300604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.308538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ed97704d-79df-4381-9fea-a83446579d4a req-072913b0-35ed-446b-b836-9a6829c0b6a6 service nova] Creating event network-vif-deleted:90c230c3-c2da-47c3-ae26-a85d36beb40a for instance 1d1023d9-1301-426e-8209-382ca96c7524 on n-h1-764486-11 Jul 20 04:19:19.332755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ed97704d-79df-4381-9fea-a83446579d4a req-072913b0-35ed-446b-b836-9a6829c0b6a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121200 Jul 20 04:19:19.333614 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 615/1302] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:19.463592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:19.464386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:19.475348 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.504395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.504880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.505680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.506590 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-54076a90-3707-4cf4-9884-3ca58754f598 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1346 microversion: 2.1 time: 0.267665 Jul 20 04:19:19.507483 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 688/1303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:19 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1346 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:19.510337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.528860 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:19.530773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:19.551005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.552612 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.554079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:19.557496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:19.739395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:19.764273 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f2f4a96b-dff7-4ac8-bb8b-99a281c44a0b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1271 microversion: 2.1 time: 0.254977 Jul 20 04:19:19.773899 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 689/1304] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:19 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:19.875572 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1199780059", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7e6d563b-6d30-4058-9507-057aaaf62886"}], "block_device_mapping_v2": [{"uuid": "7a632f87-f913-4410-932b-5a164351f47e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:20.014463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:20.027316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61f86cfc-52ed-4913-a981-7442202819dd tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.569728 Jul 20 04:19:20.030155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] validate_networks() for [('7e6d563b-6d30-4058-9507-057aaaf62886', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:20.054124 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 616/1305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:19 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:20.061831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.062696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 1d1023d9-1301-426e-8209-382ca96c7524] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.084082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.084869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.086003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.087033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.103530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance 1d1023d9-1301-426e-8209-382ca96c7524 could not be found. Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 HTTP/1.1 Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:20.105535 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1d1023d9-1301-426e-8209-382ca96c7524 could not be found. Jul 20 04:19:20.107261 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1d1023d9-1301-426e-8209-382ca96c7524'} Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1023d9-1301-426e-8209-382ca96c7524 could not be found. Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:20.108205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1023d9-1301-426e-8209-382ca96c7524 could not be found. Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1023d9-1301-426e-8209-382ca96c7524 could not be found. Jul 20 04:19:20.109892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:20.112576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance 1d1023d9-1301-426e-8209-382ca96c7524 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:20.113641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c5470b9-f25e-48fa-90a3-604c5d12aab2 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524" status: 404 len: 111 microversion: 2.1 time: 0.057668 Jul 20 04:19:20.114680 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 617/1306] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/1d1023d9-1301-426e-8209-382ca96c7524 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:20.128090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.131242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.146799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.151970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.153633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.154240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.213915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:20.452633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abec4dd8-6f05-4f77-bee4-0c84ad0358a7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 204 len: 0 microversion: 2.1 time: 0.332410 Jul 20 04:19:20.455171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 618/1307] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:20 2022] DELETE /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:20.466470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.467138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.484850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.487394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.488340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.488823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.570922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:20.712925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e263dbea-434d-466f-814f-72c4a3d5638c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 204 len: 0 microversion: 2.1 time: 0.252621 Jul 20 04:19:20.715809 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 619/1308] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:20 2022] DELETE /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:20.727060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.728055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.755074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.768261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.769795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.770325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.915495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:20.926924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f890795b-e7e6-4a89-b8f3-932d09dce2b7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1346 microversion: 2.1 time: 0.209581 Jul 20 04:19:20.930417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 620/1309] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1346 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:20.954225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:20.957464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:20.967443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.970325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:20.972288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:20.974744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.111773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:21.112396 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:21.113003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:21.113411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:21.113821 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:21.127804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.128840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.130432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.131105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.159386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:21.164993 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Getting quotas for user ab72bd0852ad4f72a0c96a7ddf1bdd63 and project 05d93c82e5c5467693db0e5f8d95d202. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:21.246187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:21.249432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a632f87-f913-4410-932b-5a164351f47e',volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:21.282494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:21.293547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6590f15-3ae2-4f9f-aa49-a222441dbcfe tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 200 len: 1475 microversion: 2.1 time: 0.348386 Jul 20 04:19:21.298653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 621/1310] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:20 2022] GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:21.304210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.307756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.330238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.331442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.332630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.333303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.460917 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5ad5ce83-03ae-47d8-9208-a1be239d4972 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595199 Jul 20 04:19:21.462289 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 690/1311] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:19:21.467342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.468205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.476058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.476818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.477812 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.478413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.515749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:21.524482 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69f2fe4d-c582-4091-9989-20a5b294d508 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.224441 Jul 20 04:19:21.525190 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 622/1312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:21.529643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4a8501b6-31bc-43e6-b994-ab0930d90f96 req-42c96682-5da3-43ea-ab7e-3b741324dc09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff905974-9f37-4a14-ba4d-43507a964702", "tag": "e74b4761-dc0f-4746-8d58-702a7c12ff2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:21.539828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4a8501b6-31bc-43e6-b994-ab0930d90f96 req-42c96682-5da3-43ea-ab7e-3b741324dc09 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.540457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4a8501b6-31bc-43e6-b994-ab0930d90f96 req-42c96682-5da3-43ea-ab7e-3b741324dc09 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.554516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4a8501b6-31bc-43e6-b994-ab0930d90f96 req-42c96682-5da3-43ea-ab7e-3b741324dc09 service nova] Creating event network-changed:e74b4761-dc0f-4746-8d58-702a7c12ff2a for instance ff905974-9f37-4a14-ba4d-43507a964702 on n-h1-764486-11 Jul 20 04:19:21.559747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4a8501b6-31bc-43e6-b994-ab0930d90f96 req-42c96682-5da3-43ea-ab7e-3b741324dc09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033251 Jul 20 04:19:21.560523 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 623/1313] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:21.570738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9253fe74-d2b3-4039-8e3c-6068da15f642 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.571604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9253fe74-d2b3-4039-8e3c-6068da15f642 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.641108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9253fe74-d2b3-4039-8e3c-6068da15f642 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:21.659211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9253fe74-d2b3-4039-8e3c-6068da15f642 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1053 microversion: 2.1 time: 0.093660 Jul 20 04:19:21.661522 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 624/1314] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1053 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:21.905100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Calling method '.version_select at 0x7f8398299af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.906047 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:21.906047 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:19:21.907915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.908535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.930691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.931211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.947457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.947898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.955418 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c10ac32d-f393-456b-906c-17311cddde5b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.271886 Jul 20 04:19:21.956909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 625/1315] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:19:21.961048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:21.961662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:21.975471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.975952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:21.976780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:21.977214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.291622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:22.301305 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-102eec97-9e6c-4baa-bf23-deb13cb87663 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.837600 Jul 20 04:19:22.306536 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 691/1316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:22.315028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1f2cbd00-0740-4191-9d83-ad16b15a3c0b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Calling method '.version_select at 0x7f838bb7ca60>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.318670 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:22.318670 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:19:22.321055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1f2cbd00-0740-4191-9d83-ad16b15a3c0b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.321055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1f2cbd00-0740-4191-9d83-ad16b15a3c0b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.343594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:22.355975 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1f2cbd00-0740-4191-9d83-ad16b15a3c0b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.356637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1f2cbd00-0740-4191-9d83-ad16b15a3c0b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.376447 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26917f67-09b5-4d28-bb5a-4c0c4b72ad57 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 200 len: 1346 microversion: 2.1 time: 0.418108 Jul 20 04:19:22.377019 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1f2cbd00-0740-4191-9d83-ad16b15a3c0b tempest-HypervisorAdminV228Test-1935902315 tempest-HypervisorAdminV228Test-1935902315-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 722 microversion: 2.28 time: 0.060025 Jul 20 04:19:22.385960 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 692/1317] 10.222.0.49 () {60 vars in 1192 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 722 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:19:22.392937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 626/1318] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:21 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 1346 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:22.395825 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.400367 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:22.412895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.413654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.414642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.416981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.544771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.546074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:22.554416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.555208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.556211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.556892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.590151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:22.838774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:22.849068 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-14f7ac97-e10e-453e-9043-14ed062d9209 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 200 len: 1475 microversion: 2.1 time: 0.461148 Jul 20 04:19:22.849996 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 693/1319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 1475 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:22.856921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:22.857964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:22.869081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.869901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:22.871000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:22.871730 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.038269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:23.070787 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-86139b77-be32-42fa-a628-7bc0e6549786 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1159 microversion: 2.1 time: 0.219192 Jul 20 04:19:23.071939 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 694/1320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1159 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:23.326103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.326794 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.338462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.343872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.345625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.347839 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.433775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:23.441405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70b35780-b07c-417e-a670-7c99b7d89b4b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.902627 Jul 20 04:19:23.444736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 627/1321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:22 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:23.448975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.449854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.457048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.457771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.458707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.459353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.475998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba HTTP/1.1 Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:23.477900 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.479500 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '80919433-b6b3-4076-8757-c53e3e17e3ba'} Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:23.480440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.481996 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.483943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:23.485576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9183932-e774-4655-b90e-31ba90f5c9ca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 404 len: 111 microversion: 2.1 time: 0.041768 Jul 20 04:19:23.486384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 628/1322] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:23.629706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.630822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.640846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.642026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.643188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.643786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.673657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba/os-volume_attachments HTTP/1.1 Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:23.676074 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.677729 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '80919433-b6b3-4076-8757-c53e3e17e3ba'} Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:23.678626 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:19:23.680095 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:23.683831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:23.685034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ee6f6e8-8c06-42a1-b31c-ff937f97d9fd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059384 Jul 20 04:19:23.686209 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 629/1323] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:23.866306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:23.866925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:23.881774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.882391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.883225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:23.883663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:23.966044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:23.999563 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0fdef10d-3742-46ab-b0bd-a9a779ac844a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.670566 Jul 20 04:19:24.009600 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 695/1324] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:24.022286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1796708726", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:24.156020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:24.462939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:24.474083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05478be5-548d-4a26-bfe0-5259f23ee53c tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 200 len: 1475 microversion: 2.1 time: 0.611597 Jul 20 04:19:24.474669 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 630/1325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:23 2022] GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 1475 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:24.479189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:24.504557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:24.554173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.554625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.555421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:24.555862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:24.942671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:25.008819 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8e8aac5-f7bd-49db-93ed-c757e923735b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1169 microversion: 2.1 time: 0.525066 Jul 20 04:19:25.025419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 631/1326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:24 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1169 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:25.048059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9752c80e-817c-4dde-b201-7ce58bbd60d3 req-ce242195-b13d-4baa-8a86-ab7d1c0a3b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:25.076132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9752c80e-817c-4dde-b201-7ce58bbd60d3 req-ce242195-b13d-4baa-8a86-ab7d1c0a3b30 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.076699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9752c80e-817c-4dde-b201-7ce58bbd60d3 req-ce242195-b13d-4baa-8a86-ab7d1c0a3b30 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.118997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9752c80e-817c-4dde-b201-7ce58bbd60d3 req-ce242195-b13d-4baa-8a86-ab7d1c0a3b30 service nova] Creating event network-changed:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h1-764486-11 Jul 20 04:19:25.130322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9752c80e-817c-4dde-b201-7ce58bbd60d3 req-ce242195-b13d-4baa-8a86-ab7d1c0a3b30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103085 Jul 20 04:19:25.131050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 632/1327] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:25.145389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1072d4d6-91dd-4d3d-ad97-1dee5b68e81a req-05d1ce13-6663-4e43-bae9-6e460ff9659b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e24f9a1-ba2a-427a-9fa3-df2948e4423e", "name": "network-vif-deleted", "tag": "1f15e670-bfff-4216-8b34-a8d7f5ce6c5d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:25.170087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1072d4d6-91dd-4d3d-ad97-1dee5b68e81a req-05d1ce13-6663-4e43-bae9-6e460ff9659b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.170655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1072d4d6-91dd-4d3d-ad97-1dee5b68e81a req-05d1ce13-6663-4e43-bae9-6e460ff9659b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.195505 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1072d4d6-91dd-4d3d-ad97-1dee5b68e81a req-05d1ce13-6663-4e43-bae9-6e460ff9659b service nova] Creating event network-vif-deleted:1f15e670-bfff-4216-8b34-a8d7f5ce6c5d for instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e on n-h1-764486-11 Jul 20 04:19:25.207682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1072d4d6-91dd-4d3d-ad97-1dee5b68e81a req-05d1ce13-6663-4e43-bae9-6e460ff9659b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070101 Jul 20 04:19:25.211562 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 633/1328] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:25.224083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.226804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.242508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.243119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.244026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.245621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.493818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:25.504005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b02c6be5-919c-4dce-9d4f-348c2d56d96f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.290721 Jul 20 04:19:25.505246 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 634/1329] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:25.510537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.511379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.519304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.520040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.521029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.521633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.729722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:25.756153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ba2713d-b822-4bdc-8c08-b108bf7a13ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.248425 Jul 20 04:19:25.759212 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 635/1330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:25.775173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:25.776214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:25.784695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.786499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.787541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:25.788257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:25.995005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:26.014182 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-883de3ad-6758-43b5-b743-5b1177a4eb37 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 2348 microversion: 2.25 time: 0.244185 Jul 20 04:19:26.015258 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 636/1331] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:25 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 2348 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:26.023600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.024759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: d5361b9d-6974-4eb0-aee8-2ef8b3910e03] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.033902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.034832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.035619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.036226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.289921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 could not be found. Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 HTTP/1.1 Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:26.291753 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 could not be found. Jul 20 04:19:26.293506 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd5361b9d-6974-4eb0-aee8-2ef8b3910e03'} Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 could not be found. Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:26.295515 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 could not be found. Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 could not be found. Jul 20 04:19:26.298449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.300385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:26.300385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fcc6303e-b60f-4525-88fb-fabc00c1b3ad tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03" status: 404 len: 111 microversion: 2.1 time: 0.276490 Jul 20 04:19:26.300385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 637/1332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/d5361b9d-6974-4eb0-aee8-2ef8b3910e03 => generated 111 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:26.301706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.302320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.309365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.310037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.311000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.311596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.404097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:26.405172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:26.405779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:26.406277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:26.407457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:26.427620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.428395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.429389 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.429986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.458641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:26.467448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:26.486876 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:26.489415 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:26.500912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:26.525680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0249b50-8c27-4b3d-a6b0-495b30c341ca tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1211 microversion: 2.1 time: 0.228088 Jul 20 04:19:26.526306 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 638/1333] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1211 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:26.543009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8eb1981c-79e4-4079-aa42-784c7af5218f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.545416 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-97434ebc-e789-4a72-8811-13ce9f59b41e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.542810 Jul 20 04:19:26.546290 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 696/1334] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:26.552796 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.554856 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 0e24f9a1-ba2a-427a-9fa3-df2948e4423e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.555625 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:26.555625 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:19:26.557206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb1981c-79e4-4079-aa42-784c7af5218f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.559797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb1981c-79e4-4079-aa42-784c7af5218f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.560738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb1981c-79e4-4079-aa42-784c7af5218f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.561187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb1981c-79e4-4079-aa42-784c7af5218f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.565660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.566357 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.567324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.568004 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.585930 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e could not be found. Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e HTTP/1.1 Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:26.588286 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e could not be found. Jul 20 04:19:26.589848 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '0e24f9a1-ba2a-427a-9fa3-df2948e4423e'} Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e could not be found. Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:26.590745 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e could not be found. Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e could not be found. Jul 20 04:19:26.592211 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:26.596568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance 0e24f9a1-ba2a-427a-9fa3-df2948e4423e could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:26.597627 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-75d134ff-b174-4eb3-af89-e1e52da05e06 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e" status: 404 len: 111 microversion: 2.1 time: 0.050222 Jul 20 04:19:26.598666 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 697/1335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/0e24f9a1-ba2a-427a-9fa3-df2948e4423e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:26.606211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.607026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.609196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:26.616311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.617072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.618234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.618891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.626454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:26.640622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8eb1981c-79e4-4079-aa42-784c7af5218f tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.112365 Jul 20 04:19:26.641835 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 639/1336] 10.222.0.49 () {60 vars in 1216 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:19:26.661166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1721ee87-494f-4678-b603-7141a997209d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.661822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1721ee87-494f-4678-b603-7141a997209d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.799661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1721ee87-494f-4678-b603-7141a997209d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:26.817941 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1721ee87-494f-4678-b603-7141a997209d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b" status: 200 len: 1215 microversion: 2.1 time: 0.175023 Jul 20 04:19:26.821965 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 640/1337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:26.835968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-079e3a5d-bdba-455b-a1b3-4a749cba36c5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.909619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-079e3a5d-bdba-455b-a1b3-4a749cba36c5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/0c5f17c8-317b-483e-b02f-b2db3fe962bb" status: 204 len: 0 microversion: 2.1 time: 0.084858 Jul 20 04:19:26.914202 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 641/1338] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:19:26 2022] DELETE /compute/v2.1/os-server-groups/0c5f17c8-317b-483e-b02f-b2db3fe962bb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:26.922286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:26.923684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:26.941326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.944812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:26.947143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:26.947839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:27.376052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:27.386207 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edfb7f85-f4e7-46a9-9d7f-d05b7e412124 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.471559 Jul 20 04:19:27.389949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 642/1339] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:27.403662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0405d576-6a0f-47d5-a249-347e2575d479 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.404340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0405d576-6a0f-47d5-a249-347e2575d479 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.447035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0405d576-6a0f-47d5-a249-347e2575d479 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:27.899623 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.scheduler.client.report [None req-0405d576-6a0f-47d5-a249-347e2575d479 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Deleted allocations for instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b Jul 20 04:19:27.936741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0405d576-6a0f-47d5-a249-347e2575d479 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b" status: 204 len: 0 microversion: 2.1 time: 0.544344 Jul 20 04:19:27.939630 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 643/1340] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:27 2022] DELETE /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:27.964994 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:27.970424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:27.970996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:27.996155 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7c81f969-0193-43b6-ba9b-fe97be8e32e0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 1.388666 Jul 20 04:19:27.997015 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 698/1341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:26 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.003673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-44c6e4f0-a244-4f57-8c8b-bcf93d372e66 req-70b93409-910f-45f5-b81a-fe0d94cd238f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5361b9d-6974-4eb0-aee8-2ef8b3910e03", "name": "network-vif-deleted", "tag": "527a1f9c-89bf-45d8-9e19-eb8f629318c0"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:28.004770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.010473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.013468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.014090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.028618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-44c6e4f0-a244-4f57-8c8b-bcf93d372e66 req-70b93409-910f-45f5-b81a-fe0d94cd238f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.033261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-44c6e4f0-a244-4f57-8c8b-bcf93d372e66 req-70b93409-910f-45f5-b81a-fe0d94cd238f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.065962 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-44c6e4f0-a244-4f57-8c8b-bcf93d372e66 req-70b93409-910f-45f5-b81a-fe0d94cd238f service nova] Creating event network-vif-deleted:527a1f9c-89bf-45d8-9e19-eb8f629318c0 for instance d5361b9d-6974-4eb0-aee8-2ef8b3910e03 on n-h2-764486-11 Jul 20 04:19:28.077055 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-44c6e4f0-a244-4f57-8c8b-bcf93d372e66 req-70b93409-910f-45f5-b81a-fe0d94cd238f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076803 Jul 20 04:19:28.080546 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 699/1342] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:28.085135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:28.087421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.088737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.096521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.099527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.100637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.101085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.272594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7594339-7923-4a49-9681-eb88f46fdd91 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 204 len: 0 microversion: 2.1 time: 0.330210 Jul 20 04:19:28.279632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 644/1343] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:27 2022] DELETE /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:28.292947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.294181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.302181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.302791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.303847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.304536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.401922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:28.414913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-612e39e1-67f2-4fc9-b6b2-0e565e57553f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b" status: 200 len: 1219 microversion: 2.1 time: 0.133755 Jul 20 04:19:28.417530 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 645/1344] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.435377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.436081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.448521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.449095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.450119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.461003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.492252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:28.583456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:28.596161 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-77c93c8d-d8b8-4654-b1b1-8130876d6015 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1211 microversion: 2.1 time: 0.514123 Jul 20 04:19:28.597024 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 700/1345] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1211 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:28.615680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.620533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.635370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.635862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.636915 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.637376 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.647669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3e3fcb5-3348-47a3-8a55-7b8c308940b5 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 204 len: 0 microversion: 2.1 time: 0.223708 Jul 20 04:19:28.651064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 646/1346] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:28 2022] DELETE /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:28.685385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:28.686121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:28.704274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.704766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.709682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:28.711250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:28.754789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:28.993656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:29.013336 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2f8bbf0-f05e-4e5e-9865-5cf33629dbf9 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 200 len: 1475 microversion: 2.1 time: 0.356069 Jul 20 04:19:29.023066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 647/1347] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 1475 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:29.033987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d30577a1-9f91-40bb-8da5-39e6b606da26 req-26ebc6c7-286a-464b-ae6a-41847799ae00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:29.043490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d30577a1-9f91-40bb-8da5-39e6b606da26 req-26ebc6c7-286a-464b-ae6a-41847799ae00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.043978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d30577a1-9f91-40bb-8da5-39e6b606da26 req-26ebc6c7-286a-464b-ae6a-41847799ae00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.062854 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d30577a1-9f91-40bb-8da5-39e6b606da26 req-26ebc6c7-286a-464b-ae6a-41847799ae00 service nova] Creating event network-changed:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h1-764486-11 Jul 20 04:19:29.082169 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d30577a1-9f91-40bb-8da5-39e6b606da26 req-26ebc6c7-286a-464b-ae6a-41847799ae00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056815 Jul 20 04:19:29.082724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 648/1348] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:29.088120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.088884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.102513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.102971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.103775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.104219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.327930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:29.342592 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e43ed380-5b1e-43f0-914f-399e97a3761e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.735538 Jul 20 04:19:29.345358 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 701/1349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:28 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:29.379568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-3d7b8bd1-f2e6-4980-b79d-45ea969c3d52 req-a6a5370c-5d80-4153-88b2-19066154db39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff905974-9f37-4a14-ba4d-43507a964702", "name": "network-vif-plugged", "status": "completed", "tag": "e74b4761-dc0f-4746-8d58-702a7c12ff2a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:29.412540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3d7b8bd1-f2e6-4980-b79d-45ea969c3d52 req-a6a5370c-5d80-4153-88b2-19066154db39 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.413121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3d7b8bd1-f2e6-4980-b79d-45ea969c3d52 req-a6a5370c-5d80-4153-88b2-19066154db39 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.435221 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3d7b8bd1-f2e6-4980-b79d-45ea969c3d52 req-a6a5370c-5d80-4153-88b2-19066154db39 service nova] Creating event network-vif-plugged:e74b4761-dc0f-4746-8d58-702a7c12ff2a for instance ff905974-9f37-4a14-ba4d-43507a964702 on n-h1-764486-11 Jul 20 04:19:29.467555 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-3d7b8bd1-f2e6-4980-b79d-45ea969c3d52 req-a6a5370c-5d80-4153-88b2-19066154db39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081138 Jul 20 04:19:29.477620 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 702/1350] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:29.490915 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.494586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.548039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.552970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.559355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.559984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.595422 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b HTTP/1.1 Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:29.598246 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:19:29.599843 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '4ae7fdeb-bfaf-4fc2-9f58-40721e61586b'} Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:29.600773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:19:29.602200 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:29.607431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:29.611582 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-daf49be0-34a5-46e4-8e22-6fc538d282ae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b" status: 404 len: 111 microversion: 2.1 time: 0.132358 Jul 20 04:19:29.612993 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 703/1351] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:29.620111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27d7f618-8e76-46a8-9786-0d4b2e06e65a", "device": "/dev/xvdb"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:29.639215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:29.643231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.651823 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f11dec31-767e-4c52-b2a0-00170aaebe0d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.565151 Jul 20 04:19:29.655023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 649/1352] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:29.660438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.667128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.670658 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.671714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.673827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:29.675179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:29.687598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.695014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.696228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:29.697067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:29.993990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.004866 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c62ba76d-ee2c-43ab-b296-d772c37f9933 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1211 microversion: 2.1 time: 0.348263 Jul 20 04:19:30.005891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 650/1353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:29 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1211 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.012499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-292536604", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:30.079181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:30.106204 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c0cd4a71-2013-4376-b229-3334e88841c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "POST /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.489739 Jul 20 04:19:30.106840 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 704/1354] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Jul 20 04:19:29 2022] POST /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:19:30.115098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.116023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.126296 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.127107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.128267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.128980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.305171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.313993 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cab7f337-1d9b-48b5-8f86-51e855ae6f6e tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 200 len: 1475 microversion: 2.1 time: 0.205738 Jul 20 04:19:30.314615 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 705/1355] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.491696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-39722b33-5f11-4c6c-9c3a-692210b86dff tempest-InstanceUsageAuditLogTestJSON-462966195 tempest-InstanceUsageAuditLogTestJSON-462966195-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.493413 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:30.493413 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:19:30.518514 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-39722b33-5f11-4c6c-9c3a-692210b86dff tempest-InstanceUsageAuditLogTestJSON-462966195 tempest-InstanceUsageAuditLogTestJSON-462966195-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 04:19:30" status: 200 len: 318 microversion: 2.1 time: 0.202527 Jul 20 04:19:30.519635 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 706/1356] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2004%3A19%3A30 => generated 318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:30.525923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.527001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.535303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.535754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.536560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.536999 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.542318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:30.542762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:30.544072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:30.544769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:30.545261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:30.554349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.554888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.555778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.556282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.575680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:30.582344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:30.597769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:30.600445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:30.654702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e2bbeb0-9df9-4cdb-bb7f-f45d86dd0d78 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647269 Jul 20 04:19:30.655668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 651/1357] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:30.666050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e87d9f4-cc07-4441-94ba-d59b5bcf1d10 tempest-InstanceUsageAuditLogTestJSON-462966195 tempest-InstanceUsageAuditLogTestJSON-462966195-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.667027 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:30.667027 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:19:30.692187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e87d9f4-cc07-4441-94ba-d59b5bcf1d10 tempest-InstanceUsageAuditLogTestJSON-462966195 tempest-InstanceUsageAuditLogTestJSON-462966195-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030648 Jul 20 04:19:30.693163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.693325 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 652/1358] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:30.702336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-028f2d87-ce23-4109-8ef7-a4f0f54592a2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.702951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-028f2d87-ce23-4109-8ef7-a4f0f54592a2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.714995 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d068516e-4191-4186-9df1-10ae94fcf0a8 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1324 microversion: 2.1 time: 0.180735 Jul 20 04:19:30.757033 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 707/1359] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:30.767511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:30.768231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:30.786939 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.787380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.788160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:30.788611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:30.806205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-028f2d87-ce23-4109-8ef7-a4f0f54592a2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:30.820280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-028f2d87-ce23-4109-8ef7-a4f0f54592a2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1214 microversion: 2.1 time: 0.119433 Jul 20 04:19:30.821698 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 653/1360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:31.024749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:31.025642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:31.037513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.037965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.038762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.039203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.430485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:31.441798 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6492de80-0dd0-4d14-a3f2-843aecd88449 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.682936 Jul 20 04:19:31.451256 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 708/1361] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:30 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:31.466990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:31.466990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:31.499220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.502323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:31.504945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.507128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.510931 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f34ad0a3-3242-4762-95b0-decbaf7d2671 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1211 microversion: 2.1 time: 0.491866 Jul 20 04:19:31.511087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.514078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 654/1362] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:31 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1211 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:31.528823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:31.536762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:31.550328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Searching by: {'deleted': False, 'project_id': '8c8f959211104019a29f2773235609a1'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:31.574091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.575414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.576588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:31.577258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:31.767653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:32.009119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.019394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1988b07-a761-431a-baf1-e2f106a5a966 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.497745 Jul 20 04:19:32.021795 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 655/1363] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:19:31 2022] GET /compute/v2.1/servers => generated 334 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:32.033971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.037616 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-297b0109-8989-4fa0-93de-902dccc3557b tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 200 len: 1475 microversion: 2.1 time: 0.571850 Jul 20 04:19:32.039384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.039784 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 709/1364] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:31 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 1475 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:32.056569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.058947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.061663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.066757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.067429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.067552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.068274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.068421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.068811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.069331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.264098 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.275856 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8b6642f9-b6f0-42ac-bccd-67eef4c789ed tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1266 microversion: 2.1 time: 0.234875 Jul 20 04:19:32.277070 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 710/1365] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:32.282534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.290352 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.291309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Searching by: {'deleted': False, 'project_id': '8c8f959211104019a29f2773235609a1'} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:19:32.302033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.302723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.303539 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.303974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.536329 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.multi_cell_list [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:19:32.629258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.641045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6ab32d0-9de2-474a-99fc-cb22cc5722e7 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1521 microversion: 2.1 time: 0.616726 Jul 20 04:19:32.652193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 656/1366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:32.662250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:32.663083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.663712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.671248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.672324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.684462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.685128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.686022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:32.686505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:32.970861 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-055b0501-255d-4d53-a376-5f61c493a064 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.692178 Jul 20 04:19:32.972140 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 711/1367] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:32.979141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:32.980140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:32.997149 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.000118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.004775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.006632 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.225252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:33.233486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:33.241951 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-241f0ca4-1d41-4917-8274-7e453da96476 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.594810 Jul 20 04:19:33.251029 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1d5f91c5-4d3b-424d-98c4-bf198426b142 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.269363 Jul 20 04:19:33.251222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 657/1368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.251328 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 712/1369] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:32 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.262286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.263023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:33.265250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-b8addc4e-20aa-475a-956e-c2d38109aa26 req-15f80730-0aed-4061-a673-8f4708fed6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40670f12-c948-46ba-b762-0cb0d2bf024a", "name": "network-vif-deleted", "tag": "0794223d-8781-4dd5-b99f-c05dd7046e91"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:33.272432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.273159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.274484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.274976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.289247 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-b8addc4e-20aa-475a-956e-c2d38109aa26 req-15f80730-0aed-4061-a673-8f4708fed6f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.290038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-b8addc4e-20aa-475a-956e-c2d38109aa26 req-15f80730-0aed-4061-a673-8f4708fed6f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.318077 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-b8addc4e-20aa-475a-956e-c2d38109aa26 req-15f80730-0aed-4061-a673-8f4708fed6f8 service nova] Creating event network-vif-deleted:0794223d-8781-4dd5-b99f-c05dd7046e91 for instance 40670f12-c948-46ba-b762-0cb0d2bf024a on n-h2-764486-11 Jul 20 04:19:33.330881 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-b8addc4e-20aa-475a-956e-c2d38109aa26 req-15f80730-0aed-4061-a673-8f4708fed6f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078566 Jul 20 04:19:33.334019 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 713/1370] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:33.347475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-72871bc4-066d-406f-81f2-e64e32208fe3 req-475a5e9b-dc3d-41e9-b61f-2893292aecc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42964081-bbee-49b1-bd89-d66aebcabecf", "name": "network-vif-deleted", "tag": "c06c0ed0-6ff0-4663-b251-be8d2061def7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:33.367444 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-72871bc4-066d-406f-81f2-e64e32208fe3 req-475a5e9b-dc3d-41e9-b61f-2893292aecc0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.368729 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-72871bc4-066d-406f-81f2-e64e32208fe3 req-475a5e9b-dc3d-41e9-b61f-2893292aecc0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.393963 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-72871bc4-066d-406f-81f2-e64e32208fe3 req-475a5e9b-dc3d-41e9-b61f-2893292aecc0 service nova] Creating event network-vif-deleted:c06c0ed0-6ff0-4663-b251-be8d2061def7 for instance 42964081-bbee-49b1-bd89-d66aebcabecf on n-h2-764486-11 Jul 20 04:19:33.404788 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-72871bc4-066d-406f-81f2-e64e32208fe3 req-475a5e9b-dc3d-41e9-b61f-2893292aecc0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068552 Jul 20 04:19:33.408411 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 714/1371] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:33.424533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b1bc311-1c0b-49a9-abe1-71c03cbf79e4 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.443339 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b1bc311-1c0b-49a9-abe1-71c03cbf79e4 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030415 Jul 20 04:19:33.447854 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 715/1372] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:33.458003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.460779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:33.478161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.481265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.482099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.482537 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.573362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:33.591774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ed79e17-3f36-4963-b082-77173d2a23ae tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1521 microversion: 2.1 time: 0.345483 Jul 20 04:19:33.597556 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 658/1373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.598131 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.598584 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.599047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lazy-loading 'fault' on Instance uuid 42964081-bbee-49b1-bd89-d66aebcabecf {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:33.625843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:33.629611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:33.643902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.644836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.646797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.648700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.761349 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:33.772097 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2bb37b46-955e-41e9-873b-6aa50f19cbf7 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 200 len: 1309 microversion: 2.1 time: 0.322792 Jul 20 04:19:33.785574 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 716/1374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:33.791387 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-2c9983cc-1cdd-46eb-99da-04bd525fb649 req-6c160b73-eabe-41d6-b8fa-92901de4f65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "name": "network-vif-plugged", "status": "completed", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:33.810235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2c9983cc-1cdd-46eb-99da-04bd525fb649 req-6c160b73-eabe-41d6-b8fa-92901de4f65f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.810690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2c9983cc-1cdd-46eb-99da-04bd525fb649 req-6c160b73-eabe-41d6-b8fa-92901de4f65f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.840338 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-2c9983cc-1cdd-46eb-99da-04bd525fb649 req-6c160b73-eabe-41d6-b8fa-92901de4f65f service nova] Creating event network-vif-plugged:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h1-764486-11 Jul 20 04:19:33.854028 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-2c9983cc-1cdd-46eb-99da-04bd525fb649 req-6c160b73-eabe-41d6-b8fa-92901de4f65f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075680 Jul 20 04:19:33.854858 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 717/1375] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:33.873977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1333721439"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:33.875693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:33.890120 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.891534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.892947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:33.900700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:33.928975 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:34.128382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:34.136387 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72473658-c5a5-4c74-a56b-510e31e5d18a tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1272 microversion: 2.1 time: 0.535990 Jul 20 04:19:34.144294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 659/1376] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:33 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1272 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:34.149761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.155584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.168606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.172694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.173829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.174482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.229984 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4c9b01fc-680b-465b-9b62-8a8647856f9a tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702/action" status: 202 len: 0 microversion: 2.1 time: 0.369415 Jul 20 04:19:34.231773 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 718/1377] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:33 2022] POST /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:19:34.236530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:34.248998 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-72680528-8b56-45fe-ad94-78cb0bd76493 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '.version_select at 0x7f838bb7c8b0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.371682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afc0062c-81cd-4a1a-96ae-b9b8e675c8cb tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 204 len: 0 microversion: 2.1 time: 0.225571 Jul 20 04:19:34.372752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 660/1378] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:34 2022] DELETE /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:34.385351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.387782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.399262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:34.401395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.403539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.407051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.408516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.509656 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-72680528-8b56-45fe-ad94-78cb0bd76493 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9" status: 204 len: 0 microversion: 2.1 time: 0.272202 Jul 20 04:19:34.510300 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 719/1379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] DELETE /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:19:34.515299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.516231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.518236 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:34.532633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.533996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.535482 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.536266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.735119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:34.746707 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7f57bf31-8021-4115-b978-3a6f783bcc68 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.235012 Jul 20 04:19:34.756980 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 720/1380] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:34.765117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.766490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.783253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.783708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.786125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.786591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.804600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:34.815274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a09fd6f8-23ca-41f1-bf6c-c13da837d96b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1313 microversion: 2.1 time: 0.439887 Jul 20 04:19:34.816591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 661/1381] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:34.822327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcc3bd89-4c26-43b9-868d-0fa40264eaf5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '.version_select at 0x7f838ba87c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.853170 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dcc3bd89-4c26-43b9-868d-0fa40264eaf5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Image not found. Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcc3bd89-4c26-43b9-868d-0fa40264eaf5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9 HTTP/1.1 Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:34.866316 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'da03a720-caba-4987-a1f6-3d2f4763e4b9'} Jul 20 04:19:34.867785 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:34.868681 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da03a720-caba-4987-a1f6-3d2f4763e4b9 Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:19:34.869827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da03a720-caba-4987-a1f6-3d2f4763e4b9 could not be found. Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:19:34.871139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:19:34.872315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.875387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcc3bd89-4c26-43b9-868d-0fa40264eaf5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:34.876852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcc3bd89-4c26-43b9-868d-0fa40264eaf5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9" status: 404 len: 62 microversion: 2.1 time: 0.058763 Jul 20 04:19:34.878180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 662/1382] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:19:34.883776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.885527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 42964081-bbee-49b1-bd89-d66aebcabecf] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.896703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.897783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.899619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.900219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.923479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance 42964081-bbee-49b1-bd89-d66aebcabecf could not be found. Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf HTTP/1.1 Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:34.925364 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 42964081-bbee-49b1-bd89-d66aebcabecf could not be found. Jul 20 04:19:34.927140 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '42964081-bbee-49b1-bd89-d66aebcabecf'} Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42964081-bbee-49b1-bd89-d66aebcabecf could not be found. Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:34.928550 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42964081-bbee-49b1-bd89-d66aebcabecf could not be found. Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42964081-bbee-49b1-bd89-d66aebcabecf could not be found. Jul 20 04:19:34.930549 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:34.932330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance 42964081-bbee-49b1-bd89-d66aebcabecf could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:34.932330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38c97907-2275-45bb-9e2c-4d7e75320df8 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf" status: 404 len: 111 microversion: 2.1 time: 0.047428 Jul 20 04:19:34.932330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 663/1383] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/42964081-bbee-49b1-bd89-d66aebcabecf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:34.933064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:34.933537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:34.954859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.955486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:34.957161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:34.957610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.017627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:35.028775 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6ac288a-d903-405d-820f-24127890933a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1698 microversion: 2.1 time: 0.269151 Jul 20 04:19:35.033359 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 721/1384] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1698 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.040889 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.042385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 40670f12-c948-46ba-b762-0cb0d2bf024a] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.051951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.052780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.053766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.054383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.086277 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance 40670f12-c948-46ba-b762-0cb0d2bf024a could not be found. Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a HTTP/1.1 Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:35.087963 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 40670f12-c948-46ba-b762-0cb0d2bf024a could not be found. Jul 20 04:19:35.089405 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '40670f12-c948-46ba-b762-0cb0d2bf024a'} Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40670f12-c948-46ba-b762-0cb0d2bf024a could not be found. Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:35.090158 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40670f12-c948-46ba-b762-0cb0d2bf024a could not be found. Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40670f12-c948-46ba-b762-0cb0d2bf024a could not be found. Jul 20 04:19:35.091354 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:35.092442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance 40670f12-c948-46ba-b762-0cb0d2bf024a could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:35.092442 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5427deb5-d8d7-4a4d-80d3-05884f30cdc6 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a" status: 404 len: 111 microversion: 2.1 time: 0.054883 Jul 20 04:19:35.093408 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 722/1385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/40670f12-c948-46ba-b762-0cb0d2bf024a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:35.098937 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-22f905f0-50e3-44b8-8fd1-321c56cf24fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.137654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-22f905f0-50e3-44b8-8fd1-321c56cf24fb tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/ce6451e7-fe61-43e9-abe0-b4063e45e1ec" status: 204 len: 0 microversion: 2.1 time: 0.042580 Jul 20 04:19:35.140487 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 723/1386] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:19:35 2022] DELETE /compute/v2.1/os-server-groups/ce6451e7-fe61-43e9-abe0-b4063e45e1ec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:35.146284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:35.150022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.150202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.157996 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.158589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.158936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6bf095d-9f5d-4be3-80b6-7afcb407e16c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1533 microversion: 2.1 time: 0.230146 Jul 20 04:19:35.159572 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.160262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 664/1387] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:34 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1533 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.163102 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.175912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.177095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.187877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.188785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.190514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.191256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.193069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:35.339209 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5d31e74a-091b-4726-b9a9-49d4fdcf8623 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "DELETE /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 204 len: 0 microversion: 2.1 time: 0.193384 Jul 20 04:19:35.339808 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 724/1388] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:35 2022] DELETE /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:35.349264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.349971 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.357841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.358527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.360079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.360692 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.429872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:35.442292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3b1bfd9-ad19-41df-a1a6-f7f2491552a0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.280255 Jul 20 04:19:35.443478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 665/1389] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.520620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:35.529427 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-203f2ba5-4b82-45c5-8958-40fbc7fa9eda tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1471 microversion: 2.1 time: 0.184555 Jul 20 04:19:35.530354 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 725/1390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:35.763769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.764586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.776480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.777062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.778125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.778669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.833104 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:35.833783 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:35.852086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.852584 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:35.853372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:35.853814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.082815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.092594 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8504af1b-dd72-449b-83a4-6ad67c52626d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1462 microversion: 2.1 time: 0.263564 Jul 20 04:19:36.093743 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 726/1391] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1462 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:36.098564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.099276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.105954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.106527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.107393 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.107918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.166185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.177717 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9073bc3e-c95e-455a-8ee8-089a045c2106 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.418314 Jul 20 04:19:36.182069 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 666/1392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:35 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.188978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.190063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.201691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.204172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.205616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.206239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.216875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:36.307196 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.318747 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9fba4f33-7d67-4910-b1ce-27449fc1c956 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1698 microversion: 2.1 time: 0.223776 Jul 20 04:19:36.319853 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 727/1393] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1698 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.324804 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.325901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.333930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.334923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.335907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.337343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.493245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20bc55d5-36fb-48f0-9d04-c2b2de029a8d tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1615 microversion: 2.1 time: 0.309513 Jul 20 04:19:36.494464 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 667/1394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1615 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.508907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.520198 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-69dd517a-63c0-4c06-893c-8013f6ef6fc6 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1539 microversion: 2.1 time: 0.198901 Jul 20 04:19:36.520803 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 728/1395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.526024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.526834 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.533734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.534530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.536380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.537182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.745706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.757289 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c7c3a68a-5792-4aba-a151-c6a51bf8e59b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.235184 Jul 20 04:19:36.758113 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 729/1396] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:36.771005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1439399d-50b5-4483-a167-d87804bf476b tempest-NetworksTest-852243713 tempest-NetworksTest-852243713-project-admin] Calling method '.version_select at 0x7f838bbd6160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.772604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:36.773189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.783613 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.784075 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.784903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:36.785346 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:36.829399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '46f6ec98db4f47ff8fc204535ebda46c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d24145bb42e47f690aebce383d0a065', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:36.829903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] flavor_id is None. Assuming migration. {{(pid=123723) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:19:36.830354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:19:36.967733 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1bf35aaf-d89e-4136-b797-9dd093b57f71 tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea/action" status: 202 len: 0 microversion: 2.1 time: 0.199106 Jul 20 04:19:36.971519 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 730/1397] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:36 2022] POST /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:36.980207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:36.985357 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:36.998744 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.000291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.008820 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.009653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.180058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1439399d-50b5-4483-a167-d87804bf476b tempest-NetworksTest-852243713 tempest-NetworksTest-852243713-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 6730 microversion: 2.1 time: 0.684243 Jul 20 04:19:37.183327 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 668/1398] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/os-networks => generated 6730 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:37.200412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.203739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.218195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.219370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.221082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.221933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.303559 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:37.315993 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-47f8e4e9-9660-4cd1-8b9c-5862124d1691 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1471 microversion: 2.1 time: 0.340031 Jul 20 04:19:37.326353 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 731/1399] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:36 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:37.336146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1a1be140-d9cc-4f4f-b1ef-245c6004e1ad tempest-NetworksTest-852243713 tempest-NetworksTest-852243713-project-admin] Calling method '.version_select at 0x7f838bca75e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.715436 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1a1be140-d9cc-4f4f-b1ef-245c6004e1ad tempest-NetworksTest-852243713 tempest-NetworksTest-852243713-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks/b082fd41-d46a-40a3-a334-ca1a83b364f9" status: 200 len: 652 microversion: 2.1 time: 0.383120 Jul 20 04:19:37.716412 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 732/1400] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/os-networks/b082fd41-d46a-40a3-a334-ca1a83b364f9 => generated 652 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:37.724887 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:37.725741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:37.735454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.736379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:37.741679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:37.743508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.029891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.048050 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a39d1c9d-3c42-46e0-90f9-6b1f1798b58f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.330199 Jul 20 04:19:38.053431 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 733/1401] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.059914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-8e9dd0fc-f615-494f-9b2a-ee0e1dea622d req-1ea38808-81de-4629-8286-290a8afe1969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfe4be6-cc34-42ac-bc33-e26dfc931291", "tag": "69652a02-0b5e-436c-a80f-56ba466afcef"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:38.081866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.087128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8e9dd0fc-f615-494f-9b2a-ee0e1dea622d req-1ea38808-81de-4629-8286-290a8afe1969 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.087615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-8e9dd0fc-f615-494f-9b2a-ee0e1dea622d req-1ea38808-81de-4629-8286-290a8afe1969 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.089590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9054fbda-cb2f-4ec2-a929-49b12af9b537 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1471 microversion: 2.1 time: 0.898011 Jul 20 04:19:38.090181 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 669/1402] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:37 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1471 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.102237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:38.103898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.105989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.126404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.126793 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-8e9dd0fc-f615-494f-9b2a-ee0e1dea622d req-1ea38808-81de-4629-8286-290a8afe1969 service nova] Creating event network-changed:69652a02-0b5e-436c-a80f-56ba466afcef for instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 on n-h2-764486-11 Jul 20 04:19:38.126938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.128211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.128685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.154068 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-8e9dd0fc-f615-494f-9b2a-ee0e1dea622d req-1ea38808-81de-4629-8286-290a8afe1969 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099223 Jul 20 04:19:38.167998 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 734/1403] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:38.191411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.192507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.202560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.205617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.206968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.207420 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.363314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.375803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8af47a5a-4282-45cb-9d50-bd579a73035a tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1631 microversion: 2.1 time: 0.284553 Jul 20 04:19:38.377263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 670/1404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1631 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.383844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1061ee53-723c-4c48-a32b-92a35ab321ad tempest-NetworksTest-852243713 tempest-NetworksTest-852243713-project-admin] Calling method '.version_select at 0x7f838bab6ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.503453 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.512046 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0b7e596e-e20d-4c66-872d-9460591306db tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1521 microversion: 2.1 time: 0.341207 Jul 20 04:19:38.512665 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 735/1405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.522946 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.523666 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.534957 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.537486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.544841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.546405 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.842674 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1061ee53-723c-4c48-a32b-92a35ab321ad tempest-NetworksTest-852243713 tempest-NetworksTest-852243713-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 6730 microversion: 2.1 time: 0.463210 Jul 20 04:19:38.849367 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 671/1406] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/os-networks => generated 6730 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.857906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.860097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.877651 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:38.882858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.885602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.889102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.889853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.893099 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-34602cba-6914-491d-a030-c930653a00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.378786 Jul 20 04:19:38.893708 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 736/1407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:38.908298 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:38.914152 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:38.924882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.925858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.928860 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.929563 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.987500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:38.987962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:38.988444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lazy-loading 'fault' on Instance uuid 933fbdd2-8589-43a1-a99a-8f22c47fcb69 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:38.989960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:39.087803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd93bfda90414060a4d3a2f8a0d53115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42cb2cc3e3e40b89c2ab0ba9bb4dc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.099393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-620e116d-b538-426a-bd5a-4da0bd37b4cc tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 200 len: 1306 microversion: 2.1 time: 0.247432 Jul 20 04:19:39.103528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 672/1408] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:38 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 1306 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.109654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c0aac418-1030-401f-96aa-d306ef7d4559 req-e84faa32-cf54-42a4-bb0a-c99859ab7a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f", "name": "network-vif-deleted", "tag": "fb6220a9-6849-48c0-a1c5-316a5e11dac0"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:39.134866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c0aac418-1030-401f-96aa-d306ef7d4559 req-e84faa32-cf54-42a4-bb0a-c99859ab7a14 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.136692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c0aac418-1030-401f-96aa-d306ef7d4559 req-e84faa32-cf54-42a4-bb0a-c99859ab7a14 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.179852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c0aac418-1030-401f-96aa-d306ef7d4559 req-e84faa32-cf54-42a4-bb0a-c99859ab7a14 service nova] Creating event network-vif-deleted:fb6220a9-6849-48c0-a1c5-316a5e11dac0 for instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f on n-h2-764486-11 Jul 20 04:19:39.183708 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7651042b-c0e6-4830-9f6b-85499f62d5a0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 204 len: 0 microversion: 2.1 time: 0.285112 Jul 20 04:19:39.185709 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 737/1409] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:38 2022] DELETE /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:39.195127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.195830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.196063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c0aac418-1030-401f-96aa-d306ef7d4559 req-e84faa32-cf54-42a4-bb0a-c99859ab7a14 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087132 Jul 20 04:19:39.197367 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 673/1410] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:39.215121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.216840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.216985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.219706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.219894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.221599 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.244797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.248800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.250987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.254700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.422000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.435188 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2cb596e1-3058-43bf-91da-873c17ee9858 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.248106 Jul 20 04:19:39.435953 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 738/1411] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.442068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.443278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.460205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.461446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.463207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.463813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.475801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.488809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b3125db-d544-4e77-adb4-49ad2769e96e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1471 microversion: 2.1 time: 0.286580 Jul 20 04:19:39.492482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 674/1412] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.503354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.504142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.521385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.522264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.523203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.523801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.592479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.593078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.593683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lazy-loading 'fault' on Instance uuid e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:39.696967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.707731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:39.711898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f937ca51-73dc-4c71-bfef-14e2d3282b1d tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1358 microversion: 2.1 time: 0.214931 Jul 20 04:19:39.713066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 675/1413] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.717042 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-39782db9-c5ff-45cd-8e21-4988f920a8d1 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1527 microversion: 2.1 time: 0.279822 Jul 20 04:19:39.728192 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 739/1414] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1527 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:39.911359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:39.912003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:39.919111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.919559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:39.920337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:39.920794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.081466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.090451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99f11fec-2e02-4330-9ea3-a7f42dfbc0e7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.183497 Jul 20 04:19:40.091680 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 676/1415] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:39 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:40.119156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.119779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] [instance: 933fbdd2-8589-43a1-a99a-8f22c47fcb69] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.127867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.128445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.129224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.132394 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.145132 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] HTTP exception thrown: Instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 could not be found. Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Request method failure captured: Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 HTTP/1.1 Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14GkS-ddSjYMCh9btv6lCuWEE-7vOWt4Px4nldtTM--s-hmNgQz-2gMknJUkmL4Dl9Cgd6dprJmF1O16jvwHGMncOvXOTNK_WivQdqJln3g7Qvi--TPTyNaX2mAJBkdPe0LBl1lXFLEhHrYkMcs9hW0H6T2TS63PIzm0vhLn2b_RJ3I Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:40.146813 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d42cb2cc3e3e40b89c2ab0ba9bb4dc08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d42cb2cc3e3e40b89c2ab0ba9bb4dc08", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: d42cb2cc3e3e40b89c2ab0ba9bb4dc08 Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-295084874 Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: bd93bfda90414060a4d3a2f8a0d53115 Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersOnMultiNodesTest-295084874-project Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 could not be found. Jul 20 04:19:40.148138 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '933fbdd2-8589-43a1-a99a-8f22c47fcb69'} Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 could not be found. Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:40.148948 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 could not be found. Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 could not be found. Jul 20 04:19:40.150456 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:40.152297 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] Returning 404 to user: Instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:40.152297 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-62cc056f-741e-441e-a30a-56b7ba859b61 tempest-ServersOnMultiNodesTest-295084874 tempest-ServersOnMultiNodesTest-295084874-project] 10.222.0.49 "GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69" status: 404 len: 111 microversion: 2.1 time: 0.033227 Jul 20 04:19:40.152297 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 740/1416] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/933fbdd2-8589-43a1-a99a-8f22c47fcb69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:19:40.290346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f29b3ace-f81f-4baf-878a-2760f2e6f9aa req-5a0e1b2f-0011-4ed2-a922-d3e1d241d2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933fbdd2-8589-43a1-a99a-8f22c47fcb69", "name": "network-vif-deleted", "tag": "a9a4c985-7a16-4d2c-97b2-f09bb8e7f8f9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:40.306433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f29b3ace-f81f-4baf-878a-2760f2e6f9aa req-5a0e1b2f-0011-4ed2-a922-d3e1d241d2d0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.307070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f29b3ace-f81f-4baf-878a-2760f2e6f9aa req-5a0e1b2f-0011-4ed2-a922-d3e1d241d2d0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.329157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f29b3ace-f81f-4baf-878a-2760f2e6f9aa req-5a0e1b2f-0011-4ed2-a922-d3e1d241d2d0 service nova] Creating event network-vif-deleted:a9a4c985-7a16-4d2c-97b2-f09bb8e7f8f9 for instance 933fbdd2-8589-43a1-a99a-8f22c47fcb69 on n-h2-764486-11 Jul 20 04:19:40.336263 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f29b3ace-f81f-4baf-878a-2760f2e6f9aa req-5a0e1b2f-0011-4ed2-a922-d3e1d241d2d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053436 Jul 20 04:19:40.338024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 677/1417] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:40.457545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.459377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.467977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.468647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.469661 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.470885 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.509975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.510733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.521089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.521545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.522737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.523165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.674022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.682735 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cea3a150-cef3-47de-b935-9f51609ca85f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.230813 Jul 20 04:19:40.692432 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 741/1418] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.736001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.736857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.743319 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.744140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.744952 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.745583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.783788 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.783965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.784544 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lazy-loading 'fault' on Instance uuid e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:40.811312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=20 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:40.839736 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cc4532e47c42fcba8496e5a6c191d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8f959211104019a29f2773235609a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:40.851044 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dc6fa1dc-c7f3-4165-a1b0-dc93c5eaed51 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 200 len: 1358 microversion: 2.1 time: 0.119566 Jul 20 04:19:40.862281 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 742/1419] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 1358 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:40.876821 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:40.884935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:40.897840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.899353 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:40.903136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:40.903802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.082561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.096727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85cbaf51-d3b3-40bb-8f78-a0a18132e5b7 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1471 microversion: 2.1 time: 0.589302 Jul 20 04:19:41.097791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 678/1420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1471 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:41.118530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.119148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.138394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.141658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.142489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.142934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.648106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:41.656767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-599dea43-7a96-4835-a474-fc56c2d845c9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.544711 Jul 20 04:19:41.659108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 679/1421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:41.678670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7a527d8d-4827-43a7-8bed-23070c79ad14 req-316eac40-4569-43f9-bd18-4eb39cf944a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff905974-9f37-4a14-ba4d-43507a964702", "name": "network-vif-plugged", "status": "completed", "tag": "e74b4761-dc0f-4746-8d58-702a7c12ff2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:41.689082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:41.700084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7a527d8d-4827-43a7-8bed-23070c79ad14 req-316eac40-4569-43f9-bd18-4eb39cf944a3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.702485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7a527d8d-4827-43a7-8bed-23070c79ad14 req-316eac40-4569-43f9-bd18-4eb39cf944a3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.732850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7a527d8d-4827-43a7-8bed-23070c79ad14 req-316eac40-4569-43f9-bd18-4eb39cf944a3 service nova] Creating event network-vif-plugged:e74b4761-dc0f-4746-8d58-702a7c12ff2a for instance ff905974-9f37-4a14-ba4d-43507a964702 on n-h1-764486-11 Jul 20 04:19:41.741254 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7a527d8d-4827-43a7-8bed-23070c79ad14 req-316eac40-4569-43f9-bd18-4eb39cf944a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080672 Jul 20 04:19:41.742798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 680/1422] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:41.756396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:41.762599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:41.774408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.775979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:41.779033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:41.779702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.074059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.084253 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbfb6994-dd26-41d2-a646-a304813010d9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.332474 Jul 20 04:19:42.084863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 681/1423] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:41 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.094939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.095454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] [instance: e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.101989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.103152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.104114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.104736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.121527 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] HTTP exception thrown: Instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f could not be found. Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Request method failure captured: Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f HTTP/1.1 Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H-f_mwjPNNHNNYbgYeOBttxfV2DTSMaferu3iwQyxockmMs1OFewN-2WmdXQ4h0UOty1XxWwAlZVRddyzGSzqoEMeg-X-gY-jQZAnFBvAJKyW0GwCZeGwgkdHlRVFpDw-mnYH0z9I4NIZlFeU5572PV_ZSe8pi47NDLkMhp7Tv5ec Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8c8f959211104019a29f2773235609a1 Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-1548960983 Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:19:42.123772 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8c8f959211104019a29f2773235609a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c8f959211104019a29f2773235609a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8c8f959211104019a29f2773235609a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8c8f959211104019a29f2773235609a1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-1548960983 Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8c8f959211104019a29f2773235609a1 Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-1548960983 Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-1548960983-project Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 70cc4532e47c42fcba8496e5a6c191d8 Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-1548960983-project Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f could not be found. Jul 20 04:19:42.126083 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f'} Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f could not be found. Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:42.127098 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f could not be found. Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f could not be found. Jul 20 04:19:42.128509 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:19:42.130892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Returning 404 to user: Instance e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:42.132304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ef3f34f-d0d5-463a-9a3e-b597db90e781 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f" status: 404 len: 111 microversion: 2.1 time: 0.046272 Jul 20 04:19:42.133373 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 682/1424] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/e43a9f8a-b3d1-4b48-9bfa-9e1b2bb4c22f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:42.138634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.139407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.146464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.147123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.148911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.149506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.180173 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.193234 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-65e491c8-409f-4834-9efd-21388857c268 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 200 len: 1527 microversion: 2.1 time: 1.329738 Jul 20 04:19:42.194054 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 743/1425] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:40 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 1527 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.201109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cb541220-b344-48f9-a5cc-5a67bae30af5 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] Calling method '.version_select at 0x7f838bd2a5e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.236557 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cb541220-b344-48f9-a5cc-5a67bae30af5 tempest-ServersTestJSON-1548960983 tempest-ServersTestJSON-1548960983-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74145650" status: 202 len: 0 microversion: 2.1 time: 0.041161 Jul 20 04:19:42.238118 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 744/1426] 10.222.0.49 () {58 vars in 1214 bytes} [Wed Jul 20 04:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74145650 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:42.366749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:42.372474 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=10 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:42.376947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3075e599-8950-42ac-932c-b3f9718b388c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1471 microversion: 2.1 time: 0.241721 Jul 20 04:19:42.387735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 683/1427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.494723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6017c9b4-e4b2-4ea6-a5b6-aa7c6564495f tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.523162 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6017c9b4-e4b2-4ea6-a5b6-aa7c6564495f tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.231245 Jul 20 04:19:42.524638 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 745/1428] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.537728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aced3e83-0056-4ad9-9714-df336c3dd1f2 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.560109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aced3e83-0056-4ad9-9714-df336c3dd1f2 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026764 Jul 20 04:19:42.575148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0579ad5d-5a68-4ac3-91f2-bc0008e74350 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.579058 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 684/1429] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.584512 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0579ad5d-5a68-4ac3-91f2-bc0008e74350 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014109 Jul 20 04:19:42.599065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d217752f-0012-42b6-b2bf-af4b4be3f48b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.599623 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 746/1430] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.609448 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d217752f-0012-42b6-b2bf-af4b4be3f48b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014730 Jul 20 04:19:42.616430 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 685/1431] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.620622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a75ef5a9-177c-42fb-a131-2cb16c4ba59b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.639997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a0b8e57f-8ae7-468c-825a-4889249270d1 req-3f91ca7e-7c0a-48f2-ae93-adc170833277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff905974-9f37-4a14-ba4d-43507a964702", "name": "network-vif-deleted", "tag": "e74b4761-dc0f-4746-8d58-702a7c12ff2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:42.654757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a0b8e57f-8ae7-468c-825a-4889249270d1 req-3f91ca7e-7c0a-48f2-ae93-adc170833277 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.656544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a0b8e57f-8ae7-468c-825a-4889249270d1 req-3f91ca7e-7c0a-48f2-ae93-adc170833277 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.665195 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a75ef5a9-177c-42fb-a131-2cb16c4ba59b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.039926 Jul 20 04:19:42.666447 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 747/1432] 10.222.0.49 () {58 vars in 1164 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.678669 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.679621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:42.687964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=36 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:42.691916 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.692750 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.693722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:42.694354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:42.702791 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a0b8e57f-8ae7-468c-825a-4889249270d1 req-3f91ca7e-7c0a-48f2-ae93-adc170833277 service nova] Creating event network-vif-deleted:e74b4761-dc0f-4746-8d58-702a7c12ff2a for instance ff905974-9f37-4a14-ba4d-43507a964702 on n-h1-764486-11 Jul 20 04:19:42.713198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a0b8e57f-8ae7-468c-825a-4889249270d1 req-3f91ca7e-7c0a-48f2-ae93-adc170833277 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078997 Jul 20 04:19:42.714823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 686/1433] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.723387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2342bd5-a3d4-4d17-9d40-0a3e401e5edc tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.734606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2342bd5-a3d4-4d17-9d40-0a3e401e5edc tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017818 Jul 20 04:19:42.743201 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 687/1434] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.757608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0072fc56-df05-46d8-9285-5b85766174eb tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.817662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0072fc56-df05-46d8-9285-5b85766174eb tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.072822 Jul 20 04:19:42.821062 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 688/1435] 10.222.0.49 () {58 vars in 1168 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:42.837224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c0f5c64-4aef-4f11-9bda-8c9ff360e033 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.866652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c0f5c64-4aef-4f11-9bda-8c9ff360e033 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032955 Jul 20 04:19:42.871997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 689/1436] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.889739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb27f00e-4f1d-411d-9f7e-cddbaf0a0dcf tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:42.910034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb27f00e-4f1d-411d-9f7e-cddbaf0a0dcf tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021648 Jul 20 04:19:42.912241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 690/1437] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:42.924067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0762d174-3ebd-4049-bb52-c5c417ba686b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.017833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0762d174-3ebd-4049-bb52-c5c417ba686b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.097110 Jul 20 04:19:43.018764 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 691/1438] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:43.033631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-64373208-9905-43ee-a708-f7edddd3ff33 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.042830 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-64373208-9905-43ee-a708-f7edddd3ff33 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014072 Jul 20 04:19:43.043823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 692/1439] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:19:43.059727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-737e7ef4-959f-4f43-a2d9-e754d8bb0b6e tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.101157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-737e7ef4-959f-4f43-a2d9-e754d8bb0b6e tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.047710 Jul 20 04:19:43.102271 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 693/1440] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.107436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.108248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.115470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.116066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.117124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.118552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.325242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.335782 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e689db2b-c0b5-48b1-bcf9-52122b277ad6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.662845 Jul 20 04:19:43.339544 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 748/1441] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:42 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.346460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d17252f9-a63e-4aed-b2cd-d2d0b6a78346 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.362177 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d17252f9-a63e-4aed-b2cd-d2d0b6a78346 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020841 Jul 20 04:19:43.363011 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 749/1442] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:43.367892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.368751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.376310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.377100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.378154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.390983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.415385 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 HTTP/1.1 Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:19:43.417478 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:19:43.419418 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'ff905974-9f37-4a14-ba4d-43507a964702'} Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:19:43.420329 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:19:43.422914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:19:43.426386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:19:43.427761 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a06f584b-770e-404f-8e9a-83d392118bee tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 404 len: 111 microversion: 2.1 time: 0.063710 Jul 20 04:19:43.428866 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 750/1443] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:19:43.434478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7550550e-4687-4611-9700-7672ec3d1e30 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.462460 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7550550e-4687-4611-9700-7672ec3d1e30 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.032203 Jul 20 04:19:43.473598 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 751/1444] 10.222.0.49 () {58 vars in 1147 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.478706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.479512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:43.487183 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.487861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.488867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.489470 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.725361 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.734836 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4e0e400e-a49f-4a95-9d11-c1965d42099f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.260064 Jul 20 04:19:43.744981 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 752/1445] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.744981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4fee10be-a4d9-429b-a15c-8ae1effe65a5 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.754816 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4fee10be-a4d9-429b-a15c-8ae1effe65a5 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017424 Jul 20 04:19:43.756471 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 753/1446] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:43.761668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1647421650", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:43.825779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] validate_networks() for [('3e927276-dddc-430b-8bdd-2a3597d05a48', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:43.867042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:43.876028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab24fbf9-6a63-43c2-b360-894b96f180a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.772687 Jul 20 04:19:43.890631 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 694/1447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:43.897657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8222a3a7-3e62-497e-a3d9-e62d79652e59 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:43.920796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8222a3a7-3e62-497e-a3d9-e62d79652e59 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037350 Jul 20 04:19:43.921428 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 695/1448] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:43.928643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-95943b4b-f927-44b3-9ee5-1da8851cb472 req-695ee006-6082-4c57-a094-2a220fd5f83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "name": "network-vif-plugged", "status": "completed", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:43.938091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-95943b4b-f927-44b3-9ee5-1da8851cb472 req-695ee006-6082-4c57-a094-2a220fd5f83e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:43.938616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-95943b4b-f927-44b3-9ee5-1da8851cb472 req-695ee006-6082-4c57-a094-2a220fd5f83e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:43.950515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-95943b4b-f927-44b3-9ee5-1da8851cb472 req-695ee006-6082-4c57-a094-2a220fd5f83e service nova] Creating event network-vif-plugged:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h1-764486-11 Jul 20 04:19:43.969639 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-95943b4b-f927-44b3-9ee5-1da8851cb472 req-695ee006-6082-4c57-a094-2a220fd5f83e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046791 Jul 20 04:19:43.971114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 696/1449] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:43.976318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c80d137b-14a5-4766-9db7-cadca07dceb0 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.014210 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c80d137b-14a5-4766-9db7-cadca07dceb0 tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.041995 Jul 20 04:19:44.017791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 697/1450] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:19:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:44.037726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e37387f-2f5d-4623-91aa-cfb009b3050c tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.064708 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e37387f-2f5d-4623-91aa-cfb009b3050c tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040192 Jul 20 04:19:44.066316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 698/1451] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:44.080652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d838c710-2469-46ea-9da8-4e6145d8106b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.103884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d838c710-2469-46ea-9da8-4e6145d8106b tempest-FlavorsV2TestJSON-1080567620 tempest-FlavorsV2TestJSON-1080567620-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027989 Jul 20 04:19:44.110745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 699/1452] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:44.355755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.356570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:44.364837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.365286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.366060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.373924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:44.375883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.376604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:44.378347 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:44.380091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:44.382494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:44.401288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.404182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.408317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.409088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.461320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for project 57523abec2014cbda05b179e7b9ed761. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:44.476891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Getting quotas for user 72d4d8f374fd472c9214bc3b5d9fcc3b and project 57523abec2014cbda05b179e7b9ed761. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:44.503288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:44.524510 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:44.528576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:44.643771 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6db20cd5-e7af-45c5-a1f7-eeb3236e5026 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.886199 Jul 20 04:19:44.644775 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 754/1453] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:44.660875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-951205b1-267a-4c72-a25b-97260fdde1bf tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.662733 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-951205b1-267a-4c72-a25b-97260fdde1bf tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:44.720659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:44.741126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7463f65-f489-48c1-8dfe-4fe73de422d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.389335 Jul 20 04:19:44.741977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 700/1454] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:44.781799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-951205b1-267a-4c72-a25b-97260fdde1bf tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:44.792836 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-951205b1-267a-4c72-a25b-97260fdde1bf tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1225 microversion: 2.1 time: 0.137859 Jul 20 04:19:44.803346 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 755/1455] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:44.816103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:44.817087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:44.837554 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.841486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.842374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:44.842847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:44.914162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1302840664", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:44.981200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:19:45.078531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.093346 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1604cb82-18df-4c73-9f29-9690686e640b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.287988 Jul 20 04:19:45.104524 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 756/1456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:44 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.122867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.123970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.148919 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.149374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.153979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.154438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.337775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:19:45.339202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:19:45.339990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:19:45.340463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:19:45.341100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:19:45.360474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.361092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.362595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.363374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.384294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.392656 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c929d1ca-e4e1-45d0-beca-ce31209c2ef2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1199 microversion: 2.1 time: 0.286138 Jul 20 04:19:45.393235 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 757/1457] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1199 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.406807 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.407433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.419700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.420778 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.422744 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.423393 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.444724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Getting quotas for project 9c71d186fac94bd5ae02be4029ea17f4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:19:45.458410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Getting quotas for user f1b511e00cd146199414b5a2aefc6b06 and project 9c71d186fac94bd5ae02be4029ea17f4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:19:45.474572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:19:45.477972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:19:45.538078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c450ccc4-b933-4533-8ab6-4c42c3e0e1f4 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794888 Jul 20 04:19:45.540077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 701/1458] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:19:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:19:45.553881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37ce35ca-d75b-4bfc-9f35-9a4d43f3e739 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.555174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37ce35ca-d75b-4bfc-9f35-9a4d43f3e739 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.620246 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:45.653438 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a1da90fa-d3f1-4d4d-a9b2-db4960ed9ccf tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 2426 microversion: 2.25 time: 0.250492 Jul 20 04:19:45.656391 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 758/1459] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 2426 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:45.682741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764486-11", "block_migration": "auto"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:45.685340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.700480 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.701383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.703718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.704235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.713635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37ce35ca-d75b-4bfc-9f35-9a4d43f3e739 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:45.716735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:45.726217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37ce35ca-d75b-4bfc-9f35-9a4d43f3e739 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1214 microversion: 2.1 time: 0.177949 Jul 20 04:19:45.727830 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 702/1460] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:45.761713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:45.762796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:45.773598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:45.779889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.781356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.782894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:45.783594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:45.788496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'flavor' on Instance uuid c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:45.817935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Going to try to live migrate instance to n-h2-764486-11 {{(pid=123723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:19:46.098893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.101154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:46.112576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8db290d8-df7d-420c-bc93-c60a8805b72c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.356823 Jul 20 04:19:46.114611 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 703/1461] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:45 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:46.121890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.122778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.151250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.151931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.152854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.153343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.235557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.245089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ebd8338-6e78-4597-a072-f30f6c209799 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1277 microversion: 2.1 time: 0.127332 Jul 20 04:19:46.258526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 704/1462] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:46.268521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-67707fa5-cc17-4b4a-a1a6-674ac4218b17 req-bfa28d92-e4b2-4b04-a5f0-e1a815002569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfe4be6-cc34-42ac-bc33-e26dfc931291", "name": "network-vif-plugged", "status": "completed", "tag": "69652a02-0b5e-436c-a80f-56ba466afcef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:46.282418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-67707fa5-cc17-4b4a-a1a6-674ac4218b17 req-bfa28d92-e4b2-4b04-a5f0-e1a815002569 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.283008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-67707fa5-cc17-4b4a-a1a6-674ac4218b17 req-bfa28d92-e4b2-4b04-a5f0-e1a815002569 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.304784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-67707fa5-cc17-4b4a-a1a6-674ac4218b17 req-bfa28d92-e4b2-4b04-a5f0-e1a815002569 service nova] Creating event network-vif-plugged:69652a02-0b5e-436c-a80f-56ba466afcef for instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 on n-h2-764486-11 Jul 20 04:19:46.336013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-67707fa5-cc17-4b4a-a1a6-674ac4218b17 req-bfa28d92-e4b2-4b04-a5f0-e1a815002569 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065316 Jul 20 04:19:46.336860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 705/1463] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:46.365474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.366884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.375900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.376560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.377511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.378127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.882736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:46.899637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec17be33-4178-424e-9f75-25bb57fc532c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.561028 Jul 20 04:19:46.911736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 706/1464] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:46.911736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:46.911736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:46.917800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.918236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:46.919014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:46.919456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.256752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:47.264590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e93b72fd-84b7-4207-a5ee-f2459a8261e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1382 microversion: 2.1 time: 0.360664 Jul 20 04:19:47.265407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 707/1465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:46 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1382 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:47.269555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.270153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:47.277992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.278569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.279376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.279835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.418652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:47.431156 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-001c12ec-af42-42dc-bc4d-58ed91d94703 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1266 microversion: 2.1 time: 0.164937 Jul 20 04:19:47.440779 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 708/1466] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:47 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:47.445825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:47.446521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:47.453012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.453733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:47.454586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:47.455097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.195909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.208873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0d4d385-ec1d-43bf-b121-a44b2ef192dc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1314 microversion: 2.1 time: 0.766626 Jul 20 04:19:48.217940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 709/1467] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:47 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.226554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.227240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.236579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.237051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.237896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.238386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.391107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:48.399002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d7e48a5-557d-47d5-966d-4366a7935c2b tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1283 microversion: 2.1 time: 0.188047 Jul 20 04:19:48.408790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 710/1468] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.414320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.414931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.425590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.426228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.426796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.427224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.831693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09f61392-b038-4d1e-b749-6ed97bdca11b tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1535 microversion: 2.1 time: 0.421402 Jul 20 04:19:48.832301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 711/1469] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1535 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:48.845379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:48.846270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:48.855091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.855756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:48.856767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:48.857368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.053281 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b5e1e63-8997-4b2d-a4b3-3319cf2bb0f1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/action" status: 202 len: 0 microversion: 2.25 time: 3.383229 Jul 20 04:19:49.055040 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 759/1470] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:19:45 2022] POST /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/action => generated 0 bytes in 3386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:49.062560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.064017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.083239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.085295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.087269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.089202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.101599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.112171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90204469-7e0c-40a9-8cbd-0356a6dbc8a0 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.278581 Jul 20 04:19:49.117088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 712/1471] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:48 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.136909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.137834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.148370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.149118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.150621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.151217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.257408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:49.271170 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c3e07638-d3b3-42f2-bc11-e98f134486a2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1272 microversion: 2.1 time: 0.213934 Jul 20 04:19:49.272743 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 760/1472] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.278792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.279480 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.288163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.288769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.289675 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.290489 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.749634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0eb03ce-796b-49c2-9175-3f1ad0e574c0 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1535 microversion: 2.1 time: 0.628863 Jul 20 04:19:49.752312 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 713/1473] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1535 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:49.770274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:49.771052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:49.778381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.779804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:49.780910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:49.781565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.157723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.174074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a258337-fd52-4113-ab8c-e30e02c04534 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1501 microversion: 2.1 time: 0.419540 Jul 20 04:19:50.175399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 714/1474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1501 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:50.190527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.191700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.202164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.209097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.210481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.211162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.362840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.376412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.378516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.380005 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fe027cb2-df05-4ded-a727-121747473d47 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 1.105968 Jul 20 04:19:50.381797 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 761/1475] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:49 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:50.398060 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-92f0f3bc-0355-48a8-a62a-bb6b7a803015 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.403713 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:19:50.403713 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:19:50.406439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92f0f3bc-0355-48a8-a62a-bb6b7a803015 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.406905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92f0f3bc-0355-48a8-a62a-bb6b7a803015 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.407746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92f0f3bc-0355-48a8-a62a-bb6b7a803015 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.408160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92f0f3bc-0355-48a8-a62a-bb6b7a803015 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.474009 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-92f0f3bc-0355-48a8-a62a-bb6b7a803015 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.090338 Jul 20 04:19:50.481940 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 762/1476] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:50.488678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.489342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.500324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.501627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.502800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.503426 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.664338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:50.677228 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b34dc58c-f05b-4cb9-9d1a-2c10f9f60178 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1325 microversion: 2.1 time: 0.500401 Jul 20 04:19:50.688127 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 715/1477] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:50.688127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:50.688127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.702771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.703606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.704604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.705195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.828341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c3ef989-38a7-40b8-9bbb-94fcdf31805c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291/action" status: 202 len: 0 microversion: 2.1 time: 0.146229 Jul 20 04:19:50.834087 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 716/1478] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:50 2022] POST /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:50.845834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:50.847834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:50.870494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.870725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:50.871522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:50.871963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.262734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.276553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a35aea7f-4da2-4628-858c-6bb737d384d7 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.440859 Jul 20 04:19:51.277885 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 717/1479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:51.284714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764486-11", "block_migration": false, "disk_over_commit": false}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:51.286358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.304871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.305634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.306815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.307443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.395518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lazy-loading 'flavor' on Instance uuid 138047fe-a8c8-4a9b-aa5a-77cbea80de4f {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:51.417161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Going to try to live migrate instance to n-h2-764486-11 {{(pid=123724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:19:51.502161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:51.696897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:51.709962 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-91a4da49-c695-4a34-949f-ab86c85409ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 1.226780 Jul 20 04:19:51.711425 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 763/1480] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:50 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:51.740030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-2cdda006-b8ca-42a6-9aaa-f55b0ea188f2 req-0eb4bf61-17b8-4622-be74-9567218f7821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aac8749-b184-4d83-b29a-f0c0ac3fac11", "tag": "8d1e4d7b-c5ef-43cb-8131-33beea91555f"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:51.764092 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2cdda006-b8ca-42a6-9aaa-f55b0ea188f2 req-0eb4bf61-17b8-4622-be74-9567218f7821 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.766796 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2cdda006-b8ca-42a6-9aaa-f55b0ea188f2 req-0eb4bf61-17b8-4622-be74-9567218f7821 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.797253 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-2cdda006-b8ca-42a6-9aaa-f55b0ea188f2 req-0eb4bf61-17b8-4622-be74-9567218f7821 service nova] Creating event network-changed:8d1e4d7b-c5ef-43cb-8131-33beea91555f for instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 on n-h2-764486-11 Jul 20 04:19:51.809435 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-2cdda006-b8ca-42a6-9aaa-f55b0ea188f2 req-0eb4bf61-17b8-4622-be74-9567218f7821 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096365 Jul 20 04:19:51.809671 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 764/1481] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:51.831729 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:51.835371 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:51.852152 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.852653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:51.855891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:51.856342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.481030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.492399 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0542e5d3-4280-4e87-b0cc-552046a51d33 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1486 microversion: 2.1 time: 0.675421 Jul 20 04:19:52.493190 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 765/1482] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:51 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1486 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:52.497914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.498555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.506892 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.507341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.508105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.508574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.947031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.958006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.959534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:52.961569 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-87723c39-9ce5-4cef-a84e-d27025389241 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.467267 Jul 20 04:19:52.962678 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 766/1483] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:52.968270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:52.969165 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:52.975841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.976669 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:52.978005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:52.978874 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.390198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:53.404959 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8b3677f8-1c59-4483-a7fa-ae76191fa716 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1325 microversion: 2.1 time: 0.440859 Jul 20 04:19:53.408252 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 767/1484] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:52 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:53.419009 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.420277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.431771 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.433099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.435155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.435833 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.829182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:53.845822 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-91a6a4d5-010b-40da-8ef3-a0f8f21851ce tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.431906 Jul 20 04:19:53.846989 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 768/1485] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:53.859910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.861268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.871852 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.872785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.874395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.875047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.890568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93246b9e-de0e-4d54-91d6-75bfca6b6045 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f/action" status: 202 len: 0 microversion: 2.1 time: 2.611286 Jul 20 04:19:53.894361 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 718/1486] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:19:51 2022] POST /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f/action => generated 0 bytes in 2613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:19:53.898037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:53.899897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:53.916609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.921502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:19:53.921895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:53.922826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:53.923280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.052218 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7a544d94-4fc0-4adb-93aa-1fade0e2b764 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 204 len: 0 microversion: 2.1 time: 0.203547 Jul 20 04:19:54.053079 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 769/1487] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:19:53 2022] DELETE /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:19:54.063637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.066350 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.077227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.077789 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.078885 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.079365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.238445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.250603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a26452aa-c211-4c05-802e-5d7a6a9aace6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.357485 Jul 20 04:19:54.252706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 719/1488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:53 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.266388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.267197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.274762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.275495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.277252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.277847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.484153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.495370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.502603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.504456 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49a161a7-c5de-4650-aeb7-12de741855c1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.250466 Jul 20 04:19:54.505572 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 720/1489] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:54.520145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.520854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.527567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.528215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.529184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.529802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.549279 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.557200 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4f297d20-558f-4b28-a409-8ede65c8128c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.499808 Jul 20 04:19:54.568734 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 770/1490] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.574260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:54.575028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:54.593160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.593708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.594560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:54.595018 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:54.786670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=8 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:54.928124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:54.944619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2f3d8cc-13ba-4006-87ef-a25c39e30fee tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1492 microversion: 2.1 time: 0.436630 Jul 20 04:19:54.947025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 721/1491] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1492 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:54.971578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c8804851-8df2-4c77-bc0d-3f6587cdeb9f req-7dbb6bb8-6414-424d-a6b4-bd38a8cffee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4", "tag": "4893d607-a04d-4225-a8a7-d5a76b51b398"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:55.004745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c8804851-8df2-4c77-bc0d-3f6587cdeb9f req-7dbb6bb8-6414-424d-a6b4-bd38a8cffee7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.005946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c8804851-8df2-4c77-bc0d-3f6587cdeb9f req-7dbb6bb8-6414-424d-a6b4-bd38a8cffee7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.043510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c8804851-8df2-4c77-bc0d-3f6587cdeb9f req-7dbb6bb8-6414-424d-a6b4-bd38a8cffee7 service nova] Creating event network-changed:4893d607-a04d-4225-a8a7-d5a76b51b398 for instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 on n-h2-764486-11 Jul 20 04:19:55.058192 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c8804851-8df2-4c77-bc0d-3f6587cdeb9f req-7dbb6bb8-6414-424d-a6b4-bd38a8cffee7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109293 Jul 20 04:19:55.059236 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 722/1492] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:55.073306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.074734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.092985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.094221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.096456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.097319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.387322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.472891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.483927 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-125b8fcd-8b57-4c1e-9e99-62491f183957 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1325 microversion: 2.1 time: 0.913956 Jul 20 04:19:55.493418 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 771/1493] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:54 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1325 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.502669 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.506508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.519642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.536127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.539586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.540280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.709243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.723531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-330b7589-cbc7-4a9d-b6b9-03524c69741a tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.659435 Jul 20 04:19:55.724173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 723/1494] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.746001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.746692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.754063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:55.765187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.765792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.766608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.767044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.802071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:55.811174 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b9c41e3d-4a08-4e63-a446-49efa54c730f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.318722 Jul 20 04:19:55.817443 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 772/1495] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:55.824921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:55.825755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:55.832910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.833627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.834622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:55.835248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:55.863066 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:19:56.065756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.074837 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-04939010-aa59-4595-98b2-d6b708a7e6b8 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.256351 Jul 20 04:19:56.076276 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 773/1496] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.096753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.097763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.120379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.120867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.121720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.122164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.477138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.491108 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-59d76b55-fd0e-4e28-afb7-9924eb5e5d62 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1492 microversion: 2.1 time: 0.410556 Jul 20 04:19:56.491841 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 774/1497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1492 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.516010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.516936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.532741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.534516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.536544 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.537260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.785365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.794942 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff557a3a-885d-4b84-af7d-549782bf5e19 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1325 microversion: 2.1 time: 0.290108 Jul 20 04:19:56.807857 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 775/1498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:56.819839 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.820006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.829952 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.830407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.831499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.832029 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.890138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.914437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.917731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:56.921417 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e73797f-76f4-4a9d-a661-f2ce77467e7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 1.191166 Jul 20 04:19:56.923992 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 724/1499] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:55 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:56.941458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:56.942095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:56.961047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.961424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:56.962336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:56.962701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.052657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.066012 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-147c9b67-5cf4-4e6a-b8fa-307cc1159463 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.256615 Jul 20 04:19:57.067264 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 776/1500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.096200 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.097345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.107634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.109625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.110928 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.111680 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.362170 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.386193 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-16ff9aee-3e67-46ff-b144-50acbf9231e5 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.295816 Jul 20 04:19:57.396467 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 777/1501] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:57.396467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-2453ef55-5de5-4f56-a00d-f0512cf3ee94 req-edd3c797-22c9-43ab-9b06-d4cb2451b5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac8749-b184-4d83-b29a-f0c0ac3fac11", "name": "network-vif-plugged", "status": "completed", "tag": "8d1e4d7b-c5ef-43cb-8131-33beea91555f"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:57.402681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2453ef55-5de5-4f56-a00d-f0512cf3ee94 req-edd3c797-22c9-43ab-9b06-d4cb2451b5a6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.403470 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2453ef55-5de5-4f56-a00d-f0512cf3ee94 req-edd3c797-22c9-43ab-9b06-d4cb2451b5a6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.419113 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-2453ef55-5de5-4f56-a00d-f0512cf3ee94 req-edd3c797-22c9-43ab-9b06-d4cb2451b5a6 service nova] Creating event network-vif-plugged:8d1e4d7b-c5ef-43cb-8131-33beea91555f for instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 on n-h2-764486-11 Jul 20 04:19:57.424850 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-2453ef55-5de5-4f56-a00d-f0512cf3ee94 req-edd3c797-22c9-43ab-9b06-d4cb2451b5a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036040 Jul 20 04:19:57.425474 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 778/1502] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:57.511342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.512434 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.533568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.534203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.535023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.535514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.650477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.662109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9597f7f-bc25-4f2e-ac81-5f6e0cba0e00 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.736745 Jul 20 04:19:57.662824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 725/1503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:56 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:57.716706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:57.726786 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e94d240d-a1a6-45f2-bb02-14de732d46a4 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1492 microversion: 2.1 time: 0.221676 Jul 20 04:19:57.728404 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 779/1504] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1492 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:19:57.814885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.816077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.823033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.824025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.825004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.825504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.947696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:57.949628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:57.960871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.961108 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:57.963004 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:57.963565 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.305775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.321819 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8397073e-3482-4600-9766-1e8ac3603561 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1325 microversion: 2.1 time: 0.511577 Jul 20 04:19:58.329790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 726/1505] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.339117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.340083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.361407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.363000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.367289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.367778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.370802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.386653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.390100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.391608 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7ddd4aa0-0389-4ed7-86e2-2cd609a5690a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.453601 Jul 20 04:19:58.392639 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 780/1506] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:57 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:19:58.407081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-54afe476-ad77-4c26-af23-2dae47744be3 req-c58627b9-92c8-48a7-aca2-e4306c856ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfe4be6-cc34-42ac-bc33-e26dfc931291", "name": "network-vif-deleted", "tag": "69652a02-0b5e-436c-a80f-56ba466afcef"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:19:58.419997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-54afe476-ad77-4c26-af23-2dae47744be3 req-c58627b9-92c8-48a7-aca2-e4306c856ad9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.421387 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-54afe476-ad77-4c26-af23-2dae47744be3 req-c58627b9-92c8-48a7-aca2-e4306c856ad9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.435099 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-54afe476-ad77-4c26-af23-2dae47744be3 req-c58627b9-92c8-48a7-aca2-e4306c856ad9 service nova] Creating event network-vif-deleted:69652a02-0b5e-436c-a80f-56ba466afcef for instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 on n-h2-764486-11 Jul 20 04:19:58.443252 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-54afe476-ad77-4c26-af23-2dae47744be3 req-c58627b9-92c8-48a7-aca2-e4306c856ad9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049303 Jul 20 04:19:58.444081 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 781/1507] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:19:58.449592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.450398 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.457111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.457732 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.458569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.459057 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.805090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.817273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-391cc06b-93a1-4d10-98de-64ff61fc1776 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.485958 Jul 20 04:19:58.818788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 727/1508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.835134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.836654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.850421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.851476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.854683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.855500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.954679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:58.963483 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4416e526-f725-47f8-9a7f-e9c2417fe639 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.518339 Jul 20 04:19:58.964072 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 782/1509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:58.977536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:58.978154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:58.990354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.990354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:58.991132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:58.991569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.030780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.031272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.031685 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lazy-loading 'fault' on Instance uuid 9dfe4be6-cc34-42ac-bc33-e26dfc931291 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:19:59.113657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.123966 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-09bcc038-f6c0-4708-9a27-80cb479f8cdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 200 len: 1304 microversion: 2.1 time: 0.157535 Jul 20 04:19:59.135642 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 783/1510] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.205125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.216658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93d2fc63-38a4-437d-a771-77dbfb97a39e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.394407 Jul 20 04:19:59.227026 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 728/1511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:58 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.343857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.344731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.352542 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.353629 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.354418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.354854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.410920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.412312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.419318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.419763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.421268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.421696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.593321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.602424 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-797f422e-b001-4119-9290-4bba55996f06 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1325 microversion: 2.1 time: 0.266810 Jul 20 04:19:59.603462 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 784/1512] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:19:59.711588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.727875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.731130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:19:59.735088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e8d3c03-89ec-4ff3-8276-81a3ad97127f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.327148 Jul 20 04:19:59.737773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 729/1513] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:19:59.840142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.840142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:19:59.853016 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.853793 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.854802 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:19:59.855333 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:19:59.980940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:19:59.981821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.002226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.002851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.003961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.004789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.205870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.219679 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff89b4b6-1150-499a-a007-e8673dceb350 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.384209 Jul 20 04:20:00.220743 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 785/1514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:00.236471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.247647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbfe9cff-caeb-4eca-b7e3-73a72de0ba6f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.270418 Jul 20 04:20:00.255464 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 730/1515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:19:59 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:00.260089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.266501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.273602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.277128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.281304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.282127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.331702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 HTTP/1.1 Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:00.333571 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:20:00.335223 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9dfe4be6-cc34-42ac-bc33-e26dfc931291'} Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:00.336182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:20:00.337849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:00.339235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:00.339235 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d039bde8-36dd-4ad3-81b1-0b395c1b39cc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 404 len: 111 microversion: 2.1 time: 0.079527 Jul 20 04:20:00.341321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 731/1516] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:00.353868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.354472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.361121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.361571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.362334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.363263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.423449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:00.454693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ea74dcbd-c603-4d97-a91f-90da2b5f021f tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Calling method '.version_select at 0x7f838beb1f70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.570065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:00.582657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8fd0dba3-29c6-4156-8dc1-8cc38830e800 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1476 microversion: 2.1 time: 0.231551 Jul 20 04:20:00.583825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 732/1517] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:00.589462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-831027680", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:00.654197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:00.658960 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ea74dcbd-c603-4d97-a91f-90da2b5f021f tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.437027 Jul 20 04:20:00.659548 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 786/1518] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:20:00.664119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:00.664763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:00.682386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.682845 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:00.683634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:00.684096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.187086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:01.187825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:01.188303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:01.188973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:01.189551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:01.202924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.203624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.204853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.205508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.236486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:01.243217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:01.260599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:01.262944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:01.292044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.309208 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-58e20a28-ddc7-4e2a-9c40-f370e25cc0c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1522 microversion: 2.1 time: 0.648194 Jul 20 04:20:01.309810 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 787/1519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:00 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:01.329801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcf7f0ba-1b43-4ed8-8fd4-1c3c40faf52e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744222 Jul 20 04:20:01.330459 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 733/1520] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:01.337449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16e1af95-3307-46a2-b8a5-58ddb69513e0 tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Action: 'create', calling method: .version_select at 0x7f838beb5310>, body: {"pool": "non_exist_pool"} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:01.340217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.343044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.360887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.361724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.365167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.365773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.602313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.613910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.615589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:01.617585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f3c39e2-1abc-4451-86e8-b5876d50ab17 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.285439 Jul 20 04:20:01.628610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 734/1521] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:01.628610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.628610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.641230 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-16e1af95-3307-46a2-b8a5-58ddb69513e0 tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] HTTP exception thrown: Floating IP pool not found. Jul 20 04:20:01.641463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.641694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.642690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16e1af95-3307-46a2-b8a5-58ddb69513e0 tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Request method failure captured: Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 26 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Jwicv1fqph8bM5e0tjcQI_Be-GipCJZ2v13y2dn25YSq53XkZK0nZAjOWC-YMSsoDoGzVlgigtvwATEeKMh19jtONOtqObXIPjGrb--xqyrs0krecnAIbe8i_8SFmQvKy2OmI46xGJYh97-71kDjb19PYS2wN35R3pDZ5cVk6rs18 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 52969784b4de4e779d9c215815596356 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-318762753 Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:20:01.643081 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/52969784b4de4e779d9c215815596356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/52969784b4de4e779d9c215815596356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/52969784b4de4e779d9c215815596356"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_52969784b4de4e779d9c215815596356", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-318762753 Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 52969784b4de4e779d9c215815596356 Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-318762753 Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FloatingIPsNegativeTestJSON-318762753-project Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 0542fcf84f054b20b2d18f89275c07de Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-318762753-project Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: {"pool": "non_exist_pool"} Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: exception: Floating IP pool not found. Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 20 04:20:01.644730 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:01.645910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-16e1af95-3307-46a2-b8a5-58ddb69513e0 tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Returning 404 to user: Floating IP pool not found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:01.647361 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-16e1af95-3307-46a2-b8a5-58ddb69513e0 tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.317509 Jul 20 04:20:01.652729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.655216 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 788/1522] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:20:01 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:01.660848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:01.674127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:01.702727 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.705878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.710239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:01.710842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:01.992605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.005020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-423a4787-d910-4dcf-a9b5-6dad83df3203 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.385274 Jul 20 04:20:02.014432 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 735/1523] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.019465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.021201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.049533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.053405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.054554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.055220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.117364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:02.125330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:02.270074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8bd5c473-bbf0-4424-a6ca-8d74c4e076c0 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 204 len: 0 microversion: 2.1 time: 0.254192 Jul 20 04:20:02.270908 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 736/1524] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:02 2022] DELETE /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:02.284881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.285702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.298232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.298572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.300613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.302255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.478077 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.491056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.494676 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a4c1a6b7-1582-4002-adc3-028815bd9892 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.838298 Jul 20 04:20:02.495266 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 789/1525] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:01 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.511227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f7e1e4a-d1c0-47d3-864c-3193eb17b63c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1218 microversion: 2.1 time: 0.238132 Jul 20 04:20:02.521409 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 737/1526] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.521409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-727677a3-465c-4ba8-996a-87325559333a tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Calling method '.version_select at 0x7f8398247b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.529019 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.534853 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.542912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.543631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.544668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.545336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.592646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-727677a3-465c-4ba8-996a-87325559333a tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a259dd40-4833-4d06-b77f-1d3a97b8626f could not be found", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:02.593667 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-727677a3-465c-4ba8-996a-87325559333a tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] HTTP exception thrown: Floating IP not found for ID a259dd40-4833-4d06-b77f-1d3a97b8626f Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-727677a3-465c-4ba8-996a-87325559333a tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Request method failure captured: Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-floating-ips/a259dd40-4833-4d06-b77f-1d3a97b8626f HTTP/1.1 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Jwicv1fqph8bM5e0tjcQI_Be-GipCJZ2v13y2dn25YSq53XkZK0nZAjOWC-YMSsoDoGzVlgigtvwATEeKMh19jtONOtqObXIPjGrb--xqyrs0krecnAIbe8i_8SFmQvKy2OmI46xGJYh97-71kDjb19PYS2wN35R3pDZ5cVk6rs18 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 52969784b4de4e779d9c215815596356 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-318762753 Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:02.597816 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/52969784b4de4e779d9c215815596356"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/52969784b4de4e779d9c215815596356"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/52969784b4de4e779d9c215815596356"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_52969784b4de4e779d9c215815596356", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-318762753 Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 52969784b4de4e779d9c215815596356 Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-318762753 Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsNegativeTestJSON-318762753-project Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 0542fcf84f054b20b2d18f89275c07de Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-318762753-project Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: exception: Floating IP not found for ID a259dd40-4833-4d06-b77f-1d3a97b8626f Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a259dd40-4833-4d06-b77f-1d3a97b8626f'} Jul 20 04:20:02.599332 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:02.600344 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a259dd40-4833-4d06-b77f-1d3a97b8626f could not be found Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44f1630c-0745-4f89-ae5a-596707f57767'] Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a259dd40-4833-4d06-b77f-1d3a97b8626f. Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:02.603566 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a259dd40-4833-4d06-b77f-1d3a97b8626f Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:02.607580 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:02.609020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a259dd40-4833-4d06-b77f-1d3a97b8626f Jul 20 04:20:02.609020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:02.609020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-727677a3-465c-4ba8-996a-87325559333a tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] Returning 404 to user: Floating IP not found for ID a259dd40-4833-4d06-b77f-1d3a97b8626f {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:02.609020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-727677a3-465c-4ba8-996a-87325559333a tempest-FloatingIPsNegativeTestJSON-318762753 tempest-FloatingIPsNegativeTestJSON-318762753-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/a259dd40-4833-4d06-b77f-1d3a97b8626f" status: 404 len: 111 microversion: 2.1 time: 0.085385 Jul 20 04:20:02.609020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 738/1527] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:20:02 2022] DELETE /compute/v2.1/os-floating-ips/a259dd40-4833-4d06-b77f-1d3a97b8626f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:02.633444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.635626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.663695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.666222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.668086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.670257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.893573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:02.901766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdb3624e-7de6-4699-bf7b-896ea1bcbc6c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1528 microversion: 2.1 time: 0.295708 Jul 20 04:20:02.905078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 739/1528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1528 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:02.909907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:02.910512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:02.929610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.930056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.930839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:02.931277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:02.975723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.004139 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-20977927-1927-4b1d-83eb-6077afe93311 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1475 microversion: 2.1 time: 0.494574 Jul 20 04:20:03.005412 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 790/1529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.139572 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-09d79be7-8145-4d2b-a5bf-d9fd1b4af479 req-7b22c3c7-c4ad-4a26-947c-4c54c5ea9a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:03.151531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-09d79be7-8145-4d2b-a5bf-d9fd1b4af479 req-7b22c3c7-c4ad-4a26-947c-4c54c5ea9a74 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.152226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-09d79be7-8145-4d2b-a5bf-d9fd1b4af479 req-7b22c3c7-c4ad-4a26-947c-4c54c5ea9a74 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.171605 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-09d79be7-8145-4d2b-a5bf-d9fd1b4af479 req-7b22c3c7-c4ad-4a26-947c-4c54c5ea9a74 service nova] Creating event network-vif-unplugged:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h2-764486-11 Jul 20 04:20:03.192086 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-09d79be7-8145-4d2b-a5bf-d9fd1b4af479 req-7b22c3c7-c4ad-4a26-947c-4c54c5ea9a74 service nova] Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:20:03.206765 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-09d79be7-8145-4d2b-a5bf-d9fd1b4af479 req-7b22c3c7-c4ad-4a26-947c-4c54c5ea9a74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.199726 Jul 20 04:20:03.208150 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 791/1530] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:03.214516 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.215503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.231589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.234182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.236209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.237249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.342729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.353741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.355523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.368827 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c46010e-aa5a-4dcb-a602-c846b66f7698 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.450342 Jul 20 04:20:03.369545 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 740/1531] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:02 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:03.511217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.512204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.525163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.529983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.537614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.538437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.740818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.754986 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4c1aa60d-f018-4726-9187-39be74b0ccb2 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.545091 Jul 20 04:20:03.765900 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 792/1532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.774784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.775818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.783276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.783738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.784563 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.785207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.813562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:03.910221 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:03.922522 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6c618458-70a8-4a91-bfa2-e55e21f0390f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1272 microversion: 2.1 time: 0.155100 Jul 20 04:20:03.923113 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 793/1533] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:03.949081 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:03.949708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:03.971088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.971975 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:03.977179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:03.977954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.423980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.428008 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:04.437088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f4d8a8e-a925-4062-9a5c-d02c284940a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.929678 Jul 20 04:20:04.439385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 741/1534] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.441946 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-908a85f3-ba02-45bf-9cf5-2b701520fd11 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1528 microversion: 2.1 time: 0.502011 Jul 20 04:20:04.442543 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 794/1535] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:03 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1528 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:04.449381 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.450265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.459852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-63a963e2-58be-4845-a1f6-90d3612a73f9 req-299efcbe-ba51-4509-8b29-1aa7b4745b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4", "name": "network-vif-plugged", "status": "completed", "tag": "4893d607-a04d-4225-a8a7-d5a76b51b398"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:04.461188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.461790 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.462582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.463611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.474536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-63a963e2-58be-4845-a1f6-90d3612a73f9 req-299efcbe-ba51-4509-8b29-1aa7b4745b66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.475609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-63a963e2-58be-4845-a1f6-90d3612a73f9 req-299efcbe-ba51-4509-8b29-1aa7b4745b66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.494587 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-63a963e2-58be-4845-a1f6-90d3612a73f9 req-299efcbe-ba51-4509-8b29-1aa7b4745b66 service nova] Creating event network-vif-plugged:4893d607-a04d-4225-a8a7-d5a76b51b398 for instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 on n-h2-764486-11 Jul 20 04:20:04.502806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-63a963e2-58be-4845-a1f6-90d3612a73f9 req-299efcbe-ba51-4509-8b29-1aa7b4745b66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060472 Jul 20 04:20:04.514296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 742/1536] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:04.524058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:04.525988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:04.533794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:04.535954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.536611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:04.537484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:04.537953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.002441 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.012787 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e42233f7-5ff5-4d10-a599-abd58d3e7c1e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1475 microversion: 2.1 time: 0.569113 Jul 20 04:20:05.013850 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 795/1537] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1475 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.027391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.028292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.046688 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.047161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.047948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.048603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.219964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.228983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.230747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.232154 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6036f7a2-9dc4-430e-befe-289a15b023cd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.715784 Jul 20 04:20:05.233736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 743/1538] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:04 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:05.238422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.239247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.247721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.248451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.249393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.249979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.434041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.443199 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c45f01bc-22f5-4945-80db-185e468abbd1 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1314 microversion: 2.1 time: 0.421893 Jul 20 04:20:05.443787 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 796/1539] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.461204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-ae284a30-589d-44b0-ae52-8f03c8d371d8 req-27803b83-e5a9-43b2-8ec2-36eea1dae358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:05.476041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:05.478150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ae284a30-589d-44b0-ae52-8f03c8d371d8 req-27803b83-e5a9-43b2-8ec2-36eea1dae358 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.479067 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ae284a30-589d-44b0-ae52-8f03c8d371d8 req-27803b83-e5a9-43b2-8ec2-36eea1dae358 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.495910 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-ae284a30-589d-44b0-ae52-8f03c8d371d8 req-27803b83-e5a9-43b2-8ec2-36eea1dae358 service nova] Creating event network-changed:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h2-764486-11 Jul 20 04:20:05.506378 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-ae284a30-589d-44b0-ae52-8f03c8d371d8 req-27803b83-e5a9-43b2-8ec2-36eea1dae358 service nova] Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:20:05.548151 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-ae284a30-589d-44b0-ae52-8f03c8d371d8 req-27803b83-e5a9-43b2-8ec2-36eea1dae358 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100989 Jul 20 04:20:05.552162 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 797/1540] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:05.558536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.559249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.567769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.572001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.573042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.573809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.796821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:05.807250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1cd6bcc9-8c31-4ae3-9ef2-cb9bd8a1f3f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.572025 Jul 20 04:20:05.808897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 744/1541] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:05.815546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:05.816850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:05.826495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.827511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:05.829068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:05.830550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.034454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.071104 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6bec721-b28b-4bdc-9a9f-fcee6814c1a1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.510572 Jul 20 04:20:06.073674 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 798/1542] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.081623 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.083035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.114207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.115202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.116224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.116961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.629220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.640635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-252099e4-a76f-4757-9932-0d2f8acfc36e tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1528 microversion: 2.1 time: 0.830325 Jul 20 04:20:06.641242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 745/1543] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:05 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1528 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.653809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.657190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.674744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.675201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.676270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.676743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.708113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:06.726883 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-431d24d6-7ace-4e47-ad2f-e52e94f1fd5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1475 microversion: 2.1 time: 0.651536 Jul 20 04:20:06.750868 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 799/1544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1475 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:06.760995 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-edce55c6-9801-4915-bdbd-73f74489bed8 req-ddce9008-52ee-4649-a812-a9cd3713ee0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "name": "network-vif-unplugged", "status": "completed", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:06.793902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-edce55c6-9801-4915-bdbd-73f74489bed8 req-ddce9008-52ee-4649-a812-a9cd3713ee0d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.794340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-edce55c6-9801-4915-bdbd-73f74489bed8 req-ddce9008-52ee-4649-a812-a9cd3713ee0d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.831095 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-edce55c6-9801-4915-bdbd-73f74489bed8 req-ddce9008-52ee-4649-a812-a9cd3713ee0d service nova] Creating event network-vif-unplugged:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h1-764486-11 Jul 20 04:20:06.842835 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-edce55c6-9801-4915-bdbd-73f74489bed8 req-ddce9008-52ee-4649-a812-a9cd3713ee0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090211 Jul 20 04:20:06.843457 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 800/1545] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:06.858932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:06.860044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:06.888743 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.889462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:06.890410 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:06.891000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.262346 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.279058 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9f40b69e-b20c-44bf-a96c-1729d40ab446 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1464 microversion: 2.1 time: 0.434358 Jul 20 04:20:07.282835 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 801/1546] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1464 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.305414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.306483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.314671 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.316241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.317420 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.318071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.601586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.618201 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-db90371a-48c2-406c-85c6-5d7eec4d6a55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.331923 Jul 20 04:20:07.623128 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 802/1547] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:07.628984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.629518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:07.642619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.643388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.645129 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.645790 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.717296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.731303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.743135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:07.744995 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa447c1e-1262-4998-aa89-a757594b60ee tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 1.097742 Jul 20 04:20:07.756657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 746/1548] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:06 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:07.937074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebda0594-47b3-4bd7-8980-bc073d656b3f tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Calling method '.version_select at 0x7f838be8ea60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:07.950092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebda0594-47b3-4bd7-8980-bc073d656b3f tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.951336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebda0594-47b3-4bd7-8980-bc073d656b3f tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.975362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebda0594-47b3-4bd7-8980-bc073d656b3f tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:07.976074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebda0594-47b3-4bd7-8980-bc073d656b3f tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:07.997126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebda0594-47b3-4bd7-8980-bc073d656b3f tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/9c71d186fac94bd5ae02be4029ea17f4?start=2022-07-19T04%3A20%3A07.291757&end=2022-07-21T04%3A20%3A07.291757" status: 200 len: 691 microversion: 2.1 time: 0.238073 Jul 20 04:20:07.997940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 747/1549] 10.222.0.49 () {58 vars in 1411 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/os-simple-tenant-usage/9c71d186fac94bd5ae02be4029ea17f4?start=2022-07-19T04%3A20%3A07.291757&end=2022-07-21T04%3A20%3A07.291757 => generated 691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:08.000035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.003286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-20f8b0da-203f-4753-ad66-601ebf5c1390 req-5fca53fc-b420-4551-93af-a82af3fd3332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32076e88-d4fa-4391-afcb-bad6d6f9fbfa", "tag": "e57fe3f6-4827-4f73-9c52-231d22c64b3e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:08.008589 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fcf9bb6a-0144-4588-a661-57bf5c6e4e9c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.383742 Jul 20 04:20:08.012743 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 803/1550] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:07 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:08.030608 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.031433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.033079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-20f8b0da-203f-4753-ad66-601ebf5c1390 req-5fca53fc-b420-4551-93af-a82af3fd3332 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.035723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-20f8b0da-203f-4753-ad66-601ebf5c1390 req-5fca53fc-b420-4551-93af-a82af3fd3332 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.045536 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.046270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.052594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-20f8b0da-203f-4753-ad66-601ebf5c1390 req-5fca53fc-b420-4551-93af-a82af3fd3332 service nova] Creating event network-changed:e57fe3f6-4827-4f73-9c52-231d22c64b3e for instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa on n-h1-764486-11 Jul 20 04:20:08.053967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.054843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.065582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-20f8b0da-203f-4753-ad66-601ebf5c1390 req-5fca53fc-b420-4551-93af-a82af3fd3332 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066199 Jul 20 04:20:08.067610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 748/1551] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:08.077756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.078712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.086885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.087565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.088750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.089335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.297656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d4d8f374fd472c9214bc3b5d9fcc3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57523abec2014cbda05b179e7b9ed761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:08.306025 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-14be989a-4d6b-4ae6-a49e-2c54d93fa76c tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 200 len: 1486 microversion: 2.1 time: 0.291668 Jul 20 04:20:08.329640 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 804/1552] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 1486 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:08.339248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-186a7d74-f5e1-4d42-bea4-a0db76fa25a3 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '.version_select at 0x7f838beb55e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.370336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-186a7d74-f5e1-4d42-bea4-a0db76fa25a3 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.371184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-186a7d74-f5e1-4d42-bea4-a0db76fa25a3 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.406293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-186a7d74-f5e1-4d42-bea4-a0db76fa25a3 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.411640 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-186a7d74-f5e1-4d42-bea4-a0db76fa25a3 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.445397 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-186a7d74-f5e1-4d42-bea4-a0db76fa25a3 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/9c71d186fac94bd5ae02be4029ea17f4?start=2022-07-19T04%3A20%3A07.291757&end=2022-07-21T04%3A20%3A07.291757" status: 200 len: 695 microversion: 2.1 time: 0.114151 Jul 20 04:20:08.446238 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 805/1553] 10.222.0.49 () {58 vars in 1411 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/os-simple-tenant-usage/9c71d186fac94bd5ae02be4029ea17f4?start=2022-07-19T04%3A20%3A07.291757&end=2022-07-21T04%3A20%3A07.291757 => generated 695 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:08.461459 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e1f1f025-1c85-4a05-bcb2-05c1507ffe55 tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Calling method '.version_select at 0x7f838bea4790>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.479338 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1f1f025-1c85-4a05-bcb2-05c1507ffe55 tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.479792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1f1f025-1c85-4a05-bcb2-05c1507ffe55 tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.509638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1f1f025-1c85-4a05-bcb2-05c1507ffe55 tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.518690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e1f1f025-1c85-4a05-bcb2-05c1507ffe55 tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.648719 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e1f1f025-1c85-4a05-bcb2-05c1507ffe55 tempest-TenantUsagesTestJSON-1485797199 tempest-TenantUsagesTestJSON-1485797199-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A07.291757&end=2022-07-21T04%3A20%3A07.291757&detailed=1" status: 200 len: 18415 microversion: 2.1 time: 0.191368 Jul 20 04:20:08.649767 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 806/1554] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T04%3A20%3A07.291757&end=2022-07-21T04%3A20%3A07.291757&detailed=1 => generated 18415 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:08.655353 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:08.656856 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:08.663840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.665035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:08.666020 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:08.666700 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.269258 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.297400 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2f93138a-e870-409f-bf13-95c99ab80c47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.645670 Jul 20 04:20:09.310853 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 807/1555] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.321870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.322775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.342072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.342689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.343859 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.346155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.426622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:09.470143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.499407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9f42f77-0f17-4f52-963d-768ee76bdb7d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1473 microversion: 2.1 time: 1.430261 Jul 20 04:20:09.503706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 749/1556] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:08 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1473 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.515969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.517799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.528393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.532923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.533894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.535149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.628713 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d21a9f30-14cd-4995-8e24-de8a42ceb192 tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 204 len: 0 microversion: 2.1 time: 0.315598 Jul 20 04:20:09.630101 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 808/1557] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:09 2022] DELETE /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:09.639291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.640683 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.649244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.650099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.651134 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.651926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.890923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.903836 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f46bf374-e615-45c0-8e94-195996e9c459 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.271766 Jul 20 04:20:09.913001 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 809/1558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:09.913001 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-3ce6d584-5475-47f3-9777-db50fd2583fb req-94702068-73e9-4ef4-a025-26da93729ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac8749-b184-4d83-b29a-f0c0ac3fac11", "name": "network-vif-deleted", "tag": "8d1e4d7b-c5ef-43cb-8131-33beea91555f"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:09.920237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3ce6d584-5475-47f3-9777-db50fd2583fb req-94702068-73e9-4ef4-a025-26da93729ecd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.920838 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3ce6d584-5475-47f3-9777-db50fd2583fb req-94702068-73e9-4ef4-a025-26da93729ecd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.937927 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3ce6d584-5475-47f3-9777-db50fd2583fb req-94702068-73e9-4ef4-a025-26da93729ecd service nova] Creating event network-vif-deleted:8d1e4d7b-c5ef-43cb-8131-33beea91555f for instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 on n-h2-764486-11 Jul 20 04:20:09.944988 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-3ce6d584-5475-47f3-9777-db50fd2583fb req-94702068-73e9-4ef4-a025-26da93729ecd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038745 Jul 20 04:20:09.946401 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 810/1559] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:09.954600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:09.955411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 0aac8749-b184-4d83-b29a-f0c0ac3fac11] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:09.964615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.965078 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.965926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:09.966431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:09.980246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:09.984632 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 could not be found. Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 HTTP/1.1 Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:20:09.986348 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 could not be found. Jul 20 04:20:09.987780 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '0aac8749-b184-4d83-b29a-f0c0ac3fac11'} Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 could not be found. Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:09.988617 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 could not be found. Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 could not be found. Jul 20 04:20:09.989914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:09.993229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance 0aac8749-b184-4d83-b29a-f0c0ac3fac11 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:09.994410 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5ba22408-2e48-418e-b120-8b4eadacb1f5 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11" status: 404 len: 111 microversion: 2.1 time: 0.046736 Jul 20 04:20:09.998864 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 811/1560] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/0aac8749-b184-4d83-b29a-f0c0ac3fac11 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:10.000265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.004197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.004906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.005943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.006820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2f1b377-11bc-4472-b31c-7170ea4fe084 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.501821 Jul 20 04:20:10.007406 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 750/1561] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:10.014515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3b84550-8a0f-4163-93b1-12c3f851b635 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '.version_select at 0x7f83980c61f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.016261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.016961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.017961 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.018610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.049218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:10.090641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b3b84550-8a0f-4163-93b1-12c3f851b635 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Image not found. Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3b84550-8a0f-4163-93b1-12c3f851b635 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9 HTTP/1.1 Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:10.093667 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'da03a720-caba-4987-a1f6-3d2f4763e4b9'} Jul 20 04:20:10.095065 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image da03a720-caba-4987-a1f6-3d2f4763e4b9 to delete Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.095972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da03a720-caba-4987-a1f6-3d2f4763e4b9 could not be found. Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:10.097221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:10.100583 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.103847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3b84550-8a0f-4163-93b1-12c3f851b635 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:10.105102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3b84550-8a0f-4163-93b1-12c3f851b635 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9" status: 404 len: 62 microversion: 2.1 time: 0.096748 Jul 20 04:20:10.106232 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 751/1562] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] DELETE /compute/v2.1/images/da03a720-caba-4987-a1f6-3d2f4763e4b9 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:10.114004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.115103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.124669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.125453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.127186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.127843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.146306 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 HTTP/1.1 Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:10.149338 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.150742 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ff905974-9f37-4a14-ba4d-43507a964702'} Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:10.151499 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.152854 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.155728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:10.156760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-211e1d05-e48f-4f56-a1ea-337cf6a5dfe9 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 404 len: 111 microversion: 2.1 time: 0.046653 Jul 20 04:20:10.158133 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 752/1563] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:10 2022] DELETE /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:20:10.166273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.167303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: ff905974-9f37-4a14-ba4d-43507a964702] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.174424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.175349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.176536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.177366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.208451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 HTTP/1.1 Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:10.210120 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.211500 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ff905974-9f37-4a14-ba4d-43507a964702'} Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:10.212260 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. Jul 20 04:20:10.213620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:10.214724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance ff905974-9f37-4a14-ba4d-43507a964702 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:10.214724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a351c2f7-4fb3-4443-9f90-d4a8efb71e5f tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702" status: 404 len: 111 microversion: 2.1 time: 0.049513 Jul 20 04:20:10.214724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 753/1564] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/ff905974-9f37-4a14-ba4d-43507a964702 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:10.221878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2884298b-1754-415f-b58f-53f626858d58 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '.version_select at 0x7f838b958820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.241843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2884298b-1754-415f-b58f-53f626858d58 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939867002" status: 202 len: 0 microversion: 2.1 time: 0.023587 Jul 20 04:20:10.246228 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 754/1565] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:20:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939867002 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:10.267398 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.275454 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-326526d9-3a6c-4672-83dc-9b5ff337726b tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1470 microversion: 2.1 time: 0.275266 Jul 20 04:20:10.276269 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 812/1566] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:09 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1470 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.315134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.315780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.322362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.322817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.323837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.324272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.523661 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:10.526261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.533861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.534740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.536939 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.537583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.816507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:10.824934 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d048751d-0440-46a1-81fc-94fd3a97170f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1470 microversion: 2.1 time: 0.305438 Jul 20 04:20:10.826092 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 813/1567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:10.842470 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:10.843000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:10.849327 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.849697 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.850458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:10.850886 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:10.966970 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-42f46606-6438-4586-a9e1-ece8abbf7bf2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "POST /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea/action" status: 202 len: 0 microversion: 2.1 time: 0.128027 Jul 20 04:20:10.971170 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 814/1568] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:10 2022] POST /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:20:11.127630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.128366 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.137706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.138698 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.140977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.141642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.161306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.174363 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4a7f8c0-14e7-4fb8-a17f-f3bab79c6a53 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.862090 Jul 20 04:20:11.177003 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 755/1569] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.184463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.186505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.195308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.196519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.197505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.198991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.255115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:11.398300 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.428812 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a528eae9-27a6-4eae-bf76-f07dfcc6ad7b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.453128 Jul 20 04:20:11.429685 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 815/1570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:10 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:11.434533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.435319 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.454899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.455401 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.456646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.457160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.886355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.908988 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.912321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:11.915174 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8ba2f0a1-0d41-4c4b-b4d3-65c3b2a916be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.484326 Jul 20 04:20:11.916568 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 816/1571] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:11.925520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:11.926481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:11.942099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.944107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:11.946818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:11.947811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.222662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.234916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ea8a53e-5079-482c-8155-a17d330d6c29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 1.055410 Jul 20 04:20:12.246506 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 756/1572] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:12.386080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-db94480f-34f5-44b0-9b73-ac1aa18858cd req-3a25c8cc-ff94-473b-9ab2-d183e4e76373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "name": "network-vif-plugged", "status": "completed", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:12.413120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-db94480f-34f5-44b0-9b73-ac1aa18858cd req-3a25c8cc-ff94-473b-9ab2-d183e4e76373 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.419013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-db94480f-34f5-44b0-9b73-ac1aa18858cd req-3a25c8cc-ff94-473b-9ab2-d183e4e76373 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.463000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-db94480f-34f5-44b0-9b73-ac1aa18858cd req-3a25c8cc-ff94-473b-9ab2-d183e4e76373 service nova] Creating event network-vif-plugged:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h2-764486-11 Jul 20 04:20:12.484430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-db94480f-34f5-44b0-9b73-ac1aa18858cd req-3a25c8cc-ff94-473b-9ab2-d183e4e76373 service nova] Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:20:12.520909 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-db94480f-34f5-44b0-9b73-ac1aa18858cd req-3a25c8cc-ff94-473b-9ab2-d183e4e76373 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272263 Jul 20 04:20:12.527510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 757/1573] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:12.549467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-df185754-7e32-4f9b-91bc-c47f0f356cb8 req-b3793011-860e-4d28-b0a0-8a3dd5b7c214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:12.568674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-df185754-7e32-4f9b-91bc-c47f0f356cb8 req-b3793011-860e-4d28-b0a0-8a3dd5b7c214 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.569342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-df185754-7e32-4f9b-91bc-c47f0f356cb8 req-b3793011-860e-4d28-b0a0-8a3dd5b7c214 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.606389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-df185754-7e32-4f9b-91bc-c47f0f356cb8 req-b3793011-860e-4d28-b0a0-8a3dd5b7c214 service nova] Creating event network-changed:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h1-764486-11 Jul 20 04:20:12.615441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-df185754-7e32-4f9b-91bc-c47f0f356cb8 req-b3793011-860e-4d28-b0a0-8a3dd5b7c214 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083481 Jul 20 04:20:12.618019 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 758/1574] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:12.630214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.639103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.655143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.659351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.660528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.662621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.691334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:12.907139 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b511e00cd146199414b5a2aefc6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c71d186fac94bd5ae02be4029ea17f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:12.917463 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a6d041aa-bf5f-4106-90de-3c378ca9739d tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 200 len: 1470 microversion: 2.1 time: 0.999070 Jul 20 04:20:12.921058 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 817/1575] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:11 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 1470 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:12.931212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:12.939054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:12.946345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.947011 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:12.947989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:12.948878 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.087712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.106877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42a05aa7-72e5-4369-8614-280d71f73fdb tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.485876 Jul 20 04:20:13.117700 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 759/1576] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.119047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.121842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.135902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.136375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.137150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.137582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.496132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.513250 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-823a3447-a437-463f-9cf7-da67aba895a0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.590229 Jul 20 04:20:13.514415 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 818/1577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:12 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.519729 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.520540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.537475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.538216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.539158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.539765 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.674946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.688824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.691566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.693086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc1de8c5-7706-45f8-ba05-9aacc1b61dca tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.580164 Jul 20 04:20:13.693647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 760/1578] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:13.699850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f64aa38-0f7b-4140-af7e-816ef0e6a8ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '.version_select at 0x7f838be8eca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.734481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0f64aa38-0f7b-4140-af7e-816ef0e6a8ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Image not found. Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f64aa38-0f7b-4140-af7e-816ef0e6a8ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/0eb71df7-1573-43c6-a025-c63358ca39e6 HTTP/1.1 Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:13.736492 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0eb71df7-1573-43c6-a025-c63358ca39e6'} Jul 20 04:20:13.737899 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0eb71df7-1573-43c6-a025-c63358ca39e6 to delete Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.738744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0eb71df7-1573-43c6-a025-c63358ca39e6 could not be found. Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:13.740032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:20:13.741317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.744613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f64aa38-0f7b-4140-af7e-816ef0e6a8ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:13.746246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f64aa38-0f7b-4140-af7e-816ef0e6a8ef tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/images/0eb71df7-1573-43c6-a025-c63358ca39e6" status: 404 len: 62 microversion: 2.1 time: 0.050960 Jul 20 04:20:13.747036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 761/1579] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] DELETE /compute/v2.1/images/0eb71df7-1573-43c6-a025-c63358ca39e6 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:20:13.755464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.756622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.763812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.764261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.765080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.765513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.785357 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 HTTP/1.1 Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:13.787412 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.788826 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48'} Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:13.789601 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.790863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.792133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:13.792133 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2759ce63-8341-426b-b843-e96e90264042 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 404 len: 111 microversion: 2.1 time: 0.037239 Jul 20 04:20:13.793192 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 762/1580] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:13 2022] DELETE /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:13.798671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.799972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] [instance: 74cb9a9f-a388-448f-93d7-8be7b3e20a48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.808500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.809982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.812091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.812787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.835559 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] HTTP exception thrown: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Request method failure captured: Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 HTTP/1.1 Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14IZsfvlSPy1Ux7m221tXb_iEH-A6Xc0M3PGNsk9yxAIYHeMCxttfUNB9giCXRhH9zRIvOvE36QxZVS_cEKDOXsuUH_vKfofQ3CbJ76epb0qzP0qWzPTarzoFRSU9Cbu1qzrQAU1KwtdXyN_40tY6BrWIItIHag8Q1vQq_2aew3HtdM Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:13.837736 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/57523abec2014cbda05b179e7b9ed761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_57523abec2014cbda05b179e7b9ed761", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 57523abec2014cbda05b179e7b9ed761 Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301 Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 72d4d8f374fd472c9214bc3b5d9fcc3b Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1312439301-project Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.839127 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '74cb9a9f-a388-448f-93d7-8be7b3e20a48'} Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:13.839898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. Jul 20 04:20:13.842908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.846678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] Returning 404 to user: Instance 74cb9a9f-a388-448f-93d7-8be7b3e20a48 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:13.847200 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:13.847994 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69882313-71ab-4171-887e-6e72fdf14696 tempest-ImagesOneServerNegativeTestJSON-1312439301 tempest-ImagesOneServerNegativeTestJSON-1312439301-project] 10.222.0.49 "GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48" status: 404 len: 111 microversion: 2.1 time: 0.053809 Jul 20 04:20:13.848781 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 763/1581] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/74cb9a9f-a388-448f-93d7-8be7b3e20a48 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:13.859156 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-728392d5-362c-4af3-8c8d-b855b6cfad63 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 0.343490 Jul 20 04:20:13.860458 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 819/1582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:13.942299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:13.942789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] [instance: 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:13.954184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.955117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.956252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:13.956917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:13.986937 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] HTTP exception thrown: Instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 could not be found. Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Request method failure captured: Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 HTTP/1.1 Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14JftjWvW3P9N8fM7bPxWj9PZ4BqsER0tUnLw9oK0X4VqEwvXmP7FCctyZ9HzYz6gJ_OenCTRgNCmEQgFlNCEuLky9S6MwumNVbX2LD7x3iUXgGJf_Q5IfFNg6GcpTMve6dY17Vu0Ztf-D-fORr7bjglCaPnK8pxDiXjZIbpZx6uh0k Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9c71d186fac94bd5ae02be4029ea17f4 Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TenantUsagesTestJSON-1064967405 Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:13.989178 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9c71d186fac94bd5ae02be4029ea17f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9c71d186fac94bd5ae02be4029ea17f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9c71d186fac94bd5ae02be4029ea17f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9c71d186fac94bd5ae02be4029ea17f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TenantUsagesTestJSON-1064967405 Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9c71d186fac94bd5ae02be4029ea17f4 Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1064967405 Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TenantUsagesTestJSON-1064967405-project Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f1b511e00cd146199414b5a2aefc6b06 Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TenantUsagesTestJSON-1064967405-project Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 could not be found. Jul 20 04:20:13.990542 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4'} Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 could not be found. Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:13.991438 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 could not be found. Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 could not be found. Jul 20 04:20:13.992709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:13.996699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] Returning 404 to user: Instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:13.997848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb04e045-e470-4f66-be21-0fb37ab31e3f tempest-TenantUsagesTestJSON-1064967405 tempest-TenantUsagesTestJSON-1064967405-project] 10.222.0.49 "GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4" status: 404 len: 111 microversion: 2.1 time: 0.060241 Jul 20 04:20:14.002460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 764/1583] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:13 2022] GET /compute/v2.1/servers/8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:14.125665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.130066 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.146653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.147408 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.150397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.152438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.531491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.532299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.542879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.545810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.547676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.549116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.830146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.853528 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6cca778-4cfe-49fd-be3c-3542d35f4a6c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.732086 Jul 20 04:20:14.857102 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 820/1584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:14.870272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-ab76aa64-96a8-4054-9763-3dcfbe9d3814 req-0b2afd2b-8110-4ed4-bbac-bacf8345ee9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4", "name": "network-vif-deleted", "tag": "4893d607-a04d-4225-a8a7-d5a76b51b398"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:14.879975 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ab76aa64-96a8-4054-9763-3dcfbe9d3814 req-0b2afd2b-8110-4ed4-bbac-bacf8345ee9d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.889083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ab76aa64-96a8-4054-9763-3dcfbe9d3814 req-0b2afd2b-8110-4ed4-bbac-bacf8345ee9d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.902760 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-ab76aa64-96a8-4054-9763-3dcfbe9d3814 req-0b2afd2b-8110-4ed4-bbac-bacf8345ee9d service nova] Creating event network-vif-deleted:4893d607-a04d-4225-a8a7-d5a76b51b398 for instance 8f53ddbf-46f0-441c-ad2a-cdb05c9a78a4 on n-h2-764486-11 Jul 20 04:20:14.908981 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-ab76aa64-96a8-4054-9763-3dcfbe9d3814 req-0b2afd2b-8110-4ed4-bbac-bacf8345ee9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053129 Jul 20 04:20:14.910926 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 821/1585] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:14.917304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:14.919248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:14.927465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.928369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.929837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:14.930793 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:14.977406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:14.991127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69a7481e-7603-4f80-b0c8-314fe4a1ea96 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.464540 Jul 20 04:20:14.992487 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 765/1586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:15.417043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.417723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.431437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.431909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.432754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.433231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.463281 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.500514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.502883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:15.508029 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-89fa2dc8-5e55-47a6-bd2e-fd57508db904 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.595173 Jul 20 04:20:15.519187 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 822/1587] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:15.871374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:15.872232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:15.883087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.885117 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:15.886082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:15.889810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.082306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.098266 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe4ec892-af8a-444a-a240-26050ca8e694 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 1.103753 Jul 20 04:20:16.100273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 766/1588] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:14 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.118529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.120673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.139415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.141500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.144657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.145718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.498237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.517365 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2740c807-3030-4251-8c60-e93f0f4db553 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.649939 Jul 20 04:20:16.527161 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 823/1589] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:15 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:16.536174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:16.546673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:16.568643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.569304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.570250 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:16.570891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:16.647595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:16.678417 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c71c4cc-3bb7-4e12-939c-5c1a11f56917 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.575930 Jul 20 04:20:16.692243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 767/1590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:17.011577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1539248477", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "564a2b2c-11f6-4b9a-ad6a-6624fb16e3e9"}, {"uuid": "6bfc7d77-d0c3-4590-8c03-cecdf57d589e"}, {"uuid": "564a2b2c-11f6-4b9a-ad6a-6624fb16e3e9"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:17.091230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] validate_networks() for [('564a2b2c-11f6-4b9a-ad6a-6624fb16e3e9', None, None, None, None, None), ('6bfc7d77-d0c3-4590-8c03-cecdf57d589e', None, None, None, None, None), ('564a2b2c-11f6-4b9a-ad6a-6624fb16e3e9', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:17.184261 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.194810 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.206559 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:17.218062 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e7c66991-1853-4695-acf0-6884e18348f1 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.686004 Jul 20 04:20:17.218900 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 824/1591] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:16 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:17.223797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:17.224984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:17.237864 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.240291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.241588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:17.244316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:17.978080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:18.147869 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:18.173702 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4082c94f-ec97-47fa-bc11-66d20cbc93ac tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 0.949873 Jul 20 04:20:18.175915 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 825/1592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:17 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:18.181533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.183204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.192240 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.193703 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.195234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.195908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.498910 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:18.811588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:18.828249 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ea59dd0e-0743-4cfe-9a92-dee07875b327 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.647739 Jul 20 04:20:18.832864 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 826/1593] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:18.845154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:18.854507 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:18.889702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.890161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:18.893812 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:18.894262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.538967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:19.542751 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:19.562699 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e543c1be-19e8-454f-805f-e4f49bb37c01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.723850 Jul 20 04:20:19.565171 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 827/1594] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:18 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:19.603411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-ca25cd87-a117-4db6-830f-371e1bb4e1d3 req-7b8f8940-699e-4078-8ccc-6e0522034d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:19.642198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ca25cd87-a117-4db6-830f-371e1bb4e1d3 req-7b8f8940-699e-4078-8ccc-6e0522034d7e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.642869 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-ca25cd87-a117-4db6-830f-371e1bb4e1d3 req-7b8f8940-699e-4078-8ccc-6e0522034d7e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.676266 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-ca25cd87-a117-4db6-830f-371e1bb4e1d3 req-7b8f8940-699e-4078-8ccc-6e0522034d7e service nova] Creating event network-vif-unplugged:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h1-764486-11 Jul 20 04:20:19.702907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-ca25cd87-a117-4db6-830f-371e1bb4e1d3 req-7b8f8940-699e-4078-8ccc-6e0522034d7e service nova] Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:20:19.751362 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-ca25cd87-a117-4db6-830f-371e1bb4e1d3 req-7b8f8940-699e-4078-8ccc-6e0522034d7e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168802 Jul 20 04:20:19.753106 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 828/1595] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:19.772644 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:19.775506 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:19.790642 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.793243 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:19.797409 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:19.802425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.005762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:21.006356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:21.006653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:21.007144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:21.007563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:21.027634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.028662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.029619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.030063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.079308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Getting quotas for project 3d7eb98b263a47d8a238b9e29baef9f4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:21.093623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Getting quotas for user eb32e9e4909744fbb5f665af1ddb3319 and project 3d7eb98b263a47d8a238b9e29baef9f4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:21.121130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:21.124296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:21.178654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:21.190203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:21.196820 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:21.198650 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-be5f96d7-6590-4f3b-a5f2-3307d666e568 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 1.441488 Jul 20 04:20:21.203120 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 829/1596] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:19 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:21.208293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-c37f2700-99c3-4954-87fd-43f5e3eaea6f req-bbf0b217-0a8e-4b8d-8371-8bfae7fe957f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32076e88-d4fa-4391-afcb-bad6d6f9fbfa", "name": "network-vif-plugged", "status": "completed", "tag": "e57fe3f6-4827-4f73-9c52-231d22c64b3e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:21.221621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c37f2700-99c3-4954-87fd-43f5e3eaea6f req-bbf0b217-0a8e-4b8d-8371-8bfae7fe957f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.222453 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c37f2700-99c3-4954-87fd-43f5e3eaea6f req-bbf0b217-0a8e-4b8d-8371-8bfae7fe957f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.237420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd04820e-e295-4768-926f-99a39f9cae3a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.230429 Jul 20 04:20:21.247731 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 768/1597] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:21.252720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:21.253610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:21.265760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.266718 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-c37f2700-99c3-4954-87fd-43f5e3eaea6f req-bbf0b217-0a8e-4b8d-8371-8bfae7fe957f service nova] Creating event network-vif-plugged:e57fe3f6-4827-4f73-9c52-231d22c64b3e for instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa on n-h1-764486-11 Jul 20 04:20:21.268494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.269364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.269816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.273822 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-c37f2700-99c3-4954-87fd-43f5e3eaea6f req-bbf0b217-0a8e-4b8d-8371-8bfae7fe957f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069220 Jul 20 04:20:21.275123 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 830/1598] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:21.281841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:21.283475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:21.292843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.294121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.295649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:21.296619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:21.953416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:21.963798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21f82f20-0e70-412d-907f-eaf96fcc9a11 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 0.715011 Jul 20 04:20:21.976708 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 769/1599] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:21 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:21.990023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:21.990490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:21.998736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.003298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.004558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.013412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.081226 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.094206 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8a194e16-682a-4ea0-a9b8-a27078f78b47 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1314 microversion: 2.1 time: 0.814013 Jul 20 04:20:22.095056 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 831/1600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:21 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.117550 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:22.119699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:22.135235 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.137042 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.138044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.141230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.445884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.460901 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2d18e7ed-9dcf-4387-8647-8689ae16272e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1217 microversion: 2.1 time: 0.349804 Jul 20 04:20:22.466935 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 832/1601] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:22 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1217 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.482080 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-396acdba-73ee-499f-ae8e-6e2b32330cb9 req-b0b39605-926e-47a3-bd69-b8c4f34ce88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:22.507894 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-396acdba-73ee-499f-ae8e-6e2b32330cb9 req-b0b39605-926e-47a3-bd69-b8c4f34ce88c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.508638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-396acdba-73ee-499f-ae8e-6e2b32330cb9 req-b0b39605-926e-47a3-bd69-b8c4f34ce88c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.547516 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-396acdba-73ee-499f-ae8e-6e2b32330cb9 req-b0b39605-926e-47a3-bd69-b8c4f34ce88c service nova] Creating event network-changed:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h1-764486-11 Jul 20 04:20:22.566879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [req-396acdba-73ee-499f-ae8e-6e2b32330cb9 req-b0b39605-926e-47a3-bd69-b8c4f34ce88c service nova] Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:20:22.615877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:22.621560 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-396acdba-73ee-499f-ae8e-6e2b32330cb9 req-b0b39605-926e-47a3-bd69-b8c4f34ce88c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152984 Jul 20 04:20:22.639204 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 833/1602] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:22.642845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09c8e22c-ebe3-46cc-8956-f010866c292a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.658839 Jul 20 04:20:22.661374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 770/1603] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:21 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:22.674921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:22.676142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:22.685229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.686203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.688013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:22.688767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:22.993471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:22.994521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:23.007870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.013693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.015504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.017040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.703702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:23.717101 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f85b430a-221b-499b-9175-d26571f32728 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 0.727810 Jul 20 04:20:23.730485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 771/1604] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:22 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:23.735997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:23.739216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:23.806227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.811945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:23.813213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:23.813861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.032393 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.054010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.055873 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.057356 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0ea9ed5f-3689-4086-892d-4111f95ce575 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 1.415135 Jul 20 04:20:24.058420 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 834/1605] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:22 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:24.065399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-1021d8e8-f28e-4172-9d7c-e81219473484 req-843e2e7d-ed23-476f-8103-c519938b0059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "name": "network-vif-unplugged", "status": "completed", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:24.095485 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-1021d8e8-f28e-4172-9d7c-e81219473484 req-843e2e7d-ed23-476f-8103-c519938b0059 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.096224 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-1021d8e8-f28e-4172-9d7c-e81219473484 req-843e2e7d-ed23-476f-8103-c519938b0059 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.118551 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-1021d8e8-f28e-4172-9d7c-e81219473484 req-843e2e7d-ed23-476f-8103-c519938b0059 service nova] Creating event network-vif-unplugged:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h1-764486-11 Jul 20 04:20:24.130936 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-1021d8e8-f28e-4172-9d7c-e81219473484 req-843e2e7d-ed23-476f-8103-c519938b0059 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070640 Jul 20 04:20:24.133619 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 835/1606] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:24.145052 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:24.146915 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:24.157503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.158242 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.162116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.162615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.310384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.319936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ada9062e-7d03-4146-a7f9-8d01a3248005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1500 microversion: 2.1 time: 0.587663 Jul 20 04:20:24.321315 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 772/1607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:23 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1500 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:24.336932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:24.337921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:24.350322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.351005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.351974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.352624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.540251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:24.557031 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-82c183a6-e9ed-4596-814d-0bc44d087042 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1271 microversion: 2.1 time: 0.421267 Jul 20 04:20:24.571204 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 836/1608] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:24 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1271 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:24.592786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:24.593460 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:24.606607 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.611436 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.613766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:24.616513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:24.694287 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lazy-loading 'flavor' on Instance uuid 32076e88-d4fa-4391-afcb-bad6d6f9fbfa {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:25.027112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.070953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ea36df4-b57b-4625-8b20-450c4263d1fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.748220 Jul 20 04:20:25.072326 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 773/1609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:24 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:25.078484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.079415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.089515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.090331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.091304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.091904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.493088 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-24037d2a-f025-4c8b-9e8d-c8f0881f66f2 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa/action" status: 202 len: 0 microversion: 2.1 time: 0.918914 Jul 20 04:20:25.498266 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 837/1610] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:20:24 2022] POST /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:25.504842 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:25.506177 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:25.515014 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.515874 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.517472 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:25.518110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:25.958238 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.970129 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.977405 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:25.991409 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cfcfd0b6-0c93-4ffb-9033-50bfe0abce2b tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.482869 Jul 20 04:20:26.003658 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 838/1611] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:26.010560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.019403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.034145 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.035205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.036292 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.036819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.542818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:26.551726 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7fa9121-7e06-42b7-9d64-e4b8d0501249 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1469 microversion: 2.1 time: 1.474590 Jul 20 04:20:26.552790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 774/1612] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:25 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1469 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:26.560495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.561710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.585695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.586153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.587275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.587748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.786620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:26.819709 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be8a47bd-653a-4338-ab29-54f41aeeee95 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1271 microversion: 2.1 time: 0.262114 Jul 20 04:20:26.834989 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 775/1613] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:26.851665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:26.852685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:26.860621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.861338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.865442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:26.867179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:26.972072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:26.987423 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e4a482d3-84d3-46dc-a2b1-4598e8a796cf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 0.981586 Jul 20 04:20:26.990526 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 839/1614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:27.010827 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.011962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.019372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.022721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.026071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.026714 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.510572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.521875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-941930ff-94e0-4597-9b7e-6aca81df59eb tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.676921 Jul 20 04:20:27.522892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 776/1615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:26 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:27.555017 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.570892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.573807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.577737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.581785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:27.583284 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ae1e42c4-19e0-42bc-adf0-9edb73172b29 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1815 microversion: 2.25 time: 0.576476 Jul 20 04:20:27.583682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.584449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.585760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.586597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.587045 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 840/1616] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1815 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:27.839621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:27.840811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:27.858652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.859488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:27.860681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:27.861282 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.223752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:28.237250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a63b714-ff08-4247-980a-a0462f05ea0c tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1462 microversion: 2.1 time: 0.670798 Jul 20 04:20:28.238081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 777/1617] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1462 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:28.253293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.254189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.267243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.267553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.268701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.269144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.276105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:28.287265 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0d96c40c-5ad0-47b9-90b7-24cb39133b2d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1313 microversion: 2.1 time: 0.451413 Jul 20 04:20:28.291360 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 841/1618] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:27 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:28.304734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.305707 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.308054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:28.327188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.327908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.329310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.330021 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.851967 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c7f37660-8dab-4d1f-8e3e-361d94eb21ed tempest-MigrationsAdminTest-636726617 tempest-MigrationsAdminTest-636726617-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1615 microversion: 2.1 time: 0.554252 Jul 20 04:20:28.862742 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 842/1619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1615 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:28.864418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:28.866321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:28.878268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.878731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:28.881590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:28.882056 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.240689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.261665 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-096b10da-b3ab-4f07-b2c2-2a384c4eaad3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.407373 Jul 20 04:20:29.267298 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 843/1620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:29.293511 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.299309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.322574 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.323483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.325740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.326859 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.369265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.378153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7def43f3-a611-4513-b70d-fe3888871005 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 1.137670 Jul 20 04:20:29.385242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 778/1621] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:28 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:29.388588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:29.401091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.401609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.407889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.408418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.417507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.417986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.443624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:29.466015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:29.549298 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.570189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.572553 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.573785 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-699baf40-17ce-4c22-9304-7b0c9aef0bd0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1805 microversion: 2.25 time: 0.304884 Jul 20 04:20:29.581600 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 844/1622] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1805 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:29.595005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.598660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.610748 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.613767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.616756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.617450 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.631576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d6c6b62-ff2b-4673-a636-d68183ee5a66 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 204 len: 0 microversion: 2.1 time: 0.245004 Jul 20 04:20:29.632864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 779/1623] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:29 2022] DELETE /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:29.646058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1d5899f-0b5d-4819-8c53-bc71f9c614d6 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '.version_select at 0x7f838b9670d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.649382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1d5899f-0b5d-4819-8c53-bc71f9c614d6 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.653442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1d5899f-0b5d-4819-8c53-bc71f9c614d6 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.689933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1d5899f-0b5d-4819-8c53-bc71f9c614d6 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 5181 microversion: 2.25 time: 0.055577 Jul 20 04:20:29.690899 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 780/1624] 10.222.0.49 () {60 vars in 1183 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/os-migrations => generated 5181 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:29.713523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.714691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.736008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.736593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.738082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.738562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.911707 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:29.925614 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-334615ea-2e50-4cfc-a5c8-2a12485c8938 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1313 microversion: 2.1 time: 0.339261 Jul 20 04:20:29.926456 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 845/1625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:29.935514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:29.938722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:29.955681 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.956128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:29.963441 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:29.964096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.154985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:30.177634 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-46411f48-a106-45c7-a1cf-aaffa377137b tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 2426 microversion: 2.25 time: 0.249023 Jul 20 04:20:30.178672 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 846/1626] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 2426 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:30.184619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-34fa7bc5-3cf1-4567-9f24-a611781b2555 req-5cc35e63-7c2c-4039-8df2-a0bc714c8984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "name": "network-vif-plugged", "status": "completed", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:30.195570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-34fa7bc5-3cf1-4567-9f24-a611781b2555 req-5cc35e63-7c2c-4039-8df2-a0bc714c8984 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.196290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-34fa7bc5-3cf1-4567-9f24-a611781b2555 req-5cc35e63-7c2c-4039-8df2-a0bc714c8984 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.213472 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-34fa7bc5-3cf1-4567-9f24-a611781b2555 req-5cc35e63-7c2c-4039-8df2-a0bc714c8984 service nova] Creating event network-vif-plugged:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h1-764486-11 Jul 20 04:20:30.219815 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-34fa7bc5-3cf1-4567-9f24-a611781b2555 req-5cc35e63-7c2c-4039-8df2-a0bc714c8984 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039526 Jul 20 04:20:30.220907 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 847/1627] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:30.228475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:30.230021 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:30.241160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.241679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.242785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.243403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.252546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:30.265440 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ee7d181-11e9-4e0b-a381-7ff48536207b tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1468 microversion: 2.1 time: 0.570855 Jul 20 04:20:30.267563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 781/1628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:29 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1468 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:30.279270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:30.279892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:30.299095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.299796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.300831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.301529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.442989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:30.467538 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-59d28739-03df-434d-8de1-e5049572c921 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 2426 microversion: 2.25 time: 0.245079 Jul 20 04:20:30.470104 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 848/1629] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:20:30 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 2426 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:20:30.476904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:30.477632 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:30.500371 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.501930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.503404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.504057 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.838576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:30.862760 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b61284f-b0af-4670-9b70-4f541669ff89 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 0.390253 Jul 20 04:20:30.865528 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 849/1630] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:30 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:30.872509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:30.874136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:30.882852 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.883978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:30.884900 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:30.885532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.039069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:31.047085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:31.060870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lazy-loading 'services' on Instance uuid c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:31.067732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-117e6283-f8cf-4494-af44-f240a486e9a2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.791261 Jul 20 04:20:31.069273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 782/1631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:30 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:31.095559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.096880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.105483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.106259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.107485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.108161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.116256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:31.177002 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8bc5600b-f9e0-4d5f-8254-c4348609593d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments/27d7f618-8e76-46a8-9786-0d4b2e06e65a" status: 202 len: 0 microversion: 2.25 time: 0.310057 Jul 20 04:20:31.178664 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 850/1632] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Jul 20 04:20:30 2022] DELETE /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments/27d7f618-8e76-46a8-9786-0d4b2e06e65a => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:31.199897 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.202096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.211653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.212793 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.213819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.214427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.257412 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4c9c3553-04e3-47ee-a3af-d68a0fa5703c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074080 Jul 20 04:20:31.261705 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 851/1633] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:31.290634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.291672 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.303303 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.304340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.305305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.305906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.561225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:31.573277 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63fde251-f615-4562-b97b-1c57cded23a0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1313 microversion: 2.1 time: 0.489202 Jul 20 04:20:31.575075 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 783/1634] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:31.615430 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:31.631822 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff08e672-6bf1-4d6a-87fd-ba996fe6f54d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1468 microversion: 2.1 time: 0.349000 Jul 20 04:20:31.645534 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 852/1635] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:31.882400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:31.883309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:31.898164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.898996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:31.901430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:31.903005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.092760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:32.093970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:32.124976 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.127338 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:32.128576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:32.130596 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.266931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:33.288087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41a6549f-815c-4fb8-b453-018108512934 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 1.410755 Jul 20 04:20:33.289009 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 784/1636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:31 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:33.317838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.323370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:33.352154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:33.373068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.373866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.377332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.383458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.476825 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:33.485692 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ca323ea3-f4f0-4b8f-acf7-36fd49856026 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 1.402329 Jul 20 04:20:33.488729 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 853/1637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:32 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:33.493760 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.500929 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9b92ad1-2615-4be2-9bee-d0dba2890bf6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.199811 Jul 20 04:20:33.509163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 785/1638] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:33 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:33.510319 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:33.515793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:33.519330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:33.531438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.532074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.537031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.538073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.539713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.551047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:33.572561 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:33.574676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.009374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:34.017901 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-925b88d0-b10e-41a9-9c49-bccdf1519b35 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 200 len: 1426 microversion: 2.1 time: 0.507407 Jul 20 04:20:34.033821 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 786/1639] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:33 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 1426 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:34.142651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d1c25d19-4250-45a0-bc0c-dbff5bb9100f req-c7f84227-87fe-49b2-bed2-8925c262adc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceee29f8-4273-4ab3-8858-6dfdd042b1ea", "name": "network-vif-deleted", "tag": "9b3f2199-26d4-416a-8634-84a8608a1de5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:34.161693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d1c25d19-4250-45a0-bc0c-dbff5bb9100f req-c7f84227-87fe-49b2-bed2-8925c262adc1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.162382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d1c25d19-4250-45a0-bc0c-dbff5bb9100f req-c7f84227-87fe-49b2-bed2-8925c262adc1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.197758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d1c25d19-4250-45a0-bc0c-dbff5bb9100f req-c7f84227-87fe-49b2-bed2-8925c262adc1 service nova] Creating event network-vif-deleted:9b3f2199-26d4-416a-8634-84a8608a1de5 for instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea on n-h1-764486-11 Jul 20 04:20:34.213673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d1c25d19-4250-45a0-bc0c-dbff5bb9100f req-c7f84227-87fe-49b2-bed2-8925c262adc1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075650 Jul 20 04:20:34.215167 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 787/1640] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:34.309102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.315565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:34.329415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.329871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.339224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.340317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.543879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:34.561806 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-79c49d3a-7a20-4f27-81d0-7b771388c78a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1334 microversion: 2.1 time: 1.063371 Jul 20 04:20:34.563152 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 854/1641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:33 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1334 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:34.568188 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:34.572328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:34.604289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.605717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:34.606780 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:34.607833 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.116030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:35.125861 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5c1d6103-190d-4448-95f4-3eca8f2b4cd2 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.561403 Jul 20 04:20:35.129704 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 855/1642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:34 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:35.143376 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.144713 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:35.155660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.161720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.165163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.165786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.243183 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c08a4d68-aafd-4179-8807-a2a443f73c67 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112137 Jul 20 04:20:35.247558 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 856/1643] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:35.265318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.266122 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: ceee29f8-4273-4ab3-8858-6dfdd042b1ea] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:35.291547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.292010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.298182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.298637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.363581 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] HTTP exception thrown: Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea could not be found. Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Request method failure captured: Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea HTTP/1.1 Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FPuDWNzFxmxry42lj0da750jlRtsDESSS6v--7oPgT6D6j_GFZMRtE8ZX5uMAmkX6Dq8KqQDkVJ65Lm4Y_z5yt7KjD8dE9vFn3Ex9RHFjrl1EqXibPq5Dt2txx6-KaMXjAUwSnv03MR5YpZ7zo88FrAdDzkCQWgFzxwMbIJIaVS0s Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:20:35.365354 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3180da7c29d64983854c1235b108c7e7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 3e8f4a044b904befbddb93375b6e213a Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea could not be found. Jul 20 04:20:35.367140 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'ceee29f8-4273-4ab3-8858-6dfdd042b1ea'} Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea could not be found. Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:35.368221 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea could not be found. Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea could not be found. Jul 20 04:20:35.370129 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:35.372752 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Returning 404 to user: Instance ceee29f8-4273-4ab3-8858-6dfdd042b1ea could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:35.375172 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b30b5589-5cb0-4cf6-a228-c2d56345fe90 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea" status: 404 len: 111 microversion: 2.1 time: 0.126885 Jul 20 04:20:35.377539 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 857/1644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/servers/ceee29f8-4273-4ab3-8858-6dfdd042b1ea => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:35.390750 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.399644 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:35.407122 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.407762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.410835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.411287 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.469239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:35.478649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:35.487709 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b53855c0-c3c8-4408-a885-5524f539b14e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 1.185750 Jul 20 04:20:35.500399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 788/1645] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:34 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:35.580408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.581515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:35.594150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.594771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.603686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.604415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.722275 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8629662d-9f35-4417-b576-c121bd0234d6 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 204 len: 0 microversion: 2.1 time: 0.340824 Jul 20 04:20:35.723324 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 858/1646] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:35 2022] DELETE /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:35.751843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:35.758340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:35.775289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.776178 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.777625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:35.778286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:35.809687 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:36.250376 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.261000 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4c6e08bf-0cb4-4f8b-a71b-763293a1bd29 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1533 microversion: 2.1 time: 0.520231 Jul 20 04:20:36.265813 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 859/1647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1533 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:36.283316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:36.286473 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:36.303467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.304962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.308193 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.309918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.541973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.556599 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2fe17dc7-768d-4c7c-ac03-dbb2aaf9fea6 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1334 microversion: 2.1 time: 0.980744 Jul 20 04:20:36.557638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 789/1648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:35 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1334 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:36.564938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:36.577383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:36.593078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.593739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.594708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.595348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.703476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2594d53f-6f29-43ae-a02c-5c7a4dc76ea0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142269 Jul 20 04:20:36.704068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 790/1649] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:36 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:36.725845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:36.728385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:36.766273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.766738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.773894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:36.774355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:36.835178 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:36.846649 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f6a22c08-f100-4ec5-9474-f955737f659a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.579702 Jul 20 04:20:36.852170 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 860/1650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:36 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.282386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.283053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.309205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.310577 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.311866 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.326126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.613646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:37.625585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca91258a-acd4-44db-9d19-cd2824f3cd55 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 0.914341 Jul 20 04:20:37.637031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 791/1651] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:36 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.643884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.645477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.653000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.653654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.654596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.655197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.842101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:37.854277 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7155ca70-ff71-4b63-8619-fbfe7b7df794 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1533 microversion: 2.1 time: 0.578582 Jul 20 04:20:37.868978 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 861/1652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1533 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:37.881756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.884158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.891828 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.893210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.894287 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.895132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.941145 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5ed5a63c-7d78-45e9-aee6-e88273d02273 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067847 Jul 20 04:20:37.942091 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 862/1653] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:37.958641 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:37.962525 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:37.970167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.970873 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:37.971840 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:37.973614 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.216147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:38.249058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de069c05-dda5-47b3-b4f7-23165454f2ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.590183 Jul 20 04:20:38.251164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 792/1654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:38.336075 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:38.348202 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-452bc75d-8246-4dfa-88a7-08912b4294e6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.402258 Jul 20 04:20:38.349076 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 863/1655] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:37 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:38.623812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9f086e35-5915-46c9-80da-350eb56994f0 req-682b5832-bbed-4cd5-b8ac-4d0db47487fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0a8ca8-6576-42ac-a734-29103d902371", "name": "network-vif-deleted", "tag": "7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:38.643421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:38.644047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:38.649858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f086e35-5915-46c9-80da-350eb56994f0 req-682b5832-bbed-4cd5-b8ac-4d0db47487fc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.650308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f086e35-5915-46c9-80da-350eb56994f0 req-682b5832-bbed-4cd5-b8ac-4d0db47487fc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.662696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.663268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.664128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.664602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.689438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9f086e35-5915-46c9-80da-350eb56994f0 req-682b5832-bbed-4cd5-b8ac-4d0db47487fc service nova] Creating event network-vif-deleted:7c2a9b75-4ea1-4b3a-b547-1f7d1a4f1a7b for instance 7b0a8ca8-6576-42ac-a734-29103d902371 on n-h2-764486-11 Jul 20 04:20:38.709312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9f086e35-5915-46c9-80da-350eb56994f0 req-682b5832-bbed-4cd5-b8ac-4d0db47487fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090297 Jul 20 04:20:38.712145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 793/1656] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:38.875544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:38.876578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:38.893064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.893807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.894773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.895398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.988823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:38.990912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:38.991604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lazy-loading 'fault' on Instance uuid 7b0a8ca8-6576-42ac-a734-29103d902371 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:20:39.202433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.216606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7397985-903f-4b4f-875d-e9adaa18b88f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 200 len: 1367 microversion: 2.1 time: 0.345862 Jul 20 04:20:39.235319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 794/1657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:38 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:39.241953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:39.243890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:39.253616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.254901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.255989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.256732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.340747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35ec7dcb-28dc-4fa5-a92e-1bc83c54d838 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.097846 Jul 20 04:20:39.342798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 795/1658] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:20:39.355166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:39.358945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:39.374408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.376757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.378125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.378582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.392786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:39.732500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.744148 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6fe2cdb5-d2a1-45d2-9b04-bf30ced9d0f6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 1.104974 Jul 20 04:20:39.747563 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 864/1659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:38 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:39.759099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:39.759965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:39.776499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.779707 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.785406 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:39.786125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:39.969063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:39.981934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2882ce4-400b-4ef7-ada0-667c4c360bef tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.637940 Jul 20 04:20:39.993722 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 796/1660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:40.211786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae536a8d-0a6d-427b-b2d0-997df34b8762 tempest-FloatingIPDetailsNegativeTestJSON-1473010104 tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project] Calling method '.version_select at 0x7f838baceaf0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.340061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:40.348887 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8713e7c6-a8c3-40ec-9c19-74307dace7c4 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.598696 Jul 20 04:20:40.351218 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 865/1661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:40.363775 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.364404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 7b0a8ca8-6576-42ac-a734-29103d902371] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:40.382365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.383368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.384520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.385477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.421906 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] HTTP exception thrown: Instance 7b0a8ca8-6576-42ac-a734-29103d902371 could not be found. Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Request method failure captured: Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 HTTP/1.1 Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FPuDWNzFxmxry42lj0da750jlRtsDESSS6v--7oPgT6D6j_GFZMRtE8ZX5uMAmkX6Dq8KqQDkVJ65Lm4Y_z5yt7KjD8dE9vFn3Ex9RHFjrl1EqXibPq5Dt2txx6-KaMXjAUwSnv03MR5YpZ7zo88FrAdDzkCQWgFzxwMbIJIaVS0s Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:20:40.429122 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3180da7c29d64983854c1235b108c7e7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 3e8f4a044b904befbddb93375b6e213a Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 7b0a8ca8-6576-42ac-a734-29103d902371 could not be found. Jul 20 04:20:40.430763 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '7b0a8ca8-6576-42ac-a734-29103d902371'} Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b0a8ca8-6576-42ac-a734-29103d902371 could not be found. Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:40.431613 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b0a8ca8-6576-42ac-a734-29103d902371 could not be found. Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b0a8ca8-6576-42ac-a734-29103d902371 could not be found. Jul 20 04:20:40.433402 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.434638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Returning 404 to user: Instance 7b0a8ca8-6576-42ac-a734-29103d902371 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:40.434638 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d86beff7-a526-435b-bed5-8432b2a9ff5e tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371" status: 404 len: 111 microversion: 2.1 time: 0.076802 Jul 20 04:20:40.434638 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 866/1662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers/7b0a8ca8-6576-42ac-a734-29103d902371 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:40.443861 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.445040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-ae536a8d-0a6d-427b-b2d0-997df34b8762 tempest-FloatingIPDetailsNegativeTestJSON-1473010104 tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP de287aff-881d-4684-9c19-9f6ad38c53c0 could not be found", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:20:40.445740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ae536a8d-0a6d-427b-b2d0-997df34b8762 tempest-FloatingIPDetailsNegativeTestJSON-1473010104 tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project] HTTP exception thrown: Floating IP not found for ID de287aff-881d-4684-9c19-9f6ad38c53c0 Jul 20 04:20:40.447514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae536a8d-0a6d-427b-b2d0-997df34b8762 tempest-FloatingIPDetailsNegativeTestJSON-1473010104 tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project] Request method failure captured: Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-floating-ips/de287aff-881d-4684-9c19-9f6ad38c53c0 HTTP/1.1 Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KXi_hxRay6UucoGMbVt8GpLidX2L7ycpk968OeuqnuUap56r6d5zgbGr2otn-W-H22CH6clJzBPyLYAEHwLHdFen027hPDrEfPITc1d-nE9pgQ_E72GQzhwJ7gxmrIG2Dq-vyPChDOiHuwYz4lBGAKs7HjTf4UMs4x1BZR5p9_Vcw Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 216e4624a46b4392b8823f2bdefea852 Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1473010104 Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:40.447922 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/216e4624a46b4392b8823f2bdefea852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/216e4624a46b4392b8823f2bdefea852"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/216e4624a46b4392b8823f2bdefea852"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_216e4624a46b4392b8823f2bdefea852", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1473010104 Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 216e4624a46b4392b8823f2bdefea852 Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1473010104 Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bab999f3d1fa474482a44b412ed82d4a Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: exception: Floating IP not found for ID de287aff-881d-4684-9c19-9f6ad38c53c0 Jul 20 04:20:40.449579 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de287aff-881d-4684-9c19-9f6ad38c53c0'} Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:40.450428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP de287aff-881d-4684-9c19-9f6ad38c53c0 could not be found Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38fcdf37-abd8-466b-b80b-e6e493253217'] Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID de287aff-881d-4684-9c19-9f6ad38c53c0. Jul 20 04:20:40.451731 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID de287aff-881d-4684-9c19-9f6ad38c53c0 Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:40.453049 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:40.455752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:40.455752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID de287aff-881d-4684-9c19-9f6ad38c53c0 Jul 20 04:20:40.455752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:40.455752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae536a8d-0a6d-427b-b2d0-997df34b8762 tempest-FloatingIPDetailsNegativeTestJSON-1473010104 tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project] Returning 404 to user: Floating IP not found for ID de287aff-881d-4684-9c19-9f6ad38c53c0 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:40.455752 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae536a8d-0a6d-427b-b2d0-997df34b8762 tempest-FloatingIPDetailsNegativeTestJSON-1473010104 tempest-FloatingIPDetailsNegativeTestJSON-1473010104-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/de287aff-881d-4684-9c19-9f6ad38c53c0" status: 404 len: 111 microversion: 2.1 time: 0.463392 Jul 20 04:20:40.455752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 797/1663] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:20:39 2022] GET /compute/v2.1/os-floating-ips/de287aff-881d-4684-9c19-9f6ad38c53c0 => generated 111 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:40.459295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f81bf85-c3b3-48e4-8753-9383d781b87d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '.version_select at 0x7f839802d430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.466276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.467664 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.468762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.469444 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.509627 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f3225ebc-d151-4c0f-9b0f-e126c8c7253e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.072227 Jul 20 04:20:40.512308 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 867/1664] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:40.518975 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f81bf85-c3b3-48e4-8753-9383d781b87d tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209689036" status: 202 len: 0 microversion: 2.1 time: 0.063222 Jul 20 04:20:40.519564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 798/1665] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:20:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209689036 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:20:40.763667 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:40.765199 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:40.780397 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.784722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:40.796994 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:40.796994 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.009156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:41.010774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:41.037883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.041156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.043174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.048797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.477586 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:41.489136 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a5f7308a-c717-4829-aeaf-38f460908286 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 0.729834 Jul 20 04:20:41.505162 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 868/1666] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:41.510708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:41.525012 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:41.550064 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.550918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.551929 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:41.552814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:41.677157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:41.687983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82e21c59-c38b-4034-a384-392843433d00 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.689381 Jul 20 04:20:41.706407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 799/1667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:40 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:42.032769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c943a5ee-34c5-444c-80b2-0a34a938ee61 req-8eecb6f0-ba99-441f-bd99-89bd9f48141e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "tag": "c15ffd4c-b7be-4b3a-8b97-d50f69d850f6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:42.054935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c943a5ee-34c5-444c-80b2-0a34a938ee61 req-8eecb6f0-ba99-441f-bd99-89bd9f48141e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.056832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c943a5ee-34c5-444c-80b2-0a34a938ee61 req-8eecb6f0-ba99-441f-bd99-89bd9f48141e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.095659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c943a5ee-34c5-444c-80b2-0a34a938ee61 req-8eecb6f0-ba99-441f-bd99-89bd9f48141e service nova] Creating event network-changed:c15ffd4c-b7be-4b3a-8b97-d50f69d850f6 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:20:42.116252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c943a5ee-34c5-444c-80b2-0a34a938ee61 req-8eecb6f0-ba99-441f-bd99-89bd9f48141e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251377 Jul 20 04:20:42.120855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 800/1668] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:42.505288 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:42.514005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.515433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:42.522337 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f0ddb19b-8e7d-4591-bba1-988f365dd827 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 1.015551 Jul 20 04:20:42.533040 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 869/1669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:41 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:42.558173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.564123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.568197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.572646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.712375 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:42.713306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:42.720456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.725240 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:42.743313 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:42.744082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.826506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:43.847797 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-64ad0fed-dfd2-4fb1-8e4b-a8b214bdd6d8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 1.333977 Jul 20 04:20:43.850084 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 801/1670] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:43.864244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:43.871802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:43.893739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.897617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.899344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:43.903397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:43.932532 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:43.944915 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0f3777a0-5165-4d68-88b6-5a5b213ce703 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 1.236726 Jul 20 04:20:43.949325 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 870/1671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:42 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:44.247781 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:44.249355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:44.261568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.262355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.266972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.271768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.348305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:44.642630 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-20bf4ede-af48-4c7a-91f8-5489818f22ba tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "DELETE /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 204 len: 0 microversion: 2.1 time: 0.403329 Jul 20 04:20:44.645011 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 871/1672] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:44 2022] DELETE /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:44.663807 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:44.666874 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:44.684100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.689121 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:44.691815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:44.692270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.026907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:45.042697 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c96b4683-2419-4abb-829d-0d2aaa4d61f2 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1468 microversion: 2.1 time: 0.391895 Jul 20 04:20:45.049509 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 872/1673] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:44 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1468 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:45.054562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:45.056004 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:45.062694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.063489 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.064614 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.065316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.343457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:45.365043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d423cfbc-0410-4caa-8091-3e3531580f87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 1.509308 Jul 20 04:20:45.370617 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 802/1674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:43 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:45.397995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:45.399141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:45.407677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.408560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.410580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:45.411275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:45.545730 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:45.556422 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-07172e8b-83ac-4904-8e27-c205cedf7526 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 0.505537 Jul 20 04:20:45.559080 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 873/1675] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:45 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:45.692949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b1d6baee-d547-44ae-aecd-f13c2c9972f9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f8398344550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1910778342", "description": "tempest-description-27254158"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:46.110101 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b1d6baee-d547-44ae-aecd-f13c2c9972f9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.484131 Jul 20 04:20:46.111310 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 874/1676] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:45 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:20:46.246857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1915306157", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "7ad14e8f-b738-4578-8a61-b639df9b6034"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:46.336924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:46.345304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91ed3390-8537-49bb-b947-078d653a3122 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.972559 Jul 20 04:20:46.348825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 803/1677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:45 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:46.366318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:46.367218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:46.379354 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] validate_networks() for [('7ad14e8f-b738-4578-8a61-b639df9b6034', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:46.385306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.386474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:46.389894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:46.390462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.453318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:47.469185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b115680-83f6-4f7a-9797-2c06573d36d4 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 200 len: 1468 microversion: 2.1 time: 1.112214 Jul 20 04:20:47.470392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 804/1678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:46 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 1468 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:47.489358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e440249-b18a-43f0-84b4-e8ac984d9b9a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f838bace8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2009048060", "description": "tempest-description-610743124"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:47.845877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:47.846930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:47.847571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:47.848196 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:47.848943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:47.867789 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.879455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.882383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:47.885161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:47.937013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Getting quotas for project e0edfeefaa7143868c28d82d07548ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:47.952784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Getting quotas for user cddd38a0cc0542829a5902490604063f and project e0edfeefaa7143868c28d82d07548ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:47.984901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:47.998030 n-d-764486-11 devstack@n-api.service[123723]: WARNING nova.utils [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1915306157 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-191530615 Jul 20 04:20:47.999379 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:48.147179 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-919d9dae-fea5-468b-b5e8-2a500530b68f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.034261 Jul 20 04:20:48.147864 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 875/1679] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:48.166232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.169521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.204603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.208331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.213906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.214372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.636047 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:48.639734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:48.652364 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fefc9ee4-5704-42d1-a239-e695067db3d0 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.497937 Jul 20 04:20:48.661307 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 876/1680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:48.679882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:48.683823 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:48.703742 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.704911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:48.706207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:48.709417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.251699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.261146 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9ae8e4c1-bb80-4267-99d9-207814f91697 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1506 microversion: 2.1 time: 0.597957 Jul 20 04:20:49.269594 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 877/1681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:48 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:49.288627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-a4abf2e5-4d01-49de-a0d3-a60564028da8 req-9204e676-188d-4206-ba1f-b47747d5871f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "tag": "c8582cd4-f46d-4618-91cd-6b04f6683845"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:49.316603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e440249-b18a-43f0-84b4-e8ac984d9b9a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.843434 Jul 20 04:20:49.317415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 805/1682] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:20:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:49.326064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.327858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.338582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-a4abf2e5-4d01-49de-a0d3-a60564028da8 req-9204e676-188d-4206-ba1f-b47747d5871f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.339670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-a4abf2e5-4d01-49de-a0d3-a60564028da8 req-9204e676-188d-4206-ba1f-b47747d5871f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.362341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.365980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.368812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.370588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.386096 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-a4abf2e5-4d01-49de-a0d3-a60564028da8 req-9204e676-188d-4206-ba1f-b47747d5871f service nova] Creating event network-changed:c8582cd4-f46d-4618-91cd-6b04f6683845 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:20:49.404565 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-a4abf2e5-4d01-49de-a0d3-a60564028da8 req-9204e676-188d-4206-ba1f-b47747d5871f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121261 Jul 20 04:20:49.405966 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 878/1683] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:49.413007 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9e67a1f5-fe8a-45cb-ad2c-663e20af2c40 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.415066 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9e67a1f5-fe8a-45cb-ad2c-663e20af2c40 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.430919 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:49.596494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9e67a1f5-fe8a-45cb-ad2c-663e20af2c40 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:49.610394 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9e67a1f5-fe8a-45cb-ad2c-663e20af2c40 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1232 microversion: 2.1 time: 0.202828 Jul 20 04:20:49.611342 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 879/1684] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1232 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:49.618356 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-900d11bf-882c-474c-89ec-c58d4eedb64b req-8423cbd0-a101-4cf3-865d-a95c01790d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3", "name": "network-vif-deleted", "tag": "1ed64614-8410-4160-97d3-350c62fdb902"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:49.672395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-900d11bf-882c-474c-89ec-c58d4eedb64b req-8423cbd0-a101-4cf3-865d-a95c01790d32 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.672848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-900d11bf-882c-474c-89ec-c58d4eedb64b req-8423cbd0-a101-4cf3-865d-a95c01790d32 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.700567 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-900d11bf-882c-474c-89ec-c58d4eedb64b req-8423cbd0-a101-4cf3-865d-a95c01790d32 service nova] Creating event network-vif-deleted:1ed64614-8410-4160-97d3-350c62fdb902 for instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 on n-h2-764486-11 Jul 20 04:20:49.725420 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-900d11bf-882c-474c-89ec-c58d4eedb64b req-8423cbd0-a101-4cf3-865d-a95c01790d32 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112786 Jul 20 04:20:49.726785 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 880/1685] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:49.763010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:49.768764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:49.780326 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.799650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.800084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:49.800555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:49.842027 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] HTTP exception thrown: Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 could not be found. Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Request method failure captured: Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 HTTP/1.1 Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14FPuDWNzFxmxry42lj0da750jlRtsDESSS6v--7oPgT6D6j_GFZMRtE8ZX5uMAmkX6Dq8KqQDkVJ65Lm4Y_z5yt7KjD8dE9vFn3Ex9RHFjrl1EqXibPq5Dt2txx6-KaMXjAUwSnv03MR5YpZ7zo88FrAdDzkCQWgFzxwMbIJIaVS0s Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:20:49.843725 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3180da7c29d64983854c1235b108c7e7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 3e8f4a044b904befbddb93375b6e213a Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 could not be found. Jul 20 04:20:49.845538 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3'} Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 could not be found. Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:49.846473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 could not be found. Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 could not be found. Jul 20 04:20:49.848166 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:20:49.849687 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Returning 404 to user: Instance edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:49.849687 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-082eb13a-9a61-45ed-9574-171c36a90938 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3" status: 404 len: 111 microversion: 2.1 time: 0.119448 Jul 20 04:20:49.850575 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 881/1686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/edd6e4a8-fb84-467d-af1e-cb1cdb10b3f3 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:49.880591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1379904770", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "21bfc5f4-6e35-462a-9812-b73df38b7e96"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:49.974951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] validate_networks() for [('21bfc5f4-6e35-462a-9812-b73df38b7e96', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:20:50.591973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:50.612783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3cd38d73-710c-4a3d-814c-fb841f205a46 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 1.293692 Jul 20 04:20:50.614001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 806/1687] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:49 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:50.633298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:50.640995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:50.655433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.656600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:50.657967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:50.673159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.396034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:51.417446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fcb0529-55c4-4e4c-971c-a5da92c89eba tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.793075 Jul 20 04:20:51.421415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 807/1688] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:50 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:51.434327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.435171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.449477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.454729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.455823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.456472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.518092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:20:51.670398 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:20:51.671183 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:20:51.671823 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:20:51.672606 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:20:51.674072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:20:51.703132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.705201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.706447 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.711927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.777149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ef114d5-13c3-4d98-9e2d-4c9cc4587e5f tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "DELETE /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 204 len: 0 microversion: 2.1 time: 0.353375 Jul 20 04:20:51.780931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 808/1689] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:20:51 2022] DELETE /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:20:51.785658 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Getting quotas for project 268aab5272cd47eb9457788b975f4f16. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:20:51.788326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.790329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.800843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Getting quotas for user 205f260c33ea4f0c8bf7f77c949073a4 and project 268aab5272cd47eb9457788b975f4f16. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:20:51.806328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.808094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.812134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.812892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.844943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:20:51.847530 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:20:51.922648 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-803b4355-75db-4dc9-95b2-59544a0c94b7 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.071395 Jul 20 04:20:51.926660 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 882/1690] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:20:51.941665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:51.941665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:51.957138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.958290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:51.959312 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:51.959921 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.189299 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.208379 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-357452cf-632a-4066-948e-d64b7b078721 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1290 microversion: 2.1 time: 0.279358 Jul 20 04:20:52.212094 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 883/1691] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.223211 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-2d04709e-4e53-4898-8219-1e63ee97bc80 req-090b7cc5-4a29-4d27-a2d6-2a054a039a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "tag": "ecbd67f9-3c70-4dde-bd1d-c0ba05c98fe8"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:52.241909 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2d04709e-4e53-4898-8219-1e63ee97bc80 req-090b7cc5-4a29-4d27-a2d6-2a054a039a12 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.246118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-2d04709e-4e53-4898-8219-1e63ee97bc80 req-090b7cc5-4a29-4d27-a2d6-2a054a039a12 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.282195 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-2d04709e-4e53-4898-8219-1e63ee97bc80 req-090b7cc5-4a29-4d27-a2d6-2a054a039a12 service nova] Creating event network-changed:ecbd67f9-3c70-4dde-bd1d-c0ba05c98fe8 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:20:52.287822 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-2d04709e-4e53-4898-8219-1e63ee97bc80 req-090b7cc5-4a29-4d27-a2d6-2a054a039a12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074459 Jul 20 04:20:52.292238 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 884/1692] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:52.309158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.309913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.317234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.328160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bfa0206a-ef0e-413e-826e-d0837efd7ffe tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1527 microversion: 2.1 time: 0.547947 Jul 20 04:20:52.334382 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 809/1693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:51 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1527 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.342381 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.343119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.344280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.347204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.349642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.350276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.359692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.360138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.360942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:52.381259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:52.652718 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:52.663361 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-667f57c9-1d6d-47f1-a9ac-9815ebf47b5e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.368707 Jul 20 04:20:52.666645 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 885/1694] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:52.680177 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3142d6f3-8da2-4f37-8fb0-28ab5319ffdc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:52.687109 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3142d6f3-8da2-4f37-8fb0-28ab5319ffdc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:52.986922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3142d6f3-8da2-4f37-8fb0-28ab5319ffdc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.000487 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3142d6f3-8da2-4f37-8fb0-28ab5319ffdc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1216 microversion: 2.1 time: 0.331707 Jul 20 04:20:53.001348 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 886/1695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1216 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:53.015791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:53.020792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:53.056165 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.056650 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.057562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.058006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.466765 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.480435 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7e465a44-3d83-4801-9926-3b8c6a463c87 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.476315 Jul 20 04:20:53.483030 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 887/1696] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:53 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:53.500848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:53.501923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:53.508590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.509345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.517482 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.517935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.768873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:53.781158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af871493-5dc1-42e4-8954-7a285a192653 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1469 microversion: 2.1 time: 1.444674 Jul 20 04:20:53.782440 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 810/1697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:52 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1469 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:53.820279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:53.821639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:53.843323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.844313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:53.847889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:53.849888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.656570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:54.669083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce8795ab-b431-4e04-8207-dc39c9bfedc6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.885029 Jul 20 04:20:54.673099 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 811/1698] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:53 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:54.686791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:54.687782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:54.707123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.708123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:54.709210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:54.712742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.165369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.178665 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d3695eb2-4bfd-40d6-b52d-854edf45181e tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 1.689891 Jul 20 04:20:55.189197 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 888/1699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:53 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:55.201997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.202964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:55.216827 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.217580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.220471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.221201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.242083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.253045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34fedf8c-d891-4ddb-8675-6c890913788c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.578570 Jul 20 04:20:55.257113 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 812/1700] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:54 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:55.262541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.270510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:55.292542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.293288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.294364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.294981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.398154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.413699 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c246b0c8-b14c-421a-895c-46a4539b3bad tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1274 microversion: 2.1 time: 0.222518 Jul 20 04:20:55.416226 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 889/1701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:55 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:55.429977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.430988 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:55.463930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.465699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.467341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.469712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.752245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8f4a044b904befbddb93375b6e213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3180da7c29d64983854c1235b108c7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:55.759765 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c9ac9794-e992-4ec4-b115-a9ef0b7eb374 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 200 len: 1427 microversion: 2.1 time: 0.342378 Jul 20 04:20:55.760945 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 890/1702] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:55 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 1427 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:55.787721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:55.788783 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:55.796096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.796821 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:55.797901 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:55.799032 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.228250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:56.239130 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a559cf84-febb-4861-803d-603f5f0afb18 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.980711 Jul 20 04:20:56.242977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 813/1703] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:55 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:56.257366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2f7d1198-0efb-4dd8-965f-8b834e8939e3 req-5f4bbf66-6c1e-4593-af87-2b2f7b1f92e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328dd8aa-9d14-40c7-8afd-05306640e26e", "name": "network-vif-deleted", "tag": "89c6b692-291c-4b48-9870-10b30c95d138"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:56.274586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2f7d1198-0efb-4dd8-965f-8b834e8939e3 req-5f4bbf66-6c1e-4593-af87-2b2f7b1f92e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.276186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2f7d1198-0efb-4dd8-965f-8b834e8939e3 req-5f4bbf66-6c1e-4593-af87-2b2f7b1f92e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.328083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2f7d1198-0efb-4dd8-965f-8b834e8939e3 req-5f4bbf66-6c1e-4593-af87-2b2f7b1f92e5 service nova] Creating event network-vif-deleted:89c6b692-291c-4b48-9870-10b30c95d138 for instance 328dd8aa-9d14-40c7-8afd-05306640e26e on n-h2-764486-11 Jul 20 04:20:56.341223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2f7d1198-0efb-4dd8-965f-8b834e8939e3 req-5f4bbf66-6c1e-4593-af87-2b2f7b1f92e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093749 Jul 20 04:20:56.346590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 814/1704] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:56.378568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4075aa19-47cc-42e1-8a75-6ac04eea99de req-721189d3-59bc-4f86-a828-a380e05abbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32076e88-d4fa-4391-afcb-bad6d6f9fbfa", "name": "network-vif-plugged", "status": "completed", "tag": "e57fe3f6-4827-4f73-9c52-231d22c64b3e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:20:56.413169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4075aa19-47cc-42e1-8a75-6ac04eea99de req-721189d3-59bc-4f86-a828-a380e05abbe6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.419408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4075aa19-47cc-42e1-8a75-6ac04eea99de req-721189d3-59bc-4f86-a828-a380e05abbe6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.447461 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4075aa19-47cc-42e1-8a75-6ac04eea99de req-721189d3-59bc-4f86-a828-a380e05abbe6 service nova] Creating event network-vif-plugged:e57fe3f6-4827-4f73-9c52-231d22c64b3e for instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa on n-h1-764486-11 Jul 20 04:20:56.458102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4075aa19-47cc-42e1-8a75-6ac04eea99de req-721189d3-59bc-4f86-a828-a380e05abbe6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108971 Jul 20 04:20:56.460448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 815/1705] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:20:56.471927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:56.475327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:56.490913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.493432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.497713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:56.499325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:56.504962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:20:57.088959 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.103409 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fadd936f-ac64-4c24-8e37-e5d54a5049a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 1.322945 Jul 20 04:20:57.105503 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 891/1706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:55 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.147323 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.153888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.179602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.184058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.184343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.187237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.190767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.203362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-233724ec-d8a7-4b60-9417-8ea7e245cb36 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.740911 Jul 20 04:20:57.211419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 816/1707] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:56 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.221028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.221643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.242313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.242767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.247722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.248435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.410870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.420473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6bef885e-25c6-472a-a04a-ea88014a8857 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1274 microversion: 2.1 time: 0.207596 Jul 20 04:20:57.422006 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 817/1708] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.427207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.428137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] [instance: 328dd8aa-9d14-40c7-8afd-05306640e26e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.452033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.456994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.458169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.461521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.489963 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] HTTP exception thrown: Instance 328dd8aa-9d14-40c7-8afd-05306640e26e could not be found. Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Request method failure captured: Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e HTTP/1.1 Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14FPuDWNzFxmxry42lj0da750jlRtsDESSS6v--7oPgT6D6j_GFZMRtE8ZX5uMAmkX6Dq8KqQDkVJ65Lm4Y_z5yt7KjD8dE9vFn3Ex9RHFjrl1EqXibPq5Dt2txx6-KaMXjAUwSnv03MR5YpZ7zo88FrAdDzkCQWgFzxwMbIJIaVS0s Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:20:57.494486 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3180da7c29d64983854c1235b108c7e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3180da7c29d64983854c1235b108c7e7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3180da7c29d64983854c1235b108c7e7 Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MigrationsAdminTest-511686878 Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 3e8f4a044b904befbddb93375b6e213a Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MigrationsAdminTest-511686878-project Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 328dd8aa-9d14-40c7-8afd-05306640e26e could not be found. Jul 20 04:20:57.496534 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '328dd8aa-9d14-40c7-8afd-05306640e26e'} Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328dd8aa-9d14-40c7-8afd-05306640e26e could not be found. Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:20:57.497670 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328dd8aa-9d14-40c7-8afd-05306640e26e could not be found. Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328dd8aa-9d14-40c7-8afd-05306640e26e could not be found. Jul 20 04:20:57.499149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:20:57.502841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] Returning 404 to user: Instance 328dd8aa-9d14-40c7-8afd-05306640e26e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:20:57.503762 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5632fd27-2a6b-4654-b3d8-4c611b2ff430 tempest-MigrationsAdminTest-511686878 tempest-MigrationsAdminTest-511686878-project] 10.222.0.49 "GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e" status: 404 len: 111 microversion: 2.1 time: 0.080468 Jul 20 04:20:57.507872 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 818/1709] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/328dd8aa-9d14-40c7-8afd-05306640e26e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:20:57.514742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:57.515763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:57.524893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.526280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.527555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:57.528684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:57.816713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.847562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b9f5c85-bdc3-4bec-af43-7d3ef7a494fd tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.338011 Jul 20 04:20:57.848340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 819/1710] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:57.920740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:57.938348 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f69a56b4-f726-4a16-a96a-a2f75c81e614 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.814478 Jul 20 04:20:57.939732 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 892/1711] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:57 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:58.125048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.125762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.150222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.152723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.155759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.157921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.221589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.223538 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.236425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.240858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.245811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.247694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.557600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:58.597878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-111ec3c8-632d-41e9-87bd-ba74070adfcc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.477787 Jul 20 04:20:58.608697 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 820/1712] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:20:58.625137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:58.628936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:58.657487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.658632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.662120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:58.663565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:58.997863 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.024937 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-da20a843-6ad0-4c6c-9814-fa526897322b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.808608 Jul 20 04:20:59.039457 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 893/1713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:59.052496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.054132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:59.064654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.065434 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.066978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.068013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.297094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.305639 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66869c68-350b-4641-8ac1-d9e3c8f46a8f tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.703051 Jul 20 04:20:59.309352 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 821/1714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:58 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:59.323590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:20:59.326407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:20:59.346419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.348085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.350219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:20:59.352737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:20:59.955973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:20:59.969224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-603e64e4-9d2a-4c39-99ca-0c20248a8ddf tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.658547 Jul 20 04:20:59.970670 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 822/1715] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:20:59.988343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5f3947bf-1205-4f6a-9f2c-a7347411c15b req-bd3b29e2-8aac-465b-983c-53d32e9ade85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd104a82-0c3a-45a4-9e70-b234e7410953", "tag": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:00.023575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f3947bf-1205-4f6a-9f2c-a7347411c15b req-bd3b29e2-8aac-465b-983c-53d32e9ade85 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.024023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f3947bf-1205-4f6a-9f2c-a7347411c15b req-bd3b29e2-8aac-465b-983c-53d32e9ade85 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.048837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.056287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5f3947bf-1205-4f6a-9f2c-a7347411c15b req-bd3b29e2-8aac-465b-983c-53d32e9ade85 service nova] Creating event network-changed:4e39f8f7-9c65-447b-81f8-864ffaf8fa5e for instance dd104a82-0c3a-45a4-9e70-b234e7410953 on n-h1-764486-11 Jul 20 04:21:00.063893 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c106eedd-5fe0-42a9-ac0d-df4268863bd1 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 1.023017 Jul 20 04:21:00.069198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5f3947bf-1205-4f6a-9f2c-a7347411c15b req-bd3b29e2-8aac-465b-983c-53d32e9ade85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097241 Jul 20 04:21:00.073782 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 823/1716] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:00.079677 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 894/1717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:20:59 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.084144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.088660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.089933 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.090568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.102878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.104620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.104795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.105450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.105897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.110341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.112648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.113265 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.681926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:00.698238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9f86fe3-0d48-44f6-b574-06ee40592ada tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.621352 Jul 20 04:21:00.700676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 824/1718] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:00.705349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:00.705955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:00.737575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.738035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:00.739066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:00.739254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.177297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.187329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b10be73-5f27-451e-9949-e64e0eb67311 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.485409 Jul 20 04:21:01.191705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.200721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 825/1719] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:01.205688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:01.206301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:01.213905 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d10fc60e-600c-43f9-b4ad-b6bdfbd65a57 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 1.133048 Jul 20 04:21:01.216493 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 895/1720] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:00 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:01.222039 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:01.225113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:01.232321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.232821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.233611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.234047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.242388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.245227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.252239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.254026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.611070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:01.628796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-405161b0-5799-40e4-83c2-f8b43803d02d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.426834 Jul 20 04:21:01.630313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 826/1721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:01 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:01.718319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:01.719474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:01.730101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.730706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.731322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:01.731754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:01.747150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:02.159990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.179565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c066a571-3a4e-46db-a49c-a8fc4bdca794 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.468041 Jul 20 04:21:02.186753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 827/1722] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:01 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:21:02.201743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-354afb6c-7c41-4ed6-8ada-d2fc87129f03 req-5fa782da-a3b1-41a2-bd9a-63bb00fb8c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "name": "network-vif-unplugged", "status": "completed", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:02.231420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-354afb6c-7c41-4ed6-8ada-d2fc87129f03 req-5fa782da-a3b1-41a2-bd9a-63bb00fb8c42 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.232182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-354afb6c-7c41-4ed6-8ada-d2fc87129f03 req-5fa782da-a3b1-41a2-bd9a-63bb00fb8c42 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.246575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.260178 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-21032a38-cad7-458d-b815-d4311a81ba72 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 1.038942 Jul 20 04:21:02.261114 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 896/1723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:01 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:02.272820 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.276665 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.277840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-354afb6c-7c41-4ed6-8ada-d2fc87129f03 req-5fa782da-a3b1-41a2-bd9a-63bb00fb8c42 service nova] Creating event network-vif-unplugged:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h1-764486-11 Jul 20 04:21:02.296548 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.297185 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.298906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.299455 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.301861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-354afb6c-7c41-4ed6-8ada-d2fc87129f03 req-5fa782da-a3b1-41a2-bd9a-63bb00fb8c42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112085 Jul 20 04:21:02.303928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 828/1724] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:02.322228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.330119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.358255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.362075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.366475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.366618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.778476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.801679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9bd16e47-04d1-4d50-9993-e284a6b8bd80 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.496411 Jul 20 04:21:02.806055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 829/1725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:02.858590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:02.890130 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5380589f-92f1-40af-98ef-0ca0a2febbda tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.620812 Jul 20 04:21:02.893400 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 897/1726] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:02.905069 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:02.912286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:02.923167 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.928217 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.929283 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:02.929958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:02.998050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=16 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:03.232147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a4fdcff-ae28-48c9-bcf0-7840d068f8c0 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Calling method '.version_select at 0x7f838b802160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.763595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:03.770277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:03.784868 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-be6d9294-fc37-4b42-9d6e-ed062a5272ff tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.889395 Jul 20 04:21:03.796587 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 898/1727] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:02 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:03.808300 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:03.809229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:03.818740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.821711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:03.825837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:03.828169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.025807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9a4fdcff-ae28-48c9-bcf0-7840d068f8c0 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] HTTP exception thrown: Image not found. Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a4fdcff-ae28-48c9-bcf0-7840d068f8c0 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Request method failure captured: Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/c776f5bf-5f71-42e4-b4fb-e71557d3dc4a/metadata/os_distro HTTP/1.1 Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Ku7FhsqpXC1ev4rnMToHbaShHIIg2ul9AoSHDwDZQQmNgMegMnZs0tZA8Dafgt_AutjJyAHM3tY3LcDvcCQTLJ111eagxGvBhIPrGRRpBFd163HGed_qQduOke0ShTaPBO1SlB7_B79ztwcg6gMbnWdMd66TFXI2iUw_LdkOWMSuQ Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:04.029330 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_203681a2c87848c5b2715bee6079c1d1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9d58b6c4b25e41e881e824c4b7dedf0c Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'image_id': 'c776f5bf-5f71-42e4-b4fb-e71557d3dc4a', 'id': 'os_distro'} Jul 20 04:21:04.031710 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:04.033087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c776f5bf-5f71-42e4-b4fb-e71557d3dc4a Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:04.035007 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c776f5bf-5f71-42e4-b4fb-e71557d3dc4a could not be found. Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:04.037192 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.039910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a4fdcff-ae28-48c9-bcf0-7840d068f8c0 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:04.043023 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a4fdcff-ae28-48c9-bcf0-7840d068f8c0 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] 10.222.0.49 "DELETE /compute/v2.1/images/c776f5bf-5f71-42e4-b4fb-e71557d3dc4a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 1.226362 Jul 20 04:21:04.043023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 830/1728] 10.222.0.49 () {58 vars in 1292 bytes} [Wed Jul 20 04:21:02 2022] DELETE /compute/v2.1/images/c776f5bf-5f71-42e4-b4fb-e71557d3dc4a/metadata/os_distro => generated 62 bytes in 1231 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:04.067371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.075136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.090365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:04.092841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.096139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.099945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.100722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.438093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:04.453968 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc792482-a672-4fa0-abc1-ec536076375b tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.409310 Jul 20 04:21:04.458076 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 831/1729] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:04.474544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.475174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.493680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.494429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.495449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.496065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.738640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:04.754416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:04.776813 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-474f4ccc-3b4d-4b72-85b8-844d1e753661 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.978342 Jul 20 04:21:04.778222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-905e5989-71b0-4d1b-9cb3-27fd5e0831ce tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.317810 Jul 20 04:21:04.788577 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 899/1730] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:03 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:04.790599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 832/1731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:04.796456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dde1bc8-2fbd-4920-808c-32df9ab371c3 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Calling method '.version_select at 0x7f839802d940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.802276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.803243 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:04.829522 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.830193 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.831202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.831837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.842240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3dde1bc8-2fbd-4920-808c-32df9ab371c3 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] HTTP exception thrown: Image not found. Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dde1bc8-2fbd-4920-808c-32df9ab371c3 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Request method failure captured: Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/images/3b863f7c-3ecc-4f18-85a0-de7e01a5072f/metadata/os_version HTTP/1.1 Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Ku7FhsqpXC1ev4rnMToHbaShHIIg2ul9AoSHDwDZQQmNgMegMnZs0tZA8Dafgt_AutjJyAHM3tY3LcDvcCQTLJ111eagxGvBhIPrGRRpBFd163HGed_qQduOke0ShTaPBO1SlB7_B79ztwcg6gMbnWdMd66TFXI2iUw_LdkOWMSuQ Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:04.844607 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_203681a2c87848c5b2715bee6079c1d1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9d58b6c4b25e41e881e824c4b7dedf0c Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'image_id': '3b863f7c-3ecc-4f18-85a0-de7e01a5072f', 'id': 'os_version'} Jul 20 04:21:04.846065 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:04.846953 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3b863f7c-3ecc-4f18-85a0-de7e01a5072f Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:04.848227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b863f7c-3ecc-4f18-85a0-de7e01a5072f could not be found. Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:04.853046 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:04.858870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dde1bc8-2fbd-4920-808c-32df9ab371c3 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:04.868387 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3dde1bc8-2fbd-4920-808c-32df9ab371c3 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] 10.222.0.49 "GET /compute/v2.1/images/3b863f7c-3ecc-4f18-85a0-de7e01a5072f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.064051 Jul 20 04:21:04.868387 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 833/1732] 10.222.0.49 () {58 vars in 1292 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/images/3b863f7c-3ecc-4f18-85a0-de7e01a5072f/metadata/os_version => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:04.879459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-eb788390-a717-44fb-b075-8d20c7b98f30 req-e458667a-e696-47d4-863d-cff7e82abbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}, {"name": "network-changed", "server_uuid": "4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84", "tag": "901375b9-d9dd-4c90-9424-bc917a51c4e2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:04.911202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb788390-a717-44fb-b075-8d20c7b98f30 req-e458667a-e696-47d4-863d-cff7e82abbdd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:04.911643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb788390-a717-44fb-b075-8d20c7b98f30 req-e458667a-e696-47d4-863d-cff7e82abbdd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:04.934481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eb788390-a717-44fb-b075-8d20c7b98f30 req-e458667a-e696-47d4-863d-cff7e82abbdd service nova] Creating event network-changed:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h1-764486-11 Jul 20 04:21:04.934981 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eb788390-a717-44fb-b075-8d20c7b98f30 req-e458667a-e696-47d4-863d-cff7e82abbdd service nova] Creating event network-changed:901375b9-d9dd-4c90-9424-bc917a51c4e2 for instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 on n-h1-764486-11 Jul 20 04:21:04.973141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-eb788390-a717-44fb-b075-8d20c7b98f30 req-e458667a-e696-47d4-863d-cff7e82abbdd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094081 Jul 20 04:21:04.974404 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 834/1733] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:04.987176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:04.989113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:05.006813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.008077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.010300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.011549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.240229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.253893 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a1c2172f-f38f-44a8-bdb5-77f9dd4f9939 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.458105 Jul 20 04:21:05.254855 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 900/1734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:05.263190 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-10f4a7f7-708b-42bf-be4f-53fb72431539 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Calling method '.version_select at 0x7f83984fde50>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.305715 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-10f4a7f7-708b-42bf-be4f-53fb72431539 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] HTTP exception thrown: Image not found. Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-10f4a7f7-708b-42bf-be4f-53fb72431539 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Request method failure captured: Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/images/f7b32bae-9a63-4167-a688-4c7838284ff8/metadata HTTP/1.1 Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14Ku7FhsqpXC1ev4rnMToHbaShHIIg2ul9AoSHDwDZQQmNgMegMnZs0tZA8Dafgt_AutjJyAHM3tY3LcDvcCQTLJ111eagxGvBhIPrGRRpBFd163HGed_qQduOke0ShTaPBO1SlB7_B79ztwcg6gMbnWdMd66TFXI2iUw_LdkOWMSuQ Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:05.310808 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_203681a2c87848c5b2715bee6079c1d1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 9d58b6c4b25e41e881e824c4b7dedf0c Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: exception: Image not found. Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'image_id': 'f7b32bae-9a63-4167-a688-4c7838284ff8'} Jul 20 04:21:05.312650 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:05.313847 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f7b32bae-9a63-4167-a688-4c7838284ff8 Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:05.315269 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f7b32bae-9a63-4167-a688-4c7838284ff8 could not be found. Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:05.316910 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:05.318399 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.322463 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-10f4a7f7-708b-42bf-be4f-53fb72431539 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Returning 404 to user: Image not found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:05.323565 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-10f4a7f7-708b-42bf-be4f-53fb72431539 tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] 10.222.0.49 "GET /compute/v2.1/images/f7b32bae-9a63-4167-a688-4c7838284ff8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.067476 Jul 20 04:21:05.324688 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 901/1735] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/images/f7b32bae-9a63-4167-a688-4c7838284ff8/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:05.556713 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2140969560", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:05.603099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.614264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40b3b4d5-cbe8-4fd8-8541-88942093209f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.637603 Jul 20 04:21:05.615272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 835/1736] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:04 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:05.643992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccbbbec0-0082-41d6-8a1b-7877eaa21dde tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Action: 'update_all', calling method: .version_select at 0x7f838b85a820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:05.722120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ccbbbec0-0082-41d6-8a1b-7877eaa21dde tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] HTTP exception thrown: Image not found. Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccbbbec0-0082-41d6-8a1b-7877eaa21dde tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Request method failure captured: Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/images/af7ec1b5-a203-4537-974d-dfbea4ddeae5/metadata HTTP/1.1 Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 57 Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Ku7FhsqpXC1ev4rnMToHbaShHIIg2ul9AoSHDwDZQQmNgMegMnZs0tZA8Dafgt_AutjJyAHM3tY3LcDvcCQTLJ111eagxGvBhIPrGRRpBFd163HGed_qQduOke0ShTaPBO1SlB7_B79ztwcg6gMbnWdMd66TFXI2iUw_LdkOWMSuQ Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:05.725175 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_203681a2c87848c5b2715bee6079c1d1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9d58b6c4b25e41e881e824c4b7dedf0c Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:05.726868 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'image_id': 'af7ec1b5-a203-4537-974d-dfbea4ddeae5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:05.727853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af7ec1b5-a203-4537-974d-dfbea4ddeae5 Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:05.729315 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af7ec1b5-a203-4537-974d-dfbea4ddeae5 could not be found. Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:05.730990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:05.732447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:05.734157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccbbbec0-0082-41d6-8a1b-7877eaa21dde tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:05.734157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccbbbec0-0082-41d6-8a1b-7877eaa21dde tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] 10.222.0.49 "PUT /compute/v2.1/images/af7ec1b5-a203-4537-974d-dfbea4ddeae5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.110121 Jul 20 04:21:05.734157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 836/1737] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:21:05 2022] PUT /compute/v2.1/images/af7ec1b5-a203-4537-974d-dfbea4ddeae5/metadata => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:05.737136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:05.737747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:05.746864 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:05.753370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.753820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.754591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:05.770102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:05.946257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:05.955355 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03a8991a-9f84-4da2-b906-a5415bd77244 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.226810 Jul 20 04:21:05.956638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 837/1738] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:05 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:05.976083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07903b76-8c44-42ce-8393-0f84b00b4cba tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Action: 'update', calling method: .version_select at 0x7f838ba74f70>, body: {"meta": {"os_distro": "alt"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:06.013092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-07903b76-8c44-42ce-8393-0f84b00b4cba tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] HTTP exception thrown: Image not found. Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07903b76-8c44-42ce-8393-0f84b00b4cba tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Request method failure captured: Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/images/2b030e83-b46e-4820-b17b-26bc701d0e24/metadata/os_distro HTTP/1.1 Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 30 Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Ku7FhsqpXC1ev4rnMToHbaShHIIg2ul9AoSHDwDZQQmNgMegMnZs0tZA8Dafgt_AutjJyAHM3tY3LcDvcCQTLJ111eagxGvBhIPrGRRpBFd163HGed_qQduOke0ShTaPBO1SlB7_B79ztwcg6gMbnWdMd66TFXI2iUw_LdkOWMSuQ Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:06.015912 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_203681a2c87848c5b2715bee6079c1d1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9d58b6c4b25e41e881e824c4b7dedf0c Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: {"meta": {"os_distro": "alt"}} Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:06.017630 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'image_id': '2b030e83-b46e-4820-b17b-26bc701d0e24', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:06.018627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2b030e83-b46e-4820-b17b-26bc701d0e24 Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:06.020170 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2b030e83-b46e-4820-b17b-26bc701d0e24 could not be found. Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:06.022962 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:06.025250 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.028893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07903b76-8c44-42ce-8393-0f84b00b4cba tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:06.029761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07903b76-8c44-42ce-8393-0f84b00b4cba tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] 10.222.0.49 "PUT /compute/v2.1/images/2b030e83-b46e-4820-b17b-26bc701d0e24/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.072014 Jul 20 04:21:06.030334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 838/1739] 10.222.0.49 () {60 vars in 1309 bytes} [Wed Jul 20 04:21:05 2022] PUT /compute/v2.1/images/2b030e83-b46e-4820-b17b-26bc701d0e24/metadata/os_distro => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:06.052597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.053442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.069036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.069036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.075927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.076888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.110494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:06.131469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:06.133187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:06.133990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:06.134604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:06.135209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:06.147325 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.148099 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.150318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.150938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.172706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Getting quotas for project b1aabe9c1e484ea8ae0ca07bfc093c88. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:06.179924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Getting quotas for user cd40edc86fb24af79986645c1e99d944 and project b1aabe9c1e484ea8ae0ca07bfc093c88. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:06.211311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:06.226923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:06.311857 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f1820294-4aab-47ae-85a8-cd5f3125a7f4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985777 Jul 20 04:21:06.313915 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 902/1740] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:06.325222 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.326231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.351963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.354201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.355307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.355932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.421726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.433092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a810e2f0-9b02-45cc-af1e-313c7924e3d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.395730 Jul 20 04:21:06.434160 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 839/1741] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:06.438897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b33b7ee0-3c13-4456-b3c6-e907a8e72313 req-3b309c4a-eeaf-45de-8347-8ae0a9a6f094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "name": "network-vif-plugged", "status": "completed", "tag": "c15ffd4c-b7be-4b3a-8b97-d50f69d850f6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:06.469275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b33b7ee0-3c13-4456-b3c6-e907a8e72313 req-3b309c4a-eeaf-45de-8347-8ae0a9a6f094 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.469725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b33b7ee0-3c13-4456-b3c6-e907a8e72313 req-3b309c4a-eeaf-45de-8347-8ae0a9a6f094 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.498436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b33b7ee0-3c13-4456-b3c6-e907a8e72313 req-3b309c4a-eeaf-45de-8347-8ae0a9a6f094 service nova] Creating event network-vif-plugged:c15ffd4c-b7be-4b3a-8b97-d50f69d850f6 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:21:06.511799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b33b7ee0-3c13-4456-b3c6-e907a8e72313 req-3b309c4a-eeaf-45de-8347-8ae0a9a6f094 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076164 Jul 20 04:21:06.512728 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 840/1742] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:06.517878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-793ed4d2-2a39-4b6f-a07b-98d367d1b7fc tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Action: 'create', calling method: .version_select at 0x7f838b8785e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:06.562201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-793ed4d2-2a39-4b6f-a07b-98d367d1b7fc tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] HTTP exception thrown: Image not found. Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-793ed4d2-2a39-4b6f-a07b-98d367d1b7fc tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Request method failure captured: Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/images/8008810c-a8e7-4048-a5ef-0fdde9db207a/metadata HTTP/1.1 Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 57 Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Ku7FhsqpXC1ev4rnMToHbaShHIIg2ul9AoSHDwDZQQmNgMegMnZs0tZA8Dafgt_AutjJyAHM3tY3LcDvcCQTLJ111eagxGvBhIPrGRRpBFd163HGed_qQduOke0ShTaPBO1SlB7_B79ztwcg6gMbnWdMd66TFXI2iUw_LdkOWMSuQ Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:06.564397 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/203681a2c87848c5b2715bee6079c1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_203681a2c87848c5b2715bee6079c1d1", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 203681a2c87848c5b2715bee6079c1d1 Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-704573414 Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9d58b6c4b25e41e881e824c4b7dedf0c Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-704573414-project Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:06.566160 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'image_id': '8008810c-a8e7-4048-a5ef-0fdde9db207a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:06.567369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8008810c-a8e7-4048-a5ef-0fdde9db207a Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:21:06.568851 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8008810c-a8e7-4048-a5ef-0fdde9db207a could not be found. Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:06.570547 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:06.571998 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:06.575240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-793ed4d2-2a39-4b6f-a07b-98d367d1b7fc tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:06.575240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-793ed4d2-2a39-4b6f-a07b-98d367d1b7fc tempest-ImagesMetadataNegativeTestJSON-704573414 tempest-ImagesMetadataNegativeTestJSON-704573414-project] 10.222.0.49 "POST /compute/v2.1/images/8008810c-a8e7-4048-a5ef-0fdde9db207a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051985 Jul 20 04:21:06.575240 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 841/1743] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Jul 20 04:21:06 2022] POST /compute/v2.1/images/8008810c-a8e7-4048-a5ef-0fdde9db207a/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:06.577052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:06.577769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:06.597766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.599354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.601421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:06.607767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:06.613792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:06.627232 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dd0087b3-2907-4a29-885f-b2e1ce31f236 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.310430 Jul 20 04:21:06.628052 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 903/1744] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:06.634341 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1351739059", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:06.725967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:07.264002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:07.264712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:07.265156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:07.265571 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:07.266176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:07.286316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.286776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.287589 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.288022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.339110 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Getting quotas for project b1aabe9c1e484ea8ae0ca07bfc093c88. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:07.348600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.353622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Getting quotas for user cd40edc86fb24af79986645c1e99d944 and project b1aabe9c1e484ea8ae0ca07bfc093c88. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:07.365568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5d8898b-af6b-453d-a17e-dcb9569eaaa3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.792077 Jul 20 04:21:07.370905 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 842/1745] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:06 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.382600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:07.385634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:07.412395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.413032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.422149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.423105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.424927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.425614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.504205 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-75e3be1b-d246-45cc-b29a-c953f5021367 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874328 Jul 20 04:21:07.507002 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 904/1746] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:07.517262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.518125 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.542072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.543960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.545112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.546906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.825407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:07.841295 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a4410ac-63dc-46df-a9c8-f6cbee6832db tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 0.459684 Jul 20 04:21:07.850842 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 843/1747] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:07.871595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:07.874597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:07.894878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.895340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:07.896114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:07.902678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.018050 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.030426 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-61823fce-7176-42b8-84d7-17dbb340f3db tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.520957 Jul 20 04:21:08.033242 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 905/1748] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:08.047002 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f16d3512-75b6-4670-bd41-fc4b0ff72cb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.048569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f16d3512-75b6-4670-bd41-fc4b0ff72cb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.133643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f16d3512-75b6-4670-bd41-fc4b0ff72cb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.147301 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f16d3512-75b6-4670-bd41-fc4b0ff72cb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1214 microversion: 2.1 time: 0.112748 Jul 20 04:21:08.148755 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 906/1749] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:08 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:08.161926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.162907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.166373 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:08.178785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.179555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.185550 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.186260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.418038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:08.450859 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8d075c76-66b6-413e-9af0-df3a1417bf3d tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.297102 Jul 20 04:21:08.452100 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 907/1750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:08 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:08.470679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:08.471304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:08.488416 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.488870 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:08.489657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:08.490091 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.087761 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.109524 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bb94fe38-c2a0-4ff6-b122-d82928e831ab tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.655003 Jul 20 04:21:09.125124 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 908/1751] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:08 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:09.130044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-a43600a9-0b3a-4f29-a9b6-26f55062cd46 req-a3f53617-b59b-4536-86e6-d301c95064f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "name": "network-vif-plugged", "status": "completed", "tag": "ecbd67f9-3c70-4dde-bd1d-c0ba05c98fe8"}, {"server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "name": "network-vif-plugged", "status": "completed", "tag": "c8582cd4-f46d-4618-91cd-6b04f6683845"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:09.154966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-a43600a9-0b3a-4f29-a9b6-26f55062cd46 req-a3f53617-b59b-4536-86e6-d301c95064f5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.157985 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-a43600a9-0b3a-4f29-a9b6-26f55062cd46 req-a3f53617-b59b-4536-86e6-d301c95064f5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.186104 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-a43600a9-0b3a-4f29-a9b6-26f55062cd46 req-a3f53617-b59b-4536-86e6-d301c95064f5 service nova] Creating event network-vif-plugged:ecbd67f9-3c70-4dde-bd1d-c0ba05c98fe8 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:21:09.188340 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-a43600a9-0b3a-4f29-a9b6-26f55062cd46 req-a3f53617-b59b-4536-86e6-d301c95064f5 service nova] Creating event network-vif-plugged:c8582cd4-f46d-4618-91cd-6b04f6683845 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:21:09.195458 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-a43600a9-0b3a-4f29-a9b6-26f55062cd46 req-a3f53617-b59b-4536-86e6-d301c95064f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068768 Jul 20 04:21:09.197276 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 909/1752] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:09.204174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.205278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.234602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.235369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.236368 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.237028 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.907128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:09.916500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc8703a2-6394-465e-b3b9-0a201449b60c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 2.072890 Jul 20 04:21:09.917118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 844/1753] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:07 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:09.935843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:09.936111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:09.956577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.957368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:09.958373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:09.959017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.580136 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:10.605153 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e87c6c43-9255-424b-86f7-f68da8085dd1 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1355 microversion: 2.1 time: 1.395950 Jul 20 04:21:10.616417 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 910/1754] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1355 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:10.627578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.632256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:10.645248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.651229 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed4f1a45-605f-4484-9bf9-f55aded8333f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.714561 Jul 20 04:21:10.652057 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 845/1755] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:09 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:10.669903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.671757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:10.681035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:10.681972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.684126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.686051 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.709068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.709463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:10.717015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:10.717554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.309580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.325301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e7b7b5cd-54cf-455d-bf6e-37e05ad9457b tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.668011 Jul 20 04:21:11.330751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 846/1756] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.351525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.355150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.376421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.377181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.378218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.382742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.853760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.863219 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26032c9e-27e8-4e23-9309-bb2bca7a3e1b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.530241 Jul 20 04:21:11.864939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 847/1757] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:11.878196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:11.879116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:11.891784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.895339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.897668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:11.903893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:11.925951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:11.936957 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-79a1aaf1-ca9b-4852-b3f9-737d013aa17a tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1272 microversion: 2.1 time: 1.319051 Jul 20 04:21:11.939798 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 911/1758] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:10 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1272 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.209364 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f0de9a25-ebe8-4f93-ad3c-cdda27095cf8 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] 10.222.0.49 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.267627 Jul 20 04:21:12.210263 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 912/1759] 10.222.0.49 () {58 vars in 1127 bytes} [Wed Jul 20 04:21:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:21:12.224035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-c8b93aca-37bd-44cd-9156-af9a2933f34f req-67ab78b5-ff87-4211-9b4f-c152a36828d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd104a82-0c3a-45a4-9e70-b234e7410953", "name": "network-vif-plugged", "status": "completed", "tag": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:12.236484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c8b93aca-37bd-44cd-9156-af9a2933f34f req-67ab78b5-ff87-4211-9b4f-c152a36828d9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.237286 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c8b93aca-37bd-44cd-9156-af9a2933f34f req-67ab78b5-ff87-4211-9b4f-c152a36828d9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.256567 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-c8b93aca-37bd-44cd-9156-af9a2933f34f req-67ab78b5-ff87-4211-9b4f-c152a36828d9 service nova] Creating event network-vif-plugged:4e39f8f7-9c65-447b-81f8-864ffaf8fa5e for instance dd104a82-0c3a-45a4-9e70-b234e7410953 on n-h1-764486-11 Jul 20 04:21:12.262672 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-c8b93aca-37bd-44cd-9156-af9a2933f34f req-67ab78b5-ff87-4211-9b4f-c152a36828d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050936 Jul 20 04:21:12.264029 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 913/1760] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:12.273103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.275481 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.306383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.307200 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.308218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.308895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.627664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.637733 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c1005c6-bd55-462b-a2be-c452ae18e11e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.771344 Jul 20 04:21:12.639434 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 848/1761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:11 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.647817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.652893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.671002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.671733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.672970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.673557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.817320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:12.841601 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c13a2983-80c0-4bd6-b61c-a9bb11ec2285 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1805 microversion: 2.1 time: 0.575363 Jul 20 04:21:12.854369 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 914/1762] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1805 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:12.859633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d81ffd2e-9428-42c8-a228-096c49384cbe tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Calling method '.version_select at 0x7f83980a2d30>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.908094 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-d81ffd2e-9428-42c8-a228-096c49384cbe tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] HTTP exception thrown: Image not found. Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d81ffd2e-9428-42c8-a228-096c49384cbe tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Request method failure captured: Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14K3en5CmriG5zbaMPKJ5Vcs9wdjYNwqC_5LVMvXijD5vVs5bPpfqjKazTQlAYscrVr63AsdwiRK0Q9yuyVmqwUQ-iWBEqXn7qQaLVhwtnQzzPk0D0qSD8OG4DrJoLE8WXef4UzKcGjq3-nYCz1InDYTI42_928hd5LqQv1Xa4xv3jc Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:12.910980 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cfb13a1f38846048871efac592d0e2d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 436be3e7a793468ca7698b92542c13de Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: exception: Image not found. Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '-1'} Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:12.912869 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.914105 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:12.917226 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:12.920385 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:12.923159 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d81ffd2e-9428-42c8-a228-096c49384cbe tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Returning 404 to user: Image not found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:12.924283 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d81ffd2e-9428-42c8-a228-096c49384cbe tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] 10.222.0.49 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.068630 Jul 20 04:21:12.925451 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 915/1763] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Jul 20 04:21:12 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:12.940860 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:12.942913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:12.954540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.958950 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:12.960723 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:12.961438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.164220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.180233 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e4693fce-5c4b-499e-adae-0565d2a2b97a tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1332 microversion: 2.1 time: 0.246716 Jul 20 04:21:13.184345 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 916/1764] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1332 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:13.206241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:13.209770 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.210270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.216113 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60f2535e-5644-4fe3-a8c7-561cf8350df6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.574847 Jul 20 04:21:13.227958 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.228734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.229688 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.230280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.232797 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 849/1765] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:12 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:13.247989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.260262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.284264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.286189 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-04b6bfca-e24c-4a1e-aa52-014b8fe1ad84 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd/ips" status: 200 len: 218 microversion: 2.1 time: 0.097524 Jul 20 04:21:13.287191 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 917/1766] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd/ips => generated 218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:13.292512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2b000192-f658-499d-983c-4258393d53c6 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Calling method '.version_select at 0x7f8398359430>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.296812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.298988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.301997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.336206 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-2b000192-f658-499d-983c-4258393d53c6 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] HTTP exception thrown: Image not found. Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2b000192-f658-499d-983c-4258393d53c6 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Request method failure captured: Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/images/e9e9b76d-e952-4d63-9558-836a6e4cfb4j HTTP/1.1 Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14K3en5CmriG5zbaMPKJ5Vcs9wdjYNwqC_5LVMvXijD5vVs5bPpfqjKazTQlAYscrVr63AsdwiRK0Q9yuyVmqwUQ-iWBEqXn7qQaLVhwtnQzzPk0D0qSD8OG4DrJoLE8WXef4UzKcGjq3-nYCz1InDYTI42_928hd5LqQv1Xa4xv3jc Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:13.338433 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cfb13a1f38846048871efac592d0e2d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 436be3e7a793468ca7698b92542c13de Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: exception: Image not found. Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'e9e9b76d-e952-4d63-9558-836a6e4cfb4j'} Jul 20 04:21:13.340273 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e9e9b76d-e952-4d63-9558-836a6e4cfb4j to delete Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:13.345528 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e9e9b76d-e952-4d63-9558-836a6e4cfb4j could not be found. Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:13.346803 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2b000192-f658-499d-983c-4258393d53c6 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Returning 404 to user: Image not found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:13.348169 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2b000192-f658-499d-983c-4258393d53c6 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] 10.222.0.49 "DELETE /compute/v2.1/images/e9e9b76d-e952-4d63-9558-836a6e4cfb4j" status: 404 len: 62 microversion: 2.1 time: 0.051535 Jul 20 04:21:13.349227 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 918/1767] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:13 2022] DELETE /compute/v2.1/images/e9e9b76d-e952-4d63-9558-836a6e4cfb4j => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:13.352920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:13.353543 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:13.372220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.372721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:13.373493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:13.373922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.011880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.035370 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-307db3f2-6917-402c-bf70-a8f65534d88d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.780088 Jul 20 04:21:14.040640 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 850/1768] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.061365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.070838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.105678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.112014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.115799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.119594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.136967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.157452 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1c37fd84-6735-4cc7-9d75-9a58b8cc644c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1314 microversion: 2.1 time: 0.815524 Jul 20 04:21:14.193666 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 919/1769] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:13 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.211483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-32bfc5bb-0e2b-49ba-b90e-f88b2cd63c16 req-8d32267d-a0d9-4bd9-bdf7-4083ad1c676f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "name": "network-vif-unplugged", "status": "completed", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:14.257124 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-32bfc5bb-0e2b-49ba-b90e-f88b2cd63c16 req-8d32267d-a0d9-4bd9-bdf7-4083ad1c676f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.257974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-32bfc5bb-0e2b-49ba-b90e-f88b2cd63c16 req-8d32267d-a0d9-4bd9-bdf7-4083ad1c676f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.260179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:14.302167 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-32bfc5bb-0e2b-49ba-b90e-f88b2cd63c16 req-8d32267d-a0d9-4bd9-bdf7-4083ad1c676f service nova] Creating event network-vif-unplugged:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h1-764486-11 Jul 20 04:21:14.325653 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-32bfc5bb-0e2b-49ba-b90e-f88b2cd63c16 req-8d32267d-a0d9-4bd9-bdf7-4083ad1c676f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130924 Jul 20 04:21:14.326266 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 920/1770] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:14.338497 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b6059c6-0515-40bd-8e1d-2da6d6170a85 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Calling method '.version_select at 0x7f838b906310>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.359860 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-7b6059c6-0515-40bd-8e1d-2da6d6170a85 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] HTTP exception thrown: Image not found. Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b6059c6-0515-40bd-8e1d-2da6d6170a85 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Request method failure captured: Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/images/8dd510cd-c875-4816-aaa9-d35da1123d581 HTTP/1.1 Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14K3en5CmriG5zbaMPKJ5Vcs9wdjYNwqC_5LVMvXijD5vVs5bPpfqjKazTQlAYscrVr63AsdwiRK0Q9yuyVmqwUQ-iWBEqXn7qQaLVhwtnQzzPk0D0qSD8OG4DrJoLE8WXef4UzKcGjq3-nYCz1InDYTI42_928hd5LqQv1Xa4xv3jc Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:14.361763 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cfb13a1f38846048871efac592d0e2d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 436be3e7a793468ca7698b92542c13de Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: exception: Image not found. Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '8dd510cd-c875-4816-aaa9-d35da1123d581'} Jul 20 04:21:14.363283 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8dd510cd-c875-4816-aaa9-d35da1123d581 to delete Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.364253 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8dd510cd-c875-4816-aaa9-d35da1123d581 could not be found. Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:14.366372 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b6059c6-0515-40bd-8e1d-2da6d6170a85 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Returning 404 to user: Image not found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:14.367706 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b6059c6-0515-40bd-8e1d-2da6d6170a85 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] 10.222.0.49 "DELETE /compute/v2.1/images/8dd510cd-c875-4816-aaa9-d35da1123d581" status: 404 len: 62 microversion: 2.1 time: 0.035328 Jul 20 04:21:14.374304 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 921/1771] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:14 2022] DELETE /compute/v2.1/images/8dd510cd-c875-4816-aaa9-d35da1123d581 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:14.379632 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.380431 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.417059 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.417573 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.421746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.425185 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.496169 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0adf04f6-f93b-4690-b054-53be98c54252 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 204 len: 0 microversion: 2.1 time: 0.452627 Jul 20 04:21:14.497527 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 851/1772] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:14 2022] DELETE /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:14.505717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.506699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.514255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.516166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.517261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.517907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.863310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.875257 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-562701bd-aa08-437b-896a-fcfc85f9669c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.499782 Jul 20 04:21:14.875843 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 922/1773] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.885785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:14.889469 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:14.901713 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.902798 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.904597 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:14.905353 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:14.941566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:14.951969 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d2fca07-9c91-4bd9-9b55-b19fa8015e90 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1535 microversion: 2.1 time: 0.452776 Jul 20 04:21:14.956487 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 852/1774] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1535 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:14.972790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f28d3214-f2fb-444f-8563-ec432a8ddc70 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Calling method '.version_select at 0x7f838b823160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.012811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f28d3214-f2fb-444f-8563-ec432a8ddc70 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] HTTP exception thrown: Image not found. Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f28d3214-f2fb-444f-8563-ec432a8ddc70 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Request method failure captured: Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/tempest-invalid-1370948554 HTTP/1.1 Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14K3en5CmriG5zbaMPKJ5Vcs9wdjYNwqC_5LVMvXijD5vVs5bPpfqjKazTQlAYscrVr63AsdwiRK0Q9yuyVmqwUQ-iWBEqXn7qQaLVhwtnQzzPk0D0qSD8OG4DrJoLE8WXef4UzKcGjq3-nYCz1InDYTI42_928hd5LqQv1Xa4xv3jc Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:15.015518 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cfb13a1f38846048871efac592d0e2d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 436be3e7a793468ca7698b92542c13de Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'tempest-invalid-1370948554'} Jul 20 04:21:15.017337 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1370948554 to delete Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.018427 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1370948554 could not be found. Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:15.019937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f28d3214-f2fb-444f-8563-ec432a8ddc70 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:15.021529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f28d3214-f2fb-444f-8563-ec432a8ddc70 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] 10.222.0.49 "DELETE /compute/v2.1/images/tempest-invalid-1370948554" status: 404 len: 62 microversion: 2.1 time: 0.060848 Jul 20 04:21:15.028320 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 853/1775] 10.222.0.49 () {58 vars in 1205 bytes} [Wed Jul 20 04:21:14 2022] DELETE /compute/v2.1/images/tempest-invalid-1370948554 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:15.050323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2f4d4e7e-e198-4c0e-9fa5-e62ae1ce7a98 req-8b2a1e74-2f73-43cd-9f4b-75a0f0c15468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "name": "network-vif-unplugged", "status": "completed", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}, {"server_uuid": "4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84", "name": "network-vif-plugged", "status": "completed", "tag": "901375b9-d9dd-4c90-9424-bc917a51c4e2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:15.069033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2f4d4e7e-e198-4c0e-9fa5-e62ae1ce7a98 req-8b2a1e74-2f73-43cd-9f4b-75a0f0c15468 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.070122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2f4d4e7e-e198-4c0e-9fa5-e62ae1ce7a98 req-8b2a1e74-2f73-43cd-9f4b-75a0f0c15468 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.088175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2f4d4e7e-e198-4c0e-9fa5-e62ae1ce7a98 req-8b2a1e74-2f73-43cd-9f4b-75a0f0c15468 service nova] Creating event network-vif-unplugged:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h1-764486-11 Jul 20 04:21:15.088921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2f4d4e7e-e198-4c0e-9fa5-e62ae1ce7a98 req-8b2a1e74-2f73-43cd-9f4b-75a0f0c15468 service nova] Creating event network-vif-plugged:901375b9-d9dd-4c90-9424-bc917a51c4e2 for instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 on n-h1-764486-11 Jul 20 04:21:15.103928 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2f4d4e7e-e198-4c0e-9fa5-e62ae1ce7a98 req-8b2a1e74-2f73-43cd-9f4b-75a0f0c15468 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.065989 Jul 20 04:21:15.104826 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 854/1776] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:15.148287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.150079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.181430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.182621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.185267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.186867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.215779 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.249425 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0298ad9c-cbd0-4342-a9a8-58a21b952de6 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.369290 Jul 20 04:21:15.253301 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 923/1777] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:14 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:15.271475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-08d8d7fe-c463-4d76-adef-158056303566 req-13d3c013-342f-4ac7-a53e-791e60a87aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:15.287930 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-08d8d7fe-c463-4d76-adef-158056303566 req-13d3c013-342f-4ac7-a53e-791e60a87aca service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.289013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-08d8d7fe-c463-4d76-adef-158056303566 req-13d3c013-342f-4ac7-a53e-791e60a87aca service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.319293 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-08d8d7fe-c463-4d76-adef-158056303566 req-13d3c013-342f-4ac7-a53e-791e60a87aca service nova] Creating event network-changed:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:21:15.331118 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-08d8d7fe-c463-4d76-adef-158056303566 req-13d3c013-342f-4ac7-a53e-791e60a87aca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074619 Jul 20 04:21:15.338255 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 924/1778] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:15.352841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9795c21d-16ea-457b-8ceb-4c7a733a5cd7 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'create', calling method: .version_select at 0x7f838bea45e0>, body: {"pool": "b082fd41-d46a-40a3-a334-ca1a83b364f9"} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:15.657289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:15.657289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3bbbcd7-e90c-4279-90b6-027613435a96 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1811 microversion: 2.1 time: 0.536605 Jul 20 04:21:15.662321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 855/1779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1811 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:15.674895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e738904-f742-44a2-bcee-da817a446048 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Calling method '.version_select at 0x7f838b85ac10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.722462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8e738904-f742-44a2-bcee-da817a446048 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] HTTP exception thrown: Image not found. Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e738904-f742-44a2-bcee-da817a446048 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Request method failure captured: Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/2eb5e561-3598-4af6-9bee-5699915802cf HTTP/1.1 Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14K3en5CmriG5zbaMPKJ5Vcs9wdjYNwqC_5LVMvXijD5vVs5bPpfqjKazTQlAYscrVr63AsdwiRK0Q9yuyVmqwUQ-iWBEqXn7qQaLVhwtnQzzPk0D0qSD8OG4DrJoLE8WXef4UzKcGjq3-nYCz1InDYTI42_928hd5LqQv1Xa4xv3jc Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:15.724441 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6cfb13a1f38846048871efac592d0e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6cfb13a1f38846048871efac592d0e2d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 6cfb13a1f38846048871efac592d0e2d Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729 Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 436be3e7a793468ca7698b92542c13de Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2051373729-project Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2eb5e561-3598-4af6-9bee-5699915802cf'} Jul 20 04:21:15.726220 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2eb5e561-3598-4af6-9bee-5699915802cf to delete Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.736646 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2eb5e561-3598-4af6-9bee-5699915802cf could not be found. Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:15.742179 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e738904-f742-44a2-bcee-da817a446048 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:15.745688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e738904-f742-44a2-bcee-da817a446048 tempest-ImagesDeleteNegativeTestJSON-2051373729 tempest-ImagesDeleteNegativeTestJSON-2051373729-project] 10.222.0.49 "DELETE /compute/v2.1/images/2eb5e561-3598-4af6-9bee-5699915802cf" status: 404 len: 62 microversion: 2.1 time: 0.064062 Jul 20 04:21:15.748111 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 856/1780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] DELETE /compute/v2.1/images/2eb5e561-3598-4af6-9bee-5699915802cf => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:15.751849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:15.754302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:15.780608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.781066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:15.786534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:15.787788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.474656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.483597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-696148c6-34a6-49d0-acc2-b65aa2c2624e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1316 microversion: 2.1 time: 0.755116 Jul 20 04:21:16.489685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 857/1781] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:15 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:16.501083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:16.502232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:16.514679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.517854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.519529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:16.524849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:16.975146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:16.978389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:16.998410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38eb5ddf-5a4b-4af2-ba49-1a78a0ab2ee1 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1314 microversion: 2.1 time: 0.506840 Jul 20 04:21:17.021546 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 858/1782] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:16 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:17.032299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:17.042074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:17.072566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.076236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.079269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:17.082100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:17.308699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=4 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:18.007495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.038622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d20c65e0-c0fa-45bc-8cfb-765ce27d8101 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 1.015484 Jul 20 04:21:18.043976 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 859/1783] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:17 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.054500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.068830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.082853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.088723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.091616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.100535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.147967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=14 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:18.766346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:18.774747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94439e65-2244-4a32-8f3b-568d0c3b1bac tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1392 microversion: 2.1 time: 0.728813 Jul 20 04:21:18.775340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 860/1784] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1392 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:18.788240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:18.788914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:18.815228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.815570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:18.816942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:18.817673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.081981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.090062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05014856-5524-449f-8def-66ad859f0fc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 200 len: 1769 microversion: 2.1 time: 0.313684 Jul 20 04:21:19.093213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 861/1785] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:18 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 1769 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.105989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fb9291e7-acfa-4967-8d23-bb45cf48db60 req-e4b4c8c0-96d7-4cff-ab02-1b46571d39eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351b5153-5b84-41b4-abc2-695d81ce3ca6", "tag": "b8616c09-ac4b-49ce-ac29-a350360cd249"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:19.121899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fb9291e7-acfa-4967-8d23-bb45cf48db60 req-e4b4c8c0-96d7-4cff-ab02-1b46571d39eb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.125578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fb9291e7-acfa-4967-8d23-bb45cf48db60 req-e4b4c8c0-96d7-4cff-ab02-1b46571d39eb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.153969 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fb9291e7-acfa-4967-8d23-bb45cf48db60 req-e4b4c8c0-96d7-4cff-ab02-1b46571d39eb service nova] Creating event network-changed:b8616c09-ac4b-49ce-ac29-a350360cd249 for instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 on n-h2-764486-11 Jul 20 04:21:19.160161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fb9291e7-acfa-4967-8d23-bb45cf48db60 req-e4b4c8c0-96d7-4cff-ab02-1b46571d39eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065242 Jul 20 04:21:19.161074 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 862/1786] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:19.170858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.172251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.187037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.187665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.189603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.190343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.279112 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9795c21d-16ea-457b-8ceb-4c7a733a5cd7 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.936961 Jul 20 04:21:19.280393 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 925/1787] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:21:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:19.286756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.287576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.295479 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.296255 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.297327 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.297856 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.386381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.399206 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53409bbc-7e6a-4471-9dd9-8b24c24beca8 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1504 microversion: 2.1 time: 0.236598 Jul 20 04:21:19.400099 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 863/1788] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.406648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f2cb05f1-ec98-437a-8c1d-408af6e0c61d req-9be905ca-c693-4df6-8d49-05414b3c038d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "name": "network-vif-deleted", "tag": "c8582cd4-f46d-4618-91cd-6b04f6683845"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:19.416921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f2cb05f1-ec98-437a-8c1d-408af6e0c61d req-9be905ca-c693-4df6-8d49-05414b3c038d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.417246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f2cb05f1-ec98-437a-8c1d-408af6e0c61d req-9be905ca-c693-4df6-8d49-05414b3c038d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.430773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f2cb05f1-ec98-437a-8c1d-408af6e0c61d req-9be905ca-c693-4df6-8d49-05414b3c038d service nova] Creating event network-vif-deleted:c8582cd4-f46d-4618-91cd-6b04f6683845 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:21:19.436826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f2cb05f1-ec98-437a-8c1d-408af6e0c61d req-9be905ca-c693-4df6-8d49-05414b3c038d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035234 Jul 20 04:21:19.438026 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 864/1789] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:19.444454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-174599600", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3e4182e1-3b84-49f1-9a99-386772005d20"}], "block_device_mapping_v2": [{"uuid": "573e5b63-c3f2-4c2e-abed-d49f5d9f75e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:19.528163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] validate_networks() for [('3e4182e1-3b84-49f1-9a99-386772005d20', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:19.571484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:19.575229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:19.586736 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5554ac85-f25d-4a3d-91e3-be561936568e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1314 microversion: 2.1 time: 0.304081 Jul 20 04:21:19.599255 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 926/1790] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:19.605568 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:19.606514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:19.614637 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.615489 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:19.616719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:19.617394 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.245859 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:20.258736 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f2c45947-a588-4d3a-b1ad-9e734622b089 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1522 microversion: 2.1 time: 0.657508 Jul 20 04:21:20.259566 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 927/1791] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:19 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:20.274422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'action', calling method: .version_select at 0x7f839a868940>, body: {"addFloatingIp": {"address": "172.25.5.95"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:20.275893 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.282404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.283008 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.284248 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.284734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.285315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:20.286666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:20.287378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:20.287952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:20.288615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:20.317225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.319016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.323474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.324174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.350378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:20.359459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Getting quotas for user c21b3bf3ba4d4558950d7337a651587f and project 8300dd17ab074d6ba2e717b2f9713a39. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:20.440966 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Acquired lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:21:20.482082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:20.483831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='573e5b63-c3f2-4c2e-abed-d49f5d9f75e2',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:20.651433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdfe73ff-9d32-4684-aa17-41026aff3ebd tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.211955 Jul 20 04:21:20.652491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 865/1792] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:21:20.657553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1910778342"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:20.658095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:20.666461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.666946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:20.667787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:20.668184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:21.118191 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Adding security group a6abbac0-faff-4928-9e5f-3759214b4f13 to port 901375b9-d9dd-4c90-9424-bc917a51c4e2 Jul 20 04:21:22.189856 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Building network info cache for instance {{(pid=123723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:21:22.788953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-706bc50c-0fa2-40be-936e-8d5618e84d8a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84/action" status: 202 len: 0 microversion: 2.1 time: 2.135370 Jul 20 04:21:22.793321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 866/1793] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:20 2022] POST /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84/action => generated 0 bytes in 2140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:22.798128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:22.798930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:22.826295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.827076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:22.828028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:22.828646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.258009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.266543 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09d1aee0-b28e-4867-b7e1-08467d5f0f01 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1382 microversion: 2.1 time: 0.472106 Jul 20 04:21:23.269161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 867/1794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:22 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1382 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.281316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.283124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.296929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.299500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.305698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.306441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.331665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] HTTP exception thrown: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Request method failure captured: Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd HTTP/1.1 Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14J8B_ZWi7GXMFZJvFolD8VOEBmI02Mg_6VwQC4ArrGfVwr6XRx5a1mRybZmegApK3_Q_M3m_ZBwkbRFdfYOEK5yNf6po51tQfK8S1NUvvEyDiPTNzITsVEA7xosJ7u_Gydx293ESPYroaig2PUZ-DzXLp19FGXOPmPps_lBLeetqpg Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:23.333431 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d7eb98b263a47d8a238b9e29baef9f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestMultiNic-240083885 Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestMultiNic-240083885-project Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: eb32e9e4909744fbb5f665af1ddb3319 Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestMultiNic-240083885-project Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:21:23.335533 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7f7d3308-443d-48f2-b940-2c9c404631cd'} Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:23.337085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:21:23.339019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:23.341457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Returning 404 to user: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:23.342536 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f6409d9-f9fa-4c02-b405-97e4ee9b16a9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 404 len: 111 microversion: 2.1 time: 0.066858 Jul 20 04:21:23.343662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 868/1795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:23.365711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.366646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.384475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.385146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.386122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.386717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.749271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:23.761147 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a74257a7-52e9-453f-89f7-928a0c711569 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1314 microversion: 2.1 time: 0.416053 Jul 20 04:21:23.764662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 869/1796] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:23.775364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:23.779554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:23.801290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.806800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:23.807842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:23.808392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.209678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.218481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.230381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.237129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4e73030-aaf7-4a81-9c98-fb094d2cd9be tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1292 microversion: 2.25 time: 0.470397 Jul 20 04:21:24.239230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 870/1797] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:23 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1292 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:24.245780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.246660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.253301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.254189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.255666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.256326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.282153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Updating instance_info_cache with network_info: [{"id": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e", "address": "fa:16:3e:90:75:b3", "network": {"id": "7ad14e8f-b738-4578-8a61-b639df9b6034", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-802695488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e0edfeefaa7143868c28d82d07548ba5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4e39f8f7-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:21:24.303199 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Releasing lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:21:24.304556 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6192308e-0014-4b3a-9f7f-7829590c6e1f tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action" status: 202 len: 0 microversion: 2.1 time: 4.034706 Jul 20 04:21:24.306628 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 928/1798] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:20 2022] POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action => generated 0 bytes in 4037 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:21:24.314179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-17e307a0-817d-4970-8cdf-0324d756dd8c req-43ade301-04f7-4c55-bce1-73d0827495bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "name": "network-vif-deleted", "tag": "ecbd67f9-3c70-4dde-bd1d-c0ba05c98fe8"}, {"server_uuid": "7f7d3308-443d-48f2-b940-2c9c404631cd", "name": "network-vif-deleted", "tag": "c15ffd4c-b7be-4b3a-8b97-d50f69d850f6"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:24.325913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-17e307a0-817d-4970-8cdf-0324d756dd8c req-43ade301-04f7-4c55-bce1-73d0827495bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.326776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-17e307a0-817d-4970-8cdf-0324d756dd8c req-43ade301-04f7-4c55-bce1-73d0827495bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.339226 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-17e307a0-817d-4970-8cdf-0324d756dd8c req-43ade301-04f7-4c55-bce1-73d0827495bc service nova] Creating event network-vif-deleted:ecbd67f9-3c70-4dde-bd1d-c0ba05c98fe8 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:21:24.339958 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-17e307a0-817d-4970-8cdf-0324d756dd8c req-43ade301-04f7-4c55-bce1-73d0827495bc service nova] Creating event network-vif-deleted:c15ffd4c-b7be-4b3a-8b97-d50f69d850f6 for instance 7f7d3308-443d-48f2-b940-2c9c404631cd on n-h2-764486-11 Jul 20 04:21:24.345781 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-17e307a0-817d-4970-8cdf-0324d756dd8c req-43ade301-04f7-4c55-bce1-73d0827495bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037754 Jul 20 04:21:24.346880 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 929/1799] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:24.353502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2009048060"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:24.354359 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:24.362646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.363276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.364259 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.364934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.586091 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.network.security_group_api [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Adding security group 85d89851-5186-4b98-b105-c9a6712bf6a7 to port 901375b9-d9dd-4c90-9424-bc917a51c4e2 Jul 20 04:21:24.590982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:24.600655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ccd2d4c-5313-41a6-a1f5-37acc17aa6f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1504 microversion: 2.1 time: 0.359438 Jul 20 04:21:24.602748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 871/1800] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:24.607917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1c7cc027-821b-473e-bdd1-56f400b1f307 req-23764135-fc82-40e0-bddf-91ec7f325de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84", "tag": "901375b9-d9dd-4c90-9424-bc917a51c4e2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:24.617002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1c7cc027-821b-473e-bdd1-56f400b1f307 req-23764135-fc82-40e0-bddf-91ec7f325de2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.618339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1c7cc027-821b-473e-bdd1-56f400b1f307 req-23764135-fc82-40e0-bddf-91ec7f325de2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.637114 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1c7cc027-821b-473e-bdd1-56f400b1f307 req-23764135-fc82-40e0-bddf-91ec7f325de2 service nova] Creating event network-changed:901375b9-d9dd-4c90-9424-bc917a51c4e2 for instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 on n-h1-764486-11 Jul 20 04:21:24.647614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1c7cc027-821b-473e-bdd1-56f400b1f307 req-23764135-fc82-40e0-bddf-91ec7f325de2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043007 Jul 20 04:21:24.649453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 872/1801] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:24.654702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec6e2f24-2e4e-4320-9c98-af14f9b53ad6 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '.version_select at 0x7f838b85a430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:24.657429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec6e2f24-2e4e-4320-9c98-af14f9b53ad6 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:24.658105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec6e2f24-2e4e-4320-9c98-af14f9b53ad6 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:24.671244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec6e2f24-2e4e-4320-9c98-af14f9b53ad6 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2734 microversion: 2.1 time: 0.020356 Jul 20 04:21:24.672614 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 873/1802] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:21:24 2022] GET /compute/v2.1/os-migrations => generated 2734 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:24.677372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed4c2326-f2c7-4958-b4ea-1c52d69eb0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'create', calling method: .version_select at 0x7f838b84c310>, body: {"pool": "b082fd41-d46a-40a3-a334-ca1a83b364f9"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:26.394559 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9c33c99c-085d-4073-ba13-637f878a40ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84/action" status: 202 len: 0 microversion: 2.1 time: 2.046219 Jul 20 04:21:26.399763 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 930/1803] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:24 2022] POST /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84/action => generated 0 bytes in 2052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:26.407648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:26.409255 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:26.427391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.428049 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:26.430367 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:26.431058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.087482 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f9d69a65-e02d-49f9-9113-a33352601c04 tempest-LiveMigrationTest-2086363685 tempest-LiveMigrationTest-2086363685-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1535 microversion: 2.1 time: 0.683369 Jul 20 04:21:27.098318 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 931/1804] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:26 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1535 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:27.098318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.098318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.109787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.109787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.110662 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.111191 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.847474 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:27.870341 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8985793e-480f-4831-a7df-1a34acf99bca tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1314 microversion: 2.1 time: 0.780234 Jul 20 04:21:27.871771 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 932/1805] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:27.878849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-c60ea746-d7fe-419f-a3a8-6308fa609b5c req-bc725c4e-428f-4171-a411-a580cd4e7d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "name": "network-vif-plugged", "status": "completed", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:27.891560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c60ea746-d7fe-419f-a3a8-6308fa609b5c req-bc725c4e-428f-4171-a411-a580cd4e7d62 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.892124 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-c60ea746-d7fe-419f-a3a8-6308fa609b5c req-bc725c4e-428f-4171-a411-a580cd4e7d62 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.905685 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-c60ea746-d7fe-419f-a3a8-6308fa609b5c req-bc725c4e-428f-4171-a411-a580cd4e7d62 service nova] Creating event network-vif-plugged:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:21:27.923411 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-c60ea746-d7fe-419f-a3a8-6308fa609b5c req-bc725c4e-428f-4171-a411-a580cd4e7d62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Jul 20 04:21:27.926737 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 933/1806] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:27.938757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:27.949119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:27.968618 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.972223 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:27.973746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:27.977432 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.430912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.450272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.456423 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:28.457690 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a116ee79-9ebc-4976-8a3f-08fb427113d8 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1292 microversion: 2.25 time: 0.528700 Jul 20 04:21:28.458838 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 934/1807] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:27 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1292 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:28.466144 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:28.467636 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:28.534330 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.537717 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:28.540419 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:28.542869 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.122193 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:29.146791 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0f6f2eb3-4bcb-4780-9ad3-a3b52507ccbf tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 200 len: 1447 microversion: 2.1 time: 0.686498 Jul 20 04:21:29.157827 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 935/1808] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:28 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 1447 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:29.157827 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-77d5ccc8-b3bd-4921-9e55-d9e8d97ad73e req-224a7336-7f01-470e-93c0-1951a3b8b9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd104a82-0c3a-45a4-9e70-b234e7410953", "tag": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:29.165118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-77d5ccc8-b3bd-4921-9e55-d9e8d97ad73e req-224a7336-7f01-470e-93c0-1951a3b8b9b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.165905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-77d5ccc8-b3bd-4921-9e55-d9e8d97ad73e req-224a7336-7f01-470e-93c0-1951a3b8b9b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.179167 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-77d5ccc8-b3bd-4921-9e55-d9e8d97ad73e req-224a7336-7f01-470e-93c0-1951a3b8b9b1 service nova] Creating event network-changed:4e39f8f7-9c65-447b-81f8-864ffaf8fa5e for instance dd104a82-0c3a-45a4-9e70-b234e7410953 on n-h1-764486-11 Jul 20 04:21:29.185476 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-77d5ccc8-b3bd-4921-9e55-d9e8d97ad73e req-224a7336-7f01-470e-93c0-1951a3b8b9b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036569 Jul 20 04:21:29.186742 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 936/1809] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:29.219456 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.221266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.240448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.243132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.244278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.245791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.781583 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4dc66e12-5b3f-4a30-88a9-834de54bec95 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.577191 Jul 20 04:21:29.782514 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 937/1810] 10.222.0.49 () {58 vars in 1292 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84/os-security-groups => generated 1156 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:29.787702 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.792950 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.809498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.809964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.810767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.811204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.849735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:29.969486 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f49361da-797f-4fda-90aa-b056bd00f375 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 204 len: 0 microversion: 2.1 time: 0.185649 Jul 20 04:21:29.971161 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 938/1811] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:29 2022] DELETE /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:29.980122 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:29.981658 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:29.988768 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.989592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:29.990611 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:29.991577 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.132760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed4c2326-f2c7-4958-b4ea-1c52d69eb0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.458625 Jul 20 04:21:30.134029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 874/1812] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:21:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:30.139013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.139887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.153477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.156795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.159736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.160494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.224600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:30.238364 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Working on deleting snapshot 28c0ccf7-ebb8-47d0-9d0e-942b210ac301 from shelved instance... Jul 20 04:21:30.338538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:30.368749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:30.385879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:30.394613 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e311e19c-1958-4ac5-9512-239b97ca30c4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1314 microversion: 2.1 time: 0.421846 Jul 20 04:21:30.399166 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 939/1813] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:29 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:30.404103 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:30.404899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:30.417948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.424232 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:30.432251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:30.432947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.314984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.330221 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.331682 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:31.340331 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e7a52072-4232-4f62-afc3-e6dac9d00d0c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1292 microversion: 2.25 time: 0.935349 Jul 20 04:21:31.343275 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 940/1814] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:30 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1292 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:31.351931 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1d9b6054-383a-45a6-9a02-8e0de7fe2d61 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f838beb5040>, body: {"security_group": {"name": " tempest-securitygroup -1057219331 ", "description": "tempest-description-2132530029"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:31.647372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Doing local delete in cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=123724) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:21:31.650440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.651145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.652459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:21:31.660167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] deallocate_for_instance() {{(pid=123724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:21:31.864146 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1d9b6054-383a-45a6-9a02-8e0de7fe2d61 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.519453 Jul 20 04:21:31.871590 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 941/1815] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:31 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:31.876738 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-b883d126-4d59-4821-a582-01ed403dd409 req-01811d07-180c-46b1-a2e1-6749fd1466c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32076e88-d4fa-4391-afcb-bad6d6f9fbfa", "name": "network-vif-unplugged", "status": "completed", "tag": "e57fe3f6-4827-4f73-9c52-231d22c64b3e"}, {"server_uuid": "351b5153-5b84-41b4-abc2-695d81ce3ca6", "name": "network-vif-plugged", "status": "completed", "tag": "b8616c09-ac4b-49ce-ac29-a350360cd249"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:31.914294 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-b883d126-4d59-4821-a582-01ed403dd409 req-01811d07-180c-46b1-a2e1-6749fd1466c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.914743 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-b883d126-4d59-4821-a582-01ed403dd409 req-01811d07-180c-46b1-a2e1-6749fd1466c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.936220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.compute.server_external_events [req-b883d126-4d59-4821-a582-01ed403dd409 req-01811d07-180c-46b1-a2e1-6749fd1466c1 service nova] Unable to find a host for instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa. Dropping event network-vif-unplugged {{(pid=123723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:21:31.936768 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-b883d126-4d59-4821-a582-01ed403dd409 req-01811d07-180c-46b1-a2e1-6749fd1466c1 service nova] Creating event network-vif-plugged:b8616c09-ac4b-49ce-ac29-a350360cd249 for instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 on n-h2-764486-11 Jul 20 04:21:31.946003 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-b883d126-4d59-4821-a582-01ed403dd409 req-01811d07-180c-46b1-a2e1-6749fd1466c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.072281 Jul 20 04:21:31.946602 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 942/1816] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:21:31.962889 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:31.963890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:31.977160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.977615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:31.978425 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:31.978865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.321720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:32.330582 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-70965759-89ab-4c89-9551-3ddc6448b940 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1388 microversion: 2.1 time: 0.373215 Jul 20 04:21:32.343659 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 943/1817] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:31 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1388 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:32.356693 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.238"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:32.361517 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:32.373398 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.374165 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.375133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:32.376766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:32.455769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Acquired lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:21:33.385049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Updating instance_info_cache with network_info: [] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:21:33.669028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:33.801041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=9,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:33.908548 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00381375-0e73-49ef-af3e-c7621255bb3e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 204 len: 0 microversion: 2.1 time: 3.772546 Jul 20 04:21:33.913234 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 875/1818] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:30 2022] DELETE /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 0 bytes in 3775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:33.918884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-891cde8a-1c7f-4f5f-ac26-9e7add391fc6 req-fa7a79e0-358f-4905-955c-a4e90c8fca01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84", "tag": "901375b9-d9dd-4c90-9424-bc917a51c4e2"}, {"name": "network-changed", "server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:33.933268 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9.", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:33.934595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Releasing lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:21:33.935318 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.935318 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Request method failure captured: Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action HTTP/1.1 Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 46 Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdMPa-CYXRU96GpIOY2cv--Z68SlDb727ywEIuz2LjqhHXDUOqaXXsSMoE0x9VbowwMzdrL4hioKZ8aKl8lcQLf3-ZhlJe1zcJeX6MW4x6PvGUtMLPI__fqu5wC7llytufXdO51D0cvcwDaPbCTLuY8kiLgyBamBP6lIFNEZLHS_M Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:33.937727 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0edfeefaa7143868c28d82d07548ba5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: cddd38a0cc0542829a5902490604063f Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: {"addFloatingIp": {"address": "172.25.5.238"}} Jul 20 04:21:33.939466 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: exception: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'dd104a82-0c3a-45a4-9e70-b234e7410953', 'body': {'addFloatingIp': {'address': '172.25.5.238'}}} Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:33.940626 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:33.942017 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.943378 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.945599 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] Jul 20 04:21:33.947055 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:33.947773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-891cde8a-1c7f-4f5f-ac26-9e7add391fc6 req-fa7a79e0-358f-4905-955c-a4e90c8fca01 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.947773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-891cde8a-1c7f-4f5f-ac26-9e7add391fc6 req-fa7a79e0-358f-4905-955c-a4e90c8fca01 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.950655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Returning 400 to user: Cannot associate floating IP 172.25.5.238 (e56529eb-a883-412d-8010-01db0446414f) with port 4e39f8f7-9c65-447b-81f8-864ffaf8fa5e using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network b082fd41-d46a-40a3-a334-ca1a83b364f9. Jul 20 04:21:33.950655 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-b7389496-2222-4408-8088-b5198fc13e32'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:33.950655 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-20aef99b-6666-40bb-99b3-a37b92844a98 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action" status: 400 len: 381 microversion: 2.1 time: 1.604666 Jul 20 04:21:33.951502 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 944/1819] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:32 2022] POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action => generated 381 bytes in 1607 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:21:33.963274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.964160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:33.965545 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-891cde8a-1c7f-4f5f-ac26-9e7add391fc6 req-fa7a79e0-358f-4905-955c-a4e90c8fca01 service nova] Creating event network-changed:901375b9-d9dd-4c90-9424-bc917a51c4e2 for instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 on n-h1-764486-11 Jul 20 04:21:33.966381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-891cde8a-1c7f-4f5f-ac26-9e7add391fc6 req-fa7a79e0-358f-4905-955c-a4e90c8fca01 service nova] Creating event network-changed:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h1-764486-11 Jul 20 04:21:33.974958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-891cde8a-1c7f-4f5f-ac26-9e7add391fc6 req-fa7a79e0-358f-4905-955c-a4e90c8fca01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059847 Jul 20 04:21:33.976686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 876/1820] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:33.980880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.981528 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:33.982494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:33.982700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d4f2a19-540d-414c-8a0d-a5e42268bd8d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839cea9940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:33.983253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.049310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:34.329886 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.338948 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b96a1ccb-22c1-4533-b334-7c2c88bb14a7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1463 microversion: 2.1 time: 0.386140 Jul 20 04:21:34.354299 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 945/1821] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1463 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:34.359506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d4f2a19-540d-414c-8a0d-a5e42268bd8d tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2" status: 200 len: 224 microversion: 2.1 time: 0.380970 Jul 20 04:21:34.360874 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 877/1822] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:21:33 2022] GET /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2 => generated 224 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:34.364241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.365141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.366383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9b4cb92b-82a0-4191-b5bb-3eb5975ddbc7 req-40493fdd-905d-4391-b52d-9612d4664f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138047fe-a8c8-4a9b-aa5a-77cbea80de4f", "name": "network-vif-deleted", "tag": "e863d0cb-4b2b-4ee1-81f1-36da768af04a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:34.379210 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.380630 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.385917 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.387749 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.397531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9b4cb92b-82a0-4191-b5bb-3eb5975ddbc7 req-40493fdd-905d-4391-b52d-9612d4664f6e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.399370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9b4cb92b-82a0-4191-b5bb-3eb5975ddbc7 req-40493fdd-905d-4391-b52d-9612d4664f6e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.428615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9b4cb92b-82a0-4191-b5bb-3eb5975ddbc7 req-40493fdd-905d-4391-b52d-9612d4664f6e service nova] Creating event network-vif-deleted:e863d0cb-4b2b-4ee1-81f1-36da768af04a for instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f on n-h2-764486-11 Jul 20 04:21:34.441837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9b4cb92b-82a0-4191-b5bb-3eb5975ddbc7 req-40493fdd-905d-4391-b52d-9612d4664f6e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079514 Jul 20 04:21:34.455883 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 878/1823] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:34.466142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.468672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.486390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.490285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.494299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.494997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.626828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.638940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4873f049-ea77-482f-8592-dc993689c25c tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1184 microversion: 2.1 time: 0.180518 Jul 20 04:21:34.644950 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.653139 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 879/1824] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1184 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:34.656621 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.659554 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:34.660890 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f648ab92-450c-4505-b540-39b7b74cc49d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1280 microversion: 2.25 time: 0.303378 Jul 20 04:21:34.662274 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 946/1825] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:34.663244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1008608443", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "787c4708-9102-4a77-b1f3-7c54d16b4955"}, {"uuid": "b70d9f80-367b-40fe-b032-ec222f09321d"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:34.677033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.677826 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:34.696528 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.702514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.703889 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:34.704980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:34.767932 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa HTTP/1.1 Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:34.775598 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:21:34.777613 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '32076e88-d4fa-4391-afcb-bad6d6f9fbfa'} Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:34.779033 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:21:34.780837 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:34.782332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:34.785117 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3581d74c-2888-4712-ac5b-ebb4e565af74 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 404 len: 111 microversion: 2.1 time: 0.111061 Jul 20 04:21:34.785117 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 947/1826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:34 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:34.805029 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8c0fea7f-838c-4e68-8114-4463395aa0c0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '.version_select at 0x7f838b884820>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:34.834752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] validate_networks() for [('787c4708-9102-4a77-b1f3-7c54d16b4955', None, None, None, None, None), ('b70d9f80-367b-40fe-b032-ec222f09321d', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:35.806541 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8c0fea7f-838c-4e68-8114-4463395aa0c0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/e56529eb-a883-412d-8010-01db0446414f" status: 202 len: 0 microversion: 2.1 time: 1.021034 Jul 20 04:21:35.808044 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 948/1827] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:21:34 2022] DELETE /compute/v2.1/os-floating-ips/e56529eb-a883-412d-8010-01db0446414f => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:35.814753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:35.815757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:35.831053 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.833382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:35.836277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:35.843054 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.099648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:36.117051 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f464f0fb-5eae-4217-918c-f2840db0e950 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1464 microversion: 2.1 time: 0.306817 Jul 20 04:21:36.131418 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 949/1828] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:35 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1464 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:36.140385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5475ed7b-62a9-4073-b8aa-0f5299e9c74b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b8841f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:36.429599 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5475ed7b-62a9-4073-b8aa-0f5299e9c74b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2" status: 202 len: 0 microversion: 2.1 time: 0.310353 Jul 20 04:21:36.430736 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 950/1829] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:36 2022] DELETE /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:36.494520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:36.495682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:36.496329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:36.497074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:36.497936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:36.513821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.514760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.519692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:36.520422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:36.552391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Getting quotas for project 3d7eb98b263a47d8a238b9e29baef9f4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:36.559886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Getting quotas for user eb32e9e4909744fbb5f665af1ddb3319 and project 3d7eb98b263a47d8a238b9e29baef9f4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:36.578002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:36.581228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:36.630476 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2042360399", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "a89cd34f-22d6-424a-a2c9-105e6fd644ba"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:36.649076 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c7697b97-566e-4347-b113-df8d6ccbad93 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992307 Jul 20 04:21:36.650395 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 880/1830] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:36.656345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1365265438", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:36.749403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:36.764293 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] validate_networks() for [('a89cd34f-22d6-424a-a2c9-105e6fd644ba', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:37.615773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:37.617370 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:37.617964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:37.618477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:37.618989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:37.628932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.629800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.630835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.632670 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.655328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:37.655947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:37.656561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:37.657363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:37.657980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:37.661078 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Getting quotas for project 34fcbc6e6a954e988b8af3a1e3180585. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:37.666927 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Getting quotas for user 2c2369cecdbb4a33b703b111245ba7f8 and project 34fcbc6e6a954e988b8af3a1e3180585. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:37.668058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.668703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.669683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.670700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.681421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:37.683964 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:37.711231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:37.719966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:37.744154 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-67c14e15-ab82-4d18-b360-2134554d33d8 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311754 Jul 20 04:21:37.745525 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 951/1831] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:37.754400 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.756639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:37.767472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:37.770631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:37.773241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.773907 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.774923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.775604 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.884966 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a415390-6b7c-41ff-853c-bf3bfc62c48d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233090 Jul 20 04:21:37.885650 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 881/1832] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:37.905480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:37.906113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:37.919792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.920251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.921069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:37.926054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:37.942314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:37.955384 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff693a2b-b778-48f6-8623-1c96dfb4d939 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1184 microversion: 2.1 time: 0.208358 Jul 20 04:21:37.958108 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 952/1833] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1184 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:37.972686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'action', calling method: .version_select at 0x7f839a868e50>, body: {"removeFloatingIp": {"address": "172.25.5.95"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:38.412249 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:38.426767 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:38.440865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.443230 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.448792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:38.451373 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:38.559421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.572402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.575921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:38.580384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d7319d5-76cc-4a75-9326-d63f5a267ee7 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1280 microversion: 2.25 time: 0.693691 Jul 20 04:21:38.581186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 882/1834] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:37 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1280 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:38.590477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1891746159", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "59f518e8-fd6b-4a1f-95e4-615888632c55"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:38.693991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:38.859363 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Acquired lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:21:39.387122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:39.388208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:39.389243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:39.389992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:39.390802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:39.405768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.406489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.407624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.408849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.436489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Getting quotas for project b1aabe9c1e484ea8ae0ca07bfc093c88. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:39.443217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Getting quotas for user cd40edc86fb24af79986645c1e99d944 and project b1aabe9c1e484ea8ae0ca07bfc093c88. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:39.461640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:39.464686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:39.538594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95e96497-3eff-48de-836f-6594b62a36f5 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955522 Jul 20 04:21:39.543169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 883/1835] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:39.553591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b86ae50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.667682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:39.669956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:39.670945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.670945 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2 HTTP/1.1 Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:39.676609 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] Jul 20 04:21:39.678845 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7e284631-b633-4bfa-98b4-5bfa36b8f2d2'} Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:39.680158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:39.681741 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.683209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-6a55a8b5-dfa4-413e-ab5f-47e909dd1c5f'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:39.687323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21fd0969-3c51-4cbf-b34c-f163860ecc4b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2" status: 404 len: 194 microversion: 2.1 time: 0.140897 Jul 20 04:21:39.688631 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 884/1836] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2 => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:39.703246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4fa2af12-f701-4006-adb0-6051703a2418 req-6a1c3022-0f4f-4e43-8e4d-17ecb160394c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32076e88-d4fa-4391-afcb-bad6d6f9fbfa", "name": "network-vif-deleted", "tag": "e57fe3f6-4827-4f73-9c52-231d22c64b3e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:39.720945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4fa2af12-f701-4006-adb0-6051703a2418 req-6a1c3022-0f4f-4e43-8e4d-17ecb160394c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.728876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4fa2af12-f701-4006-adb0-6051703a2418 req-6a1c3022-0f4f-4e43-8e4d-17ecb160394c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.747163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_external_events [req-4fa2af12-f701-4006-adb0-6051703a2418 req-6a1c3022-0f4f-4e43-8e4d-17ecb160394c service nova] Unable to find a host for instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa. Dropping event network-vif-deleted {{(pid=123724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:21:39.748055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4fa2af12-f701-4006-adb0-6051703a2418 req-6a1c3022-0f4f-4e43-8e4d-17ecb160394c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.057507 Jul 20 04:21:39.757735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 885/1837] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:21:39.767000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:39.767487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:39.793545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.794427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:39.795829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:39.797552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.014436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.027159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2fac68fe-7db8-49e8-b5aa-0c8b7f4f314c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1271 microversion: 2.1 time: 0.268225 Jul 20 04:21:40.031662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 886/1838] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:39 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:40.040484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.042034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:40.061283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.062186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.063494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.064218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.523994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.536055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e2fc653-31ea-4ea4-8a60-616e331ff282 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1285 microversion: 2.1 time: 0.501945 Jul 20 04:21:40.539103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 887/1839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:40 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1285 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:40.552198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.553024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:40.580576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.581083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.589784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.592996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.823853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:40.835786 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5410b030-84ee-4044-9725-04ac9b0e4fae tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1273 microversion: 2.1 time: 0.290996 Jul 20 04:21:40.846736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 888/1840] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:40 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:40.854151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:40.861778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:40.875646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.881280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:40.882851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:40.883436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.044656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.054927 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44238412-2ea5-4597-8fc0-ace24fc8efc9 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 200 len: 1184 microversion: 2.1 time: 0.206579 Jul 20 04:21:41.055632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 889/1841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:40 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 1184 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:41.070542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.071163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.079030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.079402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.080189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.080805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.253175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.264685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-506de9aa-db35-4f89-b554-5ec3e16d3677 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1266 microversion: 2.1 time: 0.198531 Jul 20 04:21:41.265307 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 890/1842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:41.276876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:41.285287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:41.300497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.300962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.301747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:41.302178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:41.522191 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Building network info cache for instance {{(pid=123723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:21:41.951448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.967442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.972427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:41.976007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ee1cadd-a71c-4ec4-ada9-9e9a5dde8b7f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1280 microversion: 2.25 time: 0.709168 Jul 20 04:21:41.979758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 891/1843] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:41 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1280 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:42.009786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b39e5a4-5a23-4f24-911c-0fab150735d5 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f839ce8bee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-766717386", "description": "tempest-description-1546025319"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:42.348767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b39e5a4-5a23-4f24-911c-0fab150735d5 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.366625 Jul 20 04:21:42.349676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 892/1844] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:42.355123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:42.356082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:42.373084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.373938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.375039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.375738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.788931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:42.805626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ed6bbe9-25bc-48d2-a099-cdcff876758c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1313 microversion: 2.1 time: 0.454100 Jul 20 04:21:42.808989 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 893/1845] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:42 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:42.817758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:42.829489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:42.865635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.867542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:42.869029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:42.876561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.029326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.048313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bfba1fa1-ee21-4d47-b118-76f5cee7b394 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1283 microversion: 2.1 time: 0.235456 Jul 20 04:21:43.052866 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Updating instance_info_cache with network_info: [{"id": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e", "address": "fa:16:3e:90:75:b3", "network": {"id": "7ad14e8f-b738-4578-8a61-b639df9b6034", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-802695488-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e0edfeefaa7143868c28d82d07548ba5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4e39f8f7-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:21:43.067688 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 894/1846] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:42 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1283 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:43.074811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dfd70b2f-adb6-4f09-8e08-3cef6ff84412 req-2fd37e5e-844a-4909-b820-9cdd1f46ee5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd104a82-0c3a-45a4-9e70-b234e7410953", "tag": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:43.075855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Releasing lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:21:43.076758 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0495ea54-b2fb-422f-b6e7-66b2b4f2a111 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action" status: 202 len: 0 microversion: 2.1 time: 5.117642 Jul 20 04:21:43.080934 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 953/1847] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:37 2022] POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action => generated 0 bytes in 5122 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:21:43.086050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dfd70b2f-adb6-4f09-8e08-3cef6ff84412 req-2fd37e5e-844a-4909-b820-9cdd1f46ee5e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.086253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.086556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dfd70b2f-adb6-4f09-8e08-3cef6ff84412 req-2fd37e5e-844a-4909-b820-9cdd1f46ee5e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.087253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.102281 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dfd70b2f-adb6-4f09-8e08-3cef6ff84412 req-2fd37e5e-844a-4909-b820-9cdd1f46ee5e service nova] Creating event network-changed:4e39f8f7-9c65-447b-81f8-864ffaf8fa5e for instance dd104a82-0c3a-45a4-9e70-b234e7410953 on n-h1-764486-11 Jul 20 04:21:43.103598 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.104325 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.105310 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.105908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.108704 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dfd70b2f-adb6-4f09-8e08-3cef6ff84412 req-2fd37e5e-844a-4909-b820-9cdd1f46ee5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039248 Jul 20 04:21:43.111944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 895/1848] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:43.122928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.126240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 138047fe-a8c8-4a9b-aa5a-77cbea80de4f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.139136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.139591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.140421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.140838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.187363 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] HTTP exception thrown: Instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f could not be found. Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Request method failure captured: Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f HTTP/1.1 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E9nj-pyFr_NfcW4ncFdMIGmV0seCU-0QwUV-XhQjiLBjjKtr9_ofA21gCMXv3q5XbC7QFVdk8uqh7Cb4ppd8g6fcACBrHp3qsf4BViCRPToTp_1lwb9WzkXmRydh-1t6hthwFYrkBs034cfDCqOEfTEL0zP3wnFyOLKo_4QF2X7Z8 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:43.189670 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_05d93c82e5c5467693db0e5f8d95d202", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationTest-426204656 Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationTest-426204656-project Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: ab72bd0852ad4f72a0c96a7ddf1bdd63 Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationTest-426204656-project Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f could not be found. Jul 20 04:21:43.191298 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '138047fe-a8c8-4a9b-aa5a-77cbea80de4f'} Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f could not be found. Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:43.192181 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f could not be found. Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f could not be found. Jul 20 04:21:43.195077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:43.199347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Returning 404 to user: Instance 138047fe-a8c8-4a9b-aa5a-77cbea80de4f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:43.201196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a9f9792-6237-4d4e-bb07-057aacef31cf tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f" status: 404 len: 111 microversion: 2.1 time: 0.088025 Jul 20 04:21:43.203761 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 896/1849] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/138047fe-a8c8-4a9b-aa5a-77cbea80de4f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:43.213641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.214412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.229405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.229857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.231482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.231961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.247140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.254638 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-32fde5ee-83be-44ba-af64-d150686a802d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1273 microversion: 2.1 time: 0.172360 Jul 20 04:21:43.255192 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 954/1850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:43.281610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-15adc672-aaca-4a36-a93d-2aad54c41a45 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f838b92aa60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-292323867", "description": "tempest-description-1097907100"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:43.477851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:43.492121 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-401e53eb-8fdc-41f3-9fde-18e4731384d3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1272 microversion: 2.1 time: 0.285335 Jul 20 04:21:43.492981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 897/1851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:43.505948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dc1b470b-c02f-427d-b54d-b5b4606dfbaa req-563c5482-8742-472e-b6c6-fd0d020fa161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "name": "network-vif-plugged", "status": "completed", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:43.524795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dc1b470b-c02f-427d-b54d-b5b4606dfbaa req-563c5482-8742-472e-b6c6-fd0d020fa161 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.527344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dc1b470b-c02f-427d-b54d-b5b4606dfbaa req-563c5482-8742-472e-b6c6-fd0d020fa161 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.555891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dc1b470b-c02f-427d-b54d-b5b4606dfbaa req-563c5482-8742-472e-b6c6-fd0d020fa161 service nova] Creating event network-vif-plugged:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h1-764486-11 Jul 20 04:21:43.568147 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dc1b470b-c02f-427d-b54d-b5b4606dfbaa req-563c5482-8742-472e-b6c6-fd0d020fa161 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070691 Jul 20 04:21:43.569888 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 898/1852] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:43.581191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:43.581908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:43.597943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.598434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:43.603672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:43.604370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.032788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.050982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.052547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:44.059052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e11a7d71-345b-46cf-af56-e25ce035225c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1280 microversion: 2.25 time: 0.487928 Jul 20 04:21:44.072898 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 899/1853] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:43 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1280 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:44.082790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9774981f-5889-489e-8577-b07ca94d6fba tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '.version_select at 0x7f839ced11f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.578012 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-15adc672-aaca-4a36-a93d-2aad54c41a45 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.311015 Jul 20 04:21:44.578615 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 955/1854] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:43 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:44.588137 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:44.588786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:44.605113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.605607 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:44.606422 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:44.606855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.087296 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.097542 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a6a03d0f-b6ed-45dd-9a3e-fc2bc0631598 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.516853 Jul 20 04:21:45.099116 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 956/1855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:44 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:45.114241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:45.115225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:45.131105 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.133739 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.137263 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.137912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.788208 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:45.799460 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8c0954b9-ff7a-4d9b-b332-b9cf70af5f0d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.695413 Jul 20 04:21:45.809367 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 957/1856] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:45 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:45.810689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:45.811313 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:45.829407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.837685 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:45.839494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:45.840147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.228904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:46.237076 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-eb800677-c181-4fb9-8eab-7b3fdf190634 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.435515 Jul 20 04:21:46.237668 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 958/1857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:45 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:46.263835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:46.264583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:46.302801 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.304055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:46.311289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:46.311742 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.173740 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:47.200502 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-378979aa-25eb-4c29-9520-4ab54029b79b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1314 microversion: 2.1 time: 0.961456 Jul 20 04:21:47.202757 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 959/1858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:46 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:47.214316 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-15d738d6-e86b-42d5-bb13-b6adab6788fe tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f838b8a5f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1455556956", "description": "tempest-description-1487670116"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:47.645399 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:47.674467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:47.880680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9774981f-5889-489e-8577-b07ca94d6fba tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/8bf67800-4bef-4ff3-91fc-4e16a3e56ab1" status: 202 len: 0 microversion: 2.1 time: 3.806492 Jul 20 04:21:47.882169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 900/1859] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:21:44 2022] DELETE /compute/v2.1/os-floating-ips/8bf67800-4bef-4ff3-91fc-4e16a3e56ab1 => generated 0 bytes in 3809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:47.890874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:47.892651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:47.909571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.915497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.918227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:47.920807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:47.935771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:DELETE=2,nova_cell1:SELECT=91 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:48.112766 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-15d738d6-e86b-42d5-bb13-b6adab6788fe tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.907553 Jul 20 04:21:48.113657 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 960/1860] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:47 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:48.133588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.136588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.149205 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.150161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.151171 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.151877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.441673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.453334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.454849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.456008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b74e767-03a7-4653-ba99-c1fa0c8b4ada tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1476 microversion: 2.25 time: 0.572057 Jul 20 04:21:48.480760 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 901/1861] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:47 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1476 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:48.486712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.488402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.503405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.504194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.505364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.505973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.540158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.552136 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d8d6f1ad-976b-4e01-8eb9-ab637b209160 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.430574 Jul 20 04:21:48.567889 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 961/1862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:48.579179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-07f6a381-6fca-42d6-8091-81760680ac45 req-137f176a-21a0-46cb-8ce9-e8c6507c24a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81420b50-7a17-416b-b1af-b84345fc990b", "tag": "9d69e619-a96f-444f-97e6-d031220ad912"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:48.592291 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-07f6a381-6fca-42d6-8091-81760680ac45 req-137f176a-21a0-46cb-8ce9-e8c6507c24a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.593207 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-07f6a381-6fca-42d6-8091-81760680ac45 req-137f176a-21a0-46cb-8ce9-e8c6507c24a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.606865 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-07f6a381-6fca-42d6-8091-81760680ac45 req-137f176a-21a0-46cb-8ce9-e8c6507c24a0 service nova] Creating event network-changed:9d69e619-a96f-444f-97e6-d031220ad912 for instance 81420b50-7a17-416b-b1af-b84345fc990b on n-h1-764486-11 Jul 20 04:21:48.613345 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-07f6a381-6fca-42d6-8091-81760680ac45 req-137f176a-21a0-46cb-8ce9-e8c6507c24a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042904 Jul 20 04:21:48.619263 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 962/1863] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:48.625380 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.626383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.635278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.636005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.637501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.638314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.773707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.785053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c804a92e-e74a-4447-9191-df31086240e2 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.302411 Jul 20 04:21:48.788334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 902/1864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:48.795395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d9427c4e-5dbf-4dc6-920f-229dad1d0a92 req-b8bf094a-f472-4653-a412-3cc91833ceb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d660a6-cb26-4977-b18f-dac4cd9ef224", "tag": "a302b796-8416-4169-8227-950eb5e5211e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:48.806949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d9427c4e-5dbf-4dc6-920f-229dad1d0a92 req-b8bf094a-f472-4653-a412-3cc91833ceb1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.808316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d9427c4e-5dbf-4dc6-920f-229dad1d0a92 req-b8bf094a-f472-4653-a412-3cc91833ceb1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.820055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:48.824944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d9427c4e-5dbf-4dc6-920f-229dad1d0a92 req-b8bf094a-f472-4653-a412-3cc91833ceb1 service nova] Creating event network-changed:a302b796-8416-4169-8227-950eb5e5211e for instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 on n-h1-764486-11 Jul 20 04:21:48.830868 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d9427c4e-5dbf-4dc6-920f-229dad1d0a92 req-b8bf094a-f472-4653-a412-3cc91833ceb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040745 Jul 20 04:21:48.832096 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-187a51e6-d5bd-46da-b781-358848241c4e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.210837 Jul 20 04:21:48.833029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 903/1865] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:48.842933 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 963/1866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:48.846335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbdbf19d-ba89-4f28-92ae-78234dcb8a50 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'action', calling method: .version_select at 0x7f839a871d30>, body: {"addFloatingIp": {"address": ""}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbdbf19d-ba89-4f28-92ae-78234dcb8a50 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Request method failure captured: Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action HTTP/1.1 Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 34 Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdMPa-CYXRU96GpIOY2cv--Z68SlDb727ywEIuz2LjqhHXDUOqaXXsSMoE0x9VbowwMzdrL4hioKZ8aKl8lcQLf3-ZhlJe1zcJeX6MW4x6PvGUtMLPI__fqu5wC7llytufXdO51D0cvcwDaPbCTLuY8kiLgyBamBP6lIFNEZLHS_M Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:48.849359 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0edfeefaa7143868c28d82d07548ba5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cddd38a0cc0542829a5902490604063f Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: {"addFloatingIp": {"address": ""}} Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:48.851338 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'dd104a82-0c3a-45a4-9e70-b234e7410953', 'body': {'addFloatingIp': {'address': ''}}} Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '' Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:48.852455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:21:48.854322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:21:48.855911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 04:21:48.855911 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:48.856107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4d9f3844-bf64-4f5a-9934-f69077cda519 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b8a5670>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.857223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbdbf19d-ba89-4f28-92ae-78234dcb8a50 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:48.860214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbdbf19d-ba89-4f28-92ae-78234dcb8a50 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action" status: 400 len: 142 microversion: 2.1 time: 0.023776 Jul 20 04:21:48.863330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 904/1867] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:48 2022] POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action => generated 142 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:21:48.869251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:48.870437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:48.888562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.890291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:48.896899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:48.897914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.131638 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4d9f3844-bf64-4f5a-9934-f69077cda519 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.287451 Jul 20 04:21:49.133973 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 964/1868] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:49.140417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.141417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.149079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.149827 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.150789 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.151519 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.160245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.170396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d69827d-3420-404d-93ba-cff818050850 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1314 microversion: 2.1 time: 0.305592 Jul 20 04:21:49.171538 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 905/1869] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:48 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:49.177209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:49.179199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.186183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.187085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.187939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.188578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.311017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Acquired lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:21:49.330815 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:49.348409 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7c0a1f9c-cede-438d-86d4-b97d29005a88 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1970 microversion: 2.25 time: 0.213143 Jul 20 04:21:49.350864 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 965/1870] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1970 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:49.355981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.356890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.363444 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.364146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.366079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.366836 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.400065 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:49.424178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:49.454081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=18 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:49.468945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:49.508101 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a8c44d02-0313-4c34-907f-a7798746a9aa tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 204 len: 0 microversion: 2.1 time: 0.155719 Jul 20 04:21:49.509014 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 966/1871] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:49 2022] DELETE /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:49.514746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4a295ad1-9f23-4a29-a789-4eed78fcf662 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f8398359160>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.744644 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4a295ad1-9f23-4a29-a789-4eed78fcf662 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63" status: 202 len: 0 microversion: 2.1 time: 0.234159 Jul 20 04:21:49.746511 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 967/1872] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:49 2022] DELETE /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:49.752943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.754174 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.778906 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.779759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.780691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.781097 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.815732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Releasing lock "refresh_cache-dd104a82-0c3a-45a4-9e70-b234e7410953" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:21:49.816375 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] HTTP exception thrown: floating IP not found Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Request method failure captured: Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action HTTP/1.1 Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 41 Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdMPa-CYXRU96GpIOY2cv--Z68SlDb727ywEIuz2LjqhHXDUOqaXXsSMoE0x9VbowwMzdrL4hioKZ8aKl8lcQLf3-ZhlJe1zcJeX6MW4x6PvGUtMLPI__fqu5wC7llytufXdO51D0cvcwDaPbCTLuY8kiLgyBamBP6lIFNEZLHS_M Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:49.818211 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0edfeefaa7143868c28d82d07548ba5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cddd38a0cc0542829a5902490604063f Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:49.819980 n-d-764486-11 devstack@n-api.service[123724]: exception: floating IP not found Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'dd104a82-0c3a-45a4-9e70-b234e7410953', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:49.821206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 20 04:21:49.824463 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:49.826142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Returning 404 to user: floating IP not found {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:49.826142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66b6bc91-2a82-4e15-8525-f44a84eba3a0 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action" status: 404 len: 67 microversion: 2.1 time: 0.646913 Jul 20 04:21:49.826142 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 906/1873] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:49 2022] POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action => generated 67 bytes in 648 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:49.826142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.826142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.832322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.833006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.833773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.834229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.930799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:49.946538 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3c9759aa-4ad4-447c-96c3-2661c69d45da tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1970 microversion: 2.25 time: 0.198313 Jul 20 04:21:49.947425 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 968/1874] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1970 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:49.952345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:49.953245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:49.960322 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.960816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.961602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:49.962038 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:49.989832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:49.998065 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0096cdc2-c826-419c-9da4-80e8620ab8ec tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1664 microversion: 2.1 time: 0.176897 Jul 20 04:21:49.998637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 907/1875] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.003472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839ce8bca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.026176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:50.026772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:50.027341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.027341 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63 HTTP/1.1 Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:50.029190 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] Jul 20 04:21:50.030966 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c2bdc936-7223-4344-9a0c-5d4d96c46e63'} Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.031940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:50.033323 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.034769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-81f34a90-2a93-4541-8f0d-a02bb9c80597'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66cba3fd-00f8-4bbc-9360-ba37aa76de4a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63" status: 404 len: 194 microversion: 2.1 time: 0.031048 Jul 20 04:21:50.036473 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 908/1876] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63 => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:50.037470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.037470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.044906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.045523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.046299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.046735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.108733 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:50.116807 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c69b2b85-8981-44da-808d-67c75ed6a53c tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.168157 Jul 20 04:21:50.117387 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 969/1877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:49 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.121947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c7cd514b-1705-44f4-bde0-3fb5b12e8862 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:50.167078 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-c7cd514b-1705-44f4-bde0-3fb5b12e8862 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c7cd514b-1705-44f4-bde0-3fb5b12e8862 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Request method failure captured: Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: request: POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action HTTP/1.1 Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 44 Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdMPa-CYXRU96GpIOY2cv--Z68SlDb727ywEIuz2LjqhHXDUOqaXXsSMoE0x9VbowwMzdrL4hioKZ8aKl8lcQLf3-ZhlJe1zcJeX6MW4x6PvGUtMLPI__fqu5wC7llytufXdO51D0cvcwDaPbCTLuY8kiLgyBamBP6lIFNEZLHS_M Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:50.168849 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0edfeefaa7143868c28d82d07548ba5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: cddd38a0cc0542829a5902490604063f Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:50.170693 n-d-764486-11 devstack@n-api.service[123723]: exception: Floating IP not found for address 0.0.0.0. Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'dd104a82-0c3a-45a4-9e70-b234e7410953', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:50.171674 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 20 04:21:50.173044 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.175055 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c7cd514b-1705-44f4-bde0-3fb5b12e8862 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:50.175055 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c7cd514b-1705-44f4-bde0-3fb5b12e8862 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action" status: 404 len: 88 microversion: 2.1 time: 0.052082 Jul 20 04:21:50.175055 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 970/1878] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:21:50 2022] POST /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953/action => generated 88 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:21:50.175988 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.176939 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.184387 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.184833 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.185603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.186036 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.189847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:50.198419 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26c1f400-e5ac-4e79-afb7-36d0cba0431d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.166033 Jul 20 04:21:50.198986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 909/1879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.207086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c34d42f5-c084-4592-a254-d7afce9a781d tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.207086 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:21:50.207086 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:21:50.207086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c34d42f5-c084-4592-a254-d7afce9a781d tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.207086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c34d42f5-c084-4592-a254-d7afce9a781d tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.207569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c34d42f5-c084-4592-a254-d7afce9a781d tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.207569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c34d42f5-c084-4592-a254-d7afce9a781d tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.217965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:50.233885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c34d42f5-c084-4592-a254-d7afce9a781d tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.033853 Jul 20 04:21:50.234497 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 910/1880] 10.222.0.49 () {60 vars in 1216 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:50.239100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b463ece8-5374-448b-8326-9cfbd1d2ea5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839806c3a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.323917 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:50.331627 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-43e1dc09-f203-491e-82e2-01a0b2bfdbb0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.159256 Jul 20 04:21:50.332187 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 971/1881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.337590 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.338306 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.344172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.344655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.345421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.345854 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.371948 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:50.453613 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-14029d0f-0620-4e42-b690-8742fbacbea3 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 204 len: 0 microversion: 2.1 time: 0.119888 Jul 20 04:21:50.454217 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 972/1882] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:50 2022] DELETE /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:50.459285 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.460113 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.466581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.466581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.467305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.467745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.487433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b463ece8-5374-448b-8326-9cfbd1d2ea5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd" status: 202 len: 0 microversion: 2.1 time: 0.251534 Jul 20 04:21:50.489217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 911/1883] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:50 2022] DELETE /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:50.494892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-764486-11", "block_migration": "auto"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:50.496163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.504389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.505058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.505878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.506544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.541712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'flavor' on Instance uuid 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:50.555249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Going to try to live migrate instance to n-h2-764486-11 {{(pid=123724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:21:50.657724 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:50.672965 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c0b7ea64-ea22-4341-8fe4-81b60c06cf3b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1314 microversion: 2.1 time: 0.217391 Jul 20 04:21:50.675535 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 973/1884] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.682371 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.682986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:50.690418 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.691116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.691951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.692404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.856220 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:50.867155 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b3be0360-9323-4221-8d59-cdc07a359480 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1541 microversion: 2.1 time: 0.190464 Jul 20 04:21:50.868223 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 974/1885] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1541 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:50.872835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b906f70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:50.893982 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:50.894579 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group a2fdda8c-a517-441e-898b-e7d6972c35dd not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:50.895104 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.895104 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd HTTP/1.1 Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:50.897600 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: exception: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] Jul 20 04:21:50.899312 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'a2fdda8c-a517-441e-898b-e7d6972c35dd'} Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.903917 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:50.905473 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.907052 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-ea226d69-4136-4a76-8630-8f36ef49cc95'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-63cae0ce-87a6-4606-8016-b382d72bb4e1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd" status: 404 len: 194 microversion: 2.1 time: 0.029647 Jul 20 04:21:50.908653 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 975/1886] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:21:50 2022] GET /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:50.909607 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-720fbb05-45a3-4239-9a0b-64faf597cc1c req-5de7b184-c8d0-4884-8583-0b846a4df561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43e41b7-9185-40e1-8218-d6605e3ff7aa", "tag": "3e67bc78-6d25-47d0-89c9-a390001a525c"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:50.915049 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-720fbb05-45a3-4239-9a0b-64faf597cc1c req-5de7b184-c8d0-4884-8583-0b846a4df561 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.915488 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-720fbb05-45a3-4239-9a0b-64faf597cc1c req-5de7b184-c8d0-4884-8583-0b846a4df561 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.926829 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-720fbb05-45a3-4239-9a0b-64faf597cc1c req-5de7b184-c8d0-4884-8583-0b846a4df561 service nova] Creating event network-changed:3e67bc78-6d25-47d0-89c9-a390001a525c for instance e43e41b7-9185-40e1-8218-d6605e3ff7aa on n-h1-764486-11 Jul 20 04:21:50.932109 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-720fbb05-45a3-4239-9a0b-64faf597cc1c req-5de7b184-c8d0-4884-8583-0b846a4df561 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031466 Jul 20 04:21:50.932734 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 976/1887] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:50.938847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-facf2c73-36b5-447a-8a05-6a6b3d2c8944 req-49bb363a-bc13-49aa-8dfe-287dada4f80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038f9610-51d2-4bb3-a7eb-984aabb0f873", "tag": "2fe4e06a-4044-4e69-9ccc-67dd8ee0db7d"}, {"name": "network-changed", "server_uuid": "b1d660a6-cb26-4977-b18f-dac4cd9ef224", "tag": "17918890-ee9f-42a0-ac70-9a12ace38c7b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:50.948276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-facf2c73-36b5-447a-8a05-6a6b3d2c8944 req-49bb363a-bc13-49aa-8dfe-287dada4f80a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:50.948746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-facf2c73-36b5-447a-8a05-6a6b3d2c8944 req-49bb363a-bc13-49aa-8dfe-287dada4f80a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:50.961717 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-facf2c73-36b5-447a-8a05-6a6b3d2c8944 req-49bb363a-bc13-49aa-8dfe-287dada4f80a service nova] Creating event network-changed:2fe4e06a-4044-4e69-9ccc-67dd8ee0db7d for instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 on n-h2-764486-11 Jul 20 04:21:50.962205 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-facf2c73-36b5-447a-8a05-6a6b3d2c8944 req-49bb363a-bc13-49aa-8dfe-287dada4f80a service nova] Creating event network-changed:17918890-ee9f-42a0-ac70-9a12ace38c7b for instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 on n-h1-764486-11 Jul 20 04:21:50.970130 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-facf2c73-36b5-447a-8a05-6a6b3d2c8944 req-49bb363a-bc13-49aa-8dfe-287dada4f80a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035948 Jul 20 04:21:50.970726 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 977/1888] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:50.976520 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1100403d-1201-4f71-ab97-d607a2d20206 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b85f0d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.183880 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1100403d-1201-4f71-ab97-d607a2d20206 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e" status: 202 len: 0 microversion: 2.1 time: 0.211221 Jul 20 04:21:51.185857 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 978/1889] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:21:50 2022] DELETE /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:51.216626 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.218133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:51.234000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.234442 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.235221 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.235908 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.307343 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:51.317054 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-acc5595a-721b-43fd-b2ba-f27ef466b607 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 200 len: 1598 microversion: 2.1 time: 0.129330 Jul 20 04:21:51.317632 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 979/1890] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 1598 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:51.326792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.326792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:51.329209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.329654 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.330403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.330830 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.471486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:51.479675 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-94379db2-d6cc-444e-b026-b842a96c5b6d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.160655 Jul 20 04:21:51.489180 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 980/1891] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:51.489180 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b9061f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.508527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:21:51.509225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:21:51.509876 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.509876 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e HTTP/1.1 Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:51.511968 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: exception: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] Jul 20 04:21:51.513757 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'f2fb95b3-ff24-49d2-8608-ae77f3de3f5e'} Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:51.514914 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:21:51.516286 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.518776 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-5ffa0264-6efb-4bd6-bb53-0fb49122552a'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d3c2d2bb-2c0b-471f-a271-644c39ee8b79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e" status: 404 len: 194 microversion: 2.1 time: 0.032272 Jul 20 04:21:51.521514 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 981/1892] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:51.522722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.522722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:51.526497 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.526947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.527715 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.528150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.718048 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:51.740819 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6181cc5-b000-407a-a81f-136c798efe38 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.214759 Jul 20 04:21:51.742365 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 982/1893] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:51.747457 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:51.748336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:51.763855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.764383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:51.766194 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:51.766639 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:52.548974 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:52.558424 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a22fdf34-ea54-4af7-99a1-1d2d44fa94d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.814783 Jul 20 04:21:52.567273 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 983/1894] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:51 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:52.585317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bdf425ed-12cc-492c-8767-41d13a3b8b2c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b906310>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.217005 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bdf425ed-12cc-492c-8767-41d13a3b8b2c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.647966 Jul 20 04:21:53.226926 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 984/1895] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:21:52 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:53.232676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.233502 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.241195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-24f21b06-0ab1-4a05-afe7-249c9bc23ca2 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b/action" status: 202 len: 0 microversion: 2.25 time: 2.750456 Jul 20 04:21:53.242465 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 912/1896] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:21:50 2022] POST /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b/action => generated 0 bytes in 2752 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:53.257693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.261654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.291084 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.292922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.296131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.297215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.297776 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.305464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.306577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.308855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.455608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddd38a0cc0542829a5902490604063f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0edfeefaa7143868c28d82d07548ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.480947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de96f603-91b9-4e0f-bfec-f71faefe4098 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 200 len: 1499 microversion: 2.1 time: 0.233248 Jul 20 04:21:53.483375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 913/1897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 1499 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:53.488438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.489230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 24a4b61b-c809-46e8-b128-1fcf432a32df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.505236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.505703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.507229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.507672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.523276 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] HTTP exception thrown: Instance 24a4b61b-c809-46e8-b128-1fcf432a32df could not be found. Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Request method failure captured: Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df HTTP/1.1 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E9nj-pyFr_NfcW4ncFdMIGmV0seCU-0QwUV-XhQjiLBjjKtr9_ofA21gCMXv3q5XbC7QFVdk8uqh7Cb4ppd8g6fcACBrHp3qsf4BViCRPToTp_1lwb9WzkXmRydh-1t6hthwFYrkBs034cfDCqOEfTEL0zP3wnFyOLKo_4QF2X7Z8 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:21:53.524872 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_05d93c82e5c5467693db0e5f8d95d202", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationTest-426204656 Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationTest-426204656-project Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: ab72bd0852ad4f72a0c96a7ddf1bdd63 Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationTest-426204656-project Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 24a4b61b-c809-46e8-b128-1fcf432a32df could not be found. Jul 20 04:21:53.526626 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '24a4b61b-c809-46e8-b128-1fcf432a32df'} Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a4b61b-c809-46e8-b128-1fcf432a32df could not be found. Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:53.527481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a4b61b-c809-46e8-b128-1fcf432a32df could not be found. Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a4b61b-c809-46e8-b128-1fcf432a32df could not be found. Jul 20 04:21:53.529003 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:21:53.531462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Returning 404 to user: Instance 24a4b61b-c809-46e8-b128-1fcf432a32df could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:53.532594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc13485d-3926-4e2a-866b-b22dc7d9324f tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df" status: 404 len: 111 microversion: 2.1 time: 0.048053 Jul 20 04:21:53.533853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 914/1898] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/24a4b61b-c809-46e8-b128-1fcf432a32df => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:53.540896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.542474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.550410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.550858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.551631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.552067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.610847 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.626829 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5a2b04b0-6077-4d94-92c5-17fe518c27e6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1314 microversion: 2.1 time: 0.395362 Jul 20 04:21:53.627656 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 985/1899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:53.635181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.636197 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.643955 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.644446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.645390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.645986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.814441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.827290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-455ed2c1-3c9b-4d79-92dd-ee918f524cbc tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.287458 Jul 20 04:21:53.827957 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 915/1900] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:53.839447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b77fa2d8-63f9-4d0a-82dc-c85d732b584f req-1f52c818-504d-4dfa-99d9-4e84d9ae49e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4b61b-c809-46e8-b128-1fcf432a32df", "name": "network-vif-deleted", "tag": "f56afe8b-d5c0-4caf-9222-c0075402d689"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:53.861094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b77fa2d8-63f9-4d0a-82dc-c85d732b584f req-1f52c818-504d-4dfa-99d9-4e84d9ae49e2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.863061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b77fa2d8-63f9-4d0a-82dc-c85d732b584f req-1f52c818-504d-4dfa-99d9-4e84d9ae49e2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.886894 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b77fa2d8-63f9-4d0a-82dc-c85d732b584f req-1f52c818-504d-4dfa-99d9-4e84d9ae49e2 service nova] Creating event network-vif-deleted:f56afe8b-d5c0-4caf-9222-c0075402d689 for instance 24a4b61b-c809-46e8-b128-1fcf432a32df on n-h2-764486-11 Jul 20 04:21:53.897508 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b77fa2d8-63f9-4d0a-82dc-c85d732b584f req-1f52c818-504d-4dfa-99d9-4e84d9ae49e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061606 Jul 20 04:21:53.898149 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 916/1901] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:53.911400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26340eaa-0e9f-4d2e-9093-642b7daed8ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f839cef8280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1709532945", "description": "tempest-description-985545001"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:53.946034 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:53.954192 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d6a899f2-ff92-4301-8f3e-be7969afef3c tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.324041 Jul 20 04:21:53.957233 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 986/1902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:53.962737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:53.963411 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:53.982200 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.983761 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:53.985600 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:53.987599 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.242254 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26340eaa-0e9f-4d2e-9093-642b7daed8ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.341780 Jul 20 04:21:54.242992 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 917/1903] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:54.254091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00beab91-4305-4119-b17b-d038cd8ecf0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '.version_select at 0x7f839cea9940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.262424 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:54.272414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:54.274016 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:54.280013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00beab91-4305-4119-b17b-d038cd8ecf0a tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523111020" status: 202 len: 0 microversion: 2.1 time: 0.029735 Jul 20 04:21:54.282040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 918/1904] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:21:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523111020 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:21:54.285476 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-92ca9532-ab1c-4413-84e1-1ddf61653d34 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.326132 Jul 20 04:21:54.286076 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 987/1905] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:53 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:54.289857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.291025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:54.298264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.299084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.300197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.300977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.304983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-1b503de1-a489-4c81-b851-9b99eb0dc025 req-4f3b8181-020c-4aa8-be07-edd519507ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038f9610-51d2-4bb3-a7eb-984aabb0f873", "name": "network-vif-plugged", "status": "completed", "tag": "2fe4e06a-4044-4e69-9ccc-67dd8ee0db7d"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:54.325610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-1b503de1-a489-4c81-b851-9b99eb0dc025 req-4f3b8181-020c-4aa8-be07-edd519507ac8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.326140 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-1b503de1-a489-4c81-b851-9b99eb0dc025 req-4f3b8181-020c-4aa8-be07-edd519507ac8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.354035 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-1b503de1-a489-4c81-b851-9b99eb0dc025 req-4f3b8181-020c-4aa8-be07-edd519507ac8 service nova] Creating event network-vif-plugged:2fe4e06a-4044-4e69-9ccc-67dd8ee0db7d for instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 on n-h2-764486-11 Jul 20 04:21:54.361085 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-1b503de1-a489-4c81-b851-9b99eb0dc025 req-4f3b8181-020c-4aa8-be07-edd519507ac8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061719 Jul 20 04:21:54.362593 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 988/1906] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:54.372241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d134cd18-9247-46a2-997f-045f2e3fcada tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f838b85f820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1612997694", "description": "tempest-description-423602719"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:54.561881 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d134cd18-9247-46a2-997f-045f2e3fcada tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.197667 Jul 20 04:21:54.563562 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 989/1907] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:21:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:54.571285 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.572483 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] [instance: dd104a82-0c3a-45a4-9e70-b234e7410953] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:54.592883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.596202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.617278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.617972 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.634788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:54.657051 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c107078a-7a39-4728-b97c-9cda421a0248 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.373180 Jul 20 04:21:54.661564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 919/1908] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:54.668321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:54.669006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:54.676085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:54.677719 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] HTTP exception thrown: Instance dd104a82-0c3a-45a4-9e70-b234e7410953 could not be found. Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Request method failure captured: Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 HTTP/1.1 Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdMPa-CYXRU96GpIOY2cv--Z68SlDb727ywEIuz2LjqhHXDUOqaXXsSMoE0x9VbowwMzdrL4hioKZ8aKl8lcQLf3-ZhlJe1zcJeX6MW4x6PvGUtMLPI__fqu5wC7llytufXdO51D0cvcwDaPbCTLuY8kiLgyBamBP6lIFNEZLHS_M Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:21:54.679587 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0edfeefaa7143868c28d82d07548ba5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0edfeefaa7143868c28d82d07548ba5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: e0edfeefaa7143868c28d82d07548ba5 Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: cddd38a0cc0542829a5902490604063f Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance dd104a82-0c3a-45a4-9e70-b234e7410953 could not be found. Jul 20 04:21:54.681219 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'dd104a82-0c3a-45a4-9e70-b234e7410953'} Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd104a82-0c3a-45a4-9e70-b234e7410953 could not be found. Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:21:54.686159 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd104a82-0c3a-45a4-9e70-b234e7410953 could not be found. Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd104a82-0c3a-45a4-9e70-b234e7410953 could not be found. Jul 20 04:21:54.687983 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:21:54.689969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] Returning 404 to user: Instance dd104a82-0c3a-45a4-9e70-b234e7410953 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:21:54.689969 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e31d9a13-1f69-4e69-bc9b-68b9a9573df5 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307 tempest-FloatingIPsAssociationNegativeTestJSON-1431239307-project] 10.222.0.49 "GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953" status: 404 len: 111 microversion: 2.1 time: 0.116119 Jul 20 04:21:54.690171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.690171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.690171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:54.690171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:54.691349 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 990/1909] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/servers/dd104a82-0c3a-45a4-9e70-b234e7410953 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:21:54.715652 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1630650618", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "21bfc5f4-6e35-462a-9812-b73df38b7e96"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:54.777790 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] validate_networks() for [('21bfc5f4-6e35-462a-9812-b73df38b7e96', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:21:55.036633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.045064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a4f11ce-e53d-4b0b-946b-d3335de1e5b0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1314 microversion: 2.1 time: 0.380491 Jul 20 04:21:55.055746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 920/1910] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:54 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:55.063029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.063923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.072226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.072952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.073908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.074501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.288522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.297828 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59ee9aa4-5865-4a0b-83bf-21be3fb1cb0d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.240582 Jul 20 04:21:55.308755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 921/1911] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:55.313810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.314618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.321676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.322377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.323324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.323945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.558663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.568521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-549fa103-8462-4319-8d02-0d1ae325b018 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.258278 Jul 20 04:21:55.569126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 922/1912] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:55.574543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.575224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.583106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.583558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.584966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.585409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.761026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.763510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:21:55.770917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.773215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:55.774494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e0137c4-fd72-4c2b-836d-159b3c6b150f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.203885 Jul 20 04:21:55.775171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 923/1913] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:55.783625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.784696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.792800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.793401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.794308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.794848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.822140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:21:55.845662 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:21:55.846653 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:21:55.847963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:21:55.848724 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:21:55.849326 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:21:55.865185 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.865774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.867011 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.867647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.904649 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Getting quotas for project 268aab5272cd47eb9457788b975f4f16. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:21:55.910645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Getting quotas for user 205f260c33ea4f0c8bf7f77c949073a4 and project 268aab5272cd47eb9457788b975f4f16. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:21:55.923232 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccd4dff0-baca-4888-abb6-306c80429748 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 204 len: 0 microversion: 2.1 time: 0.144938 Jul 20 04:21:55.924125 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 924/1914] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:21:55 2022] DELETE /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:21:55.928158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:21:55.931043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:21:55.931401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:55.932525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:55.939380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.941622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:55.943104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:55.944387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.007694 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-a9d3b1e7-32c9-4de7-ae5d-cc179ea6edf2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295787 Jul 20 04:21:56.013844 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 991/1915] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:21:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:21:56.025753 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-94f11c54-7433-49a8-b8e8-6ea3a10aa220 req-9c6fb24d-0f97-4b76-af12-a0260185babf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd104a82-0c3a-45a4-9e70-b234e7410953", "name": "network-vif-deleted", "tag": "4e39f8f7-9c65-447b-81f8-864ffaf8fa5e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:56.049959 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-94f11c54-7433-49a8-b8e8-6ea3a10aa220 req-9c6fb24d-0f97-4b76-af12-a0260185babf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.050496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-94f11c54-7433-49a8-b8e8-6ea3a10aa220 req-9c6fb24d-0f97-4b76-af12-a0260185babf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.081381 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-94f11c54-7433-49a8-b8e8-6ea3a10aa220 req-9c6fb24d-0f97-4b76-af12-a0260185babf service nova] Creating event network-vif-deleted:4e39f8f7-9c65-447b-81f8-864ffaf8fa5e for instance dd104a82-0c3a-45a4-9e70-b234e7410953 on n-h1-764486-11 Jul 20 04:21:56.093076 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-94f11c54-7433-49a8-b8e8-6ea3a10aa220 req-9c6fb24d-0f97-4b76-af12-a0260185babf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076491 Jul 20 04:21:56.095290 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 992/1916] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:56.107758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.111689 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.128424 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.128950 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.130022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.130340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.230971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.240479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc63b2c6-9a90-4cea-aa10-778721e7ca0c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.313916 Jul 20 04:21:56.242256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 925/1917] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:55 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:56.248940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89e39803-a25e-492b-b570-da91655725bb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.249845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89e39803-a25e-492b-b570-da91655725bb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.352764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89e39803-a25e-492b-b570-da91655725bb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.361213 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89e39803-a25e-492b-b570-da91655725bb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1216 microversion: 2.1 time: 0.116143 Jul 20 04:21:56.362442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 926/1918] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:56.367805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.368570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.379311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.382581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.386069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.386701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.535442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.546931 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-003ede8b-3005-4dc4-ae6c-ec1fa67a5a10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1464 microversion: 2.1 time: 0.182782 Jul 20 04:21:56.547880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 927/1919] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1464 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:56.554113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.554873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.562176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.562620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.563401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.563835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.728229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.749564 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dca66d17-c5a5-4819-a8c3-be42fd8c1971 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1484 microversion: 2.1 time: 0.644027 Jul 20 04:21:56.749929 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 993/1920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1484 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:56.758610 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-3f911e69-f78e-46bc-bdf1-980f9c0442b2 req-42e32800-fb4a-4a62-9994-bf649e64d507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81420b50-7a17-416b-b1af-b84345fc990b", "name": "network-vif-plugged", "status": "completed", "tag": "9d69e619-a96f-444f-97e6-d031220ad912"}, {"server_uuid": "e43e41b7-9185-40e1-8218-d6605e3ff7aa", "name": "network-vif-plugged", "status": "completed", "tag": "3e67bc78-6d25-47d0-89c9-a390001a525c"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:56.761045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:56.771001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-250100b3-3d7f-4261-acba-b244c13ca167 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.221233 Jul 20 04:21:56.776426 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 928/1921] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:56.784127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3f911e69-f78e-46bc-bdf1-980f9c0442b2 req-42e32800-fb4a-4a62-9994-bf649e64d507 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.788624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-3f911e69-f78e-46bc-bdf1-980f9c0442b2 req-42e32800-fb4a-4a62-9994-bf649e64d507 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.815477 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3f911e69-f78e-46bc-bdf1-980f9c0442b2 req-42e32800-fb4a-4a62-9994-bf649e64d507 service nova] Creating event network-vif-plugged:9d69e619-a96f-444f-97e6-d031220ad912 for instance 81420b50-7a17-416b-b1af-b84345fc990b on n-h1-764486-11 Jul 20 04:21:56.816177 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-3f911e69-f78e-46bc-bdf1-980f9c0442b2 req-42e32800-fb4a-4a62-9994-bf649e64d507 service nova] Creating event network-vif-plugged:3e67bc78-6d25-47d0-89c9-a390001a525c for instance e43e41b7-9185-40e1-8218-d6605e3ff7aa on n-h1-764486-11 Jul 20 04:21:56.826924 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-3f911e69-f78e-46bc-bdf1-980f9c0442b2 req-42e32800-fb4a-4a62-9994-bf649e64d507 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075560 Jul 20 04:21:56.828080 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 994/1922] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:56.836822 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.837758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:56.844978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.846022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.847867 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.848534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.967873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:56.971675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'deleted': False, 'project_id': '0a04668e755b457f9c3ef49d04be6adc'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:56.995509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.996227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:56.998091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:56.998745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.198014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ac7d39e-27d9-413e-88f3-86d058fb1609 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.425009 Jul 20 04:21:57.198686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 929/1923] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:21:57.214283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:57.214936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:57.223019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.224076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.226374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.227116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.285477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:57.299205 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7ef64d45-f79a-4f56-81d0-9be5f1b7345e tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.468733 Jul 20 04:21:57.308862 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 995/1924] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:56 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:57.308862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:57.311137 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'deleted': False} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:57.320608 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.321363 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.322186 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.322620 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:57.580882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.multi_cell_list [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=123723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:21:57.881835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:57.882543 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.035435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.045394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.056405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.061401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fd4e6e9-cad0-4142-b969-1333bb0f2f78 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.861567 Jul 20 04:21:58.064602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 930/1925] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:57 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:58.072183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.078079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.092147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.092854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.094013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.094617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.359441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.368766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-43dd5ac3-e5d2-4c5c-8748-2d271aff1ad9 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1315 microversion: 2.1 time: 0.302838 Jul 20 04:21:58.369360 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 931/1926] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:58.394692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.395300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.412393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.412916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.413702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.414137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.697286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.707706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ec558d7-4a34-4560-a855-1a04d19dccbb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1274 microversion: 2.1 time: 0.317421 Jul 20 04:21:58.709074 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 932/1927] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1274 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:58.714110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0ee2922a-bd79-4991-a548-1a74c2518e6c req-38f829fe-a008-4ab6-a73d-19a16bf85b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2215a044-6be8-4af3-810e-76862c594dd2", "name": "network-vif-deleted", "tag": "dd47674e-ff11-45c0-9804-2c6b2eb82b22"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:21:58.724862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0ee2922a-bd79-4991-a548-1a74c2518e6c req-38f829fe-a008-4ab6-a73d-19a16bf85b0e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.725933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0ee2922a-bd79-4991-a548-1a74c2518e6c req-38f829fe-a008-4ab6-a73d-19a16bf85b0e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.739429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0ee2922a-bd79-4991-a548-1a74c2518e6c req-38f829fe-a008-4ab6-a73d-19a16bf85b0e service nova] Creating event network-vif-deleted:dd47674e-ff11-45c0-9804-2c6b2eb82b22 for instance 2215a044-6be8-4af3-810e-76862c594dd2 on n-h1-764486-11 Jul 20 04:21:58.745874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0ee2922a-bd79-4991-a548-1a74c2518e6c req-38f829fe-a008-4ab6-a73d-19a16bf85b0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035320 Jul 20 04:21:58.747298 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 933/1928] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:21:58.754420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.755350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.767203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.767654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.768470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.768888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.840976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.841432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.841936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lazy-loading 'fault' on Instance uuid 2215a044-6be8-4af3-810e-76862c594dd2 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:21:58.935164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:58.947099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8decf78-db98-4c62-83c2-a09d7a39e331 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 200 len: 1301 microversion: 2.1 time: 0.198325 Jul 20 04:21:58.949251 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 934/1929] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 1301 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:58.958173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:58.958173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:58.967610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.968307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:58.969412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:58.970153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.253946 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2421a6ac-20ce-44a4-b1ea-4654e8945852 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22355 microversion: 2.1 time: 1.952932 Jul 20 04:21:59.265453 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 996/1930] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Jul 20 04:21:57 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22355 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:21:59.294233 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.295592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.305361 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.306254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.307317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.308153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.346971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.363217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2cb9525e-6a10-4aca-b396-30f39ab6bf7b tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.408967 Jul 20 04:21:59.363845 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 935/1931] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:58 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:59.380453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.380453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.388824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.389756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.390861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.391343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.662630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.686056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.689904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.694947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23fdf72d-5c99-4aac-931a-a5fa3d3bca90 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.327645 Jul 20 04:21:59.696305 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 936/1932] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:21:59.708546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.718759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'deleted': False, 'project_id': '0a04668e755b457f9c3ef49d04be6adc'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:21:59.734163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.736833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.738326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.739042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.760267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:21:59.771855 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4b8c21e7-5773-4fc3-92cc-50c699f98111 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1325 microversion: 2.1 time: 0.494593 Jul 20 04:21:59.776248 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 997/1933] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1325 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:21:59.782129 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.783149 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.806774 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.807673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.809922 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.810782 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.879565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6855d2c-f2c8-4e40-860a-777d5fc3b246 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?tenant_id=b1aabe9c1e484ea8ae0ca07bfc093c88" status: 200 len: 15 microversion: 2.1 time: 0.177200 Jul 20 04:21:59.885543 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 937/1934] 10.222.0.49 () {58 vars in 1230 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/detail?tenant_id=b1aabe9c1e484ea8ae0ca07bfc093c88 => generated 15 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:21:59.928365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:21:59.930988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:21:59.968438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.970199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:21:59.971053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:21:59.971493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.228145 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:00.236226 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-2610d354-9d79-4286-8f32-435f85ad4055 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1501 microversion: 2.1 time: 0.458534 Jul 20 04:22:00.250604 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 998/1935] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:00.258133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.266041 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'tenant_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'deleted': False} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:00.281543 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:00.286147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.287465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.291631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.292203 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.364173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:00.367404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.multi_cell_list [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:00.375641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21bd7e96-d15d-498d-86e0-c5e39f7e1969 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.487487 Jul 20 04:22:00.393553 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 938/1936] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:21:59 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:00.399643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.400257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 2215a044-6be8-4af3-810e-76862c594dd2] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:00.418734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.419187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.419974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.420437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.449263 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] HTTP exception thrown: Instance 2215a044-6be8-4af3-810e-76862c594dd2 could not be found. Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Request method failure captured: Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 HTTP/1.1 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14E9nj-pyFr_NfcW4ncFdMIGmV0seCU-0QwUV-XhQjiLBjjKtr9_ofA21gCMXv3q5XbC7QFVdk8uqh7Cb4ppd8g6fcACBrHp3qsf4BViCRPToTp_1lwb9WzkXmRydh-1t6hthwFYrkBs034cfDCqOEfTEL0zP3wnFyOLKo_4QF2X7Z8 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:00.455872 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_05d93c82e5c5467693db0e5f8d95d202", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationTest-426204656 Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationTest-426204656-project Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: ab72bd0852ad4f72a0c96a7ddf1bdd63 Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationTest-426204656-project Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2215a044-6be8-4af3-810e-76862c594dd2 could not be found. Jul 20 04:22:00.457481 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2215a044-6be8-4af3-810e-76862c594dd2'} Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2215a044-6be8-4af3-810e-76862c594dd2 could not be found. Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:00.458340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2215a044-6be8-4af3-810e-76862c594dd2 could not be found. Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2215a044-6be8-4af3-810e-76862c594dd2 could not be found. Jul 20 04:22:00.461479 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:00.463532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Returning 404 to user: Instance 2215a044-6be8-4af3-810e-76862c594dd2 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:00.463532 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa785d9b-dfb6-450b-b754-2e59b74c7486 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2" status: 404 len: 111 microversion: 2.1 time: 0.062443 Jul 20 04:22:00.463532 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 939/1937] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:00 2022] GET /compute/v2.1/servers/2215a044-6be8-4af3-810e-76862c594dd2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:00.469535 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.482388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1524d85-86d3-4bea-b1a7-7d098d7e35a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:00.486290 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.504111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1524d85-86d3-4bea-b1a7-7d098d7e35a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.504872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1524d85-86d3-4bea-b1a7-7d098d7e35a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.617048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b1524d85-86d3-4bea-b1a7-7d098d7e35a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:22:00.694294 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1524d85-86d3-4bea-b1a7-7d098d7e35a6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b/action" status: 202 len: 0 microversion: 2.1 time: 0.215456 Jul 20 04:22:00.695190 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 940/1938] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:00 2022] POST /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:00.702245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.703041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:00.713653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.714323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.715124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.715602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.747799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:00.776555 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5207017d-2d84-4ce6-9b31-ed035b196ff2 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b1aabe9c1e484ea8ae0ca07bfc093c88" status: 200 len: 4833 microversion: 2.1 time: 0.524388 Jul 20 04:22:00.777209 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 999/1939] 10.222.0.49 () {58 vars in 1256 bytes} [Wed Jul 20 04:22:00 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b1aabe9c1e484ea8ae0ca07bfc093c88 => generated 4833 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:00.784115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:00.784989 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:00.793818 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.794773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.795733 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:00.809181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:00.874194 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:01.019044 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-61f80c99-1f13-4837-859a-9dd6dbd2ccda tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 204 len: 0 microversion: 2.1 time: 0.240138 Jul 20 04:22:01.019657 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1000/1940] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:00 2022] DELETE /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:01.041072 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.041884 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.049357 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.049808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.050584 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.051295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.131353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.141057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2da426d-a362-419f-8845-c8263ea71db3 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.444259 Jul 20 04:22:01.144024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 941/1941] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:00 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.156803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.157332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.167909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.170460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.171565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.172035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.308128 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.318580 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ee2aaa52-27a3-47f2-8b38-4a25fb23da60 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.293445 Jul 20 04:22:01.319176 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1001/1942] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.323977 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.325082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.338390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.341161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.344074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.345817 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.527141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.535552 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-44bbb0db-833b-4bf5-b4e9-3c24b6837b37 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1522 microversion: 2.1 time: 0.215192 Jul 20 04:22:01.536127 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1002/1943] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.541616 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.547699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.558146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'tenant_id': '0a04668e755b457f9c3ef49d04be6adc', 'deleted': False} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:01.558405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.559969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.561848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39891088-a9a7-42ed-8e0f-76f72a65964c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.414037 Jul 20 04:22:01.562950 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 942/1944] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:01.565198 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.565832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.566799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.567725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-96eac274-b09b-45a3-940f-2db714364703 req-56da5f83-3f93-4da4-9d4c-267493571a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ce279b-8d08-4796-a5ae-83d15bc2e699", "tag": "812417e5-db95-4a85-b021-5a50d916cd35"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:01.567994 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.576087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-96eac274-b09b-45a3-940f-2db714364703 req-56da5f83-3f93-4da4-9d4c-267493571a2a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.576583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-96eac274-b09b-45a3-940f-2db714364703 req-56da5f83-3f93-4da4-9d4c-267493571a2a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.590037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-96eac274-b09b-45a3-940f-2db714364703 req-56da5f83-3f93-4da4-9d4c-267493571a2a service nova] Creating event network-changed:812417e5-db95-4a85-b021-5a50d916cd35 for instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 on n-h2-764486-11 Jul 20 04:22:01.598100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-96eac274-b09b-45a3-940f-2db714364703 req-56da5f83-3f93-4da4-9d4c-267493571a2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Jul 20 04:22:01.600017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 943/1945] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:01.606676 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-09c927a8-3d3d-4e56-99e6-39fe796b9af8 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0a04668e755b457f9c3ef49d04be6adc" status: 200 len: 15 microversion: 2.1 time: 0.068459 Jul 20 04:22:01.607982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.608879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.616165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.616690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.617613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.618821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.627734 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1003/1946] 10.222.0.49 () {58 vars in 1256 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0a04668e755b457f9c3ef49d04be6adc => generated 15 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:01.637324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.639378 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.652177 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.660943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.660943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.660943 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.832365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:01.841560 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-679c47f7-f462-4bc5-90f7-d01a7562761b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.212112 Jul 20 04:22:01.842243 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1004/1947] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:01.855678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.856262 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.862257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.862803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.863647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.864179 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.888408 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] HTTP exception thrown: Instance is not a member of specified network Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Request method failure captured: Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa/ips/invalid HTTP/1.1 Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14LOXAWiIOHb3_mR9b5oy1RJ2IvIEpB9tYnZ_y2goG9p7YCJFjHXge6Ox2uK2x0yJ5tq_RKtxDDqqpKjqFMemk-0--agFXTPw_Qn6riNhg3trAiL_JVBMSKtN6w95WHoEcEEAXvDwSbQ11ebKmtZyT2Zb_yDYAqIWqISwH4Yd-X_tWE Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 34fcbc6e6a954e988b8af3a1e3180585 Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:01.890197 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34fcbc6e6a954e988b8af3a1e3180585", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 34fcbc6e6a954e988b8af3a1e3180585 Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServerAddressesNegativeTestJSON-1370452660-project Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 2c2369cecdbb4a33b703b111245ba7f8 Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1370452660-project Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance is not a member of specified network Jul 20 04:22:01.892060 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'server_id': 'e43e41b7-9185-40e1-8218-d6605e3ff7aa', 'id': 'invalid'} Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 20 04:22:01.893132 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.894938 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Returning 404 to user: Instance is not a member of specified network {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:01.894938 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-be18c810-ed74-454f-8c98-6196522521e7 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.040889 Jul 20 04:22:01.894938 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1005/1948] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa/ips/invalid => generated 91 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:01.901960 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9cdb3f63-0a1f-4bb1-ba02-2ead99e785b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.906166 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9cdb3f63-0a1f-4bb1-ba02-2ead99e785b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010130 Jul 20 04:22:01.907017 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1006/1949] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:01.912525 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7acfae8e-f41a-4473-b055-18946998a92a tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:01.913229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7acfae8e-f41a-4473-b055-18946998a92a tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Failed to fetch instance by id 999 {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:22:01.913952 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-7acfae8e-f41a-4473-b055-18946998a92a tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7acfae8e-f41a-4473-b055-18946998a92a tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Request method failure captured: Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14LOXAWiIOHb3_mR9b5oy1RJ2IvIEpB9tYnZ_y2goG9p7YCJFjHXge6Ox2uK2x0yJ5tq_RKtxDDqqpKjqFMemk-0--agFXTPw_Qn6riNhg3trAiL_JVBMSKtN6w95WHoEcEEAXvDwSbQ11ebKmtZyT2Zb_yDYAqIWqISwH4Yd-X_tWE Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 34fcbc6e6a954e988b8af3a1e3180585 Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:01.915591 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34fcbc6e6a954e988b8af3a1e3180585", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 34fcbc6e6a954e988b8af3a1e3180585 Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServerAddressesNegativeTestJSON-1370452660-project Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 2c2369cecdbb4a33b703b111245ba7f8 Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1370452660-project Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 999 could not be found. Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'server_id': '999'} Jul 20 04:22:01.917141 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:01.918144 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7acfae8e-f41a-4473-b055-18946998a92a tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Returning 404 to user: Instance 999 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7acfae8e-f41a-4473-b055-18946998a92a tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009579 Jul 20 04:22:01.920696 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1007/1950] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:22:01.930646 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:01.931741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:01.939534 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.939981 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.940789 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:01.941229 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:01.995951 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:02.076412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.094072 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9574f09-2126-4dfd-b895-ff3544f24a92 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1498 microversion: 2.1 time: 0.491740 Jul 20 04:22:02.107487 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 944/1951] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:01 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1498 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:02.108562 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7de16550-0c05-40b3-bf7b-001398d37be4 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 0 microversion: 2.1 time: 0.182553 Jul 20 04:22:02.109434 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1008/1952] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:01 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:02.115493 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.119402 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.120105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.125733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.127030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:02.128241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.128746 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.129820 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.131022 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.138640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.139282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.140242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.140817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.165858 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:02.269281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:02.334654 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-763779a5-ab47-465f-b2a5-26a8c6114188 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 204 len: 0 microversion: 2.1 time: 0.223443 Jul 20 04:22:02.335395 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1009/1953] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:02 2022] DELETE /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:02.342427 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.343234 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.350471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.351071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.352063 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.352688 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.424878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3446d6f-78a3-4a11-82f8-1e08f99e73e2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.302418 Jul 20 04:22:02.425504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 945/1954] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:02.435993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cfec21df-9019-43bc-bcbe-ee1cf0319930 req-f3d426a0-67b5-44fc-ad3c-4d6c626c7d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d660a6-cb26-4977-b18f-dac4cd9ef224", "name": "network-vif-plugged", "status": "completed", "tag": "17918890-ee9f-42a0-ac70-9a12ace38c7b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:02.467758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cfec21df-9019-43bc-bcbe-ee1cf0319930 req-f3d426a0-67b5-44fc-ad3c-4d6c626c7d15 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.468363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cfec21df-9019-43bc-bcbe-ee1cf0319930 req-f3d426a0-67b5-44fc-ad3c-4d6c626c7d15 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.485567 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cfec21df-9019-43bc-bcbe-ee1cf0319930 req-f3d426a0-67b5-44fc-ad3c-4d6c626c7d15 service nova] Creating event network-vif-plugged:17918890-ee9f-42a0-ac70-9a12ace38c7b for instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 on n-h1-764486-11 Jul 20 04:22:02.505936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cfec21df-9019-43bc-bcbe-ee1cf0319930 req-f3d426a0-67b5-44fc-ad3c-4d6c626c7d15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077180 Jul 20 04:22:02.508013 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 946/1955] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:02.518202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.520087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.533164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.544334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.546617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.547243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.663385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.680794 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7711a253-73cf-40a9-809e-8f11c39c770d tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.343902 Jul 20 04:22:02.682211 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1010/1956] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:02.689164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:02.693270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.694241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.699738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3647691e-f617-4b6b-90b9-f38feee636ad tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.189751 Jul 20 04:22:02.701040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 947/1957] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:02.705752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:02.706688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.714288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.714605 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.714721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.714845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.715508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.715943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.716089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.716557 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.830898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7dd47a4-66b5-434c-ba83-1e85b3c7afa1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 0 microversion: 2.1 time: 0.128295 Jul 20 04:22:02.834558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 948/1958] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:02 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:02.839618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:02.840823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:02.848442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.849644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:02.850426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:02.851001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.004030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.013573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.022978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.023297 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-da39fe85-98b1-433c-aaf1-43111005adb5 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1528 microversion: 2.1 time: 0.337291 Jul 20 04:22:03.024341 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1011/1959] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1528 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.028442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.030272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d68f2714-45f1-4ae8-a8e9-9e8df1dda267 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.194353 Jul 20 04:22:03.031036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 949/1960] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:02 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:03.037087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.037686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.038477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.039334 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.045329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.045772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.046548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.046972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.066070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.066674 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.069130 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.073107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.265361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.276712 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93f5ec76-270b-42cc-99a8-ac7cd37e755b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.244434 Jul 20 04:22:03.287014 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 950/1961] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.292618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.293235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.294516 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e85ec930-1513-4f0f-a568-e40c081497cb tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1617 microversion: 2.1 time: 0.267323 Jul 20 04:22:03.296848 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1012/1962] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1617 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.303187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.303635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.308867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.309453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.320486 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.321395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.328814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.329386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.330400 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.331132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.442888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab72bd0852ad4f72a0c96a7ddf1bdd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d93c82e5c5467693db0e5f8d95d202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.454301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eec555f2-7b98-4a89-b4f7-88d6288da199 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 200 len: 1456 microversion: 2.1 time: 0.165532 Jul 20 04:22:03.455537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 951/1963] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.569518 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-18208fdb-3e6b-4323-a3a2-a117cd52e319 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1617 microversion: 2.1 time: 0.258881 Jul 20 04:22:03.570232 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1013/1964] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1617 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.585720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.590612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'host': 'n-h2-764486-11', 'deleted': False} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:03.593075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:03.597512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.598209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.599774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.600254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.626204 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-304e8f04-7efe-4d18-be97-0c4c07486d80 req-ef9f6c38-3a78-413d-9cff-02290ab5e31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a97a688-e2f9-48fe-8a35-cac05b5a9dfd", "name": "network-vif-deleted", "tag": "8778c0bb-598f-42c2-9839-926c9d7f74e1"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:03.652269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-304e8f04-7efe-4d18-be97-0c4c07486d80 req-ef9f6c38-3a78-413d-9cff-02290ab5e31a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.652765 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-304e8f04-7efe-4d18-be97-0c4c07486d80 req-ef9f6c38-3a78-413d-9cff-02290ab5e31a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.678672 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-304e8f04-7efe-4d18-be97-0c4c07486d80 req-ef9f6c38-3a78-413d-9cff-02290ab5e31a service nova] Creating event network-vif-deleted:8778c0bb-598f-42c2-9839-926c9d7f74e1 for instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd on n-h1-764486-11 Jul 20 04:22:03.689747 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-304e8f04-7efe-4d18-be97-0c4c07486d80 req-ef9f6c38-3a78-413d-9cff-02290ab5e31a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070246 Jul 20 04:22:03.690798 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1014/1965] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:03.730087 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.731294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:22:03.740963 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.759414 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.762742 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.763811 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.764257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.834144 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9c67bc2-a055-41a3-927c-d832abdf92b1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=n-h2-764486-11&all_tenants=1" status: 200 len: 1990 microversion: 2.1 time: 0.251430 Jul 20 04:22:03.835024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 952/1966] 10.222.0.49 () {58 vars in 1191 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers?host=n-h2-764486-11&all_tenants=1 => generated 1990 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:03.845242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.845858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:03.853447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.853906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.854672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.855296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.937548 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:03.946257 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-475c72d0-449d-4702-8c6f-25bb431ff5be tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.233167 Jul 20 04:22:03.956115 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1015/1967] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:03.961237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:03.966126 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=123723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:22:03.971152 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.971591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:03.972403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:03.973024 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.062314 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-23cacac5-2a96-426e-ae95-ff4beac15d6f tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.105018 Jul 20 04:22:04.063520 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1016/1968] 10.222.0.49 () {58 vars in 1195 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:04.073905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.074583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.081337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.081786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.082567 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.082990 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.166511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.174997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acd2bca7-2bca-4400-96f5-c5a07e7fa176 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.336097 Jul 20 04:22:04.179185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 953/1969] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:03 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:04.185304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.189030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.205501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.205953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.206743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.207185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.285678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.297533 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8ad1dd80-b4d7-4545-93d1-8e70e99871a1 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1528 microversion: 2.1 time: 0.232787 Jul 20 04:22:04.298727 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1017/1970] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1528 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:04.304156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:04.305189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.314391 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.314845 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.316219 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.316219 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.489107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.505193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.509615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:04.511851 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8da6ae1e-9192-4576-90da-6193288dda07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.330402 Jul 20 04:22:04.513583 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 954/1971] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:04.519298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.541958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.565534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.566149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.567043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.568512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.633595 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-623bbe4b-2981-48c8-9bd1-84e301305a20 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 0 microversion: 2.1 time: 0.333249 Jul 20 04:22:04.638198 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1018/1972] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:04 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:04.643879 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:04.644580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] [instance: 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.651701 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.652151 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.653092 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.653579 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.669525 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] HTTP exception thrown: Instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd could not be found. Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Request method failure captured: Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd HTTP/1.1 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14E9nj-pyFr_NfcW4ncFdMIGmV0seCU-0QwUV-XhQjiLBjjKtr9_ofA21gCMXv3q5XbC7QFVdk8uqh7Cb4ppd8g6fcACBrHp3qsf4BViCRPToTp_1lwb9WzkXmRydh-1t6hthwFYrkBs034cfDCqOEfTEL0zP3wnFyOLKo_4QF2X7Z8 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:04.671252 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/05d93c82e5c5467693db0e5f8d95d202"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_05d93c82e5c5467693db0e5f8d95d202", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-LiveMigrationTest-426204656 Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 05d93c82e5c5467693db0e5f8d95d202 Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-LiveMigrationTest-426204656 Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-LiveMigrationTest-426204656-project Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: ab72bd0852ad4f72a0c96a7ddf1bdd63 Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-LiveMigrationTest-426204656-project Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd could not be found. Jul 20 04:22:04.673091 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '1a97a688-e2f9-48fe-8a35-cac05b5a9dfd'} Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd could not be found. Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:04.674092 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd could not be found. Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd could not be found. Jul 20 04:22:04.675954 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:04.678061 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] Returning 404 to user: Instance 1a97a688-e2f9-48fe-8a35-cac05b5a9dfd could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:04.678061 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b6c48915-f7b4-4b63-9bc5-6a71537b0bf3 tempest-LiveMigrationTest-426204656 tempest-LiveMigrationTest-426204656-project] 10.222.0.49 "GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd" status: 404 len: 111 microversion: 2.1 time: 0.033646 Jul 20 04:22:04.678061 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1019/1973] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/1a97a688-e2f9-48fe-8a35-cac05b5a9dfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:04.678979 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-9d453025-35e9-4d49-9597-05af55aee7aa req-60ab0915-1770-45e5-9753-341c9360220f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d660a6-cb26-4977-b18f-dac4cd9ef224", "name": "network-vif-plugged", "status": "completed", "tag": "a302b796-8416-4169-8227-950eb5e5211e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:04.688645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-9d453025-35e9-4d49-9597-05af55aee7aa req-60ab0915-1770-45e5-9753-341c9360220f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.689499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-9d453025-35e9-4d49-9597-05af55aee7aa req-60ab0915-1770-45e5-9753-341c9360220f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.703659 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-9d453025-35e9-4d49-9597-05af55aee7aa req-60ab0915-1770-45e5-9753-341c9360220f service nova] Creating event network-vif-plugged:a302b796-8416-4169-8227-950eb5e5211e for instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 on n-h1-764486-11 Jul 20 04:22:04.709153 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-9d453025-35e9-4d49-9597-05af55aee7aa req-60ab0915-1770-45e5-9753-341c9360220f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034232 Jul 20 04:22:04.710303 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1020/1974] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:04.716914 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:04.718799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.727905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.728699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.729750 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.730356 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.829677 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:04.830505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:04.831150 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:04.831720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:04.832478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:04.923903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:04.940304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.942928 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:04.947505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:04.948656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.011727 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d966c342-7af7-4e50-a9c6-123a2effdd39 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 1068 microversion: 2.1 time: 0.299959 Jul 20 04:22:05.023169 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1021/1975] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:04 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 1068 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:22:05.032327 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.033529 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.042946 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.043393 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.044297 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.044766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.053277 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:05.307575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.321433 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-49958806-e1d8-47d6-a068-e7766d2fbc54 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.294224 Jul 20 04:22:05.323234 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1022/1976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.340632 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.341585 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.354712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.361170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.361788 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.362766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.364064 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.370333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59bcff86-4aae-418c-8134-f2cbb6501eb9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.855459 Jul 20 04:22:05.370976 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 955/1977] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:04 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.392645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.393265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.402870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.403223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.408794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.409277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.578625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.585696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:05.606211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc4e4cba-ccbd-4177-b1c1-6bb4c72b0f09 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.234097 Jul 20 04:22:05.606803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 956/1978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.618281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.618927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.627003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.627649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.628207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.628716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.700175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c2369cecdbb4a33b703b111245ba7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fcbc6e6a954e988b8af3a1e3180585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.710666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75182bd1-1e57-46c4-8124-172f439c300d tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 200 len: 1310 microversion: 2.1 time: 0.102742 Jul 20 04:22:05.711581 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 957/1979] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.731702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:05.733178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:05.741577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.742458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.743536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.744212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.885245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.894534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.896255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.897637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df99c9ed-4f02-4d07-8841-c48b1123d284 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.184674 Jul 20 04:22:05.898344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 958/1980] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:05.914185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-23d6ef95-8483-4ed1-b673-aa76e7c157d7 req-3bd7fddc-a03e-46be-9ec3-de3331d14100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43e41b7-9185-40e1-8218-d6605e3ff7aa", "name": "network-vif-deleted", "tag": "3e67bc78-6d25-47d0-89c9-a390001a525c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:05.915465 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:05.924857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-23d6ef95-8483-4ed1-b673-aa76e7c157d7 req-3bd7fddc-a03e-46be-9ec3-de3331d14100 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:05.925568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-23d6ef95-8483-4ed1-b673-aa76e7c157d7 req-3bd7fddc-a03e-46be-9ec3-de3331d14100 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:05.928917 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-200dec4d-06f2-4c14-8344-3265935a231b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.604479 Jul 20 04:22:05.932205 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1023/1981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:05 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:05.949392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-23d6ef95-8483-4ed1-b673-aa76e7c157d7 req-3bd7fddc-a03e-46be-9ec3-de3331d14100 service nova] Creating event network-vif-deleted:3e67bc78-6d25-47d0-89c9-a390001a525c for instance e43e41b7-9185-40e1-8218-d6605e3ff7aa on n-h1-764486-11 Jul 20 04:22:05.954794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-23d6ef95-8483-4ed1-b673-aa76e7c157d7 req-3bd7fddc-a03e-46be-9ec3-de3331d14100 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044480 Jul 20 04:22:05.955461 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 959/1982] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:06.339159 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.339782 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.345997 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.346458 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.347276 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.347900 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.385775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:06.390680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.391511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.410589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.411047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.412170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.412589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.615436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.632551 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e36be050-7feb-4a56-b221-28a3a68778ed tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.248930 Jul 20 04:22:06.646071 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 960/1983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:06.651169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51c7b86c-afee-464d-a666-97bf04dcf9cf tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b2f43a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.708434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51c7b86c-afee-464d-a666-97bf04dcf9cf tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/e97be782-5912-46ec-a349-21880b43dcf9" status: 200 len: 662 microversion: 2.1 time: 0.061068 Jul 20 04:22:06.709020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 961/1984] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/images/e97be782-5912-46ec-a349-21880b43dcf9 => generated 662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:06.716326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.717123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.731792 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.733633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.734388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.741893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.742769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.749862 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0acf3127-e57d-411a-9c7d-75c082b7f1b0 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1334 microversion: 2.1 time: 0.414465 Jul 20 04:22:06.750878 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1024/1985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1334 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:06.769209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-096f9b6e-ebcd-4e6b-af64-68d8a3abd1fb tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b87ce50>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.851000 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-096f9b6e-ebcd-4e6b-af64-68d8a3abd1fb tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/e97be782-5912-46ec-a349-21880b43dcf9" status: 200 len: 662 microversion: 2.1 time: 0.098048 Jul 20 04:22:06.851696 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1025/1986] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/images/e97be782-5912-46ec-a349-21880b43dcf9 => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:06.859902 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.860888 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] [instance: e43e41b7-9185-40e1-8218-d6605e3ff7aa] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.868595 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.869531 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.870656 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.871324 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.892093 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] HTTP exception thrown: Instance e43e41b7-9185-40e1-8218-d6605e3ff7aa could not be found. Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Request method failure captured: Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa HTTP/1.1 Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14LOXAWiIOHb3_mR9b5oy1RJ2IvIEpB9tYnZ_y2goG9p7YCJFjHXge6Ox2uK2x0yJ5tq_RKtxDDqqpKjqFMemk-0--agFXTPw_Qn6riNhg3trAiL_JVBMSKtN6w95WHoEcEEAXvDwSbQ11ebKmtZyT2Zb_yDYAqIWqISwH4Yd-X_tWE Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 34fcbc6e6a954e988b8af3a1e3180585 Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:06.895085 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34fcbc6e6a954e988b8af3a1e3180585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34fcbc6e6a954e988b8af3a1e3180585", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 34fcbc6e6a954e988b8af3a1e3180585 Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1370452660 Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServerAddressesNegativeTestJSON-1370452660-project Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 2c2369cecdbb4a33b703b111245ba7f8 Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1370452660-project Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance e43e41b7-9185-40e1-8218-d6605e3ff7aa could not be found. Jul 20 04:22:06.896854 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'e43e41b7-9185-40e1-8218-d6605e3ff7aa'} Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43e41b7-9185-40e1-8218-d6605e3ff7aa could not be found. Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:06.897697 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43e41b7-9185-40e1-8218-d6605e3ff7aa could not be found. Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43e41b7-9185-40e1-8218-d6605e3ff7aa could not be found. Jul 20 04:22:06.899509 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:06.905898 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] Returning 404 to user: Instance e43e41b7-9185-40e1-8218-d6605e3ff7aa could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:06.906828 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cfed2431-b1d1-49fc-b33f-02b57d33a6b6 tempest-ServerAddressesNegativeTestJSON-1370452660 tempest-ServerAddressesNegativeTestJSON-1370452660-project] 10.222.0.49 "GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa" status: 404 len: 111 microversion: 2.1 time: 0.053543 Jul 20 04:22:06.907401 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1026/1987] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/e43e41b7-9185-40e1-8218-d6605e3ff7aa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:06.916439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.917043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.917474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:06.924168 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.924875 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.925868 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.926484 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.928502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d4932dd-d308-4980-acba-fdfbdd0faa1c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.218000 Jul 20 04:22:06.929701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 962/1988] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:06.950837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:06.952112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:06.959170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.959852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:06.960878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:06.961319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.102223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:07.109757 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f03970c4-e11b-4c70-9de6-12e4a1234f0d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.163657 Jul 20 04:22:07.110399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 963/1989] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:07.299795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:07.308505 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:07.310021 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:07.311183 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6aa4c939-2e4f-40f9-9b02-7fb0f3b3181c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.399566 Jul 20 04:22:07.311728 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1027/1990] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:06 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:07.653125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.653751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:07.660984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.662397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.663437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.664113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.767274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.767894 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:07.780345 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.781202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.782377 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.783547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.828459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:07.839193 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-593b69b9-47b2-4dec-b8e0-a7e392ace481 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.189743 Jul 20 04:22:07.839884 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 964/1991] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:07 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:07.947395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:07.948520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:07.960254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.961656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:07.962926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:07.963766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.083756 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.102357 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d0d0c6d6-0203-42c4-9211-052b52303b3e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1669 microversion: 2.1 time: 0.338335 Jul 20 04:22:08.113236 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1028/1992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:07 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1669 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:08.119095 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.119601 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.136169 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.136657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.137466 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.137905 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.167227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.177176 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ac42c10e-8b2e-431f-9f39-6b223c37614a tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224/ips" status: 200 len: 179 microversion: 2.1 time: 0.061548 Jul 20 04:22:08.179108 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1029/1993] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224/ips => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:08.179917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d10f8da9-31d2-4ce5-8e37-83881528d44b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.237995 Jul 20 04:22:08.181070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 965/1994] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:07 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:08.184591 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.185708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.193256 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.193968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.195304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.195728 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.199559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.200292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.207730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.208605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.209700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.225734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.281337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:08.379433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b594d28b-04a3-416e-902d-fc208ea6f4ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 204 len: 0 microversion: 2.1 time: 0.181423 Jul 20 04:22:08.383996 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 966/1995] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:08 2022] DELETE /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:08.389281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0b00ffb4-4657-4840-99db-02f7c18e6a78 req-9e8024c7-82d2-4465-97f2-7062c9989c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ce279b-8d08-4796-a5ae-83d15bc2e699", "name": "network-vif-plugged", "status": "completed", "tag": "812417e5-db95-4a85-b021-5a50d916cd35"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:08.398572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0b00ffb4-4657-4840-99db-02f7c18e6a78 req-9e8024c7-82d2-4465-97f2-7062c9989c71 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.399020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0b00ffb4-4657-4840-99db-02f7c18e6a78 req-9e8024c7-82d2-4465-97f2-7062c9989c71 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.411529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0b00ffb4-4657-4840-99db-02f7c18e6a78 req-9e8024c7-82d2-4465-97f2-7062c9989c71 service nova] Creating event network-vif-plugged:812417e5-db95-4a85-b021-5a50d916cd35 for instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 on n-h2-764486-11 Jul 20 04:22:08.416280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0b00ffb4-4657-4840-99db-02f7c18e6a78 req-9e8024c7-82d2-4465-97f2-7062c9989c71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034164 Jul 20 04:22:08.417584 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 967/1996] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:08.422696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.423405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.431216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.432208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.432569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.432995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.524987 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.537936 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4eb759a6-e909-4666-a843-f5612d9a0da0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.357151 Jul 20 04:22:08.548899 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1030/1997] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:08.556935 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e6e330f1-7b73-45f1-82dd-e7217343ebe8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b8b6c10>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.604682 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e6e330f1-7b73-45f1-82dd-e7217343ebe8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/e448d1d0-085a-43a6-bd5a-280c731623fb" status: 200 len: 662 microversion: 2.1 time: 0.054128 Jul 20 04:22:08.606023 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1031/1998] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/images/e448d1d0-085a-43a6-bd5a-280c731623fb => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:08.611278 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.612008 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.619413 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.620461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.620852 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.621365 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.643118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.653931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.657081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:08.658690 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc3864ec-3b2e-43e7-8186-6712e2bd67c9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.240157 Jul 20 04:22:08.659807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 968/1999] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:08.665309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d86d52dd-44ee-4ca4-a3b6-6ab4fd410746 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f839cd919d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.709877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d86d52dd-44ee-4ca4-a3b6-6ab4fd410746 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/e448d1d0-085a-43a6-bd5a-280c731623fb" status: 200 len: 662 microversion: 2.1 time: 0.048210 Jul 20 04:22:08.710448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 969/2000] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/images/e448d1d0-085a-43a6-bd5a-280c731623fb => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:08.857771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:08.858700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:08.866761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.867305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:08.868170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:08.868867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.016635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.024774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c6eb4ca-f0b0-4e68-b787-1f295a1689ec tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.171092 Jul 20 04:22:09.025357 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 970/2001] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:09.138797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.149596 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e5f687ef-c356-4e24-be5d-7622cdb3acc9 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1675 microversion: 2.1 time: 0.541846 Jul 20 04:22:09.159456 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1032/2002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:08 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1675 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:09.197145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:09.197887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:09.204035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.204615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.205459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.205968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.370273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.380295 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7980c21-eeaf-4284-b20e-652a5e02a581 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.186274 Jul 20 04:22:09.389772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 971/2003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:09 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:09.557759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:09.559533 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:09.567839 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.569062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.570218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.571524 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.677073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:09.678332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:09.685542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.686295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.687074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:09.687540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:09.836787 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.854934 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-56771356-5a80-44c6-bd51-3c6e360aac05 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.303273 Jul 20 04:22:09.856085 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1033/2004] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:09 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:09.957004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.969483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.971449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:09.974421 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09302a3d-a741-4fc0-8068-e7a46a5e502e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.299829 Jul 20 04:22:09.985104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 972/2005] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:09 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:10.049259 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.051133 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:10.074035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.074655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.076070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.078540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.169297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.170037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:10.176679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.177255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.178435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.179143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.449947 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=10 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:10.465715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.486834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46e51061-3c7f-4c35-9f31-8b2f46b8f572 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1675 microversion: 2.1 time: 0.320759 Jul 20 04:22:10.488590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 973/2006] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1675 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:10.505942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-075eb116-da09-4a8c-bdfb-f4db919eec01 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f839ce8b160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.603335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-075eb116-da09-4a8c-bdfb-f4db919eec01 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/e7f740e4-a836-4560-8b6b-d97d4b37060a" status: 200 len: 661 microversion: 2.1 time: 0.113122 Jul 20 04:22:10.610496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 974/2007] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/images/e7f740e4-a836-4560-8b6b-d97d4b37060a => generated 661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:10.616282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.617157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:10.623640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.624327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.625344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:10.625948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:10.698435 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:10.716444 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-0cb6ea13-5740-4b90-a970-3ca352a73d4e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1316 microversion: 2.1 time: 0.669770 Jul 20 04:22:10.717637 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1034/2008] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:10.730545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3295d649-698c-4ac0-a654-eb015f203a3d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b8a11f0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:10.776685 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3295d649-698c-4ac0-a654-eb015f203a3d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/e7f740e4-a836-4560-8b6b-d97d4b37060a" status: 200 len: 661 microversion: 2.1 time: 0.057431 Jul 20 04:22:10.794277 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1035/2009] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/images/e7f740e4-a836-4560-8b6b-d97d4b37060a => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:10.851033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-294018394", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:10.918237 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] validate_networks() for None {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:11.107101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.119828 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a481da8-cd13-4f51-8e56-eda21aade716 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.507686 Jul 20 04:22:11.121188 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 975/2010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:10 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:11.134823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.138616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.147628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.148495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.150876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.151956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.160238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:11.261986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:11.262564 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:11.263144 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:11.263843 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:11.264403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:11.281962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.282729 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.283851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.284489 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.318941 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Getting quotas for project 833230d24aaa48f88a335662fa7ac92d. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:11.336058 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Getting quotas for user 6502ad71bb4b4be39aa2d743d55e2a0f and project 833230d24aaa48f88a335662fa7ac92d. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:11.374439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:11.382890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:11.445622 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7959c875-66be-4a24-adf7-8e5ddefe1c0d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599953 Jul 20 04:22:11.467394 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1036/2011] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:11.479369 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.480396 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.487166 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:11.491594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.496720 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.497934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.502013 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.795936 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.807153 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.809181 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.810597 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d11eab91-fd29-4d43-bd8a-e2094a92f176 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.338216 Jul 20 04:22:11.811746 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1037/2012] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:11.818320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-deb05562-76a6-4206-8f43-b4d3d2090f58 req-57f59fab-9139-4dbf-ac27-57f3d8dc1bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d660a6-cb26-4977-b18f-dac4cd9ef224", "name": "network-vif-deleted", "tag": "17918890-ee9f-42a0-ac70-9a12ace38c7b"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:11.830572 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-deb05562-76a6-4206-8f43-b4d3d2090f58 req-57f59fab-9139-4dbf-ac27-57f3d8dc1bdd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.831372 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-deb05562-76a6-4206-8f43-b4d3d2090f58 req-57f59fab-9139-4dbf-ac27-57f3d8dc1bdd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.848097 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-deb05562-76a6-4206-8f43-b4d3d2090f58 req-57f59fab-9139-4dbf-ac27-57f3d8dc1bdd service nova] Creating event network-vif-deleted:17918890-ee9f-42a0-ac70-9a12ace38c7b for instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 on n-h1-764486-11 Jul 20 04:22:11.855550 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-deb05562-76a6-4206-8f43-b4d3d2090f58 req-57f59fab-9139-4dbf-ac27-57f3d8dc1bdd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041998 Jul 20 04:22:11.856954 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1038/2013] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:11.865006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:11.866216 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:11.874758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.875255 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.876138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:11.876699 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:11.970486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:11.985110 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b86f72c7-8ae9-4de6-9af2-ffd1bd278ef0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.862599 Jul 20 04:22:11.985704 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 976/2014] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:11.996694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1072003735", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:12.108492 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.121322 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ab040e64-c01d-4a49-bb23-2e393a0d77fe tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1654 microversion: 2.1 time: 0.262466 Jul 20 04:22:12.134579 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1039/2015] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:11 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1654 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:12.146202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:12.149360 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.152340 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.160322 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.160883 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.162116 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.162741 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.470132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.479396 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-699b7c05-dd24-4754-b80a-70f91243717c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1505 microversion: 2.1 time: 0.342039 Jul 20 04:22:12.480204 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1040/2016] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:12.484923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:12.485540 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.495040 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.495506 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.496395 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.496986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.735603 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:12.754303 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f98a25bb-04ae-4f2f-8acb-a5e7c8c9a402 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.272829 Jul 20 04:22:12.755730 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1041/2017] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:12 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:12.762421 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1709532945"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:12.763696 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:12.772482 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.773716 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.775046 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:12.775903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:12.986028 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.network.security_group_api [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Adding security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf to port 812417e5-db95-4a85-b021-5a50d916cd35 Jul 20 04:22:13.418717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:13.419319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:13.419979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:13.420757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:13.421472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:13.435843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.436973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.440487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.444507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.452820 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-091ad035-f9ad-474a-946b-eb778d0f6a79 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699/action" status: 202 len: 0 microversion: 2.1 time: 0.695601 Jul 20 04:22:13.453964 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1042/2018] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:12 2022] POST /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:13.459467 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.460307 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.477946 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.479172 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.480183 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.480887 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.484046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Getting quotas for project 833230d24aaa48f88a335662fa7ac92d. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:13.494619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Getting quotas for user 6502ad71bb4b4be39aa2d743d55e2a0f and project 833230d24aaa48f88a335662fa7ac92d. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:13.520215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:13.526735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:13.628497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-692bfd8e-7813-4377-a3cd-560e04cb03a2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641538 Jul 20 04:22:13.629603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 977/2019] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:13.649542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.657557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.679861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.680318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.707056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.709455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.778984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.791311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.793272 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.794815 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e7991d4a-4fc1-4382-82dc-9c6f44741f72 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.339523 Jul 20 04:22:13.804576 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1043/2020] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:13.804576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:13.804576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:13.825508 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.826253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.827342 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:13.828147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:13.887499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=100 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:13.951619 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:13.966233 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4889a3ea-af09-469e-89f7-f0dba0bdae1f tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1455 microversion: 2.1 time: 0.169140 Jul 20 04:22:13.968341 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1044/2021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:13.983118 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d32761a2-afd4-4b1d-b136-964d19d17018 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b79ef70>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.191390 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-d32761a2-afd4-4b1d-b136-964d19d17018 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use.", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:14.193240 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-d32761a2-afd4-4b1d-b136-964d19d17018 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.193240 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d32761a2-afd4-4b1d-b136-964d19d17018 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf HTTP/1.1 Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:14.198828 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: exception: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] Jul 20 04:22:14.200973 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'f82c90eb-3de7-4f02-b5c7-da5587c36ebf'} Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:14.201940 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.203477 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:14.205099 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d32761a2-afd4-4b1d-b136-964d19d17018 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 400 to user: Security Group f82c90eb-3de7-4f02-b5c7-da5587c36ebf in use. Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-fa819338-075f-4f32-8b7d-a58124decde6'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d32761a2-afd4-4b1d-b136-964d19d17018 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf" status: 400 len: 185 microversion: 2.1 time: 0.232495 Jul 20 04:22:14.208849 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1045/2022] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:13 2022] DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf => generated 185 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:14.215154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-aac52d2f-dde8-4d81-80e2-97283e47cfe6 req-577378ef-913c-4259-8dc0-ce28da275bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ce279b-8d08-4796-a5ae-83d15bc2e699", "tag": "812417e5-db95-4a85-b021-5a50d916cd35"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.235385 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-aac52d2f-dde8-4d81-80e2-97283e47cfe6 req-577378ef-913c-4259-8dc0-ce28da275bda service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.235991 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-aac52d2f-dde8-4d81-80e2-97283e47cfe6 req-577378ef-913c-4259-8dc0-ce28da275bda service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.268965 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-aac52d2f-dde8-4d81-80e2-97283e47cfe6 req-577378ef-913c-4259-8dc0-ce28da275bda service nova] Creating event network-changed:812417e5-db95-4a85-b021-5a50d916cd35 for instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 on n-h2-764486-11 Jul 20 04:22:14.283563 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-aac52d2f-dde8-4d81-80e2-97283e47cfe6 req-577378ef-913c-4259-8dc0-ce28da275bda service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072615 Jul 20 04:22:14.285047 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1046/2023] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:14.294503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e661b89f-a815-4581-8ee5-85d03c34a5df tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.295588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-e661b89f-a815-4581-8ee5-85d03c34a5df tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.401161 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-e661b89f-a815-4581-8ee5-85d03c34a5df tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.418534 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e661b89f-a815-4581-8ee5-85d03c34a5df tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1218 microversion: 2.1 time: 0.132004 Jul 20 04:22:14.428943 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1047/2024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:14.434192 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.434880 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.443266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.443694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.444608 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.445031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.628254 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.648867 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-558938d6-2fe7-4f1d-94aa-a2e0bb1fdbac tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.218619 Jul 20 04:22:14.650009 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1048/2025] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:14.660033 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-a5d52c06-8c31-455c-9e9d-d3c3e7aa95bb req-9f56280b-2a85-4f84-9609-8aa5cc5bf5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "name": "network-vif-unplugged", "status": "completed", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.678524 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-a5d52c06-8c31-455c-9e9d-d3c3e7aa95bb req-9f56280b-2a85-4f84-9609-8aa5cc5bf5f6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.679264 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-a5d52c06-8c31-455c-9e9d-d3c3e7aa95bb req-9f56280b-2a85-4f84-9609-8aa5cc5bf5f6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.692051 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-a5d52c06-8c31-455c-9e9d-d3c3e7aa95bb req-9f56280b-2a85-4f84-9609-8aa5cc5bf5f6 service nova] Creating event network-vif-unplugged:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h1-764486-11 Jul 20 04:22:14.697463 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-a5d52c06-8c31-455c-9e9d-d3c3e7aa95bb req-9f56280b-2a85-4f84-9609-8aa5cc5bf5f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045373 Jul 20 04:22:14.698634 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1049/2026] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:14.704855 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:14.706766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.715275 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.716251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.718629 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.719364 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.819473 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6b101bb4-6404-4ea6-9d0a-115dc16e32a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699/action" status: 202 len: 0 microversion: 2.1 time: 0.118979 Jul 20 04:22:14.819980 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1050/2027] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:14 2022] POST /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:14.826573 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:14.827074 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:14.834137 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.834673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.835655 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:14.836146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:14.994493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:14.997987 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.006741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2aa6e030-c0ab-4e9e-9ae2-c1d1121b44ae tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 1.362412 Jul 20 04:22:15.007586 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 978/2028] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:13 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:15.012553 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.013607 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.014060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.014894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.015703 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7fa19447-013b-46a7-a456-9162ee7ea153 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.194443 Jul 20 04:22:15.021884 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1051/2029] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:14 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:15.027569 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.028266 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.035008 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.036251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.037577 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.038020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.038449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.038582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.040231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.041083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.115355 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.116592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.117289 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lazy-loading 'fault' on Instance uuid b1d660a6-cb26-4977-b18f-dac4cd9ef224 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:15.199448 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb32e9e4909744fbb5f665af1ddb3319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d7eb98b263a47d8a238b9e29baef9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.216237 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c4cfc130-2e14-4062-8384-a75e87e02828 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 200 len: 1303 microversion: 2.1 time: 0.192380 Jul 20 04:22:15.228572 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1052/2030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 1303 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:15.438083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.439705 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.452498 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.452954 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.453721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.454155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.558686 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.572688 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-28d9597a-c547-4f95-91e1-8f3dec63feec tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1276 microversion: 2.1 time: 0.139323 Jul 20 04:22:15.573801 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1053/2031] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:15.675796 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:15.677982 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:15.685513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.685967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.686759 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:15.687350 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:15.944374 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:15.981033 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d34e57dc-3bc6-4c26-9d8c-3b06e4e685bc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.317342 Jul 20 04:22:15.990907 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1054/2032] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:16.033112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.034231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.044333 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.045231 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.046439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.047146 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.343208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.354660 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8961e2fb-ad46-46ab-b62c-277f285aeefc tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1576 microversion: 2.1 time: 1.345407 Jul 20 04:22:16.365052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 979/2033] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:15 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1576 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:16.365052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.365052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.370822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.371689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.372842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.373621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.610673 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.622574 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d2c86f77-2777-45d8-b2db-f27a957f99c6 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.599797 Jul 20 04:22:16.633042 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1055/2034] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:16.635633 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.636428 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.642945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.643513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.644711 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.645011 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.660430 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] HTTP exception thrown: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Request method failure captured: Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 HTTP/1.1 Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14J8B_ZWi7GXMFZJvFolD8VOEBmI02Mg_6VwQC4ArrGfVwr6XRx5a1mRybZmegApK3_Q_M3m_ZBwkbRFdfYOEK5yNf6po51tQfK8S1NUvvEyDiPTNzITsVEA7xosJ7u_Gydx293ESPYroaig2PUZ-DzXLp19FGXOPmPps_lBLeetqpg Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:16.662337 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d7eb98b263a47d8a238b9e29baef9f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: eb32e9e4909744fbb5f665af1ddb3319 Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:16.663884 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'b1d660a6-cb26-4977-b18f-dac4cd9ef224'} Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:16.664781 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:16.666167 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:16.669275 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Returning 404 to user: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:16.670114 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-21ba642f-6882-43d5-9419-3e9219d20c34 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 404 len: 111 microversion: 2.1 time: 0.041999 Jul 20 04:22:16.670943 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1056/2035] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:16.675657 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.676912 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:16.683423 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.683949 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.684857 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.685363 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.784085 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.793814 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c9701b79-6d35-4e29-94dc-c51dd3fa7b21 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1276 microversion: 2.1 time: 0.121767 Jul 20 04:22:16.796436 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1057/2036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:16.942896 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-f9a311f8-9b85-41f2-bcf6-fb54c2c63112 req-74a3e6f4-bce7-4648-9dc5-6e6f50854b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d660a6-cb26-4977-b18f-dac4cd9ef224", "name": "network-vif-deleted", "tag": "a302b796-8416-4169-8227-950eb5e5211e"}, {"name": "network-changed", "server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:16.946232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.958612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.961449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:16.963901 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f40179fd-be63-43a2-a360-75f6dc03bdd9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.606734 Jul 20 04:22:16.964494 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 980/2037] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:16.977521 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-f9a311f8-9b85-41f2-bcf6-fb54c2c63112 req-74a3e6f4-bce7-4648-9dc5-6e6f50854b00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:16.978796 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-f9a311f8-9b85-41f2-bcf6-fb54c2c63112 req-74a3e6f4-bce7-4648-9dc5-6e6f50854b00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:16.991989 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-f9a311f8-9b85-41f2-bcf6-fb54c2c63112 req-74a3e6f4-bce7-4648-9dc5-6e6f50854b00 service nova] Creating event network-vif-deleted:a302b796-8416-4169-8227-950eb5e5211e for instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 on n-h1-764486-11 Jul 20 04:22:16.998056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:16.998751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.002249 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-f9a311f8-9b85-41f2-bcf6-fb54c2c63112 req-74a3e6f4-bce7-4648-9dc5-6e6f50854b00 service nova] Creating event network-changed:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h1-764486-11 Jul 20 04:22:17.006534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.011739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.012962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.015396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.019624 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-f9a311f8-9b85-41f2-bcf6-fb54c2c63112 req-74a3e6f4-bce7-4648-9dc5-6e6f50854b00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081944 Jul 20 04:22:17.024284 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1058/2038] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:17.374769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.376175 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.386627 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.387477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.388578 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.389287 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.662567 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.671963 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7b20b098-a6b2-4e28-a5f5-eb3f3c551bf9 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1576 microversion: 2.1 time: 0.303249 Jul 20 04:22:17.678833 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1059/2039] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:17.685241 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.688214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.699691 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.700968 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.701800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.702253 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.756477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:17.769321 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-365bc9ef-5636-4a13-a6cc-bda0af3f41ce tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.775105 Jul 20 04:22:17.770544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 981/2040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:16 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:17.841427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:17.845668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:17.878819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.879859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:17.883664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:17.885186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.211577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:18.223794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1a02cf3-68ff-4813-b903-f2712f9e3dfc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1276 microversion: 2.1 time: 0.415598 Jul 20 04:22:18.240690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:18.250822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 982/2041] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1276 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.258085 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cf902788-cf50-481b-bd59-de38cac1c297 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.574911 Jul 20 04:22:18.259967 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1060/2042] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:17 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:18.262946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.263573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.279188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.280579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.281793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.282332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.694734 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:18.696158 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:18.711132 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.714075 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:18.717251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:18.720073 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.188913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.202767 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f0bda3d1-38b5-4894-bae6-bc40586fd0eb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1576 microversion: 2.1 time: 0.513971 Jul 20 04:22:19.205145 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1061/2043] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1576 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:19.223636 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:19.225115 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:19.240873 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.241819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.242791 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.243407 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.758051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.790335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.795252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:19.805722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23e7e54c-9d21-463b-bb06-e9f18942d75c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 1.553581 Jul 20 04:22:19.808706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 983/2044] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:18 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:19.815165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:19.821659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:19.837151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.839146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:19.840639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:19.842755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.052631 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.066858 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-c2fedab5-886c-4e98-b020-43e45c956021 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.860009 Jul 20 04:22:20.067844 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1062/2045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:19 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:20.079976 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.082247 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.099093 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.101491 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.102622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.104280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.654334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.670576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30f48d37-6818-42a1-b4c7-e57fc89e9120 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.859994 Jul 20 04:22:20.681584 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 984/2046] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:19 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:20.696681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.707241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.724064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.725811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.726776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.728091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.925394 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:20.937426 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f804aa5a-c21b-466c-801c-87f9e257ce56 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1472 microversion: 2.1 time: 0.864809 Jul 20 04:22:20.940273 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1063/2047] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1472 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:20.951112 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:20.954939 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:20.973625 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.976956 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:20.980758 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:20.981347 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.021056 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:21.110580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.125555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74fbcc18-9464-441e-b15c-61f962075205 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1576 microversion: 2.1 time: 0.450358 Jul 20 04:22:21.137272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 985/2048] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1576 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:21.145636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.146517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.170962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.171736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.172565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.176594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.302786 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=12 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:21.532493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.549180 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9296321a-efd2-4d73-96fc-024eace49586 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.409763 Jul 20 04:22:21.563754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 986/2049] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:21.570639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ff3ba05c-7b58-4839-b976-6b0146c2b120 req-41fe8c35-50b6-469a-b7e1-32db00620431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:21.581248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ff3ba05c-7b58-4839-b976-6b0146c2b120 req-41fe8c35-50b6-469a-b7e1-32db00620431 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.582895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ff3ba05c-7b58-4839-b976-6b0146c2b120 req-41fe8c35-50b6-469a-b7e1-32db00620431 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.596433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ff3ba05c-7b58-4839-b976-6b0146c2b120 req-41fe8c35-50b6-469a-b7e1-32db00620431 service nova] Creating event network-changed:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:22:21.603682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ff3ba05c-7b58-4839-b976-6b0146c2b120 req-41fe8c35-50b6-469a-b7e1-32db00620431 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037290 Jul 20 04:22:21.605078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 987/2050] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:21.664247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.665228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.681673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.682456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.685650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.686419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.705628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] HTTP exception thrown: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Request method failure captured: Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 HTTP/1.1 Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14J8B_ZWi7GXMFZJvFolD8VOEBmI02Mg_6VwQC4ArrGfVwr6XRx5a1mRybZmegApK3_Q_M3m_ZBwkbRFdfYOEK5yNf6po51tQfK8S1NUvvEyDiPTNzITsVEA7xosJ7u_Gydx293ESPYroaig2PUZ-DzXLp19FGXOPmPps_lBLeetqpg Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:21.709488 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d7eb98b263a47d8a238b9e29baef9f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: eb32e9e4909744fbb5f665af1ddb3319 Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.712057 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'b1d660a6-cb26-4977-b18f-dac4cd9ef224'} Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:21.713147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.716171 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.732474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Returning 404 to user: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:21.733609 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc68ee09-d59c-4695-8369-48bf1ae71ccb tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 404 len: 111 microversion: 2.1 time: 0.081471 Jul 20 04:22:21.734375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 988/2051] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:21 2022] DELETE /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:21.742851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.743645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.757528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.758315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.759109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.759499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.808031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.825598 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.827083 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:21.828682 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-403ba83c-3464-4197-b6f1-e4522c0bf246 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.887079 Jul 20 04:22:21.840528 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1064/2052] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:20 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:21.853973 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.855127 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: b1d660a6-cb26-4977-b18f-dac4cd9ef224] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.874872 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.877332 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.879477 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.880192 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.904756 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] HTTP exception thrown: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Request method failure captured: Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 HTTP/1.1 Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14J8B_ZWi7GXMFZJvFolD8VOEBmI02Mg_6VwQC4ArrGfVwr6XRx5a1mRybZmegApK3_Q_M3m_ZBwkbRFdfYOEK5yNf6po51tQfK8S1NUvvEyDiPTNzITsVEA7xosJ7u_Gydx293ESPYroaig2PUZ-DzXLp19FGXOPmPps_lBLeetqpg Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:21.907447 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d7eb98b263a47d8a238b9e29baef9f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: eb32e9e4909744fbb5f665af1ddb3319 Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.911269 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'b1d660a6-cb26-4977-b18f-dac4cd9ef224'} Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:21.912512 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. Jul 20 04:22:21.914342 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:21.916904 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Returning 404 to user: Instance b1d660a6-cb26-4977-b18f-dac4cd9ef224 could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:21.937038 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-f979cf39-9341-4746-a5dc-0b3ec12626ec tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224" status: 404 len: 111 microversion: 2.1 time: 0.094762 Jul 20 04:22:21.940044 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1065/2053] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/b1d660a6-cb26-4977-b18f-dac4cd9ef224 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:21.955138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:21.956576 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:21.965596 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.966777 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.967794 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:21.968478 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:21.998032 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] HTTP exception thrown: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Request method failure captured: Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd HTTP/1.1 Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14J8B_ZWi7GXMFZJvFolD8VOEBmI02Mg_6VwQC4ArrGfVwr6XRx5a1mRybZmegApK3_Q_M3m_ZBwkbRFdfYOEK5yNf6po51tQfK8S1NUvvEyDiPTNzITsVEA7xosJ7u_Gydx293ESPYroaig2PUZ-DzXLp19FGXOPmPps_lBLeetqpg Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:22.000795 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d7eb98b263a47d8a238b9e29baef9f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: eb32e9e4909744fbb5f665af1ddb3319 Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.002640 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '7f7d3308-443d-48f2-b940-2c9c404631cd'} Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:22.003658 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.006065 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.008721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Returning 404 to user: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:22.009950 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7ac30e42-e484-4bac-937f-d7009b639d1e tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 404 len: 111 microversion: 2.1 time: 0.065341 Jul 20 04:22:22.011342 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1066/2054] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:21 2022] DELETE /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:22.022192 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.023166 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.032000 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.033142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.034871 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.035841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.384780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.412270 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.429804 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cdd5f7c1-200c-41ad-9f99-822eed1cdebf tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1490 microversion: 2.1 time: 0.417135 Jul 20 04:22:22.431052 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1067/2055] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1490 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:22.439179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-319c953b-01a0-45be-9719-e13767416d70 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.695722 Jul 20 04:22:22.442141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 989/2056] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:21 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:22.448903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.449913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] [instance: 7f7d3308-443d-48f2-b940-2c9c404631cd] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.453918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.456827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.479678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.480051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.480280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.480749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.481546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.481995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.486155 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.486970 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.509468 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] HTTP exception thrown: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Request method failure captured: Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: request: GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd HTTP/1.1 Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14J8B_ZWi7GXMFZJvFolD8VOEBmI02Mg_6VwQC4ArrGfVwr6XRx5a1mRybZmegApK3_Q_M3m_ZBwkbRFdfYOEK5yNf6po51tQfK8S1NUvvEyDiPTNzITsVEA7xosJ7u_Gydx293ESPYroaig2PUZ-DzXLp19FGXOPmPps_lBLeetqpg Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:22.512764 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d7eb98b263a47d8a238b9e29baef9f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d7eb98b263a47d8a238b9e29baef9f4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 3d7eb98b263a47d8a238b9e29baef9f4 Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-ServersTestMultiNic-240083885 Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: eb32e9e4909744fbb5f665af1ddb3319 Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-ServersTestMultiNic-240083885-project Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: method: > Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: exception: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.514824 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '7f7d3308-443d-48f2-b940-2c9c404631cd'} Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:22.515860 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. Jul 20 04:22:22.517296 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:22.518518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] Returning 404 to user: Instance 7f7d3308-443d-48f2-b940-2c9c404631cd could not be found. {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:22.518518 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-80281357-074d-436d-9f17-5bf2085ca5d2 tempest-ServersTestMultiNic-240083885 tempest-ServersTestMultiNic-240083885-project] 10.222.0.49 "GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd" status: 404 len: 111 microversion: 2.1 time: 0.081918 Jul 20 04:22:22.518518 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1068/2057] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/7f7d3308-443d-48f2-b940-2c9c404631cd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:22.520913 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-65bb71c5-f232-436d-9098-3d11502b7811 req-b57be0e2-0b8d-48c9-9dc3-2e9c2b0316c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "name": "network-vif-unplugged", "status": "completed", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:22.530648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-65bb71c5-f232-436d-9098-3d11502b7811 req-b57be0e2-0b8d-48c9-9dc3-2e9c2b0316c2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.531101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-65bb71c5-f232-436d-9098-3d11502b7811 req-b57be0e2-0b8d-48c9-9dc3-2e9c2b0316c2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.550153 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-65bb71c5-f232-436d-9098-3d11502b7811 req-b57be0e2-0b8d-48c9-9dc3-2e9c2b0316c2 service nova] Creating event network-vif-unplugged:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h1-764486-11 Jul 20 04:22:22.568911 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-65bb71c5-f232-436d-9098-3d11502b7811 req-b57be0e2-0b8d-48c9-9dc3-2e9c2b0316c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041922 Jul 20 04:22:22.570319 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1069/2058] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:22.576817 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.578721 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.588864 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.589429 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.590339 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.591023 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.834342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:22.844867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66775902-fc81-4d3a-84cd-b5153ef82581 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1576 microversion: 2.1 time: 0.400169 Jul 20 04:22:22.845555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 990/2059] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1576 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:22.861053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:22.862013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:22.894095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.895465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:22.896679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:22.897773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.199706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.211330 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-376905c7-fbb9-4e18-afc2-8b79219af309 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.639406 Jul 20 04:22:23.215956 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1070/2060] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:23.281210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.301525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.308747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:23.312710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b148805-6b7e-44ba-9717-86b8d2b89aaa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.463949 Jul 20 04:22:23.317262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 991/2061] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:22 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:23.449919 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.450560 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.460304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:23.461547 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.461867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:23.462410 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.463443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.464056 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.486097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:23.489225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.489906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.491118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:23.491969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:23.529405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:24.010501 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.021216 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-8fa37b56-f2d6-4151-ab1c-6e8d4e093338 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.576171 Jul 20 04:22:24.021830 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1071/2062] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:24.027317 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-5764c813-1ae5-4895-8ea7-665daca201e0 req-9fff6ea8-0801-4e3b-9f8f-31a99856174d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "name": "network-vif-unplugged", "status": "completed", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:24.039527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-5764c813-1ae5-4895-8ea7-665daca201e0 req-9fff6ea8-0801-4e3b-9f8f-31a99856174d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.041144 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-5764c813-1ae5-4895-8ea7-665daca201e0 req-9fff6ea8-0801-4e3b-9f8f-31a99856174d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.058983 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-5764c813-1ae5-4895-8ea7-665daca201e0 req-9fff6ea8-0801-4e3b-9f8f-31a99856174d service nova] Creating event network-vif-unplugged:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h1-764486-11 Jul 20 04:22:24.076311 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-5764c813-1ae5-4895-8ea7-665daca201e0 req-9fff6ea8-0801-4e3b-9f8f-31a99856174d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052841 Jul 20 04:22:24.077303 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1072/2063] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:24.091336 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.092062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:24.109594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.112164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.113962 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.114624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.389979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.404617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95ae589c-2ba2-482d-884a-f9bba3f0c1a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.950068 Jul 20 04:22:24.408735 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=8 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:24.416504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 992/2064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:23 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:24.430158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.431319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:24.456075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.460750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.463070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.465208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.596102 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:24.604847 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-3b341dcc-6dd8-48fb-8762-2b5adbb74b1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1574 microversion: 2.1 time: 0.526152 Jul 20 04:22:24.608415 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1073/2065] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:24 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1574 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:24.630454 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:24.633490 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:24.651848 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.652575 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:24.653690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:24.654308 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.007596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.024446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2b49961-6a86-4eed-86ba-6fa87300b3ba tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.604497 Jul 20 04:22:25.025436 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 993/2066] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:24 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.031964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1612997694"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:25.034348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.073821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.074417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.075579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.076197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.305704 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.318363 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.329219 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.331808 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b652afb1-7ce3-43ac-a5ac-04e5ffbc7ce0 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.722286 Jul 20 04:22:25.337445 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1074/2067] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:24 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:25.345209 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.346082 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.366251 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.366709 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.367500 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.367967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.603413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Adding security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 to port 812417e5-db95-4a85-b021-5a50d916cd35 Jul 20 04:22:25.885623 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:25.935461 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-614d9419-9425-4e91-a20f-d5b40ec7109b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.586443 Jul 20 04:22:25.937428 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1075/2068] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:25.954773 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:25.956154 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:25.974709 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.977891 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:25.980651 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:25.981969 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.429906 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-792be502-23ef-4703-99fb-aa291a6a711c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699/action" status: 202 len: 0 microversion: 2.1 time: 1.403130 Jul 20 04:22:26.435132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 994/2069] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:25 2022] POST /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699/action => generated 0 bytes in 1408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:26.442061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.442061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.448107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:26.457758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.463335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.466593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.468635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.546264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:26.626495 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.635544 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dd9c6213-7e82-4658-b25f-405969279431 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.695391 Jul 20 04:22:26.641927 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1076/2070] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:25 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:26.651766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-60509aa4-fbde-48f4-bc8c-2be63d28523d req-a9803576-900a-4d3e-a2d8-3988d884aa75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc269cd-7787-4fde-bf21-ca131b4e2738", "tag": "5c87874c-288b-4b97-8bd5-eb44cc50a7d7"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:26.694280 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-60509aa4-fbde-48f4-bc8c-2be63d28523d req-a9803576-900a-4d3e-a2d8-3988d884aa75 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.698274 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-60509aa4-fbde-48f4-bc8c-2be63d28523d req-a9803576-900a-4d3e-a2d8-3988d884aa75 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.728042 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-60509aa4-fbde-48f4-bc8c-2be63d28523d req-a9803576-900a-4d3e-a2d8-3988d884aa75 service nova] Creating event network-changed:5c87874c-288b-4b97-8bd5-eb44cc50a7d7 for instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 on n-h2-764486-11 Jul 20 04:22:26.738981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:26.749619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75c6255f-6420-4bdc-a3b0-4ecfdacdd68c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.313128 Jul 20 04:22:26.751674 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-60509aa4-fbde-48f4-bc8c-2be63d28523d req-a9803576-900a-4d3e-a2d8-3988d884aa75 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108497 Jul 20 04:22:26.753284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 995/2071] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:26.760253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.763489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:26.768184 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1077/2072] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:26.777568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.778317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:26.778503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-32ad9a80-4d33-441c-bb00-0338c0bf5b35 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b90eaf0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:26.779646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:26.780281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.006867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.019734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.021381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.024699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a5dd7bdb-ae7b-44a1-86b9-077293d3beeb tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1486 microversion: 2.25 time: 0.269576 Jul 20 04:22:27.026283 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 996/2073] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:26 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1486 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:27.032251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.033060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.069650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.070442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.073305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.075686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.277570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-32ad9a80-4d33-441c-bb00-0338c0bf5b35 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use.", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:27.278265 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-32ad9a80-4d33-441c-bb00-0338c0bf5b35 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.278265 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-32ad9a80-4d33-441c-bb00-0338c0bf5b35 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7 HTTP/1.1 Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:27.280240 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: exception: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] Jul 20 04:22:27.282091 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': '4f304eea-f12c-41c9-8faf-f6c51d89faf7'} Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:27.283270 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.285562 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:27.287764 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-32ad9a80-4d33-441c-bb00-0338c0bf5b35 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 400 to user: Security Group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 in use. Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-70503373-1b88-42e3-a345-e997684bc637'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:27.289445 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-32ad9a80-4d33-441c-bb00-0338c0bf5b35 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7" status: 400 len: 185 microversion: 2.1 time: 0.511347 Jul 20 04:22:27.292342 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1078/2074] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:26 2022] DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7 => generated 185 bytes in 522 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:27.296328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-d9f91408-c5f5-4f62-961d-24870e437bd4 req-344a9cb6-ea12-4523-91e4-6fabffb7c7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "name": "network-vif-unplugged", "status": "completed", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:27.320522 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-d9f91408-c5f5-4f62-961d-24870e437bd4 req-344a9cb6-ea12-4523-91e4-6fabffb7c7ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.320965 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-d9f91408-c5f5-4f62-961d-24870e437bd4 req-344a9cb6-ea12-4523-91e4-6fabffb7c7ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.346722 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-d9f91408-c5f5-4f62-961d-24870e437bd4 req-344a9cb6-ea12-4523-91e4-6fabffb7c7ce service nova] Creating event network-vif-unplugged:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:22:27.355681 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-d9f91408-c5f5-4f62-961d-24870e437bd4 req-344a9cb6-ea12-4523-91e4-6fabffb7c7ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062904 Jul 20 04:22:27.359249 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1079/2075] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:27.372926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.373817 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.390706 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.391496 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.392743 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.393384 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.427676 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:27.488682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:27.505185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d57b972-4617-4150-9143-71947038b437 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.477561 Jul 20 04:22:27.506257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 997/2076] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:27.621456 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1b0ed9ee-d3aa-4342-9269-0de153e5bc0a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 204 len: 0 microversion: 2.1 time: 0.259435 Jul 20 04:22:27.622798 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1080/2077] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:27 2022] DELETE /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:27.631465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.632013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.649704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.650368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.651545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.652154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.661976 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:27.662835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:27.674037 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.675986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:27.679202 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:27.686725 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.011900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.022334 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5097438-e802-49a8-aa32-ae2b5db52052 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1649 microversion: 2.1 time: 0.395138 Jul 20 04:22:28.039995 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 998/2078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1649 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.050673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.052546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.060959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.061653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.063126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.063865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.071903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.086381 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cb1973ff-f7e2-426f-9066-f0166eba636f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.430629 Jul 20 04:22:28.090175 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1081/2079] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:27 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.097160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.101819 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.116305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.116945 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.117984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.119111 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.403692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.414317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f8d6ffa-4f63-48a0-a55e-6499d152a5d3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.371762 Jul 20 04:22:28.415495 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 999/2080] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:28.523271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.523986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:28.537571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.538039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.538839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.539299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.759822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.768846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65a1da45-5ac6-4bab-b59a-703f92a898d7 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.250333 Jul 20 04:22:28.772575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1000/2081] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:28.784450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-14b65d37-fb13-467f-a533-6b8fd9e90688 req-b5913c34-47af-4e31-a0d4-7d7f2e5ffe73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ce279b-8d08-4796-a5ae-83d15bc2e699", "tag": "812417e5-db95-4a85-b021-5a50d916cd35"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:28.805296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-14b65d37-fb13-467f-a533-6b8fd9e90688 req-b5913c34-47af-4e31-a0d4-7d7f2e5ffe73 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.810190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-14b65d37-fb13-467f-a533-6b8fd9e90688 req-b5913c34-47af-4e31-a0d4-7d7f2e5ffe73 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.837987 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-14b65d37-fb13-467f-a533-6b8fd9e90688 req-b5913c34-47af-4e31-a0d4-7d7f2e5ffe73 service nova] Creating event network-changed:812417e5-db95-4a85-b021-5a50d916cd35 for instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 on n-h2-764486-11 Jul 20 04:22:28.848820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-14b65d37-fb13-467f-a533-6b8fd9e90688 req-b5913c34-47af-4e31-a0d4-7d7f2e5ffe73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069755 Jul 20 04:22:28.852677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1001/2082] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:22:28.885895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.901737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.929227 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:28.935664 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6c31ce9b-e7ee-474a-bb51-2f5e8c5d878e tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1476 microversion: 2.25 time: 0.844237 Jul 20 04:22:28.941950 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1082/2083] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1476 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:28.964674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c949ea87-ad76-4ee4-a74b-dc2d72c55b79 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '.version_select at 0x7f839ce8bee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:28.968766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c949ea87-ad76-4ee4-a74b-dc2d72c55b79 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:28.969937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c949ea87-ad76-4ee4-a74b-dc2d72c55b79 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:28.990385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c949ea87-ad76-4ee4-a74b-dc2d72c55b79 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.030316 Jul 20 04:22:28.994981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1002/2084] 10.222.0.49 () {60 vars in 1183 bytes} [Wed Jul 20 04:22:28 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:29.009461 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.010259 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.030622 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.035832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.042537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:29.044189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:29.051215 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.056757 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.061312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.063710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:29.067677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:29.069785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.249643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.259685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d70e02bb-f613-4114-bce0-b7dab62f5431 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1649 microversion: 2.1 time: 1.222164 Jul 20 04:22:30.265877 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1003/2085] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1649 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.271845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.275700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.289352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.292579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.293630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.294238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.485182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] Lazy-loading 'services' on Instance uuid 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:30.509697 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b94f9058-4540-4563-9153-c06f0a0e2ee1 tempest-LiveAutoBlockMigrationV225Test-493672358 tempest-LiveAutoBlockMigrationV225Test-493672358-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1970 microversion: 2.25 time: 1.506521 Jul 20 04:22:30.511030 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1083/2086] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:29 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1970 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:30.517634 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.518690 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.522189 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:30.527976 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.528747 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.529784 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.530468 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.689605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:30.707980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18f31512-6740-45e2-a30e-a46ccc5a0560 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.440709 Jul 20 04:22:30.708950 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1004/2087] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:30.715312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:30.716181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:30.722824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.723280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:30.724057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:30.724584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.017575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.025936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e0ba321-5b77-4b99-b562-7a6e060a69c9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.315300 Jul 20 04:22:31.029159 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1005/2088] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.245178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0882511-22ff-48c0-b646-78548c62d657 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.246664 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:31.246664 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:22:31.248771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0882511-22ff-48c0-b646-78548c62d657 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.250001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0882511-22ff-48c0-b646-78548c62d657 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.251142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0882511-22ff-48c0-b646-78548c62d657 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.251670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0882511-22ff-48c0-b646-78548c62d657 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.285689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0882511-22ff-48c0-b646-78548c62d657 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.247647 Jul 20 04:22:31.286297 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1006/2089] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/os-services => generated 949 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:31.292920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.293763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.301834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.302292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.303303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.303766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.332930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:31.424018 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.426926 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:31.443498 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ffe7ac99-3b90-48f9-83ec-edac24096ad3 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1511 microversion: 2.1 time: 0.930940 Jul 20 04:22:31.444093 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1084/2090] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:30 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1511 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.449010 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-4467a1f2-6324-406f-8dad-c37b13aad39e req-6fb2931d-22b0-4f48-9158-b9e863f03e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "name": "network-vif-plugged", "status": "completed", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:31.457386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e91e445e-60a7-43be-a884-913bfa19f98d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 204 len: 0 microversion: 2.25 time: 0.169458 Jul 20 04:22:31.461740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1007/2091] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:31 2022] DELETE /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:22:31.467445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.469638 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-4467a1f2-6324-406f-8dad-c37b13aad39e req-6fb2931d-22b0-4f48-9158-b9e863f03e81 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.470124 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-4467a1f2-6324-406f-8dad-c37b13aad39e req-6fb2931d-22b0-4f48-9158-b9e863f03e81 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.473325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.489679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.490146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.490942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.491387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.511304 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-4467a1f2-6324-406f-8dad-c37b13aad39e req-6fb2931d-22b0-4f48-9158-b9e863f03e81 service nova] Creating event network-vif-plugged:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:22:31.518477 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-4467a1f2-6324-406f-8dad-c37b13aad39e req-6fb2931d-22b0-4f48-9158-b9e863f03e81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072761 Jul 20 04:22:31.519939 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1085/2092] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:31.529617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-faa6f331-1d01-409f-a69c-7627c9edd230 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.531898 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:31.531898 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:22:31.534648 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-faa6f331-1d01-409f-a69c-7627c9edd230 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.535331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-faa6f331-1d01-409f-a69c-7627c9edd230 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.536314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-faa6f331-1d01-409f-a69c-7627c9edd230 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.536918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-faa6f331-1d01-409f-a69c-7627c9edd230 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.611757 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-faa6f331-1d01-409f-a69c-7627c9edd230 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.089329 Jul 20 04:22:31.615758 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1086/2093] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:31.629602 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.631296 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.641036 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.642184 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.643092 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.644331 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.850888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:31.868955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6e96419-7709-4781-83ef-a525ce619d47 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1649 microversion: 2.1 time: 0.405699 Jul 20 04:22:31.870166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1008/2094] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1649 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:31.874788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-187b4992-0046-48a9-b45b-b9f6fdaa8176 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.876318 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:31.876318 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:22:31.877809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-187b4992-0046-48a9-b45b-b9f6fdaa8176 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.879070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-187b4992-0046-48a9-b45b-b9f6fdaa8176 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.880132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-187b4992-0046-48a9-b45b-b9f6fdaa8176 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.880824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-187b4992-0046-48a9-b45b-b9f6fdaa8176 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.910362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-187b4992-0046-48a9-b45b-b9f6fdaa8176 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.038289 Jul 20 04:22:31.911626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1009/2095] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/os-services => generated 949 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:31.921146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:31.922048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:31.930228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.931041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:31.932407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:31.932775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.114115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.131102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5ddbdba-dd4d-4bb8-b309-432943e04875 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.217112 Jul 20 04:22:32.132032 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1010/2096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.162955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-238f62d0-1b4f-4e76-98ee-b6c2f7337c48 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.164859 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:32.164859 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:22:32.167198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238f62d0-1b4f-4e76-98ee-b6c2f7337c48 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.167849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238f62d0-1b4f-4e76-98ee-b6c2f7337c48 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.169047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238f62d0-1b4f-4e76-98ee-b6c2f7337c48 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.169690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238f62d0-1b4f-4e76-98ee-b6c2f7337c48 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.245721 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-238f62d0-1b4f-4e76-98ee-b6c2f7337c48 tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-764486-11&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.111251 Jul 20 04:22:32.266166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1011/2097] 10.222.0.49 () {58 vars in 1195 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/os-services?host=n-d-764486-11&binary=xxx => generated 16 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:32.282174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.285067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.320661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.321431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.324077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.325076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.361088 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.379583 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.381378 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.382833 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ce360e3e-2b6b-4ab1-a9a9-08974ea06bc9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1482 microversion: 2.25 time: 0.765446 Jul 20 04:22:32.387413 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1087/2098] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:31 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1482 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:32.397983 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1ad370f9-476e-431d-a9e4-16f29fc601ba tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.401197 n-d-764486-11 devstack@n-api.service[123723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:32.401197 n-d-764486-11 devstack@n-api.service[123723]: warnings.warn(msg) Jul 20 04:22:32.406138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad370f9-476e-431d-a9e4-16f29fc601ba tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.406837 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad370f9-476e-431d-a9e4-16f29fc601ba tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.408513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad370f9-476e-431d-a9e4-16f29fc601ba tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.417321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1ad370f9-476e-431d-a9e4-16f29fc601ba tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.475577 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1ad370f9-476e-431d-a9e4-16f29fc601ba tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.086148 Jul 20 04:22:32.483124 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1088/2099] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/os-services => generated 949 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:32.489890 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-e3f0a039-6353-4d10-8aed-aec4715962cc req-c16da3be-9b93-4485-a35f-ac5c15284b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ce279b-8d08-4796-a5ae-83d15bc2e699", "name": "network-vif-deleted", "tag": "812417e5-db95-4a85-b021-5a50d916cd35"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:32.502545 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-e3f0a039-6353-4d10-8aed-aec4715962cc req-c16da3be-9b93-4485-a35f-ac5c15284b38 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.506643 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-e3f0a039-6353-4d10-8aed-aec4715962cc req-c16da3be-9b93-4485-a35f-ac5c15284b38 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.531668 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-e3f0a039-6353-4d10-8aed-aec4715962cc req-c16da3be-9b93-4485-a35f-ac5c15284b38 service nova] Creating event network-vif-deleted:812417e5-db95-4a85-b021-5a50d916cd35 for instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 on n-h2-764486-11 Jul 20 04:22:32.538043 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-e3f0a039-6353-4d10-8aed-aec4715962cc req-c16da3be-9b93-4485-a35f-ac5c15284b38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053215 Jul 20 04:22:32.539183 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1089/2100] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:32.551920 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.554437 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:32.565225 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.566311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.567437 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.568056 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.703744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:32.714546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3522af30-2403-45bd-846c-d4fadf45795f tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.446066 Jul 20 04:22:32.716666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1012/2101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:32.723868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16cc683b-08c0-4429-937d-9bbb8b4a178b tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:32.726591 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:32.726591 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:22:32.729182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16cc683b-08c0-4429-937d-9bbb8b4a178b tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.729934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16cc683b-08c0-4429-937d-9bbb8b4a178b tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.758662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16cc683b-08c0-4429-937d-9bbb8b4a178b tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:32.759305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16cc683b-08c0-4429-937d-9bbb8b4a178b tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:32.822722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16cc683b-08c0-4429-937d-9bbb8b4a178b tempest-ServicesAdminNegativeTestJSON-1728560117 tempest-ServicesAdminNegativeTestJSON-1728560117-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.103187 Jul 20 04:22:32.823942 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1013/2102] 10.222.0.49 () {58 vars in 1197 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:22:33.051712 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.059858 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b62c36c4-da4a-46d6-b7d4-3d8e58f66dfc tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1488 microversion: 2.1 time: 0.517245 Jul 20 04:22:33.068243 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1090/2103] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1488 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.073445 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.076396 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.096049 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.097719 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.098678 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.099269 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.171239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ce985d5-30d1-413f-8ac5-e4296d0c0f6a tempest-ServicesAdminNegativeTestJSON-787700273 tempest-ServicesAdminNegativeTestJSON-787700273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.172887 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:22:33.172887 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:22:33.180438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ce985d5-30d1-413f-8ac5-e4296d0c0f6a tempest-ServicesAdminNegativeTestJSON-787700273 tempest-ServicesAdminNegativeTestJSON-787700273-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4cac75ddd37e4085bb4c635c4e6930f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aad74f4b3a24076ba0b716550a0ee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.185474 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.185925 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.186382 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lazy-loading 'fault' on Instance uuid f3ce279b-8d08-4796-a5ae-83d15bc2e699 {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ce985d5-30d1-413f-8ac5-e4296d0c0f6a tempest-ServicesAdminNegativeTestJSON-787700273 tempest-ServicesAdminNegativeTestJSON-787700273-project] Request method failure captured: Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MFmf7wHGHIyurLLqSUCQ5SztAPVFDw5icAOitHFb6LMh-lvc__hmVFoFvBMQM0orhaQ_lUwWD1sskCqx5QxEsF5vwSlVuiQh2VCBXxeWFxYc68RNbz51D10-S5SmGumfA5OFYt0Ar5jgNz0kSp-MY47kqkr0m-TJWijzXISNHaSpw Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4aad74f4b3a24076ba0b716550a0ee4e Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-787700273 Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:33.188871 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4aad74f4b3a24076ba0b716550a0ee4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4aad74f4b3a24076ba0b716550a0ee4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4aad74f4b3a24076ba0b716550a0ee4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4aad74f4b3a24076ba0b716550a0ee4e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-787700273 Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4aad74f4b3a24076ba0b716550a0ee4e Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-787700273 Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServicesAdminNegativeTestJSON-787700273-project Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4cac75ddd37e4085bb4c635c4e6930f5 Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-787700273-project Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:22:33.190906 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:22:33.191905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:22:33.193619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:33.195291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ce985d5-30d1-413f-8ac5-e4296d0c0f6a tempest-ServicesAdminNegativeTestJSON-787700273 tempest-ServicesAdminNegativeTestJSON-787700273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:33.196231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ce985d5-30d1-413f-8ac5-e4296d0c0f6a tempest-ServicesAdminNegativeTestJSON-787700273 tempest-ServicesAdminNegativeTestJSON-787700273-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.362355 Jul 20 04:22:33.196927 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1014/2104] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:22:32 2022] GET /compute/v2.1/os-services => generated 112 bytes in 364 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:33.214358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.214871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.232865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.233322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.234104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.234538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.246025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:33.294447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:33.325187 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.348342 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7f6a2163-86e0-4ba9-beeb-5e1f42afb072 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 200 len: 1306 microversion: 2.1 time: 0.276557 Jul 20 04:22:33.350300 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1091/2105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:33.364295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.366357 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.389628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.390816 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.395835 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.399762 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.494484 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83598d33-2bf2-447b-ac52-8006a62247be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 204 len: 0 microversion: 2.1 time: 0.296323 Jul 20 04:22:33.496320 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1015/2106] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:33 2022] DELETE /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:33.506159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.508875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.527267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.530654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.531843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.534244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.708133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.720061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.722330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:33.723527 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50831125-f2f8-4b0e-95f2-778c84ffe6d9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1265 microversion: 2.25 time: 0.225660 Jul 20 04:22:33.724484 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1016/2107] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:33.734565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6aefa876-1e87-4f7f-8fd3-fbef297e5a28 req-013c266a-7fc7-4d81-8261-c7986e62b39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa9e39d-8e21-4720-9cd3-1530e1b2b20b", "name": "network-vif-deleted", "tag": "c0fa74eb-ef72-432b-af08-11ae0c5c25f7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:33.760610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6aefa876-1e87-4f7f-8fd3-fbef297e5a28 req-013c266a-7fc7-4d81-8261-c7986e62b39d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.761897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6aefa876-1e87-4f7f-8fd3-fbef297e5a28 req-013c266a-7fc7-4d81-8261-c7986e62b39d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.791727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6aefa876-1e87-4f7f-8fd3-fbef297e5a28 req-013c266a-7fc7-4d81-8261-c7986e62b39d service nova] Creating event network-vif-deleted:c0fa74eb-ef72-432b-af08-11ae0c5c25f7 for instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b on n-h2-764486-11 Jul 20 04:22:33.800308 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6aefa876-1e87-4f7f-8fd3-fbef297e5a28 req-013c266a-7fc7-4d81-8261-c7986e62b39d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073610 Jul 20 04:22:33.804725 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1017/2108] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:33.811348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:33.812073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:33.831792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.832273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:33.833103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:33.833750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.089178 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.098700 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1a745537-809e-4bb7-860d-96f6fe292eb0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.747149 Jul 20 04:22:34.099459 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1092/2109] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:34.115543 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-aabbadab-137a-4654-a8f7-20ba98812bab req-073e19e6-8e75-42cc-986d-d86ed41f01bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "name": "network-vif-plugged", "status": "completed", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:34.136499 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-aabbadab-137a-4654-a8f7-20ba98812bab req-073e19e6-8e75-42cc-986d-d86ed41f01bd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.137239 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-aabbadab-137a-4654-a8f7-20ba98812bab req-073e19e6-8e75-42cc-986d-d86ed41f01bd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.166208 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-aabbadab-137a-4654-a8f7-20ba98812bab req-073e19e6-8e75-42cc-986d-d86ed41f01bd service nova] Creating event network-vif-plugged:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:22:34.182393 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-aabbadab-137a-4654-a8f7-20ba98812bab req-073e19e6-8e75-42cc-986d-d86ed41f01bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080762 Jul 20 04:22:34.183318 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1093/2110] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:34.188809 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.192918 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.216436 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.217176 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.218417 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.219026 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.257667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.266734 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c029e89-0a39-46de-96e1-3265b66ee7d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1494 microversion: 2.1 time: 0.460693 Jul 20 04:22:34.288199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1018/2111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:33 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1494 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:34.367736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.368313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.380093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.383194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.385826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.386282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.427097 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 HTTP/1.1 Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:34.431154 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:34.432756 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f3ce279b-8d08-4796-a5ae-83d15bc2e699'} Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:34.433694 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:34.435083 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:34.436312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:34.436312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3acb406e-7e8a-44b6-9a03-d07d21a120c1 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 404 len: 111 microversion: 2.1 time: 0.072884 Jul 20 04:22:34.437109 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1019/2112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:34.446594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b97847b1-6b86-49b0-959f-41a7a05a4c1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839cd91280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.797212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b97847b1-6b86-49b0-959f-41a7a05a4c1e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf" status: 202 len: 0 microversion: 2.1 time: 0.355623 Jul 20 04:22:34.798100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1020/2113] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:34 2022] DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:34.804500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:34.809855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:34.829309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.830183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.831831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:34.832549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:34.912390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.923236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.925724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.927449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7904268c-e612-4763-8854-084471171570 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1265 microversion: 2.25 time: 0.127397 Jul 20 04:22:34.945865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:34.954821 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1021/2114] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:34.958990 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6ee46acb-cc76-4947-aa28-ac51a80cd73b tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1478 microversion: 2.1 time: 0.773592 Jul 20 04:22:34.962569 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1094/2115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:34 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1478 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:34.965650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbef662e-d56d-439f-a3ce-69509f013abb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839cef8dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.116895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.117518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:35.129615 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.135446 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.136588 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.137814 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.470508 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbef662e-d56d-439f-a3ce-69509f013abb tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7" status: 202 len: 0 microversion: 2.1 time: 0.511951 Jul 20 04:22:35.472635 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1022/2116] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:34 2022] DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:35.480914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:35.483022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:35.502507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.504772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:35.507428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:35.510415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.027822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.037019 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bab68a9e-11be-4739-9451-3051039390f0 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1494 microversion: 2.1 time: 0.561898 Jul 20 04:22:36.037612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1023/2117] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1494 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:36.055534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d835e9a-08cd-453a-9d13-e5d47e7f0e59 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'create', calling method: .version_select at 0x7f838b85a0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1586061681", "description": "tempest-description-249014865"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:36.231581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.245537 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5c2ee4c3-ecda-406f-abdc-a49311b029f2 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 1.134088 Jul 20 04:22:36.248331 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1095/2118] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:35 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:36.264141 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.267218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.281449 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.283785 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.285594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.287674 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.537245 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.562772 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.566692 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:36.569517 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-594fa538-11ab-483b-91eb-cf726d5bf617 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1265 microversion: 2.25 time: 0.319929 Jul 20 04:22:36.587667 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1096/2119] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:36.606043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:36.608281 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:36.639285 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.641598 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.643708 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.644594 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.853381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d835e9a-08cd-453a-9d13-e5d47e7f0e59 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.801713 Jul 20 04:22:36.861286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1024/2120] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:22:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.866599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-974f631c-541d-41fa-9f56-a30da9799204 req-790e07b3-b9ee-4d84-8040-067f8a406683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc269cd-7787-4fde-bf21-ca131b4e2738", "name": "network-vif-plugged", "status": "completed", "tag": "5c87874c-288b-4b97-8bd5-eb44cc50a7d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:36.894876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-974f631c-541d-41fa-9f56-a30da9799204 req-790e07b3-b9ee-4d84-8040-067f8a406683 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.895401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-974f631c-541d-41fa-9f56-a30da9799204 req-790e07b3-b9ee-4d84-8040-067f8a406683 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.933905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-974f631c-541d-41fa-9f56-a30da9799204 req-790e07b3-b9ee-4d84-8040-067f8a406683 service nova] Creating event network-vif-plugged:5c87874c-288b-4b97-8bd5-eb44cc50a7d7 for instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 on n-h2-764486-11 Jul 20 04:22:36.942837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-974f631c-541d-41fa-9f56-a30da9799204 req-790e07b3-b9ee-4d84-8040-067f8a406683 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080447 Jul 20 04:22:36.945554 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1025/2121] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.952752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a3f8a981-9ce3-4fb7-87c0-122d5cfa933f req-be903fbe-6a3d-407a-9f9e-84de3b5c468e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81420b50-7a17-416b-b1af-b84345fc990b", "name": "network-vif-deleted", "tag": "9d69e619-a96f-444f-97e6-d031220ad912"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:36.961906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a3f8a981-9ce3-4fb7-87c0-122d5cfa933f req-be903fbe-6a3d-407a-9f9e-84de3b5c468e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:36.962736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a3f8a981-9ce3-4fb7-87c0-122d5cfa933f req-be903fbe-6a3d-407a-9f9e-84de3b5c468e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:36.978178 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a3f8a981-9ce3-4fb7-87c0-122d5cfa933f req-be903fbe-6a3d-407a-9f9e-84de3b5c468e service nova] Creating event network-vif-deleted:9d69e619-a96f-444f-97e6-d031220ad912 for instance 81420b50-7a17-416b-b1af-b84345fc990b on n-h1-764486-11 Jul 20 04:22:36.988089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a3f8a981-9ce3-4fb7-87c0-122d5cfa933f req-be903fbe-6a3d-407a-9f9e-84de3b5c468e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039000 Jul 20 04:22:36.990481 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1026/2122] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:36.996965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b55b05c9-26ab-4457-bed9-8f3a7771fd59 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Action: 'update', calling method: .version_select at 0x7f839cd915e0>, body: {"security_group": {"name": "tempest-sg-hth-1804480642", "description": "tempest-description-hth-2048912067"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:37.193800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.203627 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bc12a21c-3722-4aad-98f6-834f0aab4bb4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1464 microversion: 2.1 time: 0.614757 Jul 20 04:22:37.205316 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1097/2123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:36 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1464 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:37.221952 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.222982 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.231295 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.231995 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.235100 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.235808 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.319684 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.321903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.324582 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.objects.instance [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lazy-loading 'fault' on Instance uuid 81420b50-7a17-416b-b1af-b84345fc990b {{(pid=123723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:22:37.428087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b55b05c9-26ab-4457-bed9-8f3a7771fd59 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/b386e894-e3db-440e-9a63-9c286ab51ad5" status: 200 len: 218 microversion: 2.1 time: 0.435305 Jul 20 04:22:37.435010 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1027/2124] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Jul 20 04:22:36 2022] PUT /compute/v2.1/os-security-groups/b386e894-e3db-440e-9a63-9c286ab51ad5 => generated 218 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:37.441389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.442459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.456989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.457824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.461378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.462076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.489406 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.498097 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1d7167aa-cc55-4989-8f48-95585fe9c450 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 200 len: 1305 microversion: 2.1 time: 0.290553 Jul 20 04:22:37.500853 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1098/2125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 1305 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:37.517005 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.518006 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.532980 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.535071 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.536044 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.538745 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.826867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:37.838078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28703171-fed0-4b83-8c19-4b76235e2eed tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1464 microversion: 2.1 time: 0.400904 Jul 20 04:22:37.842218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1028/2126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:37.853752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-24a66ec8-eaf1-41f9-90b4-ba184bb4d6a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839cef8dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.954261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-24a66ec8-eaf1-41f9-90b4-ba184bb4d6a4 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/b386e894-e3db-440e-9a63-9c286ab51ad5" status: 200 len: 218 microversion: 2.1 time: 0.110498 Jul 20 04:22:37.955066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1029/2127] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/os-security-groups/b386e894-e3db-440e-9a63-9c286ab51ad5 => generated 218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:37.960045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:37.961206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:37.983200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.983663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:37.988811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:37.993081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.181526 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.190076 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b07d04b5-01ed-4500-aa72-bf455243fe60 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1318 microversion: 2.1 time: 0.687330 Jul 20 04:22:38.195137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.205276 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1099/2128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:38.217803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.230266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:38.231553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0961ed0e-f00b-4c07-8eed-9fa9a0018b31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1265 microversion: 2.25 time: 0.275733 Jul 20 04:22:38.246321 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:38.249689 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1030/2129] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:37 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:38.259137 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.275653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb4ec9fc-a938-46f0-86e8-9223aa22ff99 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838be8e8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.283043 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.287800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.291932 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.292614 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.469694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:38.470119 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:38.471090 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:38.473668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:38.474309 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:38.600722 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.613697 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.616626 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.617898 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.618624 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.664933 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff51f1d5-8315-4aba-9ff6-2646b7cff95e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 1068 microversion: 2.1 time: 0.457834 Jul 20 04:22:38.676054 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1100/2130] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:38 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 1068 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:22:38.678629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb4ec9fc-a938-46f0-86e8-9223aa22ff99 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/b386e894-e3db-440e-9a63-9c286ab51ad5" status: 202 len: 0 microversion: 2.1 time: 0.427754 Jul 20 04:22:38.679787 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1031/2131] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:38 2022] DELETE /compute/v2.1/os-security-groups/b386e894-e3db-440e-9a63-9c286ab51ad5 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:38.684854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.685823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.695897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.699138 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.699973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.700967 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.702116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.704769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.714527 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.717214 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.718305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.720971 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.739139 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b HTTP/1.1 Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:38.742162 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:22:38.743771 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '81420b50-7a17-416b-b1af-b84345fc990b'} Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:38.744733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:22:38.746220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.754316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:38.755457 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d134d104-500f-43a4-8b68-c1ce296f0719 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 404 len: 111 microversion: 2.1 time: 0.074433 Jul 20 04:22:38.756687 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1032/2132] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:38.782797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.785133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.836344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.836837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.837972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.840036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.896773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 HTTP/1.1 Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:38.905551 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.907583 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f3ce279b-8d08-4796-a5ae-83d15bc2e699'} Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:38.908623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.910695 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.915587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:38.925003 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cddfdb7e-796d-4228-b1bd-7553ce1056c2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 404 len: 111 microversion: 2.1 time: 0.145578 Jul 20 04:22:38.928727 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1033/2133] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:38 2022] DELETE /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:38.943171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:38.943807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: f3ce279b-8d08-4796-a5ae-83d15bc2e699] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:38.952602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.953305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.954516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:38.955288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:38.993385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 HTTP/1.1 Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:38.996780 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.998351 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f3ce279b-8d08-4796-a5ae-83d15bc2e699'} Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:38.999205 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. Jul 20 04:22:39.000618 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.003815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Instance f3ce279b-8d08-4796-a5ae-83d15bc2e699 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:39.006459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3aece740-9962-4395-b7be-0389d1233a49 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699" status: 404 len: 111 microversion: 2.1 time: 0.073789 Jul 20 04:22:39.008647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1034/2134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/f3ce279b-8d08-4796-a5ae-83d15bc2e699 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:22:39.018752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838ba74550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.090307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:39.091724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:22:39.092506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.092506 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7 HTTP/1.1 Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:39.094693 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] Jul 20 04:22:39.096239 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4f304eea-f12c-41c9-8faf-f6c51d89faf7'} Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.097233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:22:39.098561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.099855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] Jul 20 04:22:39.104513 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.106273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group 4f304eea-f12c-41c9-8faf-f6c51d89faf7 does not exist Jul 20 04:22:39.106273 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-4cd9992c-530a-42ce-af88-afdc5afc3f3d'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:39.106645 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.107783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abbd2250-4fd7-451d-8a04-8be5511e8104 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7" status: 404 len: 194 microversion: 2.1 time: 0.093205 Jul 20 04:22:39.108895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1035/2135] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:39 2022] DELETE /compute/v2.1/os-security-groups/4f304eea-f12c-41c9-8faf-f6c51d89faf7 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:39.117118 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-d2c5c7f2-9533-475f-9008-c05485caee0e tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1473 microversion: 2.1 time: 0.426750 Jul 20 04:22:39.119637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838be8e310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.120152 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1101/2136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:38 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:39.176542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:39.177428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:22:39.178881 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.178881 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf HTTP/1.1 Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:39.182532 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] Jul 20 04:22:39.184100 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f82c90eb-3de7-4f02-b5c7-da5587c36ebf'} Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.185120 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:22:39.186455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.189070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] Jul 20 04:22:39.192264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.198002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group f82c90eb-3de7-4f02-b5c7-da5587c36ebf does not exist Jul 20 04:22:39.198002 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-8aa21d61-1659-48f5-b7d6-5b409f8804cb'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:39.199336 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af14ffac-a620-462d-90f3-13305a254a54 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf" status: 404 len: 194 microversion: 2.1 time: 0.085992 Jul 20 04:22:39.200241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1036/2137] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:39 2022] DELETE /compute/v2.1/os-security-groups/f82c90eb-3de7-4f02-b5c7-da5587c36ebf => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:22:39.208882 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839800f0d0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.223862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.224763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.234632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.236505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.238180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.242112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.293518 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:39.294424 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:22:39.295081 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.295081 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e HTTP/1.1 Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:39.297503 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: exception: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] Jul 20 04:22:39.300097 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'f2fb95b3-ff24-49d2-8608-ae77f3de3f5e'} Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.301180 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:22:39.302578 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.303902 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group f2fb95b3-ff24-49d2-8608-ae77f3de3f5e does not exist Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-f25e6aa3-1bc0-46c6-8596-22d7dc5a252d'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dccb955a-dafe-4c6b-b913-81942af3a719 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e" status: 404 len: 194 microversion: 2.1 time: 0.095357 Jul 20 04:22:39.306412 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1102/2138] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:39 2022] DELETE /compute/v2.1/os-security-groups/f2fb95b3-ff24-49d2-8608-ae77f3de3f5e => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:39.312841 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-744874412", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0eb1d281-bf01-4b82-9a03-afd9c1a3143e"}]}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:39.413865 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.neutron [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] validate_networks() for [('0eb1d281-bf01-4b82-9a03-afd9c1a3143e', None, None, None, None, None)] {{(pid=123723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:39.526863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.536964 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-207b3404-aebf-4d02-914b-d4e9c74226c4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1467 microversion: 2.1 time: 0.317682 Jul 20 04:22:39.548881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1037/2139] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1467 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:39.555781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.556823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:39.563491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.564289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.565730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:39.566406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:39.653620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.665758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.668043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:39.669886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-034c43ea-a517-46af-a95b-dc84bf336b4f tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1265 microversion: 2.25 time: 0.118896 Jul 20 04:22:39.680798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1038/2140] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:39 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:39.686326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b2f4c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:39.712806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:39.713729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group a2fdda8c-a517-441e-898b-e7d6972c35dd not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:22:39.714561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.714561 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd HTTP/1.1 Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:39.717127 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] Jul 20 04:22:39.718727 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a2fdda8c-a517-441e-898b-e7d6972c35dd'} Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.719855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:22:39.721910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.723238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] Jul 20 04:22:39.726730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:39.730525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group a2fdda8c-a517-441e-898b-e7d6972c35dd does not exist Jul 20 04:22:39.730525 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-cd909f78-73f4-4127-84bf-b56d73019b5b'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:39.730525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35662862-f7fb-48f0-b6e4-aad2786a6f5a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd" status: 404 len: 194 microversion: 2.1 time: 0.047457 Jul 20 04:22:39.730525 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1039/2141] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:39 2022] DELETE /compute/v2.1/os-security-groups/a2fdda8c-a517-441e-898b-e7d6972c35dd => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:40.141170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1174819164", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "9aed6768-9363-444e-b229-69849b4ce596"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:40.243824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] validate_networks() for [('9aed6768-9363-444e-b229-69849b4ce596', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:22:40.391862 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:40.392769 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image limits 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:40.393877 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Flavor pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:40.394388 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Image pref 0:0:0 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:40.394923 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.virt.hardware [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:40.414788 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.417439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.418984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.421062 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.453978 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:40.476079 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:40.499068 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.quota [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Getting quotas for user 56c5fdfb6fe54818bbf2e85a1eb1addd and project a6da30296e6046c8b5d9c91b215505e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:40.542201 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Going to run 1 instances... {{(pid=123723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:40.550973 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:40.651731 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-476905f4-5a69-46e8-a667-33743528099e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348891 Jul 20 04:22:40.653367 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1103/2142] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:40.668928 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:40.672212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:40.692928 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.696903 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:40.697924 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:40.698844 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.447797 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:41.461729 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9f606ec5-6fab-469a-b530-9b1cfa9aec33 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1466 microversion: 2.1 time: 0.801923 Jul 20 04:22:41.462684 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1104/2143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:40 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1466 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:41.476428 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f8398332820>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.627934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG neutronclient.v2_0.client [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist", "detail": ""}} {{(pid=123723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:41.628755 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.network.security_group_api [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 not found {{(pid=123723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:22:41.629363 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.wsgi [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.629363 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: request: DELETE /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63 HTTP/1.1 Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Accept: application/json Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Accept-Encoding: identity Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Connection: close Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Content-Length: 0 Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Content-Type: application/json Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Host: 10.222.0.49 Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: Openstack-System-Scope: None Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Id: None Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Domain-Name: None Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Identity-Status: Confirmed Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Is-Admin-Project: True Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Id: default Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Domain-Name: Default Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Role: member,reader Jul 20 04:22:41.631581 n-d-764486-11 devstack@n-api.service[123723]: X-Roles: member,reader Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Id: default Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-User-Domain-Name: Default Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: method: Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: exception: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] Jul 20 04:22:41.633151 n-d-764486-11 devstack@n-api.service[123723]: action_args: {'id': 'c2bdc936-7223-4344-9a0c-5d4d96c46e63'} Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:41.634083 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:22:41.635476 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.636773 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: ERROR nova.api.openstack.wsgi Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group c2bdc936-7223-4344-9a0c-5d4d96c46e63 does not exist Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: Neutron server returns request_ids: ['req-748b1e90-95c6-4774-b6ab-d0ea2f38bb90'] {{(pid=123723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-e420b899-9bbe-417a-97f8-c95f53f7cae2 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63" status: 404 len: 194 microversion: 2.1 time: 0.169318 Jul 20 04:22:41.638212 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1105/2144] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:41 2022] DELETE /compute/v2.1/os-security-groups/c2bdc936-7223-4344-9a0c-5d4d96c46e63 => generated 194 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:41.650267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:41.650895 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:41.680078 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.680570 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:41.685911 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:41.688304 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.194968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:22:42.196254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:22:42.197081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:22:42.197715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:22:42.198440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:22:42.228642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.238090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.240287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.244435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.335234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Getting quotas for project f82efb24d3e84efb95dd38a3c4a58c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:22:42.368860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Getting quotas for user f5636bb567c44ae394dcf034d99c0668 and project f82efb24d3e84efb95dd38a3c4a58c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:22:42.374420 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.389310 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bff10696-39bb-4cb4-a99b-34a72e4d7d10 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1473 microversion: 2.1 time: 0.750985 Jul 20 04:22:42.401632 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1106/2145] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:41 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1473 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.409383 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.413305 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.425820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:22:42.427302 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.427939 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.432494 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.433163 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.436800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:22:42.475250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:42.585729 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.598575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf663a43-e209-4111-af7f-a45acba83d5e tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.863779 Jul 20 04:22:42.599465 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-dc775e78-30c8-4efb-b191-967f2158b251 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1274 microversion: 2.1 time: 0.195260 Jul 20 04:22:42.600401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1040/2146] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:22:42.602253 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1107/2147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:42.609581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.610600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.618984 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-843920373"}} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:42.623404 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:42.636281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.637249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.638293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.639402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.655623 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.661617 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.665443 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:42.667679 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:42.849514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.866133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.871240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:42.873842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c514d576-4848-45b1-a495-e24376b7d554 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 200 len: 1265 microversion: 2.25 time: 0.269621 Jul 20 04:22:42.889308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1041/2148] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:42.905791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f839cd91160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.952317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:22:42.953099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Neutron security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:22:42.953627 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.953627 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2 HTTP/1.1 Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:42.956344 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] Jul 20 04:22:42.958085 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7e284631-b633-4bfa-98b4-5bfa36b8f2d2'} Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:42.958990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:22:42.960302 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.963294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Security group 7e284631-b633-4bfa-98b4-5bfa36b8f2d2 does not exist Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-6db07f04-b608-468a-b98f-daf2dc695810'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0fbd76bf-64ea-41d6-b1e7-77aeba09002e tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2" status: 404 len: 194 microversion: 2.1 time: 0.066209 Jul 20 04:22:42.968220 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1042/2149] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:42 2022] DELETE /compute/v2.1/os-security-groups/7e284631-b633-4bfa-98b4-5bfa36b8f2d2 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:42.969954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d57fbff-e156-4dcd-a8fd-ee536ff4f213 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:42.969954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d57fbff-e156-4dcd-a8fd-ee536ff4f213 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.119871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d57fbff-e156-4dcd-a8fd-ee536ff4f213 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:43.129863 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d57fbff-e156-4dcd-a8fd-ee536ff4f213 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1216 microversion: 2.1 time: 0.169910 Jul 20 04:22:43.130376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1043/2150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:42 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.153531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.154556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.167122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.182094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.183358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.185224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.281972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:43.421862 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7fc9031f-e509-4ba5-beda-d512ff8dde6b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "POST /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e/action" status: 202 len: 0 microversion: 2.1 time: 0.818053 Jul 20 04:22:43.428776 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1108/2151] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:22:42 2022] POST /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e/action => generated 0 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:22:43.435160 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.436244 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.455257 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.456405 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.457628 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.458311 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.495463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:43.573634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-617279d3-9e12-48a8-a90e-b89ff638ff2a tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 204 len: 0 microversion: 2.1 time: 0.438380 Jul 20 04:22:43.574623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1044/2152] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:22:43 2022] DELETE /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:22:43.586104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6992582-0c31-4a2f-a8d6-0be6acbf1512 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f839cced430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.702416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6992582-0c31-4a2f-a8d6-0be6acbf1512 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.126156 Jul 20 04:22:43.704758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1045/2153] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:43.716087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:43.717555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:43.737637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.756787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:43.758194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:43.759377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.230618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.249864 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73614830-65ac-4cd6-baee-f9cdb3e546a3 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1648 microversion: 2.1 time: 0.543707 Jul 20 04:22:44.253280 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1046/2154] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1648 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.273064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.274229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.288931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.293044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.294053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.296891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.570439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.582888 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fcc65ce-d68c-4dda-8efb-9a9dbc6d04b6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1314 microversion: 2.1 time: 0.324661 Jul 20 04:22:44.594197 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1047/2155] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.600756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.601603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.609829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.610870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.613521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.615395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.633781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] HTTP exception thrown: Instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b could not be found. Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Request method failure captured: Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b HTTP/1.1 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GUzq6fjiClDA5WfhQXhxNnHqeIwC1PKpcM3tWdfyBCkXerQUjwNrc9dXQtf-RL02shIiZkbjCi1sGzvgbRrA3PGQWWNj8jO4_bCaX53nuH49NfNKydFj5JJ4F80dFelD2JCIYKVoMx04yGY987QyA-yHSLw2GMM29p4iC0AqaIImw Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:44.635822 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8300dd17ab074d6ba2e717b2f9713a39", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: c21b3bf3ba4d4558950d7337a651587f Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b could not be found. Jul 20 04:22:44.637670 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3aa9e39d-8e21-4720-9cd3-1530e1b2b20b'} Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b could not be found. Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:44.638645 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b could not be found. Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b could not be found. Jul 20 04:22:44.640172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:44.641538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Returning 404 to user: Instance 3aa9e39d-8e21-4720-9cd3-1530e1b2b20b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:44.641538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0acfaaa1-1e85-4d98-975b-31a0fe9fcd31 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b" status: 404 len: 111 microversion: 2.25 time: 0.041758 Jul 20 04:22:44.641538 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1048/2156] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/3aa9e39d-8e21-4720-9cd3-1530e1b2b20b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:22:44.649627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.650250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:44.656649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.657136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.658022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:44.658872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:44.859731 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.879822 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-b89226fb-3d8b-494d-95cf-581a7a79d221 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1473 microversion: 2.1 time: 1.449065 Jul 20 04:22:44.880447 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1109/2157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:43 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1473 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.900065 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-6de2cffa-7a5f-4400-b304-14a83f27e3d8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f83983f1790>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:44.940891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:44.952636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9b34247-3079-4604-b598-99010f680595 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1220 microversion: 2.1 time: 0.309901 Jul 20 04:22:44.964139 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1049/2158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1220 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:44.979280 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-6de2cffa-7a5f-4400-b304-14a83f27e3d8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.084287 Jul 20 04:22:44.984502 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1110/2159] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:44 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:45.271656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:45.272306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:45.287252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.287707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.288533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.288971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.602386 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:45.603147 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:45.635694 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.636182 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.641066 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.643328 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.829567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:45.847657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b5f7845-4819-41cc-96dc-0e7c396fee7b tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1648 microversion: 2.1 time: 0.581245 Jul 20 04:22:45.859644 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1050/2160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:45 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1648 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:45.900435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:45.901195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:45.911652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.915489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:45.917299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:45.918745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.773800 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:46.785231 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-eaca6f21-f564-4ace-914d-0620b1a6bc88 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1314 microversion: 2.1 time: 1.188671 Jul 20 04:22:46.802228 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1111/2161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:45 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1314 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:46.807592 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:46.819318 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:46.832101 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.835156 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:46.840440 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:46.841070 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.010403 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.024160 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-60bc952d-fae8-44e5-a57b-6aa3bd4b10c7 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1274 microversion: 2.1 time: 0.220334 Jul 20 04:22:47.038227 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1112/2162] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:46 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:47.055593 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-5997809a-3383-4880-9cb3-99a8e3d64dea tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f839862a700>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.192238 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-5997809a-3383-4880-9cb3-99a8e3d64dea tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.151607 Jul 20 04:22:47.193369 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1113/2163] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:47.204003 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.204725 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:47.213281 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.213998 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.230366 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.238832 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.282053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.292647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3330fcda-04be-4baa-9ddd-1fe1e295957d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1473 microversion: 2.1 time: 1.399471 Jul 20 04:22:47.294456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1051/2164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:45 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1473 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:47.321267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1a994665-3b37-45ed-9839-0fb1109cbc25 req-4946116d-7e9e-4502-9dcc-c35a99359095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84", "name": "network-vif-deleted", "tag": "901375b9-d9dd-4c90-9424-bc917a51c4e2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:47.356389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1a994665-3b37-45ed-9839-0fb1109cbc25 req-4946116d-7e9e-4502-9dcc-c35a99359095 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.365084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1a994665-3b37-45ed-9839-0fb1109cbc25 req-4946116d-7e9e-4502-9dcc-c35a99359095 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.425141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1a994665-3b37-45ed-9839-0fb1109cbc25 req-4946116d-7e9e-4502-9dcc-c35a99359095 service nova] Creating event network-vif-deleted:901375b9-d9dd-4c90-9424-bc917a51c4e2 for instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 on n-h1-764486-11 Jul 20 04:22:47.467372 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1a994665-3b37-45ed-9839-0fb1109cbc25 req-4946116d-7e9e-4502-9dcc-c35a99359095 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165163 Jul 20 04:22:47.469661 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1052/2165] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:47.511423 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205f260c33ea4f0c8bf7f77c949073a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268aab5272cd47eb9457788b975f4f16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:47.522422 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-bcd8a67f-ffe4-4a79-aa5b-ac79b2764430 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 200 len: 1301 microversion: 2.1 time: 0.327838 Jul 20 04:22:47.536936 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1114/2166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 1301 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:47.807961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:47.808779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:47.820156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.823443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:47.824318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:47.824853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.042647 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.044104 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.057462 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.063218 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.066868 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.068320 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.326636 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:48.340515 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-cb77232b-8a6d-4f2e-86db-b7842290831c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1274 microversion: 2.1 time: 0.302551 Jul 20 04:22:48.344028 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1115/2167] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:22:48.353992 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ae42884f-bc96-4e20-a36d-9ef4f6a9e85b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b884c10>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.422321 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ae42884f-bc96-4e20-a36d-9ef4f6a9e85b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.077164 Jul 20 04:22:48.422926 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1116/2168] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:48.434795 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.435580 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.451438 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.452475 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.453314 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.453766 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.678474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:48.688044 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b05ae266-51ee-4b04-a639-e1097f94a6e6 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1314 microversion: 2.1 time: 0.884290 Jul 20 04:22:48.695658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1053/2169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:47 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:48.704108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:48.713229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] [instance: 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:48.737058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.737519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.738329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:48.738776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:48.801259 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] HTTP exception thrown: Instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 could not be found. Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Request method failure captured: Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 HTTP/1.1 Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KdTN2-VD_y2BayvTstq3C1n2hfS1OE4Wt94DclSw9oxrnMrzWGoUxVy0MTYjD9yfu3AubdCZ8sOuKmW_Jc1JuPCnzD0Zz_UUGJjJWBaa3F2g5aoWm1TTInTh1kXCkWc2SzRIkAD3MUtqMK5hYxbgJQMzhYDq1dZPUo0h5L2_eVwIM Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:22:48.807223 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/268aab5272cd47eb9457788b975f4f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_268aab5272cd47eb9457788b975f4f16", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 268aab5272cd47eb9457788b975f4f16 Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-163642821 Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 205f260c33ea4f0c8bf7f77c949073a4 Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsTestJSON-163642821-project Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 could not be found. Jul 20 04:22:48.809265 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84'} Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 could not be found. Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:22:48.810444 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 could not be found. Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 could not be found. Jul 20 04:22:48.812234 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:22:48.831401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Returning 404 to user: Instance 4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:22:48.832464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bb4d606-e6b0-4b33-891a-b953dc87e4bd tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84" status: 404 len: 111 microversion: 2.1 time: 0.135752 Jul 20 04:22:48.833442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1054/2170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/4fceea5a-4c0a-4fb0-a9eb-ab8f4a5e7a84 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:22:48.841957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd5250f1-74da-4869-abd3-7feb8005b302 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f838b878ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.809692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd5250f1-74da-4869-abd3-7feb8005b302 tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/85d89851-5186-4b98-b105-c9a6712bf6a7" status: 202 len: 0 microversion: 2.1 time: 0.971856 Jul 20 04:22:49.811183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1055/2171] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:48 2022] DELETE /compute/v2.1/os-security-groups/85d89851-5186-4b98-b105-c9a6712bf6a7 => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:49.818046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:49.818959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:49.842742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.843198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.843991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:49.844451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:49.972799 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.987857 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-84effa9e-a5b1-48a8-a6c3-08eecb625260 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1473 microversion: 2.1 time: 1.557306 Jul 20 04:22:49.988570 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1117/2172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:48 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1473 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:49.988859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:49.998665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3926b162-0614-4e5d-aa25-c712d52634d2 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1274 microversion: 2.1 time: 0.186244 Jul 20 04:22:50.005464 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1056/2173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:50.010401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-19610618-abfc-4de4-924f-41c88f6b1546 req-281e56e9-cbcf-4f95-8571-09f119626da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc48a5a-5001-4a56-9033-1ae346c09f98", "tag": "0893c2c4-fabd-4a91-a2d2-fdb617b1ed1d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:50.014562 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-4c0892c5-55b8-4c9d-8d5e-e606dfb5129b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b906430>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.055310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19610618-abfc-4de4-924f-41c88f6b1546 req-281e56e9-cbcf-4f95-8571-09f119626da5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.057454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19610618-abfc-4de4-924f-41c88f6b1546 req-281e56e9-cbcf-4f95-8571-09f119626da5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.107280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-19610618-abfc-4de4-924f-41c88f6b1546 req-281e56e9-cbcf-4f95-8571-09f119626da5 service nova] Creating event network-changed:0893c2c4-fabd-4a91-a2d2-fdb617b1ed1d for instance fdc48a5a-5001-4a56-9033-1ae346c09f98 on n-h1-764486-11 Jul 20 04:22:50.124621 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-19610618-abfc-4de4-924f-41c88f6b1546 req-281e56e9-cbcf-4f95-8571-09f119626da5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114123 Jul 20 04:22:50.125986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1057/2174] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:50.132992 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-4c0892c5-55b8-4c9d-8d5e-e606dfb5129b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.137576 Jul 20 04:22:50.138861 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1118/2175] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:49 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:50.151097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.155996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:50.170471 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-fdd30bbe-57c6-4001-8ee8-17b8c72de17c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] Calling method '.version_select at 0x7f83986055e0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:50.172336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.173093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.174166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:50.174830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:50.454212 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:50.521934 n-d-764486-11 devstack@n-api.service[123723]: DEBUG dbcounter [-] [123723] Writing DB stats nova_cell0:SELECT=6 {{(pid=123723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:51.070391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:51.083995 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29668c07-1905-4eae-b7a2-e38cc17cf8f8 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1314 microversion: 2.1 time: 0.953837 Jul 20 04:22:51.088545 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1058/2176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:50 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:51.105107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.107730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.132294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.134013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.136527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.142673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.502054 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-fdd30bbe-57c6-4001-8ee8-17b8c72de17c tempest-SecurityGroupsTestJSON-163642821 tempest-SecurityGroupsTestJSON-163642821-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a6abbac0-faff-4928-9e5f-3759214b4f13" status: 202 len: 0 microversion: 2.1 time: 1.364351 Jul 20 04:22:51.503734 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1119/2177] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:22:50 2022] DELETE /compute/v2.1/os-security-groups/a6abbac0-faff-4928-9e5f-3759214b4f13 => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:22:51.512148 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:51.513124 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:51.532030 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.532803 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:51.535509 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:51.550986 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.292780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:52.418737 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.428888 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-1fe0502d-998d-4115-a976-11f260b04309 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1316 microversion: 2.1 time: 0.923722 Jul 20 04:22:52.432248 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1120/2178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1316 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.444260 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-515fcb7e-bb73-4df9-86c0-1829add75d84 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b90e4c0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.576821 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-515fcb7e-bb73-4df9-86c0-1829add75d84 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.143356 Jul 20 04:22:52.577522 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1121/2179] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.593513 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.594031 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.613200 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.618157 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.622089 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.622754 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.712142 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Going to try to terminate instance {{(pid=123723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:22:52.926007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:52.928169 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-9d50ec41-18bc-444f-98e1-8ed2349f9d7d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 204 len: 0 microversion: 2.25 time: 0.349470 Jul 20 04:22:52.929330 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1122/2180] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:22:52 2022] DELETE /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:22:52.936035 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.940660 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.947749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-220152b5-9f2c-4fbe-8bbf-abf7c76aa7eb tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1473 microversion: 2.1 time: 1.850758 Jul 20 04:22:52.951164 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.951416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1059/2181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:51 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1473 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:52.954107 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.954899 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.958183 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.964982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:52.975801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:52.983748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.984447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:52.985360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:52.985968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.125493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:53.716405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.739350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.778387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:53.780198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e765305e-79f8-4320-92cb-fb3b6a2b2cd6 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1733 microversion: 2.25 time: 0.827271 Jul 20 04:22:53.781812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1060/2182] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1733 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:53.795725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:53.800194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:53.824584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.829103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:53.833328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:53.836131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.393813 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.policy [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:54.409730 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-ff99b126-9521-4645-9361-89c9a9bb29ab tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1314 microversion: 2.1 time: 1.478110 Jul 20 04:22:54.413823 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1123/2183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:52 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1314 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:54.424439 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-7c14bf8f-72c0-4080-a13a-21f6789fda6e tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f83986f43a0>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.524199 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [None req-7c14bf8f-72c0-4080-a13a-21f6789fda6e tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.108346 Jul 20 04:22:54.525297 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1124/2184] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:54 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:54.530555 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [req-78530ce2-68f9-4cfd-a063-d65688475189 req-00cf3e32-0a94-4371-9985-15969f97d88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022bab84-b6a8-4a41-b57c-3e10398f31c3", "tag": "eb72573f-539a-45d2-997a-8d751f89ef3e"}]} {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:54.579096 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-78530ce2-68f9-4cfd-a063-d65688475189 req-00cf3e32-0a94-4371-9985-15969f97d88e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.581851 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [req-78530ce2-68f9-4cfd-a063-d65688475189 req-00cf3e32-0a94-4371-9985-15969f97d88e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.650145 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.compute.server_external_events [req-78530ce2-68f9-4cfd-a063-d65688475189 req-00cf3e32-0a94-4371-9985-15969f97d88e service nova] Creating event network-changed:eb72573f-539a-45d2-997a-8d751f89ef3e for instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 on n-h1-764486-11 Jul 20 04:22:54.667954 n-d-764486-11 devstack@n-api.service[123723]: INFO nova.api.openstack.requestlog [req-78530ce2-68f9-4cfd-a063-d65688475189 req-00cf3e32-0a94-4371-9985-15969f97d88e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141182 Jul 20 04:22:54.673418 n-d-764486-11 devstack@n-api.service[123723]: [pid: 123723|app: 0|req: 1125/2185] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:54.685267 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.api.openstack.wsgi [None req-115147a7-87a5-43f6-9b28-939ec8101fa4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:54.687668 n-d-764486-11 devstack@n-api.service[123723]: DEBUG nova.compute.api [None req-115147a7-87a5-43f6-9b28-939ec8101fa4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:54.702685 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-115147a7-87a5-43f6-9b28-939ec8101fa4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.704512 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-115147a7-87a5-43f6-9b28-939ec8101fa4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:54.706401 n-d-764486-11 devstack@n-api.service[123723]: DEBUG oslo_concurrency.lockutils [None req-115147a7-87a5-43f6-9b28-939ec8101fa4 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:54.731069 n-d-764486-11 devstack@n-api.service[123723]: Traceback (most recent call last): Jul 20 04:22:54.731298 n-d-764486-11 devstack@n-api.service[123723]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 20 04:22:54.731298 n-d-764486-11 devstack@n-api.service[123723]: timer() Jul 20 04:22:54.731495 n-d-764486-11 devstack@n-api.service[123723]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 20 04:22:54.731495 n-d-764486-11 devstack@n-api.service[123723]: cb(*args, **kw) Jul 20 04:22:54.731651 n-d-764486-11 devstack@n-api.service[123723]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 20 04:22:54.731651 n-d-764486-11 devstack@n-api.service[123723]: waiter.switch() Jul 20 04:22:54.731825 n-d-764486-11 devstack@n-api.service[123723]: greenlet.error: cannot switch to a different thread Jul 20 04:22:55.402797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:55.425564 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25a82aa4-6739-447b-81c4-dd8fc7371676 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1316 microversion: 2.1 time: 1.641236 Jul 20 04:22:55.426761 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1061/2186] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:53 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1316 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:55.432511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-41f2b228-7727-4720-992f-7ab3144d1d4f req-9e30e970-d889-4839-a867-b62da9cfd0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "name": "network-vif-plugged", "status": "completed", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:55.456924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-41f2b228-7727-4720-992f-7ab3144d1d4f req-9e30e970-d889-4839-a867-b62da9cfd0a7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.457608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-41f2b228-7727-4720-992f-7ab3144d1d4f req-9e30e970-d889-4839-a867-b62da9cfd0a7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.488283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-41f2b228-7727-4720-992f-7ab3144d1d4f req-9e30e970-d889-4839-a867-b62da9cfd0a7 service nova] Creating event network-vif-plugged:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:22:55.495743 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-41f2b228-7727-4720-992f-7ab3144d1d4f req-9e30e970-d889-4839-a867-b62da9cfd0a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067199 Jul 20 04:22:55.497042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1062/2187] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:55.510155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:55.511414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:55.518961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.519763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:55.521060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:55.521701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.870085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.889975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.894909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:56.903175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91c970be-499f-4fa2-96ef-8894c9660d07 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1733 microversion: 2.25 time: 1.403980 Jul 20 04:22:56.909244 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1063/2188] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:55 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1733 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:56.924749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:56.925375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:56.950254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.950710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:56.951493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:56.952101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.626910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:57.635694 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5e50c6d-8c22-4c58-bb99-a92408520f0b tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1314 microversion: 2.1 time: 0.724812 Jul 20 04:22:57.640697 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1064/2189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:56 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.646149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8edef215-8b09-44e3-89c8-d5a2eb55316c tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b9c04c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.771003 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8edef215-8b09-44e3-89c8-d5a2eb55316c tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.129009 Jul 20 04:22:57.771889 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1065/2190] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:57.787388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:57.788927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:57.802292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.803117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:57.804080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:57.806329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.869747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:58.884652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91791f2a-1201-4d0d-8b56-ca06e3da47d8 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1316 microversion: 2.1 time: 1.111415 Jul 20 04:22:58.885665 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1066/2191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:22:57 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:22:58.900134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4b7bb798-9f30-4d2c-90f8-62f4f40a1ff0 req-9b7f5ca5-f846-4a61-a5a6-3d43ae18e0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc48a5a-5001-4a56-9033-1ae346c09f98", "name": "network-vif-plugged", "status": "completed", "tag": "0893c2c4-fabd-4a91-a2d2-fdb617b1ed1d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:58.919824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4b7bb798-9f30-4d2c-90f8-62f4f40a1ff0 req-9b7f5ca5-f846-4a61-a5a6-3d43ae18e0aa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:58.920557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4b7bb798-9f30-4d2c-90f8-62f4f40a1ff0 req-9b7f5ca5-f846-4a61-a5a6-3d43ae18e0aa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:58.975892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4b7bb798-9f30-4d2c-90f8-62f4f40a1ff0 req-9b7f5ca5-f846-4a61-a5a6-3d43ae18e0aa service nova] Creating event network-vif-plugged:0893c2c4-fabd-4a91-a2d2-fdb617b1ed1d for instance fdc48a5a-5001-4a56-9033-1ae346c09f98 on n-h1-764486-11 Jul 20 04:22:58.986896 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4b7bb798-9f30-4d2c-90f8-62f4f40a1ff0 req-9b7f5ca5-f846-4a61-a5a6-3d43ae18e0aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099262 Jul 20 04:22:59.011207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1067/2192] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:22:59.028049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:22:59.029256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:22:59.066283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.068491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.069549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:22:59.072677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:22:59.130740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:22:59.425513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.434309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.452521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:22:59.457778 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e0929f6-e90f-4fcd-b37b-d0caf77fecd5 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 200 len: 1666 microversion: 2.25 time: 0.444957 Jul 20 04:22:59.479746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1068/2193] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:22:59 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 1666 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:22:59.633305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1959056920", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "ae8e82e2-541d-4bad-b7ba-1a3c1e47e30c"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:22:59.736298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] validate_networks() for [('ae8e82e2-541d-4bad-b7ba-1a3c1e47e30c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:01.103150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:01.104265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:01.104781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:01.105188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:01.105600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:01.124078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.127100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.128183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.129843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.175366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Getting quotas for project 79c01dad88a044848fde724f2e610051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:01.190036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Getting quotas for user 6889981a862845ba8f1817d605db27db and project 79c01dad88a044848fde724f2e610051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:01.243002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:01.245948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:01.416581 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b4ddb81-082b-437e-ad77-6f8937c57f02 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935413 Jul 20 04:23:01.423483 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1069/2194] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:01.435987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:01.441166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:01.459951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.460958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:01.472153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:01.474841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.420760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.428790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6973fe0-7528-418a-9f55-fb29c967b9be tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1501 microversion: 2.1 time: 1.000264 Jul 20 04:23:02.429383 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1070/2195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:01 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1501 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:02.443929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9617805-f1b3-45b4-86fa-af5794a30a95 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba74e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.548116 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9617805-f1b3-45b4-86fa-af5794a30a95 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.107918 Jul 20 04:23:02.550587 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1071/2196] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:02.555530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.556256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:02.572069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.572941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.573915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.574634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.911672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:02.927862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3e89033-9477-4529-ab2d-bcdb2403519c tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1316 microversion: 2.1 time: 0.375961 Jul 20 04:23:02.929948 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1072/2197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:02.938517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0091c039-f881-4f96-a9a8-cb0460670b6c req-8fa00eac-0f6d-4eb2-a54a-d697937bba66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e", "name": "network-vif-deleted", "tag": "6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:02.952623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0091c039-f881-4f96-a9a8-cb0460670b6c req-8fa00eac-0f6d-4eb2-a54a-d697937bba66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:02.953232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0091c039-f881-4f96-a9a8-cb0460670b6c req-8fa00eac-0f6d-4eb2-a54a-d697937bba66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:02.970153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0091c039-f881-4f96-a9a8-cb0460670b6c req-8fa00eac-0f6d-4eb2-a54a-d697937bba66 service nova] Creating event network-vif-deleted:6dc3ce4d-c65a-440e-9c56-3c46dd3e74cd for instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e on n-h2-764486-11 Jul 20 04:23:02.975650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0091c039-f881-4f96-a9a8-cb0460670b6c req-8fa00eac-0f6d-4eb2-a54a-d697937bba66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044271 Jul 20 04:23:02.981136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1073/2198] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:02.992994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:02.993888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.002584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.003337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.004292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.004928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.030264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] HTTP exception thrown: Instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e could not be found. Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Request method failure captured: Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e HTTP/1.1 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GUzq6fjiClDA5WfhQXhxNnHqeIwC1PKpcM3tWdfyBCkXerQUjwNrc9dXQtf-RL02shIiZkbjCi1sGzvgbRrA3PGQWWNj8jO4_bCaX53nuH49NfNKydFj5JJ4F80dFelD2JCIYKVoMx04yGY987QyA-yHSLw2GMM29p4iC0AqaIImw Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:03.033154 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8300dd17ab074d6ba2e717b2f9713a39", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: c21b3bf3ba4d4558950d7337a651587f Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e could not be found. Jul 20 04:23:03.034227 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e'} Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e could not be found. Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:03.034794 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e could not be found. Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e could not be found. Jul 20 04:23:03.035702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:03.039984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Returning 404 to user: Instance c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:03.041239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b60f378-d852-42f0-abd5-f0a501f3bb74 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e" status: 404 len: 111 microversion: 2.25 time: 0.058646 Jul 20 04:23:03.042017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1074/2199] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:02 2022] GET /compute/v2.1/servers/c3c37184-4f4e-4aa6-b05c-7f7b2ae3fb9e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:03.047228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:03.048702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.056537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.057273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.058839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.059491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.164323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:03.184784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b4ed2e5-f75a-4e11-8329-224a79d8f097 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1270 microversion: 2.1 time: 0.140916 Jul 20 04:23:03.199358 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1075/2200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:03 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:03.226655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:03.227311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:03.247819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.248702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.255595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:03.258555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:03.333445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lazy-loading 'flavor' on Instance uuid fdc48a5a-5001-4a56-9033-1ae346c09f98 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:03.699763 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b40e489-1ca9-4102-abb4-26308c2e67dd tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "POST /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98/action" status: 202 len: 0 microversion: 2.1 time: 0.496916 Jul 20 04:23:03.702042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1076/2201] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:03 2022] POST /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:04.196657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1064631703", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:04.368868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] validate_networks() for [('3be1a5c3-f459-4f21-b8e0-bb88f21e1335', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:06.111843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:06.113474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:06.114019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:06.114431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:06.114844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:06.135192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.135645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.136916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.137536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.164654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Getting quotas for project ee50acf92da24b3185b6da3c165a7d71. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:06.175050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Getting quotas for user 99ee2b91f0c04c59a1b76708d2c85083 and project ee50acf92da24b3185b6da3c165a7d71. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:06.198566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:06.201321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:06.215561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:06.259865 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5499940b-1fe9-489e-9a3b-e40c1ad8d47b tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.555665 Jul 20 04:23:06.264959 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1077/2202] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:06.272669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-905365df-7128-4e9d-884f-1bd83b85b235 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '.version_select at 0x7f838b878940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.322441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-905365df-7128-4e9d-884f-1bd83b85b235 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869364950" status: 204 len: 0 microversion: 2.25 time: 0.055714 Jul 20 04:23:06.323575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1078/2203] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:23:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869364950 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:23:06.348697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56f00260-c1c1-444c-bd5b-de6d7de8eb36 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b830ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.434024 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56f00260-c1c1-444c-bd5b-de6d7de8eb36 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.109029 Jul 20 04:23:06.434770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1079/2204] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:06.446634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:06.449158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:06.457155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.457917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:06.458996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:06.460071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.492084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:07.505504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1820b83f-d0af-4abe-8824-61782c20aad1 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1492 microversion: 2.1 time: 1.069570 Jul 20 04:23:07.515904 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1080/2205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:06 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1492 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:07.536857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f20d5fc0-bd18-400a-a265-d04a957235f8 req-6e9962af-eb02-40fe-ba3d-117e305a4221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022bab84-b6a8-4a41-b57c-3e10398f31c3", "name": "network-vif-plugged", "status": "completed", "tag": "eb72573f-539a-45d2-997a-8d751f89ef3e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:07.564748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f20d5fc0-bd18-400a-a265-d04a957235f8 req-6e9962af-eb02-40fe-ba3d-117e305a4221 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.568579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f20d5fc0-bd18-400a-a265-d04a957235f8 req-6e9962af-eb02-40fe-ba3d-117e305a4221 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.592211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f20d5fc0-bd18-400a-a265-d04a957235f8 req-6e9962af-eb02-40fe-ba3d-117e305a4221 service nova] Creating event network-vif-plugged:eb72573f-539a-45d2-997a-8d751f89ef3e for instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 on n-h1-764486-11 Jul 20 04:23:07.609416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f20d5fc0-bd18-400a-a265-d04a957235f8 req-6e9962af-eb02-40fe-ba3d-117e305a4221 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091416 Jul 20 04:23:07.611659 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1081/2206] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:07.635167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:07.636184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:07.681584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.684399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:07.691408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:07.696819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.384172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:08.395511 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da431693-c9b0-4f4a-a572-4d559e23075a tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1316 microversion: 2.1 time: 0.782340 Jul 20 04:23:08.397011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1082/2207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:07 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1316 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:08.406570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:08.407249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:08.420657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.421113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:08.421908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:08.422890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.026262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.048956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-995df11b-d352-4d59-9ccb-3635eb26b6ad tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1318 microversion: 2.1 time: 0.650802 Jul 20 04:23:09.053771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1083/2208] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:08 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.060843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.062383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.071038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.071728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.072696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.073133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.173595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:09.189402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e3d69fc-923d-4acf-88d4-3ef59cb0ffe2 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1282 microversion: 2.1 time: 0.133506 Jul 20 04:23:09.191819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1084/2209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.202993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09213240-235c-423b-845b-581a30e84726 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f839cef8dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.265449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09213240-235c-423b-845b-581a30e84726 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.071359 Jul 20 04:23:09.266696 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1085/2210] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:09 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:09.658938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:09.659582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:09.678484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.678484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.684316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:09.685871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:09.781004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:10.009243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce33fd5c-ee6e-4400-b261-327a577e961e tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 204 len: 0 microversion: 2.1 time: 0.738539 Jul 20 04:23:10.013475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1086/2211] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:09 2022] DELETE /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:10.030460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e6b8878d-4bda-485f-9b82-ece3edb840ca req-8a24d531-df2c-4502-acd1-b87feb23e936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe55fb2-74aa-4293-b7f3-dcac8e43c130", "tag": "086e22dc-2965-43d3-b13e-4814c5ec0c9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:10.058226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e6b8878d-4bda-485f-9b82-ece3edb840ca req-8a24d531-df2c-4502-acd1-b87feb23e936 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.062433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e6b8878d-4bda-485f-9b82-ece3edb840ca req-8a24d531-df2c-4502-acd1-b87feb23e936 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.103755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e6b8878d-4bda-485f-9b82-ece3edb840ca req-8a24d531-df2c-4502-acd1-b87feb23e936 service nova] Creating event network-changed:086e22dc-2965-43d3-b13e-4814c5ec0c9c for instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 on n-h2-764486-11 Jul 20 04:23:10.119028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e6b8878d-4bda-485f-9b82-ece3edb840ca req-8a24d531-df2c-4502-acd1-b87feb23e936 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104026 Jul 20 04:23:10.120953 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1087/2212] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:10.135957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.140046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.154026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.158204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.159239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.159763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.251904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:10.316385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:10.462299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-890e847e-28fd-4ca4-aaa8-17ef0332954c tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 204 len: 0 microversion: 2.25 time: 0.333729 Jul 20 04:23:10.463373 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1088/2213] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:23:10 2022] DELETE /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:23:10.474557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:10.483061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:10.493812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.494383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:10.495313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:10.495882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.483165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:11.497945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2acda781-5030-458d-8e70-c689bb9fa711 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1503 microversion: 2.1 time: 1.029779 Jul 20 04:23:11.498544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1089/2214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:10 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1503 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:11.517822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-beabae66-c0f6-4525-bc65-04ec0dcbc28e req-1f038c33-a0e0-473a-8621-f724dbf4ce85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "name": "network-vif-unplugged", "status": "completed", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:11.561872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-beabae66-c0f6-4525-bc65-04ec0dcbc28e req-1f038c33-a0e0-473a-8621-f724dbf4ce85 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.562326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-beabae66-c0f6-4525-bc65-04ec0dcbc28e req-1f038c33-a0e0-473a-8621-f724dbf4ce85 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.593653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-beabae66-c0f6-4525-bc65-04ec0dcbc28e req-1f038c33-a0e0-473a-8621-f724dbf4ce85 service nova] Creating event network-vif-unplugged:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:23:11.618283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-beabae66-c0f6-4525-bc65-04ec0dcbc28e req-1f038c33-a0e0-473a-8621-f724dbf4ce85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116731 Jul 20 04:23:11.621505 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1090/2215] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:11.635215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:11.635215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:11.650978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.651436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:11.652612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:11.658741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.197638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:12.206605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b2b34f8-ceeb-48f4-970f-f594fa3af69f tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1498 microversion: 2.1 time: 0.583775 Jul 20 04:23:12.218016 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1091/2216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:11 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1498 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:12.218016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:12.218016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:12.238241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.238241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:12.239079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:12.240804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.009124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:13.019304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7212f34c-c678-4fae-b548-5ff3cc52f7fb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1318 microversion: 2.1 time: 0.808669 Jul 20 04:23:13.020135 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1092/2217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:12 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:13.033817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:13.037195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:13.052151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.052976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.057332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.057959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.540026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:13.549910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8a5d356-95b3-4e8f-830a-4ed7d5fa7315 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.525956 Jul 20 04:23:13.560027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1093/2218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:13.566274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26fdfac2-2bfe-4897-bba9-d1e635c6e763 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba10430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:13.692870 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26fdfac2-2bfe-4897-bba9-d1e635c6e763 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1454 microversion: 2.1 time: 0.131205 Jul 20 04:23:13.697841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1094/2219] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:13.707711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:13.712672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:13.737758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.738523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.739580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.740342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.833047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:13.843247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:13.844089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lazy-loading 'fault' on Instance uuid 4e5f0b31-a570-467c-9fa5-0b6f31db53ad {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:14.080984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.104574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.106524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.113476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e96bae51-670d-414a-9d57-b7ae5399f3b9 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 200 len: 1351 microversion: 2.25 time: 0.413958 Jul 20 04:23:14.114416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1095/2220] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:13 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 1351 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:14.124032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.133799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.152265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.152757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.153572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.154003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.328057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d0f5dc2-5587-4365-aa93-3c91a45d9809 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.212456 Jul 20 04:23:14.330728 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1096/2221] 10.222.0.49 () {58 vars in 1295 bytes} [Wed Jul 20 04:23:14 2022] DELETE /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3/os-server-password => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:14.341029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a39cfec7-0a6a-4a9e-9af8-10606604ab02 req-5237b10c-c0fd-4368-9fc2-4ca79d2b9a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:14.365047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a39cfec7-0a6a-4a9e-9af8-10606604ab02 req-5237b10c-c0fd-4368-9fc2-4ca79d2b9a8e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.365440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a39cfec7-0a6a-4a9e-9af8-10606604ab02 req-5237b10c-c0fd-4368-9fc2-4ca79d2b9a8e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.396916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a39cfec7-0a6a-4a9e-9af8-10606604ab02 req-5237b10c-c0fd-4368-9fc2-4ca79d2b9a8e service nova] Creating event network-changed:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:23:14.405878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a39cfec7-0a6a-4a9e-9af8-10606604ab02 req-5237b10c-c0fd-4368-9fc2-4ca79d2b9a8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073719 Jul 20 04:23:14.411400 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1097/2222] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:14.420110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.420860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.435226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.439464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.440777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.442242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.566811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c5fdfb6fe54818bbf2e85a1eb1addd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6da30296e6046c8b5d9c91b215505e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:14.579224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edf5f34f-2104-4412-8305-16c053bd1b73 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 200 len: 1456 microversion: 2.1 time: 0.165372 Jul 20 04:23:14.579970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1098/2223] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:14.593183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-57ef23d4-3001-4fc5-a77f-a923fef68387 req-db2bb056-e1d2-435d-8e53-3579d2613e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5f0b31-a570-467c-9fa5-0b6f31db53ad", "name": "network-vif-deleted", "tag": "89488716-dcfe-4e5a-99e2-bb2b8ce560a4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:14.603731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-57ef23d4-3001-4fc5-a77f-a923fef68387 req-db2bb056-e1d2-435d-8e53-3579d2613e2c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.604206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-57ef23d4-3001-4fc5-a77f-a923fef68387 req-db2bb056-e1d2-435d-8e53-3579d2613e2c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.622673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-57ef23d4-3001-4fc5-a77f-a923fef68387 req-db2bb056-e1d2-435d-8e53-3579d2613e2c service nova] Creating event network-vif-deleted:89488716-dcfe-4e5a-99e2-bb2b8ce560a4 for instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad on n-h2-764486-11 Jul 20 04:23:14.629701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-57ef23d4-3001-4fc5-a77f-a923fef68387 req-db2bb056-e1d2-435d-8e53-3579d2613e2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046844 Jul 20 04:23:14.631154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1099/2224] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:14.637911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7dd3dcae-6710-4d8f-966e-2e554c36afd3 req-b2703aa6-5be2-45cf-9484-46a15a1abd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe55fb2-74aa-4293-b7f3-dcac8e43c130", "name": "network-vif-plugged", "status": "completed", "tag": "086e22dc-2965-43d3-b13e-4814c5ec0c9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:14.649305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7dd3dcae-6710-4d8f-966e-2e554c36afd3 req-b2703aa6-5be2-45cf-9484-46a15a1abd1e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.649898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7dd3dcae-6710-4d8f-966e-2e554c36afd3 req-b2703aa6-5be2-45cf-9484-46a15a1abd1e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.710364 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7dd3dcae-6710-4d8f-966e-2e554c36afd3 req-b2703aa6-5be2-45cf-9484-46a15a1abd1e service nova] Creating event network-vif-plugged:086e22dc-2965-43d3-b13e-4814c5ec0c9c for instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 on n-h2-764486-11 Jul 20 04:23:14.725886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7dd3dcae-6710-4d8f-966e-2e554c36afd3 req-b2703aa6-5be2-45cf-9484-46a15a1abd1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093046 Jul 20 04:23:14.748291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1100/2225] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:14.753145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:14.754124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:14.762659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.763284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:14.764376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:14.764954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.166610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:15.175156 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12b07a34-c160-4157-a8fb-afd27bd6aec3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1318 microversion: 2.1 time: 0.429190 Jul 20 04:23:15.176068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1101/2226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:14 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:15.180967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:15.181462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:15.188883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.189395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.190217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.190617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.219774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e677ad9-36cc-4fdf-8c32-fbf0cd277828 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.042031 Jul 20 04:23:15.226379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1102/2227] 10.222.0.49 () {58 vars in 1292 bytes} [Wed Jul 20 04:23:15 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3/os-server-password => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:23:15.226379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:15.226787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:15.233236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.233719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:15.235157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:15.235602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.015014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.023824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-360f8050-67ca-4e48-9a71-012d6ec5e57f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.801973 Jul 20 04:23:16.025205 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1103/2228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:15 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.030559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4efd60b-d12d-4c1a-bbc0-2fe633ff37af tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba74820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.086551 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4efd60b-d12d-4c1a-bbc0-2fe633ff37af tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1463 microversion: 2.1 time: 0.059744 Jul 20 04:23:16.087477 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1104/2229] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1463 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.092215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.092854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: 4e5f0b31-a570-467c-9fa5-0b6f31db53ad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.099364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.099822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.100633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.101072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.116747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] HTTP exception thrown: Instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad could not be found. Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Request method failure captured: Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad HTTP/1.1 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GUzq6fjiClDA5WfhQXhxNnHqeIwC1PKpcM3tWdfyBCkXerQUjwNrc9dXQtf-RL02shIiZkbjCi1sGzvgbRrA3PGQWWNj8jO4_bCaX53nuH49NfNKydFj5JJ4F80dFelD2JCIYKVoMx04yGY987QyA-yHSLw2GMM29p4iC0AqaIImw Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:16.118433 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8300dd17ab074d6ba2e717b2f9713a39", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: c21b3bf3ba4d4558950d7337a651587f Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad could not be found. Jul 20 04:23:16.119631 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4e5f0b31-a570-467c-9fa5-0b6f31db53ad'} Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad could not be found. Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:16.120249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad could not be found. Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad could not be found. Jul 20 04:23:16.121735 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.122596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Returning 404 to user: Instance 4e5f0b31-a570-467c-9fa5-0b6f31db53ad could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:16.122596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e54ec297-3c2a-487f-aec4-ba765a9d8115 tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad" status: 404 len: 111 microversion: 2.25 time: 0.031367 Jul 20 04:23:16.122596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1105/2230] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/4e5f0b31-a570-467c-9fa5-0b6f31db53ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:16.128507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.129009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.135011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.135464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.136233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.136710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.155494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:16.164855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:16.190152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:16.248017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6984bc12-57cb-46c8-8e5c-9ab642029b4b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "DELETE /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 204 len: 0 microversion: 2.1 time: 0.123494 Jul 20 04:23:16.248672 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1106/2231] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:16 2022] DELETE /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:23:16.256831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.257535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.263617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.264071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.264865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.265371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.270175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=6,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 HTTP/1.1 Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:16.282594 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:16.283985 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fdc48a5a-5001-4a56-9033-1ae346c09f98'} Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:16.284847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:16.287472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:16.288815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:16.288815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97668028-e5c8-4668-af7a-6d3ba0e72332 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 404 len: 111 microversion: 2.1 time: 0.034923 Jul 20 04:23:16.289973 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1107/2232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:16.295572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-361a13ac-0b06-4fa3-ae84-9064844cdccf tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b9c0040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.343634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-361a13ac-0b06-4fa3-ae84-9064844cdccf tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 200 len: 1463 microversion: 2.1 time: 0.052536 Jul 20 04:23:16.344328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1108/2233] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 1463 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.349083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.349577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.356016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.356506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.357297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.357735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.387150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:23:16.471017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb3d7230-b3fa-488f-a6ac-66e7a0db8d2d tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 204 len: 0 microversion: 2.25 time: 0.125373 Jul 20 04:23:16.471833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1109/2234] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:23:16 2022] DELETE /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:23:16.476724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.477412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.483403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.483935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.485420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.485861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.728170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.736575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebf0ceee-1d7d-4b23-933b-b7c0688a9ecb tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1508 microversion: 2.1 time: 0.263673 Jul 20 04:23:16.737167 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1110/2235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:16.742092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:16.742869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:16.754367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.755271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.756248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:16.756787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:16.978487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:16.986960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4de279b9-1be6-41e1-9d3d-62052489ccc1 tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1509 microversion: 2.1 time: 0.248622 Jul 20 04:23:16.987837 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1111/2236] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:16 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:17.001509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.002196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.010669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.011479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.012282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.013419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.028705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 HTTP/1.1 Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:17.030505 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:17.032375 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fdc48a5a-5001-4a56-9033-1ae346c09f98'} Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:17.033123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:17.034334 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:17.036117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:17.037317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f58207a-1b03-4b06-ad4f-d824eec24636 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 404 len: 111 microversion: 2.1 time: 0.047547 Jul 20 04:23:17.038066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1112/2237] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:16 2022] DELETE /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:17.043863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.044535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.051423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.051762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.052643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.053294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.201601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.210149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c562d44-b67d-4e98-9e8d-bba1db3d06e1 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1466 microversion: 2.1 time: 0.170870 Jul 20 04:23:17.210738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1113/2238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1466 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:17.215386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.216078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.226335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.226790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.227586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.228021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.381386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.389669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.392339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.393805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2fc8698-a995-4953-8b1a-4af36978a2fa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1564 microversion: 2.25 time: 0.182146 Jul 20 04:23:17.394638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1114/2239] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:17.399899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ed5ffe17-7e51-47d3-8c9e-55100207c515 req-5e873d46-3dcc-44dd-ae76-ea364ef0d584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc48a5a-5001-4a56-9033-1ae346c09f98", "name": "network-vif-deleted", "tag": "0893c2c4-fabd-4a91-a2d2-fdb617b1ed1d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:17.408707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed5ffe17-7e51-47d3-8c9e-55100207c515 req-5e873d46-3dcc-44dd-ae76-ea364ef0d584 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.409146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed5ffe17-7e51-47d3-8c9e-55100207c515 req-5e873d46-3dcc-44dd-ae76-ea364ef0d584 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.421417 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ed5ffe17-7e51-47d3-8c9e-55100207c515 req-5e873d46-3dcc-44dd-ae76-ea364ef0d584 service nova] Creating event network-vif-deleted:0893c2c4-fabd-4a91-a2d2-fdb617b1ed1d for instance fdc48a5a-5001-4a56-9033-1ae346c09f98 on n-h1-764486-11 Jul 20 04:23:17.426367 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ed5ffe17-7e51-47d3-8c9e-55100207c515 req-5e873d46-3dcc-44dd-ae76-ea364ef0d584 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030244 Jul 20 04:23:17.427103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1115/2240] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:17.437020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.437760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.444226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.444725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.445493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.445927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.584885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.592689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83afd033-c8f7-4850-91e5-be54ab92a9a2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1508 microversion: 2.1 time: 0.160946 Jul 20 04:23:17.599834 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1116/2241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:17.606164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-421c481b-3c5c-4db6-84b1-63da44286237 req-a8e4c74f-1403-42ac-8cd6-3fe3b340f08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "name": "network-vif-plugged", "status": "completed", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:17.611167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:17.618838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-421c481b-3c5c-4db6-84b1-63da44286237 req-a8e4c74f-1403-42ac-8cd6-3fe3b340f08b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.619280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-421c481b-3c5c-4db6-84b1-63da44286237 req-a8e4c74f-1403-42ac-8cd6-3fe3b340f08b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.633067 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-421c481b-3c5c-4db6-84b1-63da44286237 req-a8e4c74f-1403-42ac-8cd6-3fe3b340f08b service nova] Creating event network-vif-plugged:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:23:17.639057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-421c481b-3c5c-4db6-84b1-63da44286237 req-a8e4c74f-1403-42ac-8cd6-3fe3b340f08b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037664 Jul 20 04:23:17.639841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1117/2242] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:17.645890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.646590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.653438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.653890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.654692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.655196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.949219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:17.961419 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14e78ba3-4271-43cb-95bb-def3ed8b3d7a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.319126 Jul 20 04:23:17.963943 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1118/2243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:17.971504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:17.972422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: fdc48a5a-5001-4a56-9033-1ae346c09f98] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:17.985152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.985698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:17.987177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:17.989025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.015566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 HTTP/1.1 Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:18.017668 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:18.018819 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fdc48a5a-5001-4a56-9033-1ae346c09f98'} Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:18.019400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. Jul 20 04:23:18.020480 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:18.022251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance fdc48a5a-5001-4a56-9033-1ae346c09f98 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:18.024966 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbb47192-2a5b-4838-89b1-985d5d4d33d5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98" status: 404 len: 111 microversion: 2.1 time: 0.059204 Jul 20 04:23:18.029285 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1119/2244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:17 2022] GET /compute/v2.1/servers/fdc48a5a-5001-4a56-9033-1ae346c09f98 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:18.099245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-43932e99-31b0-41a8-9155-33622f9353e1 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Action: 'create', calling method: .version_select at 0x7f838bcc09d0>, body: {"keypair": {"name": "tempest-keypair-722891880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH64ZOFpFhhq1hWcV8HNi0cXkii1tkDBWRMZjjqs6fbpDUxHHB6BvcwjjWyDykKp27Jllk5/0kimaFDtnPc3G5MtTlnGPmgcfmto2nDkF6aZFm5SC6i/DevDeU88C/Purw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:18.119112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-43932e99-31b0-41a8-9155-33622f9353e1 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Getting quotas for project 281a7cc370494bed803a3ae78ee441bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:18.134462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-43932e99-31b0-41a8-9155-33622f9353e1 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Getting quotas for user eeef5d6890bd48fb9bf4a55f715e0f2c and project 281a7cc370494bed803a3ae78ee441bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:18.165657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-43932e99-31b0-41a8-9155-33622f9353e1 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133801 Jul 20 04:23:18.167623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1120/2245] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:23:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:18.178728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1517639931"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:18.180051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.188812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.189474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.190265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.190832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.595810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63adad54-06af-4fea-9314-a7b0e36b126d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "POST /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738/action" status: 202 len: 0 microversion: 2.1 time: 0.425920 Jul 20 04:23:18.596575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1121/2246] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:18 2022] POST /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:23:18.602780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:18.604518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.614305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.615243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.616570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.617139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.709629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:18.710087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:18.710571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:18.711151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:18.711590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:18.830813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.838666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.839053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.843004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.843463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.916284 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e08ea5da-35bf-4de9-ba3c-29b9c874c135 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "POST /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130/action" status: 202 len: 1110 microversion: 2.1 time: 0.318463 Jul 20 04:23:18.920816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1122/2247] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:18 2022] POST /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130/action => generated 1110 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:23:18.926411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:18.927030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:18.948197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.948652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:18.949473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:18.949912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.016953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.017704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.018177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lazy-loading 'fault' on Instance uuid 022bab84-b6a8-4a41-b57c-3e10398f31c3 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:19.097701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5636bb567c44ae394dcf034d99c0668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82efb24d3e84efb95dd38a3c4a58c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.104869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:19.106725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1044898-b9b2-4b9a-9156-eaf1d8faa4aa tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 200 len: 1306 microversion: 2.1 time: 0.184756 Jul 20 04:23:19.107321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1123/2248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:18 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 1306 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.125018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.125454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.137643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.138088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.138879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.139308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.194074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b HTTP/1.1 Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:19.199675 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:19.200935 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '81420b50-7a17-416b-b1af-b84345fc990b'} Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:19.201524 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:19.202478 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:19.204194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:19.204194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4bde28f3-234c-40f1-ade4-82d27a0e1212 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 404 len: 111 microversion: 2.1 time: 0.092979 Jul 20 04:23:19.204194 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1124/2249] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:19 2022] DELETE /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:19.221844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.222489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.231752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.232205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.233048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.233489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.332830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.353640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.355271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c21b3bf3ba4d4558950d7337a651587f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8300dd17ab074d6ba2e717b2f9713a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.360622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d29a45af-a9cc-4b10-8f51-fd253c3a5cfa tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 200 len: 1347 microversion: 2.25 time: 0.146008 Jul 20 04:23:19.361313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1125/2250] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 1347 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:19.378183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb6dabd7-711e-40d2-8794-27c2fce7ce8b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f8398283040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.454659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb6dabd7-711e-40d2-8794-27c2fce7ce8b tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.082553 Jul 20 04:23:19.455248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1126/2251] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.459666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-36ff8d24-dad7-442d-ae92-34c698121a92 req-99496e61-221e-4822-87a4-bd9f07a282c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2848d05-a6b8-4a72-9774-0f49ec9cf583", "name": "network-vif-deleted", "tag": "3f22db6d-7095-4a4b-8c65-fec308924fc4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:19.468830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-36ff8d24-dad7-442d-ae92-34c698121a92 req-99496e61-221e-4822-87a4-bd9f07a282c0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.469285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-36ff8d24-dad7-442d-ae92-34c698121a92 req-99496e61-221e-4822-87a4-bd9f07a282c0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.481731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-36ff8d24-dad7-442d-ae92-34c698121a92 req-99496e61-221e-4822-87a4-bd9f07a282c0 service nova] Creating event network-vif-deleted:3f22db6d-7095-4a4b-8c65-fec308924fc4 for instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 on n-h1-764486-11 Jul 20 04:23:19.487337 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-36ff8d24-dad7-442d-ae92-34c698121a92 req-99496e61-221e-4822-87a4-bd9f07a282c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030932 Jul 20 04:23:19.488223 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1127/2252] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:19.493544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.494253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.502854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.503319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.504187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.504671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.802122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:19.811774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6813c53-41e8-45fa-afc0-bdba858b3e1d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.322282 Jul 20 04:23:19.823143 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1128/2253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:19.835813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:19.836460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:19.850608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.851046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:19.851837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:19.852270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.122463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:20.130362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b2f50d5-bfdf-4959-b002-8c86ba8a6cd3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.315629 Jul 20 04:23:20.131408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1129/2254] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:19 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:20.141017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.142849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 81420b50-7a17-416b-b1af-b84345fc990b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.150283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.150735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.151520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.151968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.169714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b HTTP/1.1 Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.171216 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:20.172479 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '81420b50-7a17-416b-b1af-b84345fc990b'} Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.173101 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. Jul 20 04:23:20.174109 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.174996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 81420b50-7a17-416b-b1af-b84345fc990b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.174996 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3dde21d4-b3f0-460c-b785-2d650e534559 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b" status: 404 len: 111 microversion: 2.1 time: 0.039575 Jul 20 04:23:20.176634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1130/2255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/81420b50-7a17-416b-b1af-b84345fc990b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.182294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bef1e22f-9092-43f0-8e1b-45e06d96983e req-3624ea86-d524-403c-9a8c-17a373b97fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022bab84-b6a8-4a41-b57c-3e10398f31c3", "name": "network-vif-deleted", "tag": "eb72573f-539a-45d2-997a-8d751f89ef3e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:20.191622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bef1e22f-9092-43f0-8e1b-45e06d96983e req-3624ea86-d524-403c-9a8c-17a373b97fea service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.191805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bef1e22f-9092-43f0-8e1b-45e06d96983e req-3624ea86-d524-403c-9a8c-17a373b97fea service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.207383 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bef1e22f-9092-43f0-8e1b-45e06d96983e req-3624ea86-d524-403c-9a8c-17a373b97fea service nova] Creating event network-vif-deleted:eb72573f-539a-45d2-997a-8d751f89ef3e for instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 on n-h1-764486-11 Jul 20 04:23:20.210941 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bef1e22f-9092-43f0-8e1b-45e06d96983e req-3624ea86-d524-403c-9a8c-17a373b97fea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Jul 20 04:23:20.211772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1131/2256] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:20.216782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e0165f72-c752-42df-ac84-46a15dc8aefe req-61e40180-4f85-48e7-9fd2-7772731420f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "name": "network-vif-unplugged", "status": "completed", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:20.226170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e0165f72-c752-42df-ac84-46a15dc8aefe req-61e40180-4f85-48e7-9fd2-7772731420f0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.226608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e0165f72-c752-42df-ac84-46a15dc8aefe req-61e40180-4f85-48e7-9fd2-7772731420f0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.238999 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e0165f72-c752-42df-ac84-46a15dc8aefe req-61e40180-4f85-48e7-9fd2-7772731420f0 service nova] Creating event network-vif-unplugged:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:23:20.244328 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e0165f72-c752-42df-ac84-46a15dc8aefe req-61e40180-4f85-48e7-9fd2-7772731420f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031390 Jul 20 04:23:20.245320 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1132/2257] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:20.250230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.250931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] [instance: 022bab84-b6a8-4a41-b57c-3e10398f31c3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.257419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.257870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.258642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.259074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.277896 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] HTTP exception thrown: Instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 could not be found. Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Request method failure captured: Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 HTTP/1.1 Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MPMldp6GFdwy9O1K7YRG04dkitnahSNiPKCN_42rpaWQQBfktu9klq_gzs8ckSHCCs2PnVqHpCmJW4puHj9VAYvv9nLY86No7E6ipoTOWQGBLm24gVq2LbVd84lugF3BYE8WO1DSFtw4qFOO_KS8yxdDVIi3wlN7eevpTRoGZc7C8 Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: f82efb24d3e84efb95dd38a3c4a58c4d Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerPasswordTestJSON-1908387503 Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.280280 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f82efb24d3e84efb95dd38a3c4a58c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f82efb24d3e84efb95dd38a3c4a58c4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f82efb24d3e84efb95dd38a3c4a58c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f82efb24d3e84efb95dd38a3c4a58c4d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerPasswordTestJSON-1908387503 Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: f82efb24d3e84efb95dd38a3c4a58c4d Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1908387503 Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerPasswordTestJSON-1908387503-project Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f5636bb567c44ae394dcf034d99c0668 Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerPasswordTestJSON-1908387503-project Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 could not be found. Jul 20 04:23:20.282131 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '022bab84-b6a8-4a41-b57c-3e10398f31c3'} Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 could not be found. Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.282737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 could not be found. Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 could not be found. Jul 20 04:23:20.283744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.284671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] Returning 404 to user: Instance 022bab84-b6a8-4a41-b57c-3e10398f31c3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.284671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76e1cf4f-cb50-45cf-93dc-5afc5431fa3b tempest-ServerPasswordTestJSON-1908387503 tempest-ServerPasswordTestJSON-1908387503-project] 10.222.0.49 "GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3" status: 404 len: 111 microversion: 2.1 time: 0.036342 Jul 20 04:23:20.284671 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1133/2258] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/022bab84-b6a8-4a41-b57c-3e10398f31c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.291456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.291964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.298239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.298681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.299455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.299880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.316167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa HTTP/1.1 Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.318583 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.319668 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '32076e88-d4fa-4391-afcb-bad6d6f9fbfa'} Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.320264 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.321279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.322250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.322250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08f6970d-3f3b-4dbd-83bd-477fdfda00f5 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 404 len: 111 microversion: 2.1 time: 0.036299 Jul 20 04:23:20.324495 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1134/2259] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:20 2022] DELETE /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.332157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.333177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 32076e88-d4fa-4391-afcb-bad6d6f9fbfa] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.340879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.341430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.342299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.342951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.362451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa HTTP/1.1 Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.364070 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.365244 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '32076e88-d4fa-4391-afcb-bad6d6f9fbfa'} Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.365856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. Jul 20 04:23:20.366842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.367731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 32076e88-d4fa-4391-afcb-bad6d6f9fbfa could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.367731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-107e24a6-c39b-42e6-b52f-21b6e600951c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa" status: 404 len: 111 microversion: 2.1 time: 0.039304 Jul 20 04:23:20.369752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1135/2260] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/32076e88-d4fa-4391-afcb-bad6d6f9fbfa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:23:20.374814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.375308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.397897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.401455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.403690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.408844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.435195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 HTTP/1.1 Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.438778 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.440102 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9dfe4be6-cc34-42ac-bc33-e26dfc931291'} Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.440947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.441905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.447833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.449158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2ff009d-9b91-4482-ac40-83f631b06d34 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 404 len: 111 microversion: 2.1 time: 0.078375 Jul 20 04:23:20.454217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1136/2261] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:20 2022] DELETE /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.467076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.467982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] [instance: e2848d05-a6b8-4a72-9774-0f49ec9cf583] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.475705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.476450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.477390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.477986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.495458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] HTTP exception thrown: Instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 could not be found. Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Request method failure captured: Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 HTTP/1.1 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14GUzq6fjiClDA5WfhQXhxNnHqeIwC1PKpcM3tWdfyBCkXerQUjwNrc9dXQtf-RL02shIiZkbjCi1sGzvgbRrA3PGQWWNj8jO4_bCaX53nuH49NfNKydFj5JJ4F80dFelD2JCIYKVoMx04yGY987QyA-yHSLw2GMM29p4iC0AqaIImw Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.497179 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8300dd17ab074d6ba2e717b2f9713a39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8300dd17ab074d6ba2e717b2f9713a39", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8300dd17ab074d6ba2e717b2f9713a39 Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-137735346 Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: c21b3bf3ba4d4558950d7337a651587f Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-137735346-project Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 could not be found. Jul 20 04:23:20.498324 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e2848d05-a6b8-4a72-9774-0f49ec9cf583'} Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 could not be found. Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.498916 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 could not be found. Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 could not be found. Jul 20 04:23:20.501027 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.501902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] Returning 404 to user: Instance e2848d05-a6b8-4a72-9774-0f49ec9cf583 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.501902 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e29d3d51-96f7-49c3-8340-8fea9c81af5a tempest-LiveAutoBlockMigrationV225Test-137735346 tempest-LiveAutoBlockMigrationV225Test-137735346-project] 10.222.0.49 "GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583" status: 404 len: 111 microversion: 2.25 time: 0.043373 Jul 20 04:23:20.501902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1137/2262] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/e2848d05-a6b8-4a72-9774-0f49ec9cf583 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:20.504802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.505445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 9dfe4be6-cc34-42ac-bc33-e26dfc931291] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.513424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.513873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.514705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.515138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.552113 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 HTTP/1.1 Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.554915 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.556001 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9dfe4be6-cc34-42ac-bc33-e26dfc931291'} Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.556633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. Jul 20 04:23:20.557641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.558512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 9dfe4be6-cc34-42ac-bc33-e26dfc931291 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.558512 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a77a872-5138-4243-b06f-8e5a832e715c tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291" status: 404 len: 111 microversion: 2.1 time: 0.055375 Jul 20 04:23:20.560144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1138/2263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/9dfe4be6-cc34-42ac-bc33-e26dfc931291 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.566075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cac34bf8-cb20-40bc-b476-2d1e29914494 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f83985b5310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.622011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cac34bf8-cb20-40bc-b476-2d1e29914494 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.060644 Jul 20 04:23:20.622517 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1139/2264] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:20.633510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.634721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.642301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.642754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.643549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.643980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.661621 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b HTTP/1.1 Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.664640 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.665781 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4ae7fdeb-bfaf-4fc2-9f58-40721e61586b'} Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.666453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.667424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.668424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.668424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01a9a3a2-c32d-4ae8-a59b-d4af0c5f1e1d tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b" status: 404 len: 111 microversion: 2.1 time: 0.036544 Jul 20 04:23:20.668424 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1140/2265] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:20 2022] DELETE /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.677311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.677311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.682109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.682562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.683340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.683772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.700121 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b HTTP/1.1 Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:20.701467 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.702565 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4ae7fdeb-bfaf-4fc2-9f58-40721e61586b'} Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:20.703846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. Jul 20 04:23:20.704865 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:20.705793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 4ae7fdeb-bfaf-4fc2-9f58-40721e61586b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:20.705793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2bc1ff39-021c-4d22-b34e-f48b73ce02aa tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b" status: 404 len: 111 microversion: 2.1 time: 0.032130 Jul 20 04:23:20.705793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1141/2266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/4ae7fdeb-bfaf-4fc2-9f58-40721e61586b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:20.831134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:20.832035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:20.850386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.850386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:20.850386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:20.851161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.163739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.174361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96da1454-7a5b-445d-9a4b-fe91040d4ef3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.348013 Jul 20 04:23:21.185482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1142/2267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:20 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:21.204345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:21.213686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:21.224376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.224927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.225784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:21.226315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:21.554910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:21.565935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffd2ca39-ff01-4a33-a92d-4e7776efd36f tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.379123 Jul 20 04:23:21.575531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1143/2268] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:21 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:21.586676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1292419917", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "89e09b4a-e813-4f2f-acbd-c1d33eedd440"}], "security_groups": [{"name": "tempest-securitygroup--237260508"}], "key_name": "tempest-keypair-722891880", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:21.993553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] validate_networks() for [('89e09b4a-e813-4f2f-acbd-c1d33eedd440', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:23.424815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Getting quotas for project 281a7cc370494bed803a3ae78ee441bf. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:23.442768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Getting quotas for user eeef5d6890bd48fb9bf4a55f715e0f2c and project 281a7cc370494bed803a3ae78ee441bf. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:23.485271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:23.486040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:23.487209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:23.487777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:23.488335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:23.531191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.532130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.533062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:23.533510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:23.605787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Getting quotas for project 281a7cc370494bed803a3ae78ee441bf. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:23.620627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Getting quotas for user eeef5d6890bd48fb9bf4a55f715e0f2c and project 281a7cc370494bed803a3ae78ee441bf. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:23.692126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:23.695051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:23.832055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aeaf7191-530e-4988-a6a2-00e9bec73377 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.255411 Jul 20 04:23:23.833433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1144/2269] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:23.840990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69e3d605-6b80-4e99-b4e0-c5e92ec84005 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f83985b5790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.971912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69e3d605-6b80-4e99-b4e0-c5e92ec84005 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.137168 Jul 20 04:23:23.985161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1145/2270] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:23.988344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:23.991574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.017662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.018300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.019143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.019588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.537757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:24.554879 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f853fbfb-e598-4f8f-8ce4-67f14c4bebc9 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.569314 Jul 20 04:23:24.555563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1146/2271] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:23 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:24.574486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2fc5735c-15d0-430d-926a-4f50379ddf1d req-d1df8f97-960e-44f4-acb0-b70df2464ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "name": "network-vif-plugged", "status": "completed", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:24.618723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2fc5735c-15d0-430d-926a-4f50379ddf1d req-d1df8f97-960e-44f4-acb0-b70df2464ba7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.619172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2fc5735c-15d0-430d-926a-4f50379ddf1d req-d1df8f97-960e-44f4-acb0-b70df2464ba7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.666381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2fc5735c-15d0-430d-926a-4f50379ddf1d req-d1df8f97-960e-44f4-acb0-b70df2464ba7 service nova] Creating event network-vif-plugged:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:23:24.678231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2fc5735c-15d0-430d-926a-4f50379ddf1d req-d1df8f97-960e-44f4-acb0-b70df2464ba7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114259 Jul 20 04:23:24.679358 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1147/2272] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:24.686337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:24.687399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:24.695200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.716404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:24.720860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:24.721384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.176056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.185287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b68cfd7-5b3d-4f51-9635-75e8536eb9c9 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.504582 Jul 20 04:23:25.189601 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1148/2273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:24 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.203209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.204084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.223108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.224188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.225611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.227422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.459974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.468190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a253509e-4c6d-4422-acfe-c5a7c52c6060 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1329 microversion: 2.1 time: 0.276737 Jul 20 04:23:25.474293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1149/2274] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1329 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.479424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e7bc7d0-b21d-4b7c-837e-d4c738dd9794 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838bace670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.582252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e7bc7d0-b21d-4b7c-837e-d4c738dd9794 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.106647 Jul 20 04:23:25.585854 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1150/2275] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:25.599892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:25.600582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:25.614996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:25.616873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.617481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.618280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:25.618993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:25.981352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:25.996260 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8494edf8-e192-43ec-9ce5-a7f3ed79913e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.406505 Jul 20 04:23:25.998124 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1151/2276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:25 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:26.207135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.208075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.221297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.225374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.227586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.232651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.553395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:26.568123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f9b39e3-17bd-476c-b585-27b4d2149353 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1324 microversion: 2.1 time: 0.366155 Jul 20 04:23:26.568891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1152/2277] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:26.579302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.581626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.613945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.615558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.618437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.625898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.689783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba HTTP/1.1 Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:26.698593 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:26.700063 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '80919433-b6b3-4076-8757-c53e3e17e3ba'} Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:26.701078 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:26.702340 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:26.705034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:26.709755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5508023e-682e-4e1f-8e2b-3f30974c9eca tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 404 len: 111 microversion: 2.1 time: 0.136629 Jul 20 04:23:26.712796 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1153/2278] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:26 2022] DELETE /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:26.723451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:26.737978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:26.745780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.761851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:26.762977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:26.767996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.069620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.082829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac350035-ca7a-4df2-98c8-d04845b65869 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1335 microversion: 2.1 time: 0.365920 Jul 20 04:23:27.085296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1154/2279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:26 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1335 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.096308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1683debe-185b-44b1-9d98-e4fa723381ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838bd2d9d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.205618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1683debe-185b-44b1-9d98-e4fa723381ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.118974 Jul 20 04:23:27.212306 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1155/2280] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.231292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c810e715-5173-4b9b-8520-2baddefec221 req-79c90427-9c0d-45b4-abc8-86ed4125d2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc269cd-7787-4fde-bf21-ca131b4e2738", "name": "network-vif-plugged", "status": "completed", "tag": "5c87874c-288b-4b97-8bd5-eb44cc50a7d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:27.266116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c810e715-5173-4b9b-8520-2baddefec221 req-79c90427-9c0d-45b4-abc8-86ed4125d2e4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.267685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c810e715-5173-4b9b-8520-2baddefec221 req-79c90427-9c0d-45b4-abc8-86ed4125d2e4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.283697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:27.310498 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c810e715-5173-4b9b-8520-2baddefec221 req-79c90427-9c0d-45b4-abc8-86ed4125d2e4 service nova] Creating event network-vif-plugged:5c87874c-288b-4b97-8bd5-eb44cc50a7d7 for instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 on n-h2-764486-11 Jul 20 04:23:27.323216 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c810e715-5173-4b9b-8520-2baddefec221 req-79c90427-9c0d-45b4-abc8-86ed4125d2e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109506 Jul 20 04:23:27.332988 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1156/2281] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:27.342375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.343092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 80919433-b6b3-4076-8757-c53e3e17e3ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.378767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.379233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.380038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.380521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.446321 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba HTTP/1.1 Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:27.455522 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:27.456835 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '80919433-b6b3-4076-8757-c53e3e17e3ba'} Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:27.457455 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. Jul 20 04:23:27.458429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:27.464177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 80919433-b6b3-4076-8757-c53e3e17e3ba could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:27.467494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b66a31d-3e2f-4867-b560-2fb02194abff tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba" status: 404 len: 111 microversion: 2.1 time: 0.133460 Jul 20 04:23:27.470955 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1157/2282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/80919433-b6b3-4076-8757-c53e3e17e3ba => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:27.484791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.491304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.513362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.531323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.532342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:27.533022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:27.908765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:27.924965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0e385ed-06eb-4d25-a65f-ae5222951a87 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.450666 Jul 20 04:23:27.928443 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1158/2283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:27 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:27.956002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:27.956553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:27.988587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.009137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.013514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.013986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.062302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 HTTP/1.1 Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:28.069758 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:28.070930 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7d2c4d27-2793-4a99-b2ab-36dab046bca1'} Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:28.071658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:28.072692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:28.075181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:28.076288 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6b78f45-1511-461c-a2a9-0cf10c414530 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 404 len: 111 microversion: 2.1 time: 0.146145 Jul 20 04:23:28.084927 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1159/2284] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:23:27 2022] DELETE /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:28.094081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.095541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.113871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.115524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.119815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.120576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.945387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:28.960916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d626d1db-d372-4545-8b2d-69d0dd431b09 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1520 microversion: 2.1 time: 0.874578 Jul 20 04:23:28.963324 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1160/2285] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1520 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:28.971731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:28.978655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] [instance: 7d2c4d27-2793-4a99-b2ab-36dab046bca1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:28.992828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.993550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:28.994510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:28.996943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.027475 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] HTTP exception thrown: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Request method failure captured: Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 HTTP/1.1 Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14H_7vHgmxJFpy2ppwdPbgtSBLkq3IVy8WQlnsmxZbJi2ZHtHdFXNVeFRfAbrYh-MCH_9_Qx8-_DGwxB5SVpRJByJiB37th6IgfopI88SoBgQJSXSUwIOlJQyeqts-5ymNZqAYqoI6eRjwm59LE7CWoAutSyG9arGhNvi9tvqOwkiDw Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:29.034583 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6da30296e6046c8b5d9c91b215505e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6da30296e6046c8b5d9c91b215505e6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a6da30296e6046c8b5d9c91b215505e6 Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1212112482 Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 56c5fdfb6fe54818bbf2e85a1eb1addd Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1212112482-project Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:29.035997 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7d2c4d27-2793-4a99-b2ab-36dab046bca1'} Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:29.036905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. Jul 20 04:23:29.038149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:29.040067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] Returning 404 to user: Instance 7d2c4d27-2793-4a99-b2ab-36dab046bca1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:29.042715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0539deef-22b5-42c0-b5e3-42997449cec7 tempest-DeleteServersTestJSON-1212112482 tempest-DeleteServersTestJSON-1212112482-project] 10.222.0.49 "GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1" status: 404 len: 111 microversion: 2.1 time: 0.077265 Jul 20 04:23:29.047368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1161/2286] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:28 2022] GET /compute/v2.1/servers/7d2c4d27-2793-4a99-b2ab-36dab046bca1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:23:29.050178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.050862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.082795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.083284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.084107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.084589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.474889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.486185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3dca09a9-f3be-4bf3-994d-515b3784d9fe tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1402 microversion: 2.1 time: 0.441471 Jul 20 04:23:29.490186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1162/2287] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.494992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19aa1062-525a-4e2a-b943-9af115cda0e0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f8398103700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.573918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19aa1062-525a-4e2a-b943-9af115cda0e0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.082375 Jul 20 04:23:29.574662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1163/2288] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.586107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:29.587063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:29.595835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.596658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.597670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:29.598596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:29.920559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:29.937135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ea80942-ab22-46f6-83aa-2e91ccfe71aa tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.360798 Jul 20 04:23:29.938647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1164/2289] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:29 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:29.943730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0797d40c-6d44-4e8a-8c19-2f5481b835b0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'create', calling method: .version_select at 0x7f838bace0d0>, body: {"pool": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:33.556515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:33.666857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:34.102909 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0797d40c-6d44-4e8a-8c19-2f5481b835b0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.162920 Jul 20 04:23:34.103511 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1165/2290] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:23:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:34.119902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.124009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.165210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.175521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.178506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.181662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.501483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.515454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8934e470-e09e-48ae-836f-32f8e40ed5f4 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1402 microversion: 2.1 time: 0.404419 Jul 20 04:23:34.526971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1166/2291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:34.535866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-217337fc-031b-40c0-a25f-2850435caeb6 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838bace280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.646602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-217337fc-031b-40c0-a25f-2850435caeb6 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.118069 Jul 20 04:23:34.648771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1167/2292] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:34.653681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:34.654471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:34.693071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.695182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.696202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:34.697514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:34.988723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:34.999477 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53b834db-7906-4c0a-8406-c64e3616cae2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.349388 Jul 20 04:23:35.000875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1168/2293] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:34 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:35.017273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9f39781c-6bf9-465f-8792-bb13503f891e req-afb3c818-3dde-4d50-bf27-23d826a94eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b84961-2ce4-4e3c-b374-8f9ac0dd006b", "tag": "d374ff46-7a4c-4194-a5ec-606575168f18"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:35.027109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f39781c-6bf9-465f-8792-bb13503f891e req-afb3c818-3dde-4d50-bf27-23d826a94eff service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.032109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f39781c-6bf9-465f-8792-bb13503f891e req-afb3c818-3dde-4d50-bf27-23d826a94eff service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.057065 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9f39781c-6bf9-465f-8792-bb13503f891e req-afb3c818-3dde-4d50-bf27-23d826a94eff service nova] Creating event network-changed:d374ff46-7a4c-4194-a5ec-606575168f18 for instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b on n-h1-764486-11 Jul 20 04:23:35.075083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9f39781c-6bf9-465f-8792-bb13503f891e req-afb3c818-3dde-4d50-bf27-23d826a94eff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072113 Jul 20 04:23:35.096739 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1169/2294] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:35.114401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1916049144", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:35.220885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] validate_networks() for [('3be1a5c3-f459-4f21-b8e0-bb88f21e1335', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:35.861480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:35.863472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:35.864535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:35.865420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:35.866237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:35.880297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.881163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.883504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:35.884166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:35.909608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Getting quotas for project ee50acf92da24b3185b6da3c165a7d71. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:35.920094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Getting quotas for user 99ee2b91f0c04c59a1b76708d2c85083 and project ee50acf92da24b3185b6da3c165a7d71. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:35.942006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:35.946943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:36.019849 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0197b7c0-0302-4744-834b-892e28688d48 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921189 Jul 20 04:23:36.021282 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1170/2295] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:36.027395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.029023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.039038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.039494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.040551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.041162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.222749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.233416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7988fdbe-b0eb-4ad2-b768-84411894f0e2 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1402 microversion: 2.1 time: 0.209296 Jul 20 04:23:36.244204 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1171/2296] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1402 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.249048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c821a6bf-c190-4ea0-9c6f-f7907c453b08 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f8398103040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.312725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c821a6bf-c190-4ea0-9c6f-f7907c453b08 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.066745 Jul 20 04:23:36.314050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1172/2297] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.319435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.320297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.332059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.332250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.333140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:36.333572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:36.771743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.799895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46e0d864-cd04-4ce9-b0de-7c5d84a89e72 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.485196 Jul 20 04:23:36.800751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1173/2298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:36.805846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12b1c013-7e16-4ad0-987a-3e0b355a2913 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:36.806040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-12b1c013-7e16-4ad0-987a-3e0b355a2913 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:36.898078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-12b1c013-7e16-4ad0-987a-3e0b355a2913 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:36.909317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12b1c013-7e16-4ad0-987a-3e0b355a2913 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1224 microversion: 2.1 time: 0.107464 Jul 20 04:23:36.919518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1174/2299] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:36 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.252072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.252999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.263771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.266038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.267025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.267611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.567311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:37.581638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc20aeb2-1165-4ed0-864a-b02e6cb417da tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1402 microversion: 2.1 time: 0.334967 Jul 20 04:23:37.585575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1175/2300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1402 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.608954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c54a46a-ae32-45b2-a55b-ca165dde6acd tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba965e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.709476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c54a46a-ae32-45b2-a55b-ca165dde6acd tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.121507 Jul 20 04:23:37.717284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1176/2301] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:37.725894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a12e776d-3c2c-4e90-862d-16e4e8c441c6 req-eee238ac-d6c8-49c5-b7c6-5529568ffec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b84961-2ce4-4e3c-b374-8f9ac0dd006b", "name": "network-vif-plugged", "status": "completed", "tag": "d374ff46-7a4c-4194-a5ec-606575168f18"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:37.760168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a12e776d-3c2c-4e90-862d-16e4e8c441c6 req-eee238ac-d6c8-49c5-b7c6-5529568ffec2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.760670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a12e776d-3c2c-4e90-862d-16e4e8c441c6 req-eee238ac-d6c8-49c5-b7c6-5529568ffec2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.796174 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a12e776d-3c2c-4e90-862d-16e4e8c441c6 req-eee238ac-d6c8-49c5-b7c6-5529568ffec2 service nova] Creating event network-vif-plugged:d374ff46-7a4c-4194-a5ec-606575168f18 for instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b on n-h1-764486-11 Jul 20 04:23:37.806760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a12e776d-3c2c-4e90-862d-16e4e8c441c6 req-eee238ac-d6c8-49c5-b7c6-5529568ffec2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086526 Jul 20 04:23:37.807543 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1177/2302] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:37.820521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:37.821242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:37.836035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.836773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:37.839094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:37.839926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.269648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.279501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2417fcac-4730-48cb-95e1-6394e643d4c8 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.465172 Jul 20 04:23:38.280076 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1178/2303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:37 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:38.289199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.301284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.308691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.309323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.310355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.321081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.506192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:38.518137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22ae11c8-ee5e-416f-99bc-eb88aff623a3 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1282 microversion: 2.1 time: 0.231514 Jul 20 04:23:38.519479 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1179/2304] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:38.605018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:38.605652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:38.630340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.633615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:38.634254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:38.634704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.776549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:39.793914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-45ea6d19-23c3-4029-b472-5f70bfd1095c tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1402 microversion: 2.1 time: 1.192806 Jul 20 04:23:39.810823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1180/2305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:38 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1402 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:39.837555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59f2fd42-5361-4e2b-a6cb-bd1280f29f9f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba965e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.956513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59f2fd42-5361-4e2b-a6cb-bd1280f29f9f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.136103 Jul 20 04:23:39.962266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1181/2306] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:39.967247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:39.970329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:39.986299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.991309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:39.992490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:39.993435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.502886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.516307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34954a80-43b5-406f-9762-e6b60fceee55 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.552774 Jul 20 04:23:40.517935 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1182/2307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:39 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.523609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.531852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.548708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.552499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.553831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.554740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.936625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:40.949299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50d26ee0-83f0-45cb-93e5-41a05c672405 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.429231 Jul 20 04:23:40.962102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1183/2308] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:40.970612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:40.971694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:40.979871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.980588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:40.981926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:40.982513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.007256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:41.243765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:41.255426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d698ee2-4443-44c5-961b-7610be1b17dd tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1589 microversion: 2.1 time: 0.291890 Jul 20 04:23:41.256417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1184/2309] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:40 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1589 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.266820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d75ec677-2a07-4cba-9368-0fda01286cc4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba0d4c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.346741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d75ec677-2a07-4cba-9368-0fda01286cc4 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.087927 Jul 20 04:23:41.352168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1185/2310] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:41.358041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.358550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.379017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.379674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.381223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.381662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.790695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a6e6c16-4a32-447f-8218-5b3090281890 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.440420 Jul 20 04:23:41.791662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1186/2311] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b/os-interface => generated 284 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:41.797869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:41.799666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:41.824863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.825717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:41.828101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:41.828101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.615689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:42.632792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1c97d33-8079-4699-91b3-92b42c6a248b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.839892 Jul 20 04:23:42.633704 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1187/2312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:41 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:42.646335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:42.647172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:42.666842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.667537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:42.668501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:42.669085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.229277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:43.264840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a8cc1d2-c433-4d26-bad9-f95643b05f08 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.629555 Jul 20 04:23:43.266471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1188/2313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:42 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:43.275516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-926f73b8-65b0-4556-a979-864c2c80b9a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba87e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.417293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-926f73b8-65b0-4556-a979-864c2c80b9a8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.145348 Jul 20 04:23:43.423481 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1189/2314] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:43.429027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dbed95f0-91e6-4cca-8467-5514cea00e3a req-dbc57d1d-97f3-44fe-b81e-39d8526656f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d025bd78-43f4-4e76-b0d6-40e67808c28f", "tag": "62918383-a5c6-4c5d-975c-342094fde378"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:43.439045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dbed95f0-91e6-4cca-8467-5514cea00e3a req-dbc57d1d-97f3-44fe-b81e-39d8526656f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.439688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dbed95f0-91e6-4cca-8467-5514cea00e3a req-dbc57d1d-97f3-44fe-b81e-39d8526656f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.473765 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dbed95f0-91e6-4cca-8467-5514cea00e3a req-dbc57d1d-97f3-44fe-b81e-39d8526656f8 service nova] Creating event network-changed:62918383-a5c6-4c5d-975c-342094fde378 for instance d025bd78-43f4-4e76-b0d6-40e67808c28f on n-h1-764486-11 Jul 20 04:23:43.493049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dbed95f0-91e6-4cca-8467-5514cea00e3a req-dbc57d1d-97f3-44fe-b81e-39d8526656f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057988 Jul 20 04:23:43.494653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1190/2315] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:43.654400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:43.655902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:43.679984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.684160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:43.686724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:43.687484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.597580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:44.606534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bccc0057-b2b0-47c2-a3cf-9d1c329e1271 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.958835 Jul 20 04:23:44.607208 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1191/2316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:43 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:44.613453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:44.622833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:44.644122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.652974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:44.655845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:44.657501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.116876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.125832 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ee6fcdb-1d25-4047-84b9-c8eb217694dd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.516803 Jul 20 04:23:45.134897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1192/2317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:44 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:45.144345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3986c388-d54d-4dd2-9282-ccb0bfb37a54 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838bace3a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.283967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3986c388-d54d-4dd2-9282-ccb0bfb37a54 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1455 microversion: 2.1 time: 0.147973 Jul 20 04:23:45.287915 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1193/2318] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:45.405145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.405975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.413831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.414749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.416429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.417122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.706740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:45.717225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8468f50-976a-4732-bb49-9e06eddb1473 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1589 microversion: 2.1 time: 0.316732 Jul 20 04:23:45.721851 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1194/2319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1589 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:23:45.729634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b3c8479e-4141-479d-9750-8443565170f0 req-874cb233-8c12-4b6a-8e4d-6b0f59a69a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b84961-2ce4-4e3c-b374-8f9ac0dd006b", "tag": "d374ff46-7a4c-4194-a5ec-606575168f18"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:45.766755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b3c8479e-4141-479d-9750-8443565170f0 req-874cb233-8c12-4b6a-8e4d-6b0f59a69a72 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.768932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b3c8479e-4141-479d-9750-8443565170f0 req-874cb233-8c12-4b6a-8e4d-6b0f59a69a72 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.815655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b3c8479e-4141-479d-9750-8443565170f0 req-874cb233-8c12-4b6a-8e4d-6b0f59a69a72 service nova] Creating event network-changed:d374ff46-7a4c-4194-a5ec-606575168f18 for instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b on n-h1-764486-11 Jul 20 04:23:45.859007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b3c8479e-4141-479d-9750-8443565170f0 req-874cb233-8c12-4b6a-8e4d-6b0f59a69a72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112601 Jul 20 04:23:45.861163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1195/2320] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:45.878299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:45.881238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:45.899036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:45.903203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.904235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:45.905886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:45.908205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:46.508779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:46.519282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b7b6dee-f982-44a8-ba91-8e71c74487af tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.656203 Jul 20 04:23:46.535943 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1196/2321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:45 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:46.907156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:46.930420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-486500522", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "bdfde7f5-52b9-488e-a5cf-0b7ac669f0a8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:47.006864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] validate_networks() for [('bdfde7f5-52b9-488e-a5cf-0b7ac669f0a8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:47.604291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:47.604725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:47.605764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:47.606175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:47.606584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:47.620993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.622156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.626529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.629147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.651074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Getting quotas for project becc2205ba484f5ca739ba6e23d7eab2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:47.656929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Getting quotas for user f75da3e5aa0c426281a4bb7bd29d7a66 and project becc2205ba484f5ca739ba6e23d7eab2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:47.671270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:47.674430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:47.712496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:47.732071 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4fadca0-169d-4a29-88b8-edcc27037458 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.194324 Jul 20 04:23:47.732972 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1197/2322] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:23:47.739341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.740395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:47.762388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.763140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.764035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:47.764642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:47.936015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:47.944610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9bcaa29-9dac-4b14-a2c5-0847ab04d5fd tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.210346 Jul 20 04:23:47.945199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1198/2323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:47.950884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bade4b67-0c1c-4c4d-a6b6-471d72f3fe06 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ba96040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:47.995680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bade4b67-0c1c-4c4d-a6b6-471d72f3fe06 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1464 microversion: 2.1 time: 0.049308 Jul 20 04:23:47.996257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1199/2324] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:47 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1464 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:48.184970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3f01d86-d094-4d7e-a20b-76de56fc22cc tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1524708487", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:48.186853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a3f01d86-d094-4d7e-a20b-76de56fc22cc tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] HTTP exception thrown: min_count must be <= max_count Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3f01d86-d094-4d7e-a20b-76de56fc22cc tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Request method failure captured: Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 184 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS8d8HKEl6MYavkQHuz6MvJybr2DuHSBxNfJ9ULfxuNskswg406VwKQT22S9qvF7-pnmunHSCqux06yErOPWO6Qr2YpgbCyB8GaYiIAvsH4Rrf4fG0Yl78xi-74B_fdmQiPokDBqjGsVWEXKsuIw-YCkoYRfJm_LpbOWjkTcQU430 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:48.189323 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a21c5bcb70d44d3ba3aa1a462aa2b540", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6e7fb33c02164faf86b660aabf2f522d Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:23:48.190623 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1524708487", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: exception: min_count must be <= max_count Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1524708487', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:23:48.191227 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3f01d86-d094-4d7e-a20b-76de56fc22cc tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Returning 400 to user: min_count must be <= max_count {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3f01d86-d094-4d7e-a20b-76de56fc22cc tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.193574 Jul 20 04:23:48.192462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1200/2325] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:47 2022] POST /compute/v2.1/servers => generated 74 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:23:48.279744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-989303218", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:48.339526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:23:48.554138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:23:48.554585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:23:48.555058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:23:48.555455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:23:48.555861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:23:48.565741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.566181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.567007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.567436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.586033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Getting quotas for project 5aed97a8de2a4a2faa4dc529e98342ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:23:48.591514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Getting quotas for user 90e97cf3519b4665aff6b4274c34a205 and project 5aed97a8de2a4a2faa4dc529e98342ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:23:48.604840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:23:48.606970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:23:48.654271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a673213-cb0b-4714-8ecc-8a520b1dce32 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461950 Jul 20 04:23:48.660227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1201/2326] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:23:48.660227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.660771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:48.668039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.668511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.669286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.669722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.838009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:48.863754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5acea93-7094-4c29-ab7f-62b60e722fe3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.191711 Jul 20 04:23:48.864405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1202/2327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:48.879516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:48.880976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:48.890064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.891346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:48.892451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:48.893673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.039809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.048667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.050815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.052128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47ca34ea-05f8-4114-aabd-85baca975668 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1321 microversion: 2.26 time: 0.185492 Jul 20 04:23:49.053099 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1203/2328] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:48 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:49.058284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6051097e-511c-43da-93c1-9aa2c859dad6 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838bbd6310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.108899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6051097e-511c-43da-93c1-9aa2c859dad6 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 200 len: 1464 microversion: 2.1 time: 0.054293 Jul 20 04:23:49.110215 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1204/2329] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.115032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-350e2670-60d6-4cfc-8afd-4f01ddafb17d tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-131304697", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "max_count": 0}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-350e2670-60d6-4cfc-8afd-4f01ddafb17d tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Request method failure captured: Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 167 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS8d8HKEl6MYavkQHuz6MvJybr2DuHSBxNfJ9ULfxuNskswg406VwKQT22S9qvF7-pnmunHSCqux06yErOPWO6Qr2YpgbCyB8GaYiIAvsH4Rrf4fG0Yl78xi-74B_fdmQiPokDBqjGsVWEXKsuIw-YCkoYRfJm_LpbOWjkTcQU430 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:49.118735 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a21c5bcb70d44d3ba3aa1a462aa2b540", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6e7fb33c02164faf86b660aabf2f522d Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-131304697", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "max_count": 0}} Jul 20 04:23:49.119961 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-131304697', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'max_count': 0}}} Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.120637 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:49.121850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:49.122902 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:23:49.122902 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:23:49.122902 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:23:49.122902 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.124673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-350e2670-60d6-4cfc-8afd-4f01ddafb17d tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:49.126304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-350e2670-60d6-4cfc-8afd-4f01ddafb17d tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015007 Jul 20 04:23:49.127546 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1205/2330] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:49.143442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.144372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.165541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.166008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.166810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.167253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.273352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.284089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84e6b67b-03a5-43fd-aafb-1bf902649c80 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1222 microversion: 2.1 time: 0.155038 Jul 20 04:23:49.285230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1206/2331] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.298784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.300106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.315238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.316339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.317281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.318239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.582406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.590563 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef0549d7-6a4f-478c-8ea9-213747cd75a0 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.304089 Jul 20 04:23:49.591808 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1207/2332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.604919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:49.605772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.612758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.613238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.614046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.614486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.805380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:49.813452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01aec76e-a4c1-4bc6-aa15-838dd1bbc7f0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1467 microversion: 2.1 time: 0.220604 Jul 20 04:23:49.814512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1208/2333] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:49 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1467 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:49.819535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e854cc0f-845b-4c37-adde-904de0719801 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-955983289", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "max_count": 2.5}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e854cc0f-845b-4c37-adde-904de0719801 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Request method failure captured: Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 169 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS8d8HKEl6MYavkQHuz6MvJybr2DuHSBxNfJ9ULfxuNskswg406VwKQT22S9qvF7-pnmunHSCqux06yErOPWO6Qr2YpgbCyB8GaYiIAvsH4Rrf4fG0Yl78xi-74B_fdmQiPokDBqjGsVWEXKsuIw-YCkoYRfJm_LpbOWjkTcQU430 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:49.822427 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a21c5bcb70d44d3ba3aa1a462aa2b540", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6e7fb33c02164faf86b660aabf2f522d Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-955983289", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "max_count": 2.5}} Jul 20 04:23:49.823772 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-955983289', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'max_count': 2.5}}} Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.824535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:49.825753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:49.826737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:23:49.826737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:23:49.826737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:23:49.826737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:49.828252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e854cc0f-845b-4c37-adde-904de0719801 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:49.829287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e854cc0f-845b-4c37-adde-904de0719801 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013695 Jul 20 04:23:49.830017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1209/2334] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:49.845577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f033885b-98f1-4de6-8075-02ad50bebe03 req-da39f020-caa5-470e-8187-2d49f0748094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc269cd-7787-4fde-bf21-ca131b4e2738", "name": "network-vif-unplugged", "status": "completed", "tag": "5c87874c-288b-4b97-8bd5-eb44cc50a7d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:49.857283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f033885b-98f1-4de6-8075-02ad50bebe03 req-da39f020-caa5-470e-8187-2d49f0748094 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.858011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f033885b-98f1-4de6-8075-02ad50bebe03 req-da39f020-caa5-470e-8187-2d49f0748094 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.873397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f033885b-98f1-4de6-8075-02ad50bebe03 req-da39f020-caa5-470e-8187-2d49f0748094 service nova] Creating event network-vif-unplugged:5c87874c-288b-4b97-8bd5-eb44cc50a7d7 for instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 on n-h2-764486-11 Jul 20 04:23:49.922320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f033885b-98f1-4de6-8075-02ad50bebe03 req-da39f020-caa5-470e-8187-2d49f0748094 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090763 Jul 20 04:23:49.924312 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1210/2335] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:49.931924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1614174429"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:49.938566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:49.946251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.946913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:49.947767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:49.948264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.221455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:50.248732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0987ab31-24a5-43a8-80cf-1d7d7e506825 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "POST /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e/action" status: 202 len: 0 microversion: 2.1 time: 0.320698 Jul 20 04:23:50.249391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1211/2336] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:49 2022] POST /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:23:50.256120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.257438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.267517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.268953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.269960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.270462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.505582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.513091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dac09660-86b7-42c4-9608-fa0872f85288 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1515 microversion: 2.1 time: 0.262226 Jul 20 04:23:50.513660 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1212/2337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:50.518031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17ba78ef-0289-4231-8e4b-097a7745c5e3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-585369285", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 0}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17ba78ef-0289-4231-8e4b-097a7745c5e3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Request method failure captured: Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 167 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS8d8HKEl6MYavkQHuz6MvJybr2DuHSBxNfJ9ULfxuNskswg406VwKQT22S9qvF7-pnmunHSCqux06yErOPWO6Qr2YpgbCyB8GaYiIAvsH4Rrf4fG0Yl78xi-74B_fdmQiPokDBqjGsVWEXKsuIw-YCkoYRfJm_LpbOWjkTcQU430 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:50.520785 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a21c5bcb70d44d3ba3aa1a462aa2b540", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6e7fb33c02164faf86b660aabf2f522d Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-585369285", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 0}} Jul 20 04:23:50.521962 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-585369285', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'min_count': 0}}} Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 0 Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:50.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:50.525174 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17ba78ef-0289-4231-8e4b-097a7745c5e3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17ba78ef-0289-4231-8e4b-097a7745c5e3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007552 Jul 20 04:23:50.526366 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1213/2338] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:50 2022] POST /compute/v2.1/servers => generated 130 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:50.537118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.537725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.544430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.544880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.545644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.546077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.764831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.773336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.774982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:50.776202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a78a992d-f9d2-4f2b-b100-c38f9fa1c0e3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1361 microversion: 2.26 time: 0.242839 Jul 20 04:23:50.776911 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1214/2339] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:50.782134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9da0fdf6-527e-4248-8dfc-4ffff586b9b3 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f83980d3b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.825419 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9da0fdf6-527e-4248-8dfc-4ffff586b9b3 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1455 microversion: 2.1 time: 0.047425 Jul 20 04:23:50.825986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1215/2340] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:50.830580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:50.831185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:50.837652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.838099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:50.838858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:50.839287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.049603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.057679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5594a60-9321-4cc5-a3fa-202065c24c46 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1318 microversion: 2.1 time: 0.230676 Jul 20 04:23:51.058263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1216/2341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:50 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:51.063247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e286b60-99e4-4cd5-b60e-5eb65f1d2cf3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1328606066", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 2.5}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e286b60-99e4-4cd5-b60e-5eb65f1d2cf3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Request method failure captured: Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 170 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS8d8HKEl6MYavkQHuz6MvJybr2DuHSBxNfJ9ULfxuNskswg406VwKQT22S9qvF7-pnmunHSCqux06yErOPWO6Qr2YpgbCyB8GaYiIAvsH4Rrf4fG0Yl78xi-74B_fdmQiPokDBqjGsVWEXKsuIw-YCkoYRfJm_LpbOWjkTcQU430 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:23:51.066857 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a21c5bcb70d44d3ba3aa1a462aa2b540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a21c5bcb70d44d3ba3aa1a462aa2b540", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a21c5bcb70d44d3ba3aa1a462aa2b540 Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-429309537 Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6e7fb33c02164faf86b660aabf2f522d Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-429309537-project Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1328606066", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 2.5}} Jul 20 04:23:51.068410 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1328606066', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'min_count': 2.5}}} Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:51.069440 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:23:51.071206 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:23:51.073026 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:23:51.073026 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:23:51.073026 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 04:23:51.073026 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:23:51.074552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e286b60-99e4-4cd5-b60e-5eb65f1d2cf3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:23:51.075412 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e286b60-99e4-4cd5-b60e-5eb65f1d2cf3 tempest-MultipleCreateNegativeTestJSON-429309537 tempest-MultipleCreateNegativeTestJSON-429309537-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016072 Jul 20 04:23:51.076310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1217/2342] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:23:51 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:23:51.083467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:51.084238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:51.091637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.092083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.093128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.093789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.730210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:51.744754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a6c0c34-a163-46f5-b434-91f48263210a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.667420 Jul 20 04:23:51.752539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1218/2343] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:51 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:51.756252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:51.758203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:51.765115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.765292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:51.766680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:51.767151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.118416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.126664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ec4dd07-bc64-4f8c-a494-104f36628cc3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1521 microversion: 2.1 time: 0.379091 Jul 20 04:23:52.127576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1219/2344] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:51 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:52.132045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.132971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.142496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.143114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.143883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.144340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.441982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.455191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.456816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.457862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-202b6477-22f5-43f8-971c-7fde02910c2a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1361 microversion: 2.26 time: 0.329367 Jul 20 04:23:52.458416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1220/2345] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:52.469525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e46fc6db-869d-4a34-afc3-0f8b86adb951 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b9565e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.548743 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e46fc6db-869d-4a34-afc3-0f8b86adb951 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1455 microversion: 2.1 time: 0.083287 Jul 20 04:23:52.549539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1221/2346] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:52.554533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3a332b4f-815a-47ed-9fa7-4634f0c31af8 req-d2f9dc43-650b-4dfe-ac28-30a7697aac82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025bd78-43f4-4e76-b0d6-40e67808c28f", "name": "network-vif-plugged", "status": "completed", "tag": "62918383-a5c6-4c5d-975c-342094fde378"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:52.568972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3a332b4f-815a-47ed-9fa7-4634f0c31af8 req-d2f9dc43-650b-4dfe-ac28-30a7697aac82 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.569737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3a332b4f-815a-47ed-9fa7-4634f0c31af8 req-d2f9dc43-650b-4dfe-ac28-30a7697aac82 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.582913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3a332b4f-815a-47ed-9fa7-4634f0c31af8 req-d2f9dc43-650b-4dfe-ac28-30a7697aac82 service nova] Creating event network-vif-plugged:62918383-a5c6-4c5d-975c-342094fde378 for instance d025bd78-43f4-4e76-b0d6-40e67808c28f on n-h1-764486-11 Jul 20 04:23:52.588314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3a332b4f-815a-47ed-9fa7-4634f0c31af8 req-d2f9dc43-650b-4dfe-ac28-30a7697aac82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037344 Jul 20 04:23:52.589144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1222/2347] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:52.595943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.603008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.615426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.616471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.617504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.618262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.935609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:52.945329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41cae45c-54be-4b3f-b8e4-2bdcfeeb2d51 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1318 microversion: 2.1 time: 0.354522 Jul 20 04:23:52.956624 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1223/2348] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:52.961937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:52.962764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:52.970969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.971519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:52.972663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:52.973298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.315965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:53.324627 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e16d9d21-8ecb-41e7-bab1-d8ea1f68cf38 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1324 microversion: 2.1 time: 0.366417 Jul 20 04:23:53.335037 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1224/2349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:52 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:53.340230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b528a8d2-a436-435e-b9da-c89bd250649a req-94ef6a45-63d5-4bd8-953f-561b0f01b815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4720567-7f18-444e-a14d-b6eab7499465", "tag": "51b49117-3255-4b11-ae1c-b490dd27fd94"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:53.354643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b528a8d2-a436-435e-b9da-c89bd250649a req-94ef6a45-63d5-4bd8-953f-561b0f01b815 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.355345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b528a8d2-a436-435e-b9da-c89bd250649a req-94ef6a45-63d5-4bd8-953f-561b0f01b815 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.371413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b528a8d2-a436-435e-b9da-c89bd250649a req-94ef6a45-63d5-4bd8-953f-561b0f01b815 service nova] Creating event network-changed:51b49117-3255-4b11-ae1c-b490dd27fd94 for instance c4720567-7f18-444e-a14d-b6eab7499465 on n-h1-764486-11 Jul 20 04:23:53.376553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b528a8d2-a436-435e-b9da-c89bd250649a req-94ef6a45-63d5-4bd8-953f-561b0f01b815 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039890 Jul 20 04:23:53.377802 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1225/2350] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:53.383944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.385083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:53.394044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.394630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.395506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.396042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.658195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:53.670130 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5272b1c8-473a-4a7b-9cc0-bfb9d19f18ba tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1521 microversion: 2.1 time: 0.290606 Jul 20 04:23:53.671439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1226/2351] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:53.678778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:53.680634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:53.696688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.697382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:53.698316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:53.699035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.060241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.070471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.072588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.073949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f909cec-47b2-4329-9aaf-60ea5e61f84d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1361 microversion: 2.26 time: 0.400494 Jul 20 04:23:54.074704 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1227/2352] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:53 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:54.089789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd08d12c-1e27-4c60-9190-3aa9cb41f7ff tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b956c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.136005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd08d12c-1e27-4c60-9190-3aa9cb41f7ff tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1455 microversion: 2.1 time: 0.059976 Jul 20 04:23:54.136606 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1228/2353] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:54.146087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.146833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.154290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.154858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.155871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.157315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.425744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.435703 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41d4cf18-fea1-49c8-94b1-017bd4f03f17 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1318 microversion: 2.1 time: 0.298045 Jul 20 04:23:54.436610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1229/2354] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:54.454342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.454342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.460601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.461282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.462063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.462502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.654625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.664302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2975ec9-c66b-477a-aa7c-977cb54d10a0 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1464 microversion: 2.1 time: 0.216977 Jul 20 04:23:54.665058 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1230/2355] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:54.672782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.673782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.691809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.692808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.693920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.694447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.839460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:54.848398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b7fdac8-55f9-41aa-beae-c9d805428ffe tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 200 len: 1520 microversion: 2.1 time: 0.182035 Jul 20 04:23:54.849206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1231/2356] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:54.865499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:54.866528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:54.872941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.873396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.874208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:54.874812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:54.985507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46db2c47-f4ef-48b4-8c1c-9f6815118f71 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 0 microversion: 2.1 time: 0.123393 Jul 20 04:23:54.987040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1232/2357] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:54 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:23:54.994131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:54.995112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.006881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.007616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.008768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.009684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.028472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:55.200326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:55.213400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10195766-4c77-413d-85a7-705f791bbba0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1521 microversion: 2.1 time: 0.223712 Jul 20 04:23:55.218384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1233/2358] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:54 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:55.231619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.243"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:55.233045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:55.252266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.253836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.259144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:55.259845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:55.304030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Acquired lock "refresh_cache-a8ae7451-caaf-4bff-aabf-f25af9b6e887" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:23:57.967935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:23:58.576734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:58.599326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:23:58.850770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Updating instance_info_cache with network_info: [{"id": "9f8ff807-2660-47cf-8c78-6176cafcc1bc", "address": "fa:16:3e:68:af:79", "network": {"id": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1739990385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ee50acf92da24b3185b6da3c165a7d71", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f8ff807-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:23:58.868311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Releasing lock "refresh_cache-a8ae7451-caaf-4bff-aabf-f25af9b6e887" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:23:58.869481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-429edd07-a237-4463-b770-88cd16a19514 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action" status: 202 len: 0 microversion: 2.1 time: 3.649806 Jul 20 04:23:58.870222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1234/2359] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:23:55 2022] POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action => generated 0 bytes in 3651 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:23:58.875444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:58.889293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:58.900954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.901717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.902716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.903382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.979333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:58.979980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:58.982683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lazy-loading 'fault' on Instance uuid 59f518e8-fd6b-4a1f-95e4-615888632c55 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:23:59.250012 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47fb7c54-a1ee-4b02-bf80-921062e84dd1 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1600 microversion: 2.1 time: 0.378377 Jul 20 04:23:59.261598 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1235/2360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:58 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1600 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:59.268020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.286119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:59.301849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.302574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.303531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.304125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.487056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:59.495386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:59.496928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:23:59.498094 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d882e2da-08f8-4e9f-8a3d-6bfef13ce165 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1361 microversion: 2.26 time: 0.234864 Jul 20 04:23:59.498658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1236/2361] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:23:59.509179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd522d1d-47f6-4f3b-a310-8763c57c0966 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838bbc1430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.609936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd522d1d-47f6-4f3b-a310-8763c57c0966 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1455 microversion: 2.1 time: 0.104221 Jul 20 04:23:59.624614 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1237/2362] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:23:59.630256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-662a59a6-7385-4c9c-b809-dd82897aeb4d req-43a47e27-966e-45d4-b6aa-4b6b7e46d117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9871b7-062e-4375-997b-75b3ad72a5ab", "tag": "1815532c-79d2-4d88-b6d7-c1d6cc2194ab"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:23:59.649987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-662a59a6-7385-4c9c-b809-dd82897aeb4d req-43a47e27-966e-45d4-b6aa-4b6b7e46d117 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.650438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-662a59a6-7385-4c9c-b809-dd82897aeb4d req-43a47e27-966e-45d4-b6aa-4b6b7e46d117 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.675073 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-662a59a6-7385-4c9c-b809-dd82897aeb4d req-43a47e27-966e-45d4-b6aa-4b6b7e46d117 service nova] Creating event network-changed:1815532c-79d2-4d88-b6d7-c1d6cc2194ab for instance 9f9871b7-062e-4375-997b-75b3ad72a5ab on n-h2-764486-11 Jul 20 04:23:59.689580 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-662a59a6-7385-4c9c-b809-dd82897aeb4d req-43a47e27-966e-45d4-b6aa-4b6b7e46d117 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062605 Jul 20 04:23:59.690544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1238/2363] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:23:59.704517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:23:59.706023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:23:59.716243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.716726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:23:59.717515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:23:59.717953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.220140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:00.237602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d601b14c-dd01-4341-a7b2-1b09c43138e3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1318 microversion: 2.1 time: 0.545620 Jul 20 04:24:00.244400 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1239/2364] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:23:59 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:00.256824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2c031455-ace6-480b-95ad-808ac2cdeda6 req-72a690a6-e4af-4539-a821-8f7f4c76883a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe55fb2-74aa-4293-b7f3-dcac8e43c130", "name": "network-vif-plugged", "status": "completed", "tag": "086e22dc-2965-43d3-b13e-4814c5ec0c9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:00.270666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2c031455-ace6-480b-95ad-808ac2cdeda6 req-72a690a6-e4af-4539-a821-8f7f4c76883a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.272235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2c031455-ace6-480b-95ad-808ac2cdeda6 req-72a690a6-e4af-4539-a821-8f7f4c76883a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.299749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2c031455-ace6-480b-95ad-808ac2cdeda6 req-72a690a6-e4af-4539-a821-8f7f4c76883a service nova] Creating event network-vif-plugged:086e22dc-2965-43d3-b13e-4814c5ec0c9c for instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 on n-h2-764486-11 Jul 20 04:24:00.308807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2c031455-ace6-480b-95ad-808ac2cdeda6 req-72a690a6-e4af-4539-a821-8f7f4c76883a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061820 Jul 20 04:24:00.318905 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1240/2365] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:00.326116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:00.327038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:00.350313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.351850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.353487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:00.354328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:00.817794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:00.829191 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b717b2eb-d4f0-4dba-9954-db1cb1fabc20 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1521 microversion: 2.1 time: 0.507839 Jul 20 04:24:00.834279 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1241/2366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:00 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:00.981113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-915375906", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:01.048657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] validate_networks() for [('df7757b0-396b-4bf1-b000-1e40cba2840e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:01.526058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:01.526702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:01.526938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:01.527342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:01.527745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:01.540314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.540993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.541941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.543001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.568431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Getting quotas for project dc99560066644ac58bff06cc8fb86577. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:01.582467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Getting quotas for user 100f850e2270414e8f8449695b53c2aa and project dc99560066644ac58bff06cc8fb86577. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:01.603221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:01.605985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:01.643008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:01.679145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8bf9a183-dca5-43b6-8aba-056b101ae3f1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.843701 Jul 20 04:24:01.685038 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1242/2367] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:01.692877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.243"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:01.701315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:01.752246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.757445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.758919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:01.759722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:01.824619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Acquired lock "refresh_cache-d025bd78-43f4-4e76-b0d6-40e67808c28f" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:24:05.046836 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.neutron [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] re-assign floating IP 172.25.5.243 from instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 Jul 20 04:24:05.109452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:24:06.041968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Updating instance_info_cache with network_info: [{"id": "9f8ff807-2660-47cf-8c78-6176cafcc1bc", "address": "fa:16:3e:68:af:79", "network": {"id": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1739990385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ee50acf92da24b3185b6da3c165a7d71", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f8ff807-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:24:06.063645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:24:06.985277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Updating instance_info_cache with network_info: [{"id": "62918383-a5c6-4c5d-975c-342094fde378", "address": "fa:16:3e:4a:1d:9d", "network": {"id": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1739990385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ee50acf92da24b3185b6da3c165a7d71", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62918383-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:24:07.005888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Releasing lock "refresh_cache-d025bd78-43f4-4e76-b0d6-40e67808c28f" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:24:07.007324 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb7d5429-b419-4507-bd25-b4474c65d61a tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f/action" status: 202 len: 0 microversion: 2.1 time: 5.325488 Jul 20 04:24:07.009274 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1243/2368] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:01 2022] POST /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f/action => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:24:07.015707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:07.017485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.028417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.029127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.031220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.031850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.138120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b494600e-134e-4106-8629-9d28b37c647e tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action" status: 202 len: 0 microversion: 2.1 time: 0.127042 Jul 20 04:24:07.144317 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1244/2369] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:07 2022] POST /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:07.149458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.150125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.157908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.158427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.159480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.160123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.351410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.364641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.366555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.368061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62cf49a9-062c-407b-8948-c32294f3623f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1361 microversion: 2.26 time: 0.222490 Jul 20 04:24:07.379596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1245/2370] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:07.385147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a76938dd-84d7-42cc-9b95-41bf92ee2331 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b9fcca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.431236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a76938dd-84d7-42cc-9b95-41bf92ee2331 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1455 microversion: 2.1 time: 0.050206 Jul 20 04:24:07.431931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1246/2371] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.441886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.442796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.465045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.465501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.466292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.466920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.628998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.642529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb3e0034-37f0-4551-8f2a-5ab0b19a73a3 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1318 microversion: 2.1 time: 0.208933 Jul 20 04:24:07.643310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1247/2372] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.647985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.648778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.655703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.656156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.657046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.657474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.798066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:07.800531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:07.807697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8eb6d5cd-16f6-41ee-9111-14d9a4c0f90d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1313 microversion: 2.1 time: 0.163227 Jul 20 04:24:07.808276 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1248/2373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:07.813726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c9cc6e59-3f39-49df-b4c6-3c3858c225fe req-a3ff7e1a-6ed8-4855-836f-12a0740c195d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:07.822567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c9cc6e59-3f39-49df-b4c6-3c3858c225fe req-a3ff7e1a-6ed8-4855-836f-12a0740c195d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.823305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c9cc6e59-3f39-49df-b4c6-3c3858c225fe req-a3ff7e1a-6ed8-4855-836f-12a0740c195d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.837720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c9cc6e59-3f39-49df-b4c6-3c3858c225fe req-a3ff7e1a-6ed8-4855-836f-12a0740c195d service nova] Creating event network-changed:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:24:07.843048 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c9cc6e59-3f39-49df-b4c6-3c3858c225fe req-a3ff7e1a-6ed8-4855-836f-12a0740c195d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Jul 20 04:24:07.843800 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1249/2374] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:07.850044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:07.850736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:07.858292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.858938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:07.859899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:07.860513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.088959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:08.098816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8af14c14-8b2f-464d-9314-834d29521376 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1506 microversion: 2.1 time: 0.252957 Jul 20 04:24:08.100370 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1250/2375] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:07 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.115943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "name": "network-vif-plugged", "status": "completed", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}, {"server_uuid": "9f9871b7-062e-4375-997b-75b3ad72a5ab", "name": "network-vif-plugged", "status": "completed", "tag": "1815532c-79d2-4d88-b6d7-c1d6cc2194ab"}, {"server_uuid": "c4720567-7f18-444e-a14d-b6eab7499465", "name": "network-vif-plugged", "status": "completed", "tag": "51b49117-3255-4b11-ae1c-b490dd27fd94"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:08.125909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.126415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.151561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] Creating event network-vif-plugged:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:24:08.152229 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] Creating event network-vif-plugged:1815532c-79d2-4d88-b6d7-c1d6cc2194ab for instance 9f9871b7-062e-4375-997b-75b3ad72a5ab on n-h2-764486-11 Jul 20 04:24:08.153638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] Creating event network-vif-plugged:51b49117-3255-4b11-ae1c-b490dd27fd94 for instance c4720567-7f18-444e-a14d-b6eab7499465 on n-h1-764486-11 Jul 20 04:24:08.163377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ef79e2de-3320-4818-9deb-64c8f33bbc5f req-b65716d6-ac24-4193-8226-285bd7a954d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051041 Jul 20 04:24:08.164327 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1251/2376] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:08.169776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'action', calling method: .version_select at 0x7f839a871dc0>, body: {"removeFloatingIp": {"address": "172.25.5.243"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:08.386580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.393531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.393983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.394758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.395191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.781755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] HTTP exception thrown: Floating IP 172.25.5.243 is not associated with instance a8ae7451-caaf-4bff-aabf-f25af9b6e887. Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Request method failure captured: Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action HTTP/1.1 Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 49 Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Mmd5RvP0Vpp6dDsswUumrCo2dFW42QKkne7-UP2IM4GsA92F3xOyKG8qshlS5TS-Q_oumdWP-lgLBsC_hfHUPrNZSbdxXplNQYfel7YKivnmAdkQ31ohe5CbH1kLHREFGStz_ST0-eFQZOMUGvVQNY4fs9BTYYzT6KM8Xq8R9e6oI Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:08.784400 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee50acf92da24b3185b6da3c165a7d71", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 99ee2b91f0c04c59a1b76708d2c85083 Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: {"removeFloatingIp": {"address": "172.25.5.243"}} Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:08.785875 n-d-764486-11 devstack@n-api.service[123724]: exception: Floating IP 172.25.5.243 is not associated with instance a8ae7451-caaf-4bff-aabf-f25af9b6e887. Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a8ae7451-caaf-4bff-aabf-f25af9b6e887', 'body': {'removeFloatingIp': {'address': '172.25.5.243'}}} Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.243 is not associated with instance a8ae7451-caaf-4bff-aabf-f25af9b6e887. Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.786807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:08.788203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:08.788203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:08.788203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:08.788203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:08.788203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.243 is not associated with instance a8ae7451-caaf-4bff-aabf-f25af9b6e887. Jul 20 04:24:08.788203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:08.789686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Returning 409 to user: Floating IP 172.25.5.243 is not associated with instance a8ae7451-caaf-4bff-aabf-f25af9b6e887. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:08.790552 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8343229d-5fa3-480a-8d56-bdb679fd9418 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action" status: 409 len: 146 microversion: 2.1 time: 0.625098 Jul 20 04:24:08.791300 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1252/2377] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:08 2022] POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action => generated 146 bytes in 626 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:08.796992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.798354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.805528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.806204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.807316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.807753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.963405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81dd03c0-a159-467a-ad5d-df7dcecec496 tempest-ServersAdminTestJSON-1539622709 tempest-ServersAdminTestJSON-1539622709-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1617 microversion: 2.1 time: 0.170686 Jul 20 04:24:08.964141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1253/2378] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1617 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:08.980709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:08.981798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:08.988417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.988945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:08.989959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:08.990602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.126441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.136017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-081c2ce0-ddd5-427f-9591-6b3e344f03bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 200 len: 1506 microversion: 2.1 time: 0.170120 Jul 20 04:24:09.137640 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1254/2379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:08 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.148777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.149514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.156039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.156775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.157841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.158266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.353183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.361406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.363033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.364157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73b9909f-d286-433b-8f48-f08292337615 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1361 microversion: 2.26 time: 0.224004 Jul 20 04:24:09.364745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1255/2380] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:09.369075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0f2e807-5f22-4730-9dba-23eff95a4a10 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b0de4c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.412831 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0f2e807-5f22-4730-9dba-23eff95a4a10 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1464 microversion: 2.1 time: 0.047054 Jul 20 04:24:09.413400 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1256/2381] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1464 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.417772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:09.418379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.424653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.425104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.425872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.426306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.558751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:09.567129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a162bb75-189e-4024-aebc-37385046a43f tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1318 microversion: 2.1 time: 0.152772 Jul 20 04:24:09.567701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1257/2382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:09 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:09.572383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.243"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:09.704695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:09.711093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.711551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.712332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:09.712946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:09.923700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Acquired lock "refresh_cache-d025bd78-43f4-4e76-b0d6-40e67808c28f" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:24:10.832844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:24:11.304550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Updating instance_info_cache with network_info: [{"id": "62918383-a5c6-4c5d-975c-342094fde378", "address": "fa:16:3e:4a:1d:9d", "network": {"id": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1739990385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ee50acf92da24b3185b6da3c165a7d71", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62918383-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:24:11.317656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Releasing lock "refresh_cache-d025bd78-43f4-4e76-b0d6-40e67808c28f" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:24:11.318670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5967b498-d27d-48d2-b5ea-adfca9c7ea58 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f/action" status: 202 len: 0 microversion: 2.1 time: 1.749905 Jul 20 04:24:11.319348 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1258/2383] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:09 2022] POST /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f/action => generated 0 bytes in 1751 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:24:11.323830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.324474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.330738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.331193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.331973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.332432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.465305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:11.475262 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-261e6bdd-2b23-4766-bc2a-20afd2745297 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1313 microversion: 2.1 time: 0.154909 Jul 20 04:24:11.484065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1259/2384] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:11.484065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.484065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.488668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.489135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.489929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.490373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.519837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:11.557300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:11.591463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:11.626200 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-664443be-ba65-468a-9b36-cda54c8e701c tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 204 len: 0 microversion: 2.1 time: 0.148968 Jul 20 04:24:11.630641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1260/2385] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:11 2022] DELETE /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:11.633206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.634268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.640903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.641399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.642173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.642722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.671011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:11.791628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9c9eabf-3746-4692-b47b-30e2b7007f6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 204 len: 0 microversion: 2.1 time: 0.163172 Jul 20 04:24:11.792462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1261/2386] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:11 2022] DELETE /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:11.802851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1caa01cb-4f70-43cc-b5f7-bc32332fe006 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b09cb80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.879753 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1caa01cb-4f70-43cc-b5f7-bc32332fe006 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 200 len: 1464 microversion: 2.1 time: 0.085915 Jul 20 04:24:11.888521 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1262/2387] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 1464 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:11.894202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}, {"name": "network-changed", "server_uuid": "d025bd78-43f4-4e76-b0d6-40e67808c28f", "tag": "62918383-a5c6-4c5d-975c-342094fde378"}, {"name": "network-changed", "server_uuid": "403f7f87-2388-4131-99fa-1905c114302c", "tag": "dbe5063c-f6e2-4367-8df9-d3524b37f76d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:11.907482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.907926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.927178 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] Creating event network-changed:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:24:11.927688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] Creating event network-changed:62918383-a5c6-4c5d-975c-342094fde378 for instance d025bd78-43f4-4e76-b0d6-40e67808c28f on n-h1-764486-11 Jul 20 04:24:11.928299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] Creating event network-changed:dbe5063c-f6e2-4367-8df9-d3524b37f76d for instance 403f7f87-2388-4131-99fa-1905c114302c on n-h2-764486-11 Jul 20 04:24:11.944924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b95e5d0b-3e24-4c16-8234-a5ccc2028f4a req-4a5c496b-c318-460c-b8ad-23a7fb22b5d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.054425 Jul 20 04:24:11.946046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1263/2388] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:11.957222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:11.957977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:11.968759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.969450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:11.973417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:11.974087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.184690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.193864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.195365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.197705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08e5ad83-bdd5-41b4-b89b-7fd90c7cb4b7 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1545 microversion: 2.26 time: 0.249779 Jul 20 04:24:12.200647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1264/2389] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:11 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1545 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:12.207283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.208199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.218077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.218559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.219979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.220592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.242299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:12.440270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.448696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84d40875-d0ce-4637-b47e-cbbb75bf8729 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1467 microversion: 2.1 time: 0.246779 Jul 20 04:24:12.459990 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1265/2390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1467 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:12.459990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.459990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.465937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.466950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.468623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.469172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.499808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:12.605947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1fc44a5e-7fc4-42cb-bb62-e8f3dd3465ca tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 204 len: 0 microversion: 2.1 time: 0.155169 Jul 20 04:24:12.612439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1266/2391] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:12 2022] DELETE /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:12.618062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.618663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.626197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.626805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.627922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.628772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.800737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.808672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-636e4237-fc48-4457-9a50-086ecb00d87d tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 200 len: 1470 microversion: 2.1 time: 0.199435 Jul 20 04:24:12.809558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1267/2392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:12.815386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-01ead200-51f4-46a9-9aeb-db86f2e5dc18 req-02155ed1-096d-413f-a35a-1d3ece7ec49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f7f87-2388-4131-99fa-1905c114302c", "name": "network-vif-plugged", "status": "completed", "tag": "dbe5063c-f6e2-4367-8df9-d3524b37f76d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:12.824138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-01ead200-51f4-46a9-9aeb-db86f2e5dc18 req-02155ed1-096d-413f-a35a-1d3ece7ec49b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.824620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-01ead200-51f4-46a9-9aeb-db86f2e5dc18 req-02155ed1-096d-413f-a35a-1d3ece7ec49b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.836498 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-01ead200-51f4-46a9-9aeb-db86f2e5dc18 req-02155ed1-096d-413f-a35a-1d3ece7ec49b service nova] Creating event network-vif-plugged:dbe5063c-f6e2-4367-8df9-d3524b37f76d for instance 403f7f87-2388-4131-99fa-1905c114302c on n-h2-764486-11 Jul 20 04:24:12.841448 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-01ead200-51f4-46a9-9aeb-db86f2e5dc18 req-02155ed1-096d-413f-a35a-1d3ece7ec49b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030736 Jul 20 04:24:12.842642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1268/2393] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:12.848930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:12.849813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:12.856207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.856766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.857545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:12.857982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:12.987686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:12.995377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0b7c1cb-5668-4341-b320-01f82ca167f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1466 microversion: 2.1 time: 0.152000 Jul 20 04:24:12.995946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1269/2394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:12 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:13.000545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1503897880", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "ae8e82e2-541d-4bad-b7ba-1a3c1e47e30c"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:13.050647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] validate_networks() for [('ae8e82e2-541d-4bad-b7ba-1a3c1e47e30c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:13.408543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:13.408963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:13.409429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:13.409862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:13.410265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:13.419560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.419999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.420820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.421291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.438985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Getting quotas for project 79c01dad88a044848fde724f2e610051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:13.444603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Getting quotas for user 6889981a862845ba8f1817d605db27db and project 79c01dad88a044848fde724f2e610051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:13.456851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:13.459094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:13.505351 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eaf61b45-eacd-4c9e-b5c5-f650b12b104f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508312 Jul 20 04:24:13.506604 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1270/2395] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:13.511211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838b0f4790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.526010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.526725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.527336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.534826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.535340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.536117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.536582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.562493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.563244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.577630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.578151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.605468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:13.621091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5cf7b49-90e1-4ad0-84cf-54c0f01bf275 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-560464634" status: 201 len: 0 microversion: 2.26 time: 0.113820 Jul 20 04:24:13.621749 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1271/2396] 10.222.0.49 () {62 vars in 1376 bytes} [Wed Jul 20 04:24:13 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-560464634 => generated 0 bytes in 115 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:24:13.740593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1796118683", "block_migration": true, "disk_over_commit": false}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:13.741886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.748231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.748803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.749663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.750432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.775997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lazy-loading 'flavor' on Instance uuid c4720567-7f18-444e-a14d-b6eab7499465 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:13.790119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Going to try to live migrate instance to tempest-host-1796118683 {{(pid=123724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:24:13.798596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] HTTP exception thrown: Compute host tempest-host-1796118683 could not be found. Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Request method failure captured: Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465/action HTTP/1.1 Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 107 Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NTDg9H_4EPo5wor0A13EVlUlBMBOLz5lsif50mSSP6vBb-ZgbYSEl8eGl3siZqhni5Bt3TVvMPziEcSCzg4XV9LVUaNzK7l69yxZBoEaLdpL87ZNG6DJtIYo-0Hw3Z_QuBsDQNnECqC7sZu2Si8MS8yvHT2eHJkqGU_jl4im5Zs6Y Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4ca4f08c987849c2ac8b6941001a3750 Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationNegativeTest-2007935775 Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:24:13.815000 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ca4f08c987849c2ac8b6941001a3750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ca4f08c987849c2ac8b6941001a3750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ca4f08c987849c2ac8b6941001a3750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ca4f08c987849c2ac8b6941001a3750", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationNegativeTest-2007935775 Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4ca4f08c987849c2ac8b6941001a3750 Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2007935775 Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationNegativeTest-2007935775-project-admin Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4408871542a14fc5b61a69aa5ef823f0 Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationNegativeTest-2007935775-project-admin Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: {"os-migrateLive": {"host": "tempest-host-1796118683", "block_migration": true, "disk_over_commit": false}} Jul 20 04:24:13.817263 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: exception: Compute host tempest-host-1796118683 could not be found. Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c4720567-7f18-444e-a14d-b6eab7499465', 'body': {'os-migrateLive': {'host': 'tempest-host-1796118683', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:13.818188 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1796118683 could not be found. Jul 20 04:24:13.819557 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1796118683 could not be found. Jul 20 04:24:13.821350 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1796118683 could not be found. Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Returning 400 to user: Compute host tempest-host-1796118683 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb35cac9-9ab2-4c87-8817-6aedc0c40618 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465/action" status: 400 len: 100 microversion: 2.1 time: 0.194250 Jul 20 04:24:13.822859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1272/2397] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Jul 20 04:24:13 2022] POST /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465/action => generated 100 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:13.826694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:13.827324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:13.837893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.838501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:13.839291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:13.839730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.146818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:14.167746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f67cfe6-59f1-4c2f-b17a-5274b97671dd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1313 microversion: 2.1 time: 0.343504 Jul 20 04:24:14.177817 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1273/2398] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:13 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:14.177817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.243"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:14.177817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:14.189374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.190206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.191371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:14.192066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:14.220169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Acquired lock "refresh_cache-a8ae7451-caaf-4bff-aabf-f25af9b6e887" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:24:16.856676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:24:18.129205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Updating instance_info_cache with network_info: [{"id": "9f8ff807-2660-47cf-8c78-6176cafcc1bc", "address": "fa:16:3e:68:af:79", "network": {"id": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1739990385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ee50acf92da24b3185b6da3c165a7d71", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f8ff807-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:24:18.145483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Releasing lock "refresh_cache-a8ae7451-caaf-4bff-aabf-f25af9b6e887" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:24:18.146469 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cfe65c2-1f29-4bc5-be84-ce10d48e9531 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action" status: 202 len: 0 microversion: 2.1 time: 3.976911 Jul 20 04:24:18.150188 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1274/2399] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:14 2022] POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action => generated 0 bytes in 3978 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:24:18.152617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-887fc62c-7ed6-4121-a163-867d4b7647e0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b00ae50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.259791 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-887fc62c-7ed6-4121-a163-867d4b7647e0 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?changes-since=2022-07-20T04%3A22%3A09Z" status: 200 len: 1902 microversion: 2.1 time: 0.111667 Jul 20 04:24:18.260403 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1275/2400] 10.222.0.49 () {58 vars in 1198 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/images?changes-since=2022-07-20T04%3A22%3A09Z => generated 1902 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:18.264890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.267509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.276838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.277283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.278060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.278494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.522789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.530269 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5f8397e-0291-4d88-b528-26595574b622 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1318 microversion: 2.1 time: 0.268886 Jul 20 04:24:18.530840 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1276/2401] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:18.536118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eda30706-451e-4d4a-9911-ef56247cbd75 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838b00a5e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.543505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eda30706-451e-4d4a-9911-ef56247cbd75 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.543883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eda30706-451e-4d4a-9911-ef56247cbd75 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.556094 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eda30706-451e-4d4a-9911-ef56247cbd75 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-560464634" status: 204 len: 0 microversion: 2.26 time: 0.024211 Jul 20 04:24:18.556752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1277/2402] 10.222.0.49 () {60 vars in 1357 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-560464634 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:18.561960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.562570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.569355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.569851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.570628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.571054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.785675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:18.793264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5feba39-6b8c-4f2e-be0e-1e058889644a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1467 microversion: 2.1 time: 0.235575 Jul 20 04:24:18.793888 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1278/2403] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1467 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:18.798219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.798822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 038f9610-51d2-4bb3-a7eb-984aabb0f873] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.800629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:18.809258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.809775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.810627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.811177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.827214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] HTTP exception thrown: Instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 could not be found. Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Request method failure captured: Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 HTTP/1.1 Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KvHbwwn1rKj8hfAhjSa_M6shvbXBVkD-KIsnxmeyegtEHq_tIhzRXslgH8HVm0x4wrPE-12HYoW_OhOKRz2gb7gnoIwv0QoSLvywzOqK5VO4Zt9V0qIfj-LvfX0L2TkvSyGaihUmWn1AL-y8gUeAiUkrEuhilvDmS1-3QUaspfGpI Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b1aabe9c1e484ea8ae0ca07bfc093c88 Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:18.829285 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1aabe9c1e484ea8ae0ca07bfc093c88", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b1aabe9c1e484ea8ae0ca07bfc093c88 Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminTestJSON-1437699849-project Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cd40edc86fb24af79986645c1e99d944 Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminTestJSON-1437699849-project Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 could not be found. Jul 20 04:24:18.830549 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '038f9610-51d2-4bb3-a7eb-984aabb0f873'} Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 could not be found. Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:18.831245 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 could not be found. Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 could not be found. Jul 20 04:24:18.833420 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:18.835807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Returning 404 to user: Instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:18.835807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-823c1858-97b9-416d-a00a-4bcf0fd7f6c2 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873" status: 404 len: 111 microversion: 2.1 time: 0.035943 Jul 20 04:24:18.835807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1279/2404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/038f9610-51d2-4bb3-a7eb-984aabb0f873 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:18.836539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7803b0d4-0674-4400-aa2e-03510a3aa29e req-8cf7a1b4-ea0c-4e14-88ad-93cb9d630312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d025bd78-43f4-4e76-b0d6-40e67808c28f", "tag": "62918383-a5c6-4c5d-975c-342094fde378"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:18.844243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7803b0d4-0674-4400-aa2e-03510a3aa29e req-8cf7a1b4-ea0c-4e14-88ad-93cb9d630312 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.845275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7803b0d4-0674-4400-aa2e-03510a3aa29e req-8cf7a1b4-ea0c-4e14-88ad-93cb9d630312 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.857000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7803b0d4-0674-4400-aa2e-03510a3aa29e req-8cf7a1b4-ea0c-4e14-88ad-93cb9d630312 service nova] Creating event network-changed:62918383-a5c6-4c5d-975c-342094fde378 for instance d025bd78-43f4-4e76-b0d6-40e67808c28f on n-h1-764486-11 Jul 20 04:24:18.862040 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7803b0d4-0674-4400-aa2e-03510a3aa29e req-8cf7a1b4-ea0c-4e14-88ad-93cb9d630312 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029685 Jul 20 04:24:18.862802 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1280/2405] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:18.867642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7e68e53c-1b38-40bd-b0c4-7e558f13b4fb req-01966589-50bc-4b8f-9c27-800da321cf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "name": "network-vif-unplugged", "status": "completed", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:18.876472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7e68e53c-1b38-40bd-b0c4-7e558f13b4fb req-01966589-50bc-4b8f-9c27-800da321cf8c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.877133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7e68e53c-1b38-40bd-b0c4-7e558f13b4fb req-01966589-50bc-4b8f-9c27-800da321cf8c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.888903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7e68e53c-1b38-40bd-b0c4-7e558f13b4fb req-01966589-50bc-4b8f-9c27-800da321cf8c service nova] Creating event network-vif-unplugged:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:24:18.894392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7e68e53c-1b38-40bd-b0c4-7e558f13b4fb req-01966589-50bc-4b8f-9c27-800da321cf8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030471 Jul 20 04:24:18.894999 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1281/2406] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:18.900027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:18.900753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:18.907657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.908321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.909111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:18.909546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:18.926472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:19.047364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:19.055048 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-765f4c6e-fbe1-43dc-8655-b1ca5698efb0 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1499 microversion: 2.1 time: 0.158919 Jul 20 04:24:19.055610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1282/2407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:18 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:19.059906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7c720809-cc14-444e-8b39-6551eed8c7db req-8239af3b-834f-42a0-812f-f9a060888b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d025bd78-43f4-4e76-b0d6-40e67808c28f", "name": "network-vif-deleted", "tag": "62918383-a5c6-4c5d-975c-342094fde378"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:19.068253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c720809-cc14-444e-8b39-6551eed8c7db req-8239af3b-834f-42a0-812f-f9a060888b30 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.068717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c720809-cc14-444e-8b39-6551eed8c7db req-8239af3b-834f-42a0-812f-f9a060888b30 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.080252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7c720809-cc14-444e-8b39-6551eed8c7db req-8239af3b-834f-42a0-812f-f9a060888b30 service nova] Creating event network-vif-deleted:62918383-a5c6-4c5d-975c-342094fde378 for instance d025bd78-43f4-4e76-b0d6-40e67808c28f on n-h1-764486-11 Jul 20 04:24:19.085118 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7c720809-cc14-444e-8b39-6551eed8c7db req-8239af3b-834f-42a0-812f-f9a060888b30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028434 Jul 20 04:24:19.085682 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1283/2408] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:19.090487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ce21c36-c60d-486f-9a2e-aa9407b1daad tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '.version_select at 0x7f838b09c280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.275065 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ce21c36-c60d-486f-9a2e-aa9407b1daad tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/c0435f9b-ac61-4470-b6be-83909d7519c0" status: 200 len: 184 microversion: 2.1 time: 0.188219 Jul 20 04:24:19.275643 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1284/2409] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:24:19 2022] GET /compute/v2.1/os-floating-ips/c0435f9b-ac61-4470-b6be-83909d7519c0 => generated 184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:19.280028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-193d7777-a30b-48b3-bb18-299b1ba0a06c tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b001b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.351170 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-193d7777-a30b-48b3-bb18-299b1ba0a06c tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1273080808" status: 200 len: 485 microversion: 2.1 time: 0.074465 Jul 20 04:24:19.351723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1285/2410] 10.222.0.49 () {58 vars in 1230 bytes} [Wed Jul 20 04:24:19 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1273080808 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:19.356324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838b09c8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.364872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.365313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.365866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:19.370991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.371428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.372166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.372805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.394632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.395075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.408446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:19.423332 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-24cc065a-0ff4-4e75-aeb2-94649a96285d tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.070132 Jul 20 04:24:19.423918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1286/2411] 10.222.0.49 () {60 vars in 1294 bytes} [Wed Jul 20 04:24:19 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:19.428331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:19.428837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:19.434677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.435120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.435874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.436334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.461889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:19.535755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03d76e9d-f976-48d5-9a3b-7968287534f9 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 204 len: 0 microversion: 2.1 time: 0.110408 Jul 20 04:24:19.536581 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1287/2412] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:19 2022] DELETE /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:19.542840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1596038522", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:19.592884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:19.795922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:19.796345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:19.796846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:19.797252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:19.798328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:19.807300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.807747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.808836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.809270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.826273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Getting quotas for project 5aed97a8de2a4a2faa4dc529e98342ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:19.831580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Getting quotas for user 90e97cf3519b4665aff6b4274c34a205 and project 5aed97a8de2a4a2faa4dc529e98342ae. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:19.844106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:19.846977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:19.890641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e592d41d-2878-4a94-9ff4-0ca848ebb793 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.352846 Jul 20 04:24:19.891526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1288/2413] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:19.896534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:19.897376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:19.905229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.905682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.906451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:19.907563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:19.933227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lazy-loading 'flavor' on Instance uuid 403f7f87-2388-4131-99fa-1905c114302c {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:20.008522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25ed56a4-01ff-4cdd-895e-cdf799abbf1d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "POST /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c/action" status: 200 len: 32 microversion: 2.1 time: 0.115770 Jul 20 04:24:20.009143 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1289/2414] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:19 2022] POST /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:24:20.014773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.243"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:20.143199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:20.149773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:20.150262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.151037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:20.151462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:20.359407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Acquired lock "refresh_cache-a8ae7451-caaf-4bff-aabf-f25af9b6e887" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:24:21.128292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:24:21.838180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Updating instance_info_cache with network_info: [{"id": "9f8ff807-2660-47cf-8c78-6176cafcc1bc", "address": "fa:16:3e:68:af:79", "network": {"id": "3be1a5c3-f459-4f21-b8e0-bb88f21e1335", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1739990385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ee50acf92da24b3185b6da3c165a7d71", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f8ff807-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:24:21.862775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Releasing lock "refresh_cache-a8ae7451-caaf-4bff-aabf-f25af9b6e887" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:24:21.864024 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d88f3d22-e720-43e7-83f3-c8ade8923c23 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action" status: 202 len: 0 microversion: 2.1 time: 1.853822 Jul 20 04:24:21.865074 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1290/2415] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:20 2022] POST /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887/action => generated 0 bytes in 1855 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:24:21.871441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9427a185-9748-4ea4-8b8d-5f74e785fc74 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f839a64c820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:21.986109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9427a185-9748-4ea4-8b8d-5f74e785fc74 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?server=a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 957 microversion: 2.1 time: 0.119155 Jul 20 04:24:21.986906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1291/2416] 10.222.0.49 () {58 vars in 1208 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/images?server=a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 957 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:21.998963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88349e0f-3a7e-4438-803e-af0896acbfbe tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838afaadc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.010040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88349e0f-3a7e-4438-803e-af0896acbfbe tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.010582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88349e0f-3a7e-4438-803e-af0896acbfbe tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.019682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88349e0f-3a7e-4438-803e-af0896acbfbe tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 200 len: 12 microversion: 2.26 time: 0.024952 Jul 20 04:24:22.020395 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1292/2417] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:24:21 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.025345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.026211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.034785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.035299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.036401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.041942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.142564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.150613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5cba81a5-a10b-42ef-b275-63b8b3bda997 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 200 len: 1427 microversion: 2.1 time: 0.128958 Jul 20 04:24:22.160975 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1293/2418] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.167171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.167906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.175546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.176255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.179731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.180261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.340615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.353242 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16f46fe9-e09b-4b8c-9a27-601b8b82e3f1 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1318 microversion: 2.1 time: 0.190881 Jul 20 04:24:22.353872 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1294/2419] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.359317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.360781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.369340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.370026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.370988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.372603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.476971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.485794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-454894c2-57ad-47a6-8251-7ee3fad3c4dd tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1277 microversion: 2.1 time: 0.130152 Jul 20 04:24:22.495095 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1295/2420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.499345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.499956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.506656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.507106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.507880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.508310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.696739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.715321 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-737ab9be-bce9-4685-a77a-3b03df20368b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.227260 Jul 20 04:24:22.719197 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1296/2421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:22.735077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8025d09a-2b41-4af4-bbaa-eec1802f0d8d req-329715ed-0a20-41df-8764-6ace798babf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}, {"name": "network-changed", "server_uuid": "4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c", "tag": "7df575d2-21ab-4c1a-a4cf-eccec78bdca5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:22.759404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8025d09a-2b41-4af4-bbaa-eec1802f0d8d req-329715ed-0a20-41df-8764-6ace798babf5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.760030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8025d09a-2b41-4af4-bbaa-eec1802f0d8d req-329715ed-0a20-41df-8764-6ace798babf5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.783052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8025d09a-2b41-4af4-bbaa-eec1802f0d8d req-329715ed-0a20-41df-8764-6ace798babf5 service nova] Creating event network-changed:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:24:22.783872 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8025d09a-2b41-4af4-bbaa-eec1802f0d8d req-329715ed-0a20-41df-8764-6ace798babf5 service nova] Creating event network-changed:7df575d2-21ab-4c1a-a4cf-eccec78bdca5 for instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c on n-h1-764486-11 Jul 20 04:24:22.791500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8025d09a-2b41-4af4-bbaa-eec1802f0d8d req-329715ed-0a20-41df-8764-6ace798babf5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068784 Jul 20 04:24:22.792316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1297/2422] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:22.797236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.801451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:22.802203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Searching by: {'deleted': False, 'project_id': '281a7cc370494bed803a3ae78ee441bf'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:24:22.807943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.808416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.809240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.809678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.843108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:24:22.886517 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e8c02d8-1317-40ef-842b-4b12d7628d2e tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.092881 Jul 20 04:24:22.887342 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1298/2423] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/servers => generated 340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:22.895213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b4a6e9f0-f189-454a-a863-3f991f0c4cd6 req-bbdc6dd7-911f-4ae2-8b91-6ad6a450027d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038f9610-51d2-4bb3-a7eb-984aabb0f873", "name": "network-vif-deleted", "tag": "2fe4e06a-4044-4e69-9ccc-67dd8ee0db7d"}, {"server_uuid": "abe55fb2-74aa-4293-b7f3-dcac8e43c130", "name": "network-vif-deleted", "tag": "086e22dc-2965-43d3-b13e-4814c5ec0c9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:22.910154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b4a6e9f0-f189-454a-a863-3f991f0c4cd6 req-bbdc6dd7-911f-4ae2-8b91-6ad6a450027d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.910751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b4a6e9f0-f189-454a-a863-3f991f0c4cd6 req-bbdc6dd7-911f-4ae2-8b91-6ad6a450027d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.915687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=1,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:22.926458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b4a6e9f0-f189-454a-a863-3f991f0c4cd6 req-bbdc6dd7-911f-4ae2-8b91-6ad6a450027d service nova] Creating event network-vif-deleted:2fe4e06a-4044-4e69-9ccc-67dd8ee0db7d for instance 038f9610-51d2-4bb3-a7eb-984aabb0f873 on n-h2-764486-11 Jul 20 04:24:22.927081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b4a6e9f0-f189-454a-a863-3f991f0c4cd6 req-bbdc6dd7-911f-4ae2-8b91-6ad6a450027d service nova] Creating event network-vif-deleted:086e22dc-2965-43d3-b13e-4814c5ec0c9c for instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 on n-h2-764486-11 Jul 20 04:24:22.934631 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b4a6e9f0-f189-454a-a863-3f991f0c4cd6 req-bbdc6dd7-911f-4ae2-8b91-6ad6a450027d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046042 Jul 20 04:24:22.935659 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1299/2424] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:22.942127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:22.942779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:22.949597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.950126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.950988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:22.952095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:22.974789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] HTTP exception thrown: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Request method failure captured: Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f HTTP/1.1 Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Mmd5RvP0Vpp6dDsswUumrCo2dFW42QKkne7-UP2IM4GsA92F3xOyKG8qshlS5TS-Q_oumdWP-lgLBsC_hfHUPrNZSbdxXplNQYfel7YKivnmAdkQ31ohe5CbH1kLHREFGStz_ST0-eFQZOMUGvVQNY4fs9BTYYzT6KM8Xq8R9e6oI Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:22.978134 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee50acf92da24b3185b6da3c165a7d71", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 99ee2b91f0c04c59a1b76708d2c85083 Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:22.980325 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd025bd78-43f4-4e76-b0d6-40e67808c28f'} Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:22.981212 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:22.982470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:22.983736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Returning 404 to user: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:22.983736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d07ba5e-7e46-46ea-8db7-e72956a7af30 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 404 len: 111 microversion: 2.1 time: 0.046194 Jul 20 04:24:22.986835 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1300/2425] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:22 2022] DELETE /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:22.991805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81fcab56-fcfc-4e18-ae72-36560a33d8a6 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838afff9d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.057955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81fcab56-fcfc-4e18-ae72-36560a33d8a6 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 485 microversion: 2.1 time: 0.069904 Jul 20 04:24:23.058694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1301/2426] 10.222.0.49 () {58 vars in 1316 bytes} [Wed Jul 20 04:24:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 485 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:23.067265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838b0de550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.076828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.077417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.078011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.089352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.089973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.091510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.092510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.120506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.121089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.131469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.132058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.161370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:23.182286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-418ce722-1dc1-47cc-aa4c-b5e71cbbf4ae tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-802457071" status: 201 len: 0 microversion: 2.26 time: 0.122429 Jul 20 04:24:23.183440 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1302/2427] 10.222.0.49 () {62 vars in 1376 bytes} [Wed Jul 20 04:24:23 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-802457071 => generated 0 bytes in 124 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:24:23.197186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.205217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:23.205982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Searching by: {'deleted': False, 'project_id': '281a7cc370494bed803a3ae78ee441bf'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:24:23.213509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.214209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.215164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.215747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.254920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:24:23.345052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:23.353545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.353993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.583811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6fd1b7b-1dc5-488c-bda8-5d3dd08f4565 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.398892 Jul 20 04:24:23.584893 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1303/2428] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:23.589570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.590316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: d025bd78-43f4-4e76-b0d6-40e67808c28f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.609001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.609642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.616511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.617397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.655852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] HTTP exception thrown: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Request method failure captured: Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f HTTP/1.1 Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Mmd5RvP0Vpp6dDsswUumrCo2dFW42QKkne7-UP2IM4GsA92F3xOyKG8qshlS5TS-Q_oumdWP-lgLBsC_hfHUPrNZSbdxXplNQYfel7YKivnmAdkQ31ohe5CbH1kLHREFGStz_ST0-eFQZOMUGvVQNY4fs9BTYYzT6KM8Xq8R9e6oI Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:23.662184 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee50acf92da24b3185b6da3c165a7d71", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 99ee2b91f0c04c59a1b76708d2c85083 Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:23.663663 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd025bd78-43f4-4e76-b0d6-40e67808c28f'} Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:23.664488 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. Jul 20 04:24:23.665790 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.668848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Returning 404 to user: Instance d025bd78-43f4-4e76-b0d6-40e67808c28f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:23.669770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8451f15-8460-4dc2-8373-abd7f1091490 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f" status: 404 len: 111 microversion: 2.1 time: 0.084118 Jul 20 04:24:23.670668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1304/2429] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/d025bd78-43f4-4e76-b0d6-40e67808c28f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:23.686337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfacf558-cb63-45c6-8494-8d0608a3a6cd tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b0443a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.782708 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfacf558-cb63-45c6-8494-8d0608a3a6cd tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 485 microversion: 2.1 time: 0.110396 Jul 20 04:24:23.789937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1305/2430] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 485 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:23.803442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.804275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 351b5153-5b84-41b4-abc2-695d81ce3ca6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.810679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.811437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.812563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.813000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.827426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] HTTP exception thrown: Instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 could not be found. Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Request method failure captured: Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 HTTP/1.1 Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KvHbwwn1rKj8hfAhjSa_M6shvbXBVkD-KIsnxmeyegtEHq_tIhzRXslgH8HVm0x4wrPE-12HYoW_OhOKRz2gb7gnoIwv0QoSLvywzOqK5VO4Zt9V0qIfj-LvfX0L2TkvSyGaihUmWn1AL-y8gUeAiUkrEuhilvDmS1-3QUaspfGpI Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b1aabe9c1e484ea8ae0ca07bfc093c88 Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:23.829074 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1aabe9c1e484ea8ae0ca07bfc093c88", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b1aabe9c1e484ea8ae0ca07bfc093c88 Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminTestJSON-1437699849-project Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cd40edc86fb24af79986645c1e99d944 Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminTestJSON-1437699849-project Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 could not be found. Jul 20 04:24:23.830536 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '351b5153-5b84-41b4-abc2-695d81ce3ca6'} Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 could not be found. Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:23.831406 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 could not be found. Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 could not be found. Jul 20 04:24:23.833349 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:23.835417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Returning 404 to user: Instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:23.835417 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb2398f5-2cbd-4666-9f69-eb5b01caff77 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6" status: 404 len: 111 microversion: 2.1 time: 0.038741 Jul 20 04:24:23.835417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1306/2431] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/351b5153-5b84-41b4-abc2-695d81ce3ca6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:23.839289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31d7f4d8-e19e-4e02-9f89-16cc849a962f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838afaa310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.847479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31d7f4d8-e19e-4e02-9f89-16cc849a962f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.848070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31d7f4d8-e19e-4e02-9f89-16cc849a962f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.857027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31d7f4d8-e19e-4e02-9f89-16cc849a962f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 200 len: 35 microversion: 2.26 time: 0.021787 Jul 20 04:24:23.857808 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1307/2432] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 35 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:23.863125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:23.863945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:23.869857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.870306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:23.871072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:23.871505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.103302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:24.111223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d904dcec-a86b-4d33-87f5-e2ca7dd6c4d3 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1318 microversion: 2.1 time: 0.252244 Jul 20 04:24:24.111804 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1308/2433] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:23 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:24.116622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:24.117224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:24.123237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.123682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.124468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:24.125061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:24.328181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:24.337132 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-264ad118-c5b7-41d0-9623-07752a1dfbaf tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1319 microversion: 2.1 time: 0.224160 Jul 20 04:24:24.337702 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1309/2434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:24 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:24.342260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9be315a8-161c-4dab-9453-65604bfcd438 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:24.350818 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9be315a8-161c-4dab-9453-65604bfcd438 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012151 Jul 20 04:24:24.351366 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1310/2435] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:24.355684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c910371-508e-43ec-ad0e-13b162392520 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '.version_select at 0x7f838affe700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.340672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c910371-508e-43ec-ad0e-13b162392520 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/c0435f9b-ac61-4470-b6be-83909d7519c0" status: 202 len: 0 microversion: 2.1 time: 0.988180 Jul 20 04:24:25.341273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1311/2436] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:24:24 2022] DELETE /compute/v2.1/os-floating-ips/c0435f9b-ac61-4470-b6be-83909d7519c0 => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:25.345771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.346408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.353070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.353551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.354310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.354748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.483814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:25.493916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb4add62-2fd7-4349-8a11-d5d4aa122a91 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.151469 Jul 20 04:24:25.494771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1312/2437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:25 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:25.500479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57a11459-dfa8-49d3-8e61-df9ab755ae1a tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838affedc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.613586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-57a11459-dfa8-49d3-8e61-df9ab755ae1a tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.117534 Jul 20 04:24:25.614264 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1313/2438] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:24:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:25.627630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.628209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.634981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.635427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.636195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.636660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.663543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:25.748265 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50e97282-0d4c-4086-b702-0d1584c95441 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "DELETE /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 204 len: 0 microversion: 2.1 time: 0.125101 Jul 20 04:24:25.752859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1314/2439] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:25 2022] DELETE /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:25.758914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838b00a8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.766386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.767400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.768181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.773888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.774533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.775283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.775714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.801216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.801664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.825029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:25.840699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-744ab0ac-69ee-4819-8836-5c1427d87fa9 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-802457071" status: 204 len: 0 microversion: 2.26 time: 0.086281 Jul 20 04:24:25.841246 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1315/2440] 10.222.0.49 () {60 vars in 1360 bytes} [Wed Jul 20 04:24:25 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-802457071 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:25.846156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:25.846566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:25.852889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.853339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.854112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.854547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.880073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:25.947955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:25.955143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f0dfda0-32e8-4d9b-bc0d-e82e7399acbc tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 204 len: 0 microversion: 2.1 time: 0.112740 Jul 20 04:24:25.955734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1316/2441] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:25 2022] DELETE /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:25.960609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d6f11289-0ee8-4f9a-afd9-604f2fd4e598 req-861ae722-0a42-41bd-91a1-83f2ae79f9fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:25.969566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d6f11289-0ee8-4f9a-afd9-604f2fd4e598 req-861ae722-0a42-41bd-91a1-83f2ae79f9fd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:25.970534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d6f11289-0ee8-4f9a-afd9-604f2fd4e598 req-861ae722-0a42-41bd-91a1-83f2ae79f9fd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:25.974371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:25.981902 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d6f11289-0ee8-4f9a-afd9-604f2fd4e598 req-861ae722-0a42-41bd-91a1-83f2ae79f9fd service nova] Creating event network-changed:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:24:25.987374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d6f11289-0ee8-4f9a-afd9-604f2fd4e598 req-861ae722-0a42-41bd-91a1-83f2ae79f9fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030376 Jul 20 04:24:25.987941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1317/2442] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:25.992737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8f50bc84-ec03-42f3-9dfb-c5226596be14 req-c6cc3f18-e33b-455a-afef-e95e52869879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351b5153-5b84-41b4-abc2-695d81ce3ca6", "name": "network-vif-deleted", "tag": "b8616c09-ac4b-49ce-ac29-a350360cd249"}, {"name": "network-changed", "server_uuid": "373acc79-5e68-441b-b349-959d024eb637", "tag": "f2a6ab87-6050-4b95-8b4a-05d07ec2666e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:26.002245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8f50bc84-ec03-42f3-9dfb-c5226596be14 req-c6cc3f18-e33b-455a-afef-e95e52869879 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.002700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8f50bc84-ec03-42f3-9dfb-c5226596be14 req-c6cc3f18-e33b-455a-afef-e95e52869879 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.016131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8f50bc84-ec03-42f3-9dfb-c5226596be14 req-c6cc3f18-e33b-455a-afef-e95e52869879 service nova] Creating event network-vif-deleted:b8616c09-ac4b-49ce-ac29-a350360cd249 for instance 351b5153-5b84-41b4-abc2-695d81ce3ca6 on n-h2-764486-11 Jul 20 04:24:26.016659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8f50bc84-ec03-42f3-9dfb-c5226596be14 req-c6cc3f18-e33b-455a-afef-e95e52869879 service nova] Creating event network-changed:f2a6ab87-6050-4b95-8b4a-05d07ec2666e for instance 373acc79-5e68-441b-b349-959d024eb637 on n-h2-764486-11 Jul 20 04:24:26.023073 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8f50bc84-ec03-42f3-9dfb-c5226596be14 req-c6cc3f18-e33b-455a-afef-e95e52869879 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033765 Jul 20 04:24:26.023846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1318/2443] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:26.029040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.029725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.036625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.037068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.037842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.038267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.169911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.177318 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c2ea678-6cf7-4192-84fe-1ba4e152884f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1318 microversion: 2.1 time: 0.152585 Jul 20 04:24:26.177884 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1319/2444] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.182363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.182844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.188681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.189127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.189878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.190568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.215833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:26.289883 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-312c1728-1d88-4c08-81f7-8ef12d5e0d3e tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 204 len: 0 microversion: 2.1 time: 0.110800 Jul 20 04:24:26.290467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1320/2445] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:26 2022] DELETE /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:26.295397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.296090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.301699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.302156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.302911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.303348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.430002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.437667 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36eb0e5b-355d-4e11-a43a-817559369bda tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1319 microversion: 2.1 time: 0.146090 Jul 20 04:24:26.438272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1321/2446] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.442948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-715c276f-2b0b-4763-9460-9af7e74133dc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b001b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.509354 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-715c276f-2b0b-4763-9460-9af7e74133dc tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.070062 Jul 20 04:24:26.509946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1322/2447] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.514273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f3f92af9-4438-4483-afd5-1668c8122457 req-843e2de5-2c22-4ae8-b9af-1c3c23bad2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c", "name": "network-vif-plugged", "status": "completed", "tag": "7df575d2-21ab-4c1a-a4cf-eccec78bdca5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:26.523341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f3f92af9-4438-4483-afd5-1668c8122457 req-843e2de5-2c22-4ae8-b9af-1c3c23bad2fe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.523791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f3f92af9-4438-4483-afd5-1668c8122457 req-843e2de5-2c22-4ae8-b9af-1c3c23bad2fe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.533835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f3f92af9-4438-4483-afd5-1668c8122457 req-843e2de5-2c22-4ae8-b9af-1c3c23bad2fe service nova] Creating event network-vif-plugged:7df575d2-21ab-4c1a-a4cf-eccec78bdca5 for instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c on n-h1-764486-11 Jul 20 04:24:26.538847 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f3f92af9-4438-4483-afd5-1668c8122457 req-843e2de5-2c22-4ae8-b9af-1c3c23bad2fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027825 Jul 20 04:24:26.539414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1323/2448] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:26.544265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.545009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.550854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.551303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.552059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.552544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.685965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.693706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6e433dd-d755-494e-b78c-c311a52f58f3 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1470 microversion: 2.1 time: 0.153237 Jul 20 04:24:26.694273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1324/2449] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.698750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a0d188a-455d-49e5-85c1-d470e4314310 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838afaa940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.705594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0d188a-455d-49e5-85c1-d470e4314310 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.706035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0d188a-455d-49e5-85c1-d470e4314310 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.714361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a0d188a-455d-49e5-85c1-d470e4314310 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 200 len: 12 microversion: 2.26 time: 0.019143 Jul 20 04:24:26.714908 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1325/2450] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 12 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.719020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.720100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.725527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.725969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.726702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.727130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.854736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:26.863196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-792f68a6-9c89-44b8-b197-231b07de24b8 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1714 microversion: 2.1 time: 0.147330 Jul 20 04:24:26.863979 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1326/2451] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1714 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:26.868278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:26.868905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:26.874724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.875165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:26.875917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:26.876339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.011250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:27.019777 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7211ceb4-355d-481c-a286-aabe46f8c810 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1526 microversion: 2.1 time: 0.155043 Jul 20 04:24:27.020344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1327/2452] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:26 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.024899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.025503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.031570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.032017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.033435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.033868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.185264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:27.195301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-828be90b-abd2-4036-8ac1-2053eac0ecc4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.173906 Jul 20 04:24:27.195888 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1328/2453] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.208088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4cf2c14-dfeb-4cec-b1ed-4d3044f284e9 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af28ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.256655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4cf2c14-dfeb-4cec-b1ed-4d3044f284e9 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.059632 Jul 20 04:24:27.257232 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1329/2454] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:27.262102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838b00ae50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.269681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.270131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.270603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.275874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.276320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.277099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.277531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.301662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.302353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.316305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:27.330987 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ddc9bbb2-3f8d-4c03-8ab6-0c58dfb1aaf8 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.072747 Jul 20 04:24:27.331597 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1330/2455] 10.222.0.49 () {60 vars in 1294 bytes} [Wed Jul 20 04:24:27 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:27.336207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.336782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.342734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.343182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.343945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.344399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.503612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:27.511032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9cfade2b-35f8-48d3-9cd6-41134bea58bd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1318 microversion: 2.1 time: 0.178485 Jul 20 04:24:27.511597 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1331/2456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.519094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ab27de1-3882-4123-9ef8-d704b2c4c77e tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af553a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.619057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ab27de1-3882-4123-9ef8-d704b2c4c77e tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A22%3A05Z" status: 200 len: 6334 microversion: 2.1 time: 0.106396 Jul 20 04:24:27.630447 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1332/2457] 10.222.0.49 () {58 vars in 1219 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-20T04%3A22%3A05Z => generated 6334 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.635585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af28f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.644345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.644818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.645292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.650961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.651438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.652165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.652647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.677799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.678332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.687188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.687701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.717336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:27.738337 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cae3ce4-5eb6-41e2-8f34-73a2edbb34cb tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-1674584693" status: 201 len: 0 microversion: 2.26 time: 0.106576 Jul 20 04:24:27.739566 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1333/2458] 10.222.0.49 () {62 vars in 1379 bytes} [Wed Jul 20 04:24:27 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-1674584693 => generated 0 bytes in 108 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:24:27.749010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:27.749849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:27.759512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.759961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.760765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:27.761286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:27.917205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:27.925342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b85fc29d-489d-4952-bc8e-11fbad3c83de tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1319 microversion: 2.1 time: 0.185330 Jul 20 04:24:27.925923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1334/2459] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:27.930350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c86ed14-b7fe-4bc4-86fd-a859a42e1c73 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af501f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.003420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c86ed14-b7fe-4bc4-86fd-a859a42e1c73 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1273080808" status: 200 len: 665 microversion: 2.1 time: 0.076435 Jul 20 04:24:28.003990 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1335/2460] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Jul 20 04:24:27 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1273080808 => generated 665 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:28.009121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.009723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.017593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.018045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.018802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.019233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.035825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:28.056121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.056587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.057031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lazy-loading 'fault' on Instance uuid 59f518e8-fd6b-4a1f-95e4-615888632c55 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:28.099576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd40edc86fb24af79986645c1e99d944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aabe9c1e484ea8ae0ca07bfc093c88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.106999 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50e65e76-4a0e-4c3d-b3b1-8f9ca233a244 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 200 len: 1304 microversion: 2.1 time: 0.101929 Jul 20 04:24:28.107558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1336/2461] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:28.112167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af50ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.119482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.119925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.120405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.125594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.126568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.127303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.127731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.150292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.150668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.159018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.159451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.181010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:28.203222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e44e2e82-29da-476d-9252-e288e665b1be tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-1878167925" status: 201 len: 0 microversion: 2.26 time: 0.094575 Jul 20 04:24:28.203887 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1337/2462] 10.222.0.49 () {62 vars in 1379 bytes} [Wed Jul 20 04:24:28 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-1878167925 => generated 0 bytes in 96 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:24:28.209365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.209980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.216844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.217489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.218426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.219015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.404370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.416198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acee4535-9c1a-4c1e-a633-5a39aefed217 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1714 microversion: 2.1 time: 0.209107 Jul 20 04:24:28.417055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1338/2463] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1714 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:28.435159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb87edec-9a18-4659-8ca3-e89d9bc70b30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af28550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.497395 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb87edec-9a18-4659-8ca3-e89d9bc70b30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1467 microversion: 2.1 time: 0.068153 Jul 20 04:24:28.501969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1339/2464] 10.222.0.49 () {58 vars in 1337 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1467 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:28.503854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.504499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.510842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.511375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.512214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.512867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.680195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.688107 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfbac6b2-897d-4f9b-ad37-a1021ec63142 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1526 microversion: 2.1 time: 0.188823 Jul 20 04:24:28.689368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1340/2465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:28.694617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-48562a5e-cbf4-4634-a931-c785dff2d4b0 req-c0e828ca-b4a1-4b5a-8567-b3a1b3cd5cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f518e8-fd6b-4a1f-95e4-615888632c55", "name": "network-vif-deleted", "tag": "b33ae5d0-d0b8-42b5-b735-0f07032c788a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:28.702569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48562a5e-cbf4-4634-a931-c785dff2d4b0 req-c0e828ca-b4a1-4b5a-8567-b3a1b3cd5cb3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.703084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48562a5e-cbf4-4634-a931-c785dff2d4b0 req-c0e828ca-b4a1-4b5a-8567-b3a1b3cd5cb3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.713879 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-48562a5e-cbf4-4634-a931-c785dff2d4b0 req-c0e828ca-b4a1-4b5a-8567-b3a1b3cd5cb3 service nova] Creating event network-vif-deleted:b33ae5d0-d0b8-42b5-b735-0f07032c788a for instance 59f518e8-fd6b-4a1f-95e4-615888632c55 on n-h2-764486-11 Jul 20 04:24:28.718716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-48562a5e-cbf4-4634-a931-c785dff2d4b0 req-c0e828ca-b4a1-4b5a-8567-b3a1b3cd5cb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028103 Jul 20 04:24:28.719334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1341/2466] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:28.724785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.725481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.731520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.731972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.733174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.733174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.925434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:28.933835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a076abb0-2861-4540-8659-35d814385e2d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.212761 Jul 20 04:24:28.934654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1342/2467] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:28 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:28.948045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af78700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:28.957653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.958188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.958735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:28.965625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.966155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.966994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.967494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:28.991698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:28.992156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.008677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:29.026789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66c61fb3-ab52-456d-ba74-dfe61526d6e6 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.084480 Jul 20 04:24:29.027987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1343/2468] 10.222.0.49 () {60 vars in 1294 bytes} [Wed Jul 20 04:24:28 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:29.033026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c91b874-def1-4240-996a-acd1b42e53f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af50ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.089641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c91b874-def1-4240-996a-acd1b42e53f8 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1467 microversion: 2.1 time: 0.060668 Jul 20 04:24:29.090687 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1344/2469] 10.222.0.49 () {58 vars in 1323 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1467 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.095844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.097694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.104853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.105550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.106456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.107079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.239906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:29.247361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a4885e4-dee0-4690-bbf7-dc14dd558807 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1318 microversion: 2.1 time: 0.155544 Jul 20 04:24:29.247921 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1345/2470] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.261092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b8a31759-8b84-479a-b9c7-2ac9742627f1 req-d66b4cca-9501-4e4b-bde8-bd1170cf7254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373acc79-5e68-441b-b349-959d024eb637", "name": "network-vif-plugged", "status": "completed", "tag": "f2a6ab87-6050-4b95-8b4a-05d07ec2666e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:29.269658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8a31759-8b84-479a-b9c7-2ac9742627f1 req-d66b4cca-9501-4e4b-bde8-bd1170cf7254 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.270094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8a31759-8b84-479a-b9c7-2ac9742627f1 req-d66b4cca-9501-4e4b-bde8-bd1170cf7254 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.281471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b8a31759-8b84-479a-b9c7-2ac9742627f1 req-d66b4cca-9501-4e4b-bde8-bd1170cf7254 service nova] Creating event network-vif-plugged:f2a6ab87-6050-4b95-8b4a-05d07ec2666e for instance 373acc79-5e68-441b-b349-959d024eb637 on n-h2-764486-11 Jul 20 04:24:29.286921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b8a31759-8b84-479a-b9c7-2ac9742627f1 req-d66b4cca-9501-4e4b-bde8-bd1170cf7254 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029327 Jul 20 04:24:29.287859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1346/2471] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:29.292974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.293668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.300712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.301164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.302495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.302495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.493040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:29.502014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d2e888f-5a28-42f6-bd95-f6a6b1e9c9a4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1319 microversion: 2.1 time: 0.212590 Jul 20 04:24:29.502634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1347/2472] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.507494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b44ce531-aae2-4d02-a390-967c6d0fd998 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af55430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.515825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b44ce531-aae2-4d02-a390-967c6d0fd998 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.516282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b44ce531-aae2-4d02-a390-967c6d0fd998 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.527515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b44ce531-aae2-4d02-a390-967c6d0fd998 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 200 len: 12 microversion: 2.26 time: 0.023757 Jul 20 04:24:29.528216 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1348/2473] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.536645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90b9175d-6892-4caa-95cb-6349d5f4bb57 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af288b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.624325 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90b9175d-6892-4caa-95cb-6349d5f4bb57 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.094816 Jul 20 04:24:29.636984 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1349/2474] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.636984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.636984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] [instance: 59f518e8-fd6b-4a1f-95e4-615888632c55] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.648263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.648897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.650872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.650872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.679052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] HTTP exception thrown: Instance 59f518e8-fd6b-4a1f-95e4-615888632c55 could not be found. Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Request method failure captured: Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 HTTP/1.1 Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14KvHbwwn1rKj8hfAhjSa_M6shvbXBVkD-KIsnxmeyegtEHq_tIhzRXslgH8HVm0x4wrPE-12HYoW_OhOKRz2gb7gnoIwv0QoSLvywzOqK5VO4Zt9V0qIfj-LvfX0L2TkvSyGaihUmWn1AL-y8gUeAiUkrEuhilvDmS1-3QUaspfGpI Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b1aabe9c1e484ea8ae0ca07bfc093c88 Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:29.681092 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1aabe9c1e484ea8ae0ca07bfc093c88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1aabe9c1e484ea8ae0ca07bfc093c88", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b1aabe9c1e484ea8ae0ca07bfc093c88 Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminTestJSON-1437699849 Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminTestJSON-1437699849-project Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cd40edc86fb24af79986645c1e99d944 Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminTestJSON-1437699849-project Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 59f518e8-fd6b-4a1f-95e4-615888632c55 could not be found. Jul 20 04:24:29.682475 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '59f518e8-fd6b-4a1f-95e4-615888632c55'} Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f518e8-fd6b-4a1f-95e4-615888632c55 could not be found. Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:29.683321 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f518e8-fd6b-4a1f-95e4-615888632c55 could not be found. Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f518e8-fd6b-4a1f-95e4-615888632c55 could not be found. Jul 20 04:24:29.684780 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:29.686566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] Returning 404 to user: Instance 59f518e8-fd6b-4a1f-95e4-615888632c55 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:29.687411 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c3c803a-dc78-4640-8436-7670b7ce2812 tempest-ServersAdminTestJSON-1437699849 tempest-ServersAdminTestJSON-1437699849-project] 10.222.0.49 "GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55" status: 404 len: 111 microversion: 2.1 time: 0.061307 Jul 20 04:24:29.691725 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1350/2475] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/59f518e8-fd6b-4a1f-95e4-615888632c55 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:29.697253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.697879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.708043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.709487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.710118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.711039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.810480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeef5d6890bd48fb9bf4a55f715e0f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a7cc370494bed803a3ae78ee441bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:29.820042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8016141-e414-4ed3-998e-c8384b0dfeff tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 200 len: 1647 microversion: 2.1 time: 0.130922 Jul 20 04:24:29.821089 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1351/2476] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 1647 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:29.827925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af553a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:29.837189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.837810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.838494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:29.846512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.847219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.848131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.848879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.883890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:29.885635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:29.903337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:29.921914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7727f1f5-c4ac-44b7-a838-38779836b065 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.099536 Jul 20 04:24:29.922749 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1352/2477] 10.222.0.49 () {60 vars in 1294 bytes} [Wed Jul 20 04:24:29 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:29.931589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0dd85a4-f5bf-46fb-b62c-8aa9a399847a tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838b09c280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.008012 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0dd85a4-f5bf-46fb-b62c-8aa9a399847a tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.080010 Jul 20 04:24:30.013027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1353/2478] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jul 20 04:24:29 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.013360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.013972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.021003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.021432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.022310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.022903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.059930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.060403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.060860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lazy-loading 'fault' on Instance uuid a8ae7451-caaf-4bff-aabf-f25af9b6e887 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:30.138895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99ee2b91f0c04c59a1b76708d2c85083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee50acf92da24b3185b6da3c165a7d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.155425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e8c94cb-eaec-40aa-8376-4a13989b6433 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 200 len: 1314 microversion: 2.1 time: 0.145663 Jul 20 04:24:30.160304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1354/2479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.165234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af558b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.174061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.174499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.174974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.183749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.184188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.187219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.189173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.267459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.267933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.288804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:30.295894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.296344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.351300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:30.381706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-706dccc9-ab67-44fe-8d8e-453ddc7b4fdf tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-1200195441" status: 201 len: 0 microversion: 2.26 time: 0.220209 Jul 20 04:24:30.382370 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1355/2480] 10.222.0.49 () {62 vars in 1379 bytes} [Wed Jul 20 04:24:30 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-1200195441 => generated 0 bytes in 222 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 04:24:30.393282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.393907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.400746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.401200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.401984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.402578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.573160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.582243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f5de062-08e0-4d8b-9993-6f439dad03d4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.198880 Jul 20 04:24:30.583053 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1356/2481] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.587645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1481fd37-622d-41ec-ac5b-ea0d10c76d25 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af55280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.643449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1481fd37-622d-41ec-ac5b-ea0d10c76d25 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/015a4084-97ff-4146-83ba-116b77f93e6a" status: 200 len: 784 microversion: 2.1 time: 0.059187 Jul 20 04:24:30.651978 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1357/2482] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/images/015a4084-97ff-4146-83ba-116b77f93e6a => generated 784 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:30.660118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.660897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.668199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.668793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.669798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.670374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.879626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:30.897574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdc28f25-6d0e-48dc-9285-b32892ec335a tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1509 microversion: 2.1 time: 0.250769 Jul 20 04:24:30.900055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1358/2483] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:30 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:30.912711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838af32700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:30.926602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.927307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.927949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:30.936905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.937398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.938652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.939219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.974284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.974766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:30.985737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:30.986469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.012682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:31.028727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71afaea9-c7d7-46ed-89cb-206b8650de21 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-204758894" status: 201 len: 0 microversion: 2.26 time: 0.126811 Jul 20 04:24:31.029457 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1359/2484] 10.222.0.49 () {62 vars in 1376 bytes} [Wed Jul 20 04:24:30 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags/tempest-tag-204758894 => generated 0 bytes in 128 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 20 04:24:31.038076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.038862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.045174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.045623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.046562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.046984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.199088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:31.207613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d7d9b91-e559-4c06-88f2-348bd94c36c4 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1469 microversion: 2.1 time: 0.174039 Jul 20 04:24:31.208452 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1360/2485] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.224214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ce42be7-438f-4e27-88b0-9f5856933d07 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af280d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.317186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ce42be7-438f-4e27-88b0-9f5856933d07 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.107884 Jul 20 04:24:31.318570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1361/2486] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.323889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bb9a3485-ff1c-429d-a126-ea74ce432f15 req-0f7afe48-6514-454a-b671-e66e89fee873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ae7451-caaf-4bff-aabf-f25af9b6e887", "name": "network-vif-deleted", "tag": "9f8ff807-2660-47cf-8c78-6176cafcc1bc"}, {"server_uuid": "d2b84961-2ce4-4e3c-b374-8f9ac0dd006b", "name": "network-vif-deleted", "tag": "d374ff46-7a4c-4194-a5ec-606575168f18"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:31.334652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bb9a3485-ff1c-429d-a126-ea74ce432f15 req-0f7afe48-6514-454a-b671-e66e89fee873 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.335242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bb9a3485-ff1c-429d-a126-ea74ce432f15 req-0f7afe48-6514-454a-b671-e66e89fee873 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.350793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bb9a3485-ff1c-429d-a126-ea74ce432f15 req-0f7afe48-6514-454a-b671-e66e89fee873 service nova] Creating event network-vif-deleted:9f8ff807-2660-47cf-8c78-6176cafcc1bc for instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 on n-h1-764486-11 Jul 20 04:24:31.351444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bb9a3485-ff1c-429d-a126-ea74ce432f15 req-0f7afe48-6514-454a-b671-e66e89fee873 service nova] Creating event network-vif-deleted:d374ff46-7a4c-4194-a5ec-606575168f18 for instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b on n-h1-764486-11 Jul 20 04:24:31.365177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bb9a3485-ff1c-429d-a126-ea74ce432f15 req-0f7afe48-6514-454a-b671-e66e89fee873 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045005 Jul 20 04:24:31.366145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1362/2487] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:31.376714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.376714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] [instance: d2b84961-2ce4-4e3c-b374-8f9ac0dd006b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.385554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.386125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.387672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.388416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.407810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] HTTP exception thrown: Instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b could not be found. Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Request method failure captured: Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b HTTP/1.1 Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14M1dD-VNFVtBYGAc15Dke72RjKO12LxaDq8kOvmWNFm8CNIqt-Oy-2x0ku9UwYNnq_vjhYFxIU-05O8KtZFilPBhAJUM2_cb9F-SV77DWXEGSE3nUSoTD-DwGy9gXf48CvKYXwlim1ArG44Pqt2S6cmfyokZtzHBhmJPOOyL8phmt0 Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 281a7cc370494bed803a3ae78ee441bf Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestManualDisk-1492197973 Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:31.409670 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/281a7cc370494bed803a3ae78ee441bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/281a7cc370494bed803a3ae78ee441bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/281a7cc370494bed803a3ae78ee441bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_281a7cc370494bed803a3ae78ee441bf", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestManualDisk-1492197973 Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 281a7cc370494bed803a3ae78ee441bf Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestManualDisk-1492197973 Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestManualDisk-1492197973-project Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: eeef5d6890bd48fb9bf4a55f715e0f2c Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestManualDisk-1492197973-project Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b could not be found. Jul 20 04:24:31.411140 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd2b84961-2ce4-4e3c-b374-8f9ac0dd006b'} Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b could not be found. Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:31.411963 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b could not be found. Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b could not be found. Jul 20 04:24:31.413410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.415180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Returning 404 to user: Instance d2b84961-2ce4-4e3c-b374-8f9ac0dd006b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:31.415521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9f706ee-5dc3-41dd-9af9-656e30b7acd6 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b" status: 404 len: 111 microversion: 2.1 time: 0.043268 Jul 20 04:24:31.416555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1363/2488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/d2b84961-2ce4-4e3c-b374-8f9ac0dd006b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:31.421513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.422253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.424368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:31.430423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.431008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.431881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.432468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.607647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:31.629495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7cf40e4-9669-4370-91bc-093c80b33008 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1509 microversion: 2.1 time: 0.211601 Jul 20 04:24:31.632798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1364/2489] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.638885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Action: 'update_all', calling method: .version_select at 0x7f838aec3940>, body: {"tags": ["tempest-tag-931109025", "tempest-tag-746653156"]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:31.650296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.651465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.657210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.673343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.673834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.674775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.675222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.712839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.714137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.741734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:31.768798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f14482fd-8771-4588-b565-dc748a609e32 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 200 len: 60 microversion: 2.26 time: 0.134532 Jul 20 04:24:31.770007 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1365/2490] 10.222.0.49 () {62 vars in 1311 bytes} [Wed Jul 20 04:24:31 2022] PUT /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 60 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:31.775669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:31.777668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] [instance: a8ae7451-caaf-4bff-aabf-f25af9b6e887] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.785446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.786139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.787020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.787548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.806156 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] HTTP exception thrown: Instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 could not be found. Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Request method failure captured: Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 HTTP/1.1 Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Mmd5RvP0Vpp6dDsswUumrCo2dFW42QKkne7-UP2IM4GsA92F3xOyKG8qshlS5TS-Q_oumdWP-lgLBsC_hfHUPrNZSbdxXplNQYfel7YKivnmAdkQ31ohe5CbH1kLHREFGStz_ST0-eFQZOMUGvVQNY4fs9BTYYzT6KM8Xq8R9e6oI Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:31.807998 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee50acf92da24b3185b6da3c165a7d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee50acf92da24b3185b6da3c165a7d71", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ee50acf92da24b3185b6da3c165a7d71 Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1173433547 Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 99ee2b91f0c04c59a1b76708d2c85083 Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1173433547-project Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 could not be found. Jul 20 04:24:31.809449 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a8ae7451-caaf-4bff-aabf-f25af9b6e887'} Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 could not be found. Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:31.810278 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 could not be found. Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 could not be found. Jul 20 04:24:31.811570 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:31.813006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] Returning 404 to user: Instance a8ae7451-caaf-4bff-aabf-f25af9b6e887 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:31.813006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40c15a79-68a5-4706-864f-036026807f27 tempest-FloatingIPsAssociationTestJSON-1173433547 tempest-FloatingIPsAssociationTestJSON-1173433547-project] 10.222.0.49 "GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887" status: 404 len: 111 microversion: 2.1 time: 0.037998 Jul 20 04:24:31.816912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1366/2491] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] GET /compute/v2.1/servers/a8ae7451-caaf-4bff-aabf-f25af9b6e887 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:31.822144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:31.822926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:31.830376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.832336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.833120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:31.833576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:31.858036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lazy-loading 'flavor' on Instance uuid 373acc79-5e68-441b-b349-959d024eb637 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:31.956082 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-014c7bd8-bf3e-4149-b231-2d080f429c6c tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637/action" status: 202 len: 0 microversion: 2.1 time: 0.137579 Jul 20 04:24:31.959903 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1367/2492] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:31 2022] POST /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:31.974201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6afa1cf5-aa1d-4c8c-8a69-71d3b0aac680 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af288b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.622259 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6afa1cf5-aa1d-4c8c-8a69-71d3b0aac680 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f" status: 204 len: 0 microversion: 2.1 time: 0.663343 Jul 20 04:24:32.623708 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1368/2493] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:31 2022] DELETE /compute/v2.1/images/0ddb9249-899b-4999-9537-ccf8de2c4f4f => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:32.632388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b0a4c06-05a1-43fb-a390-22721fdc6a67 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] Calling method '.version_select at 0x7f838af501f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.662202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b0a4c06-05a1-43fb-a390-22721fdc6a67 tempest-ServersTestManualDisk-1492197973 tempest-ServersTestManualDisk-1492197973-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722891880" status: 202 len: 0 microversion: 2.1 time: 0.037079 Jul 20 04:24:32.662793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1369/2494] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:24:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722891880 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:32.671769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:32.672730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.679104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.679674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.680329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.680821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.898681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:32.907056 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7652dc49-a189-44e4-8623-63750a8ed421 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.239162 Jul 20 04:24:32.908427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1370/2495] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:32 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:32.914638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:32.916148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:32.922766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.923833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:32.925418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:32.925959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.023194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:33.040596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e09a3f38-d9a0-4673-88d9-01fdb9367692 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "PUT /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1081 microversion: 2.1 time: 0.130827 Jul 20 04:24:33.041300 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1371/2496] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:24:32 2022] PUT /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1081 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.058555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b78ed65-2eb0-4184-9bb0-5f7e1ee5ec4c tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838aec33a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:33.069424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b78ed65-2eb0-4184-9bb0-5f7e1ee5ec4c tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.070107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b78ed65-2eb0-4184-9bb0-5f7e1ee5ec4c tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.085388 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b78ed65-2eb0-4184-9bb0-5f7e1ee5ec4c tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 200 len: 60 microversion: 2.26 time: 0.042248 Jul 20 04:24:33.086312 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1372/2497] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jul 20 04:24:33 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 60 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.099056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:33.101285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:33.111844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.112729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.113852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:33.114574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:33.222333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:33.343833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:33.475536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:33.484004 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-549c4451-1016-41c9-aa7a-11e5a1e0a0a6 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1460 microversion: 2.1 time: 0.396287 Jul 20 04:24:33.496094 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1373/2498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:33 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1460 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:33.502184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4ea3bf1-b603-4ddf-a749-ac872b8e3735 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af501f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.055530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4ea3bf1-b603-4ddf-a749-ac872b8e3735 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b" status: 204 len: 0 microversion: 2.1 time: 0.557919 Jul 20 04:24:34.059257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1374/2499] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:33 2022] DELETE /compute/v2.1/images/6197cd96-885c-40ce-9f40-b9469f04c22b => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:34.065017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.066269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.073845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.074368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.075284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.075786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.324050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:34.335246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbb853a3-71ad-4c72-97a3-307b2cd3ed2d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1507 microversion: 2.1 time: 0.274812 Jul 20 04:24:34.337880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1375/2500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:34.354229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '.version_select at 0x7f838afaaee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.377816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.378017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.378766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.394327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.394969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.395910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.396529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.433024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.433899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.453645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'flavor' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:34.475448 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c00834db-7ba1-46a6-ae50-dac3e2a6aa70 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags" status: 204 len: 0 microversion: 2.26 time: 0.133336 Jul 20 04:24:34.476944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1376/2501] 10.222.0.49 () {60 vars in 1294 bytes} [Wed Jul 20 04:24:34 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:34.482201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:34.483125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:34.491696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.493174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:34.494457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:34.495087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.430445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ca83aeb-2e9f-4996-8ab3-23d5040ae6fb tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1613 microversion: 2.1 time: 0.951648 Jul 20 04:24:35.432088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1377/2502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:34 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1613 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:35.451925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:35.451925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:35.466518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.466995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.467785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:35.470768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:35.716371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:35.724520 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fabd568-9e4b-4431-9af6-2f8bf1c6092d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.290511 Jul 20 04:24:35.725824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1378/2503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:35 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:35.744925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c72c0b23-54f2-4e9b-ac77-ca0292ca502d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838af789d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.475560 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c72c0b23-54f2-4e9b-ac77-ca0292ca502d tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639" status: 204 len: 0 microversion: 2.1 time: 0.748868 Jul 20 04:24:36.481077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1379/2504] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:35 2022] DELETE /compute/v2.1/images/1b8e13be-6130-477e-9d91-af51812da639 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:36.488787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.489764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:36.497011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.497672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.498665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.499253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.727745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:36.752585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7950dd94-f4dd-40cb-a70e-75ae814839d2 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1507 microversion: 2.1 time: 0.269677 Jul 20 04:24:36.755595 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1380/2505] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:36.762443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:36.762934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:36.775825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.776340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.777181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:36.777613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:36.825980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:36.989737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df297b02-8cd9-4054-a4e8-fa19e7258f8a tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 204 len: 0 microversion: 2.26 time: 0.232563 Jul 20 04:24:36.994133 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1381/2506] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:24:36 2022] DELETE /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:24:36.999972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6ddd0d7-48ad-40f9-a610-97d92a239767 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.002398 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:24:37.002398 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:24:37.005634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6ddd0d7-48ad-40f9-a610-97d92a239767 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.006589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6ddd0d7-48ad-40f9-a610-97d92a239767 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.007728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6ddd0d7-48ad-40f9-a610-97d92a239767 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.009501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6ddd0d7-48ad-40f9-a610-97d92a239767 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.043609 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6ddd0d7-48ad-40f9-a610-97d92a239767 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.048029 Jul 20 04:24:37.050179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1382/2507] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:24:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:37.051785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.052417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.059913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.060618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.072227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.072870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.111829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:37.249314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-317d0192-0c02-439a-b696-ba942b17f994 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 204 len: 0 microversion: 2.1 time: 0.202873 Jul 20 04:24:37.249920 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1383/2508] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:37 2022] DELETE /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:37.269161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:37.269886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.286683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.287248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.288141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.288709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.634000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:37.651684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d642c9d-a529-42ef-ab74-7948833ee790 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.399778 Jul 20 04:24:37.665207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1384/2509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:37 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:37.672293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:37.676549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:37.698222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.698685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.699487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:37.699931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:37.892114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:37.892551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:37.906865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:37.907100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:37.910482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:38.078389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.087482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.087960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.088827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.089452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.109457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=1,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:38.125796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e1073968-bb0c-4098-89d6-077b7d0903cd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "POST /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c/action" status: 202 len: 1113 microversion: 2.1 time: 0.458687 Jul 20 04:24:38.127878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1385/2510] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:37 2022] POST /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c/action => generated 1113 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:24:38.135791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.136594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.145574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.146044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.147085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.147557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.638829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.654646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.656176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:38.658504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2cf0d24f-6daa-409f-91b5-98948f0bcf2f tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1551 microversion: 2.26 time: 0.528525 Jul 20 04:24:38.658629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1386/2511] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1551 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:38.663371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-764486-11", "block_migration": true, "disk_over_commit": false}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:38.666274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.675397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.675847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.676689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.679904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.724464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Lazy-loading 'flavor' on Instance uuid 373acc79-5e68-441b-b349-959d024eb637 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:38.774835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 373acc79-5e68-441b-b349-959d024eb637 while it is in vm_state suspended Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Request method failure captured: Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637/action HTTP/1.1 Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 98 Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NTDg9H_4EPo5wor0A13EVlUlBMBOLz5lsif50mSSP6vBb-ZgbYSEl8eGl3siZqhni5Bt3TVvMPziEcSCzg4XV9LVUaNzK7l69yxZBoEaLdpL87ZNG6DJtIYo-0Hw3Z_QuBsDQNnECqC7sZu2Si8MS8yvHT2eHJkqGU_jl4im5Zs6Y Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4ca4f08c987849c2ac8b6941001a3750 Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationNegativeTest-2007935775 Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:24:38.780496 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ca4f08c987849c2ac8b6941001a3750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ca4f08c987849c2ac8b6941001a3750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ca4f08c987849c2ac8b6941001a3750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ca4f08c987849c2ac8b6941001a3750", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationNegativeTest-2007935775 Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4ca4f08c987849c2ac8b6941001a3750 Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2007935775 Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationNegativeTest-2007935775-project-admin Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4408871542a14fc5b61a69aa5ef823f0 Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationNegativeTest-2007935775-project-admin Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: {"os-migrateLive": {"host": "n-h1-764486-11", "block_migration": true, "disk_over_commit": false}} Jul 20 04:24:38.781999 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'os-migrateLive' instance 373acc79-5e68-441b-b349-959d024eb637 while it is in vm_state suspended Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '373acc79-5e68-441b-b349-959d024eb637', 'body': {'os-migrateLive': {'host': 'n-h1-764486-11', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:24:38.783368 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 373acc79-5e68-441b-b349-959d024eb637 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:38.785103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 373acc79-5e68-441b-b349-959d024eb637 while it is in vm_state suspended Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 373acc79-5e68-441b-b349-959d024eb637 while it is in vm_state suspended Jul 20 04:24:38.788584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:38.790783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 373acc79-5e68-441b-b349-959d024eb637 while it is in vm_state suspended {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:38.790783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c038d860-912f-41be-af02-f5a1a53c7512 tempest-LiveMigrationNegativeTest-2007935775 tempest-LiveMigrationNegativeTest-2007935775-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637/action" status: 409 len: 155 microversion: 2.1 time: 0.122760 Jul 20 04:24:38.790783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1387/2512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:24:38 2022] POST /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637/action => generated 155 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:38.797673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:38.798931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:38.814466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.814920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:38.815974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:38.821692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.529049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:39.543682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f0f8bba-c4b3-407f-8b90-f504645a0d88 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1473 microversion: 2.1 time: 0.748871 Jul 20 04:24:39.554289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1388/2513] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:38 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1473 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:39.561972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.562861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.572003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.572842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.573815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.574360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.931358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:39.944667 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-046076ad-b806-4311-9c4f-5b2678e47443 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.387714 Jul 20 04:24:39.946755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1389/2514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:39.957636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:39.958935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:39.974812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.975280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:39.980764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:39.981406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.433794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:40.448908 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c91ec686-17c1-4d2b-a38e-22e20407533c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.498633 Jul 20 04:24:40.461508 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1390/2515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:39 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:40.466747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:40.467525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:40.478100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.478959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.480072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.482419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.527016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:40.665976 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef0ba0ad-1a94-45b1-88e3-1e3fc2d3a9f1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "DELETE /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 204 len: 0 microversion: 2.1 time: 0.201865 Jul 20 04:24:40.670453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1391/2516] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:40 2022] DELETE /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:40.837627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ac7b14f-33bf-480f-84df-8ac0996efa09 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838aec3c10>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGjuboOfhvafzl7gjfH0qrYlBEvQGh9GDFTiR9dxHkYdb4V7czhKCQy0hD61BKvXXtEnSkkcvw+ePdomImo/30l4s3hFvCtJklDk9HPXTArV7T+NM1hc4n/IS4pZZsJog=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:40.842891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9ac7b14f-33bf-480f-84df-8ac0996efa09 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ac7b14f-33bf-480f-84df-8ac0996efa09 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 257 Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:40.851092 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGjuboOfhvafzl7gjfH0qrYlBEvQGh9GDFTiR9dxHkYdb4V7czhKCQy0hD61BKvXXtEnSkkcvw+ePdomImo/30l4s3hFvCtJklDk9HPXTArV7T+NM1hc4n/IS4pZZsJog=="}} Jul 20 04:24:40.852680 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGjuboOfhvafzl7gjfH0qrYlBEvQGh9GDFTiR9dxHkYdb4V7czhKCQy0hD61BKvXXtEnSkkcvw+ePdomImo/30l4s3hFvCtJklDk9HPXTArV7T+NM1hc4n/IS4pZZsJog=='}}} Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 20 04:24:40.853378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:24:40.854403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 04:24:40.855599 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:40.858375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ac7b14f-33bf-480f-84df-8ac0996efa09 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:40.860454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ac7b14f-33bf-480f-84df-8ac0996efa09 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.187894 Jul 20 04:24:40.862777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1392/2517] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:40.871804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:40.873324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:40.882717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.883172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:40.883953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:40.889126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.245671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.263746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.278995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.284911 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73da2d87-f4cb-4a80-8ef8-179197d8ed5b tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1509 microversion: 2.26 time: 0.418850 Jul 20 04:24:41.298398 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1393/2518] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:40 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1509 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:41.302076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.303380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.322963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.323422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.324277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.325019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.451975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.463648 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d41b069f-8ea4-49f6-bf37-9813438ad782 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1431 microversion: 2.1 time: 0.174805 Jul 20 04:24:41.464266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1394/2519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1431 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:41.475020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.475782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.482956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.483411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.484185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.484803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.706542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:41.735026 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ca0a827-4e20-4201-bc72-92cfa0d4311b tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1466 microversion: 2.1 time: 0.266947 Jul 20 04:24:41.737070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1395/2520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1466 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:41.759483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838aec7dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1176985752", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:41.804236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:41.812247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for user 158d511298b34427afbab040c635cc96 and project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:41.834995 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 2167 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1176985752", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:41.861226 n-d-764486-11 devstack@n-api.service[123724]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1176985752', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:41.863327 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be7ffce5-be62-4bac-a565-d19755467475 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.111490 Jul 20 04:24:41.865532 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1396/2521] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Jul 20 04:24:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:24:41.876483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:41.877174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:41.888695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.889133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:41.890354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:41.892447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.144263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.154319 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5c60d08-a0ce-479a-9031-8657ffd3a2ca tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.288038 Jul 20 04:24:42.154902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1397/2522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:41 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:42.183084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-945d76b0-bef2-405c-b465-791cc325de74 req-ee58ac31-64af-4424-ab60-b70b1d428136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9871b7-062e-4375-997b-75b3ad72a5ab", "name": "network-vif-deleted", "tag": "1815532c-79d2-4d88-b6d7-c1d6cc2194ab"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:42.205568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-945d76b0-bef2-405c-b465-791cc325de74 req-ee58ac31-64af-4424-ab60-b70b1d428136 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.213625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-945d76b0-bef2-405c-b465-791cc325de74 req-ee58ac31-64af-4424-ab60-b70b1d428136 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.236934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-945d76b0-bef2-405c-b465-791cc325de74 req-ee58ac31-64af-4424-ab60-b70b1d428136 service nova] Creating event network-vif-deleted:1815532c-79d2-4d88-b6d7-c1d6cc2194ab for instance 9f9871b7-062e-4375-997b-75b3ad72a5ab on n-h2-764486-11 Jul 20 04:24:42.263930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-945d76b0-bef2-405c-b465-791cc325de74 req-ee58ac31-64af-4424-ab60-b70b1d428136 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105765 Jul 20 04:24:42.272544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1398/2523] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:42.278410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.279108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.290707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:42.310014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.310502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.313270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.314462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.562545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.573175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b56452c-b3ae-4bf9-9ec6-41a4b6d727f3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.299198 Jul 20 04:24:42.575194 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1399/2524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:42.589995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba3fd885-284c-479a-9d0b-690a310dc825 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838aec79d0>, body: {"keypair": {"name": "tempest-keypair-2115208906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMN2NpmvAbM8sOZzxoqhLM/rSWzOoUQ7eZRBEJMDlYqNidJpmX34I6NV9kw3F/ZOS4J/Dn3gwlHrWnXJHIe4C2Xrcbmpg+S1FNfq6f9K8PgS0Ct7+D6y36x/NRfgS/+Kg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:42.604956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba3fd885-284c-479a-9d0b-690a310dc825 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:42.610420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba3fd885-284c-479a-9d0b-690a310dc825 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for user 158d511298b34427afbab040c635cc96 and project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:42.655632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba3fd885-284c-479a-9d0b-690a310dc825 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067215 Jul 20 04:24:42.657003 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1400/2525] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:42.663473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.665913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.675894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.676618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.677582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.678175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.717604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.719452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.722954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lazy-loading 'fault' on Instance uuid 9f9871b7-062e-4375-997b-75b3ad72a5ab {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:42.830390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.855476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.858936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f75da3e5aa0c426281a4bb7bd29d7a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becc2205ba484f5ca739ba6e23d7eab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:42.861341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e61758a-06b2-46f7-9417-dfbe1899e0a3 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 200 len: 1351 microversion: 2.26 time: 0.201701 Jul 20 04:24:42.862871 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1401/2526] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 1351 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:24:42.872834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:42.873668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:42.881249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.882437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.883597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.884257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.927768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:42.928624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:42.929300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lazy-loading 'fault' on Instance uuid 2cc269cd-7787-4fde-bf21-ca131b4e2738 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:24:43.051022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.065772 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85e23d85-64e8-48ea-9faa-f7d375a010ba tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 200 len: 1308 microversion: 2.1 time: 0.195497 Jul 20 04:24:43.071491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1402/2527] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:42 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.091343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838aec3820>, body: {"keypair": {"name": "tempest-keypair-2115208906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF4fHQUJXd/ppB/Cow/58GvTsARi5AIcCdinXDCjzs/OnFAUeEedLa5ISxRW/FxoDVTaeZAa8xs8BejvEHHPdHipIEgoYdQlHXquen88bOfIcJq0yoHghqKLVrkrdUUzw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:43.152298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:43.173951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for user 158d511298b34427afbab040c635cc96 and project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:43.272813 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] HTTP exception thrown: Key pair 'tempest-keypair-2115208906' already exists. Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 273 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "tempest-keypair-2115208906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF4fHQUJXd/ppB/Cow/58GvTsARi5AIcCdinXDCjzs/OnFAUeEedLa5ISxRW/FxoDVTaeZAa8xs8BejvEHHPdHipIEgoYdQlHXquen88bOfIcJq0yoHghqKLVrkrdUUzw=="}} Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: exception: Key pair 'tempest-keypair-2115208906' already exists. Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-2115208906', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF4fHQUJXd/ppB/Cow/58GvTsARi5AIcCdinXDCjzs/OnFAUeEedLa5ISxRW/FxoDVTaeZAa8xs8BejvEHHPdHipIEgoYdQlHXquen88bOfIcJq0yoHghqKLVrkrdUUzw=='}}} Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '158d511298b34427afbab040c635cc96-tempest-keypair-2115208906' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:24:43.284011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result.read() Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 04:24:43.288433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '158d511298b34427afbab040c635cc96-tempest-keypair-2115208906' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 4, 24, 43, 253319), 'updated_at': None, 'name': 'tempest-keypair-2115208906', 'user_id': '158d511298b34427afbab040c635cc96', 'fingerprint': '4f:80:3f:ee:28:65:86:c3:00:52:a9:43:2e:ec:16:48', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF4fHQUJXd/ppB/Cow/58GvTsARi5AIcCdinXDCjzs/OnFAUeEedLa5ISxRW/FxoDVTaeZAa8xs8BejvEHHPdHipIEgoYdQlHXquen88bOfIcJq0yoHghqKLVrkrdUUzw==', 'type': 'ssh'}] Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair.create() Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._create() Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-2115208906' already exists. Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 20 04:24:43.292634 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-2115208906' already exists. Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-2115208906' already exists. Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:43.299103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 409 to user: Key pair 'tempest-keypair-2115208906' already exists. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:43.301451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdd7bbd7-2f01-4fbf-8e71-47f4eed6ffda tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.228217 Jul 20 04:24:43.304710 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1403/2528] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:43 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:24:43.320072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:43.324051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:43.345525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.346305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.347300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.350101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.509723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.512686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:43.536575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8629a5ed-d9f7-4349-98c2-d746e56176e1 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 200 len: 1295 microversion: 2.1 time: 0.230482 Jul 20 04:24:43.546590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1404/2529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:43 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.565180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:43.566841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:43.588068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.588578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.590596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:43.591038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:43.952207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:43.961646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b4a53d2-2ec5-465e-b73f-9eece9b5de79 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.413731 Jul 20 04:24:43.962200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1405/2530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:43 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:43.975580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-612c676a-e022-4d73-9edb-a43486a348e9 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Calling method '.version_select at 0x7f838ae90940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.005813 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-612c676a-e022-4d73-9edb-a43486a348e9 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115208906" status: 202 len: 0 microversion: 2.1 time: 0.041036 Jul 20 04:24:44.007794 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1406/2531] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115208906 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:24:44.020647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.022347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.040613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.041510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.043209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.044895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.231053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:44.239892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d13156bc-09e6-425f-be27-15f66b921f80 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.230817 Jul 20 04:24:44.245394 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1407/2532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:44.250613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.251453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] [instance: 9f9871b7-062e-4375-997b-75b3ad72a5ab] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.258776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.259474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.260426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.261017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.280556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] HTTP exception thrown: Instance 9f9871b7-062e-4375-997b-75b3ad72a5ab could not be found. Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Request method failure captured: Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab HTTP/1.1 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NRTxgy-nvLl8fHUfJRHpU5FIT8tj-4-bV-ffON4yi9OgQXJikC64jTVS_c4iCDET4Ty0OER1eO_u5DHrLbwwTj6GGB6nNUZOUDs0CJsETZvoaK6eo9GoYRfKzJ5c8Ulge-AWZydt3-qOtLw-WXU3bJRx_pkcv4XRQp8tlwPBaMDes Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.26 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: becc2205ba484f5ca739ba6e23d7eab2 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerTagsTestJSON-695856221 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/becc2205ba484f5ca739ba6e23d7eab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/becc2205ba484f5ca739ba6e23d7eab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/becc2205ba484f5ca739ba6e23d7eab2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_becc2205ba484f5ca739ba6e23d7eab2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerTagsTestJSON-695856221 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: becc2205ba484f5ca739ba6e23d7eab2 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerTagsTestJSON-695856221 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerTagsTestJSON-695856221-project Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f75da3e5aa0c426281a4bb7bd29d7a66 Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerTagsTestJSON-695856221-project Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9f9871b7-062e-4375-997b-75b3ad72a5ab could not be found. Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9f9871b7-062e-4375-997b-75b3ad72a5ab'} Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9871b7-062e-4375-997b-75b3ad72a5ab could not be found. Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9871b7-062e-4375-997b-75b3ad72a5ab could not be found. Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.283710 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9871b7-062e-4375-997b-75b3ad72a5ab could not be found. Jul 20 04:24:44.288322 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.289854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] Returning 404 to user: Instance 9f9871b7-062e-4375-997b-75b3ad72a5ab could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.291038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a842a7d0-e781-4426-a854-4467142dbe27 tempest-ServerTagsTestJSON-695856221 tempest-ServerTagsTestJSON-695856221-project] 10.222.0.49 "GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab" status: 404 len: 111 microversion: 2.26 time: 0.044456 Jul 20 04:24:44.292215 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1408/2533] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/9f9871b7-062e-4375-997b-75b3ad72a5ab => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:44.310987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0285e2c3-82d3-4e98-8836-fdca25d71e17 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838af19b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMigEGtgeylz3YCOFCGLHZLhtVs1AlQBHTu453497a4U2PXrhALkeGhgOeK5knTq1+ZpgMBP2z/Q/juwn7AwpQ5/lcuW2+KZtSnI8I9hoq8QgPTOOnPeI/dNpsT5hiCh/A=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0285e2c3-82d3-4e98-8836-fdca25d71e17 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 247 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMigEGtgeylz3YCOFCGLHZLhtVs1AlQBHTu453497a4U2PXrhALkeGhgOeK5knTq1+ZpgMBP2z/Q/juwn7AwpQ5/lcuW2+KZtSnI8I9hoq8QgPTOOnPeI/dNpsT5hiCh/A=="}} Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMigEGtgeylz3YCOFCGLHZLhtVs1AlQBHTu453497a4U2PXrhALkeGhgOeK5knTq1+ZpgMBP2z/Q/juwn7AwpQ5/lcuW2+KZtSnI8I9hoq8QgPTOOnPeI/dNpsT5hiCh/A=='}}} Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '' Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:24:44.320235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:24:44.324384 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.328552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0285e2c3-82d3-4e98-8836-fdca25d71e17 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.329778 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0285e2c3-82d3-4e98-8836-fdca25d71e17 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.036353 Jul 20 04:24:44.332304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1409/2534] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:44.344072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.345311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: 2cc269cd-7787-4fde-bf21-ca131b4e2738] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.361766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.362222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.363006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.363447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.401438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] HTTP exception thrown: Instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 could not be found. Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Request method failure captured: Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 HTTP/1.1 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14LsyRoNrDz-wkmhzYFFOsUu6uXDzVRTEhOCWTnZAXGD6fruBPAp7AZl_kjXG8ufcAMPsR6Ps7gBFYbQ0BfM5YHzOu6za6kIjYDYKPpNWyxgRbgAKILoxTqUEN3JYR3ZH9E3v3YYcCvezVQfeBwAkVUUUBAAbLhAe5KL2juFuZECvBM Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 833230d24aaa48f88a335662fa7ac92d Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListImageFiltersTestJSON-1492367117 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/833230d24aaa48f88a335662fa7ac92d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/833230d24aaa48f88a335662fa7ac92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/833230d24aaa48f88a335662fa7ac92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_833230d24aaa48f88a335662fa7ac92d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListImageFiltersTestJSON-1492367117 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 833230d24aaa48f88a335662fa7ac92d Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1492367117 Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListImageFiltersTestJSON-1492367117-project Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6502ad71bb4b4be39aa2d743d55e2a0f Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListImageFiltersTestJSON-1492367117-project Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 could not be found. Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2cc269cd-7787-4fde-bf21-ca131b4e2738'} Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 could not be found. Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 could not be found. Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.404716 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 could not be found. Jul 20 04:24:44.409726 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.413209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Returning 404 to user: Instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.414853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a002f51-6622-43f8-a335-23eebd2c0e30 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738" status: 404 len: 111 microversion: 2.1 time: 0.080658 Jul 20 04:24:44.415945 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1410/2535] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/2cc269cd-7787-4fde-bf21-ca131b4e2738 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:44.422752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838afaaee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-709529032", "public_key": " "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.451579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:44.493919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for user 158d511298b34427afbab040c635cc96 and project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:44.520430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 94 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-709529032", "public_key": " "}} Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-709529032', 'public_key': ' '}}} Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.522282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.526381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55771c0d-c8c8-46a2-ba6c-ce0bfc11c718 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.106837 Jul 20 04:24:44.532269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1411/2536] 10.222.0.49 () {60 vars in 1157 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:24:44.538039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7b5fea9b-e781-4c7d-8dcf-6f2b02269b98 req-8baba931-724e-4817-877d-9fd91ba0dbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc269cd-7787-4fde-bf21-ca131b4e2738", "name": "network-vif-deleted", "tag": "5c87874c-288b-4b97-8bd5-eb44cc50a7d7"}, {"server_uuid": "373acc79-5e68-441b-b349-959d024eb637", "name": "network-vif-deleted", "tag": "f2a6ab87-6050-4b95-8b4a-05d07ec2666e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.565307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7b5fea9b-e781-4c7d-8dcf-6f2b02269b98 req-8baba931-724e-4817-877d-9fd91ba0dbcb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.572110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7b5fea9b-e781-4c7d-8dcf-6f2b02269b98 req-8baba931-724e-4817-877d-9fd91ba0dbcb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.584756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7b5fea9b-e781-4c7d-8dcf-6f2b02269b98 req-8baba931-724e-4817-877d-9fd91ba0dbcb service nova] Creating event network-vif-deleted:5c87874c-288b-4b97-8bd5-eb44cc50a7d7 for instance 2cc269cd-7787-4fde-bf21-ca131b4e2738 on n-h2-764486-11 Jul 20 04:24:44.585985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7b5fea9b-e781-4c7d-8dcf-6f2b02269b98 req-8baba931-724e-4817-877d-9fd91ba0dbcb service nova] Creating event network-vif-deleted:f2a6ab87-6050-4b95-8b4a-05d07ec2666e for instance 373acc79-5e68-441b-b349-959d024eb637 on n-h2-764486-11 Jul 20 04:24:44.593858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7b5fea9b-e781-4c7d-8dcf-6f2b02269b98 req-8baba931-724e-4817-877d-9fd91ba0dbcb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059308 Jul 20 04:24:44.596030 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1412/2537] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:44.605928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.607447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.622433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.623966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.625631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.626488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.659165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:44.815614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-180e9a5d-b12d-49c7-b46a-07c701aca4ca tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 204 len: 0 microversion: 2.1 time: 0.217640 Jul 20 04:24:44.816759 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1413/2538] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:44 2022] DELETE /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:44.827928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c9af819-d15e-446b-a867-6665b591e1ce tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838aede8b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMNTcNLRZ83k8S42tnKMMGYBq8p/dTdfhb9SoVJYPjePR/CYuaIQfRGv5DKTCuR6RCIB+6n1yegeClFeL5cosd+444CpZ3HLXM3Yu53SvBd6aWVCR/abVhKtgsX5hW+lg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c9af819-d15e-446b-a867-6665b591e1ce tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 507 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMNTcNLRZ83k8S42tnKMMGYBq8p/dTdfhb9SoVJYPjePR/CYuaIQfRGv5DKTCuR6RCIB+6n1yegeClFeL5cosd+444CpZ3HLXM3Yu53SvBd6aWVCR/abVhKtgsX5hW+lg=="}} Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMNTcNLRZ83k8S42tnKMMGYBq8p/dTdfhb9SoVJYPjePR/CYuaIQfRGv5DKTCuR6RCIB+6n1yegeClFeL5cosd+444CpZ3HLXM3Yu53SvBd6aWVCR/abVhKtgsX5hW+lg=='}}} Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 20 04:24:44.834915 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.837644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c9af819-d15e-446b-a867-6665b591e1ce tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.843466 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c9af819-d15e-446b-a867-6665b591e1ce tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.016605 Jul 20 04:24:44.843466 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1414/2539] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:44 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:24:44.843906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.846440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: 373acc79-5e68-441b-b349-959d024eb637] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.859225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.859708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.870962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.873019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.893222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] HTTP exception thrown: Instance 373acc79-5e68-441b-b349-959d024eb637 could not be found. Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Request method failure captured: Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 HTTP/1.1 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS-d_OACYhHcMgo5Ex0meKU3jBGYqpkWM49f2RLKpD8hB5UQwkdsXQft5rLom3bUrzyA5x5tNDAdXq4gyJYmszIFW01U493p6d90n5lclbrMD_zJ1UtKuxAFcQs-6cEQBLjSZQTayjtCnWtAprKOkhQjdP6NH7Iu_18aZOg9N-b50 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5aed97a8de2a4a2faa4dc529e98342ae Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationNegativeTest-1277426273 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aed97a8de2a4a2faa4dc529e98342ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aed97a8de2a4a2faa4dc529e98342ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aed97a8de2a4a2faa4dc529e98342ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aed97a8de2a4a2faa4dc529e98342ae", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationNegativeTest-1277426273 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5aed97a8de2a4a2faa4dc529e98342ae Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1277426273 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationNegativeTest-1277426273-project Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 90e97cf3519b4665aff6b4274c34a205 Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationNegativeTest-1277426273-project Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 373acc79-5e68-441b-b349-959d024eb637 could not be found. Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '373acc79-5e68-441b-b349-959d024eb637'} Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373acc79-5e68-441b-b349-959d024eb637 could not be found. Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373acc79-5e68-441b-b349-959d024eb637 could not be found. Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:44.895372 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373acc79-5e68-441b-b349-959d024eb637 could not be found. Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Returning 404 to user: Instance 373acc79-5e68-441b-b349-959d024eb637 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:44.899365 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f35a1c71-33c7-486c-9b1d-5d9dff540164 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637" status: 404 len: 111 microversion: 2.1 time: 0.056877 Jul 20 04:24:44.900726 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1415/2540] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/373acc79-5e68-441b-b349-959d024eb637 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:44.905987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:44.906473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:44.913835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.914384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:44.915247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:44.915952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.300921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:45.315123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-64187755-3540-4384-a0a6-729954673576 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1472 microversion: 2.1 time: 0.412876 Jul 20 04:24:45.315730 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1416/2541] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:44 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:45.329897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Action: 'create', calling method: .version_select at 0x7f838ae40790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1016857558", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:45.363545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:45.378184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Getting quotas for user 158d511298b34427afbab040c635cc96 and project e7c13a477e06497fa7f4006bcac7fc2c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:45.407279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 118 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1016857558", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1016857558', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 04:24:45.414514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 04:24:45.418199 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:45.422053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:45.424238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-787a371c-e1fe-4d1b-bb8e-9ef9499f1001 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.102508 Jul 20 04:24:45.431134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1417/2542] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:24:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:24:45.439435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.446123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.453973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.454749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.455883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.456583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.514551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:24:45.649264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5b1ff11-7ea3-49b2-8c77-a182f07099a9 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 204 len: 0 microversion: 2.1 time: 0.214614 Jul 20 04:24:45.650283 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1418/2543] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:24:45 2022] DELETE /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:45.659921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:45.661152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:45.694353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.695062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:45.695771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:45.696281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.099377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.108594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d92afe5-d7a7-4766-b2d3-10928b5140bc tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.455709 Jul 20 04:24:46.109349 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1419/2544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:45 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.121372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.122059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.138040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.143448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.144665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.147788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.650168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:46.660801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27b300f4-f6eb-41b7-8802-048cbf74fd25 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.548152 Jul 20 04:24:46.663719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1420/2545] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:46.683208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff8b1563-c452-44d7-8ef7-4be9efd3f837 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Calling method '.version_select at 0x7f838ae40af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.708617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ff8b1563-c452-44d7-8ef7-4be9efd3f837 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1095162523 not found for user 158d511298b34427afbab040c635cc96 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff8b1563-c452-44d7-8ef7-4be9efd3f837 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Request method failure captured: Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1095162523 HTTP/1.1 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OHuvWwSdYM2DELZYyRNhPFRV7UZnR5IsCWMPwr4BX7e692J6u0p7TlLZXKi0l1Jb-Y8VylBMxgA_sfMvvL3xKXLFIPaGjL7U6nswtbIz1TyOXY66h0JOQ7YE7V1ybJ8Ol79iVw5NXDC9-RJ0N6-QCop4COLatMpgDtc0IQ3M_utR4 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e7c13a477e06497fa7f4006bcac7fc2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e7c13a477e06497fa7f4006bcac7fc2c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e7c13a477e06497fa7f4006bcac7fc2c Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1256602518 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 158d511298b34427afbab040c635cc96 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1256602518-project Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: exception: Keypair tempest-keypair-non-existent-1095162523 not found for user 158d511298b34427afbab040c635cc96 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'tempest-keypair-non-existent-1095162523'} Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1095162523 not found for user 158d511298b34427afbab040c635cc96 Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.711076 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1095162523 not found for user 158d511298b34427afbab040c635cc96 Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1095162523 not found for user 158d511298b34427afbab040c635cc96 Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff8b1563-c452-44d7-8ef7-4be9efd3f837 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1095162523 not found for user 158d511298b34427afbab040c635cc96 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff8b1563-c452-44d7-8ef7-4be9efd3f837 tempest-KeyPairsNegativeTestJSON-1256602518 tempest-KeyPairsNegativeTestJSON-1256602518-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1095162523" status: 404 len: 145 microversion: 2.1 time: 0.043120 Jul 20 04:24:46.714590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1421/2546] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:24:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1095162523 => generated 145 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:46.728430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:46.729323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:46.762540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.763406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:46.764724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:46.765628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.014608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:47.448855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.463991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3eba3116-dc5b-484a-ae49-a9b00fd8970a tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1473 microversion: 2.1 time: 0.749207 Jul 20 04:24:47.475754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1422/2547] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:46 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1473 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:47.481466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.482676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.489630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.490320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.491585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.492175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.812841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:47.835829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ada7900e-26f6-478e-88c2-8499b3e18808 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1472 microversion: 2.1 time: 0.357075 Jul 20 04:24:47.837892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1423/2548] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:47.852324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:47.854442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:47.859924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:47.871529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.872267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:47.873576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:47.874601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.200250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.216432 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f403a58-1358-4ba5-b88e-44def6132e49 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.374386 Jul 20 04:24:48.217665 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1424/2549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:47 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.228802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.229988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.245286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.252022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.253268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.254334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.598136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.607307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-badb7fc6-a635-4e7e-ae20-75e29e23f57a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.388146 Jul 20 04:24:48.607891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1425/2550] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.620563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.624338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.640575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.651262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.653587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.655199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.935956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:48.939415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:24:48.947538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb246dc7-d90c-480a-ab31-bb7f48918009 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1473 microversion: 2.1 time: 0.332958 Jul 20 04:24:48.949565 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1426/2551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:48.958800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:48.964647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:48.978253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.982289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:48.984878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:48.986355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.285343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.299655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f981db5-962e-4a70-8245-4052dc612ea5 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1472 microversion: 2.1 time: 0.347110 Jul 20 04:24:49.318110 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1427/2552] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:48 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:49.324803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.336571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.348008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.360564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.362096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.362684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.806734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:49.818000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93c9de86-8e02-47e8-8955-23d9faa4b082 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.497960 Jul 20 04:24:49.821733 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1428/2553] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:49.835746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:49.837003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:49.848606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.849570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:49.851026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:49.851636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.208452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.221143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fcd718c2-6958-4e40-9d93-29dd7d53637e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1505 microversion: 2.1 time: 0.397920 Jul 20 04:24:50.222452 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1429/2554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:49 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:50.458048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c01b3f35-a58e-4672-b6c1-56fd4ec323f7 tempest-AZV2TestJSON-604380005 tempest-AZV2TestJSON-604380005-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.460730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c01b3f35-a58e-4672-b6c1-56fd4ec323f7 tempest-AZV2TestJSON-604380005 tempest-AZV2TestJSON-604380005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.461390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c01b3f35-a58e-4672-b6c1-56fd4ec323f7 tempest-AZV2TestJSON-604380005 tempest-AZV2TestJSON-604380005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.463524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c01b3f35-a58e-4672-b6c1-56fd4ec323f7 tempest-AZV2TestJSON-604380005 tempest-AZV2TestJSON-604380005-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.463524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c01b3f35-a58e-4672-b6c1-56fd4ec323f7 tempest-AZV2TestJSON-604380005 tempest-AZV2TestJSON-604380005-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.542015 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c01b3f35-a58e-4672-b6c1-56fd4ec323f7 tempest-AZV2TestJSON-604380005 tempest-AZV2TestJSON-604380005-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.317711 Jul 20 04:24:50.548906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1430/2555] 10.222.0.49 () {58 vars in 1163 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:24:50.569456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.570353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.589935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.590781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.595855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.596540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.795784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e97cf3519b4665aff6b4274c34a205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aed97a8de2a4a2faa4dc529e98342ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:50.810182 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1f4f5d1-2bbe-4264-8588-77ef58e0a540 tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 200 len: 1431 microversion: 2.1 time: 0.256642 Jul 20 04:24:50.823762 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1431/2556] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 1431 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:50.838070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:50.838695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:50.857396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.858771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:50.859746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:50.860196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.093383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6502ad71bb4b4be39aa2d743d55e2a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833230d24aaa48f88a335662fa7ac92d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.121242 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e55ba249-11ce-477f-ae7b-79be30905715 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 200 len: 1430 microversion: 2.1 time: 0.295772 Jul 20 04:24:51.122879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1432/2557] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:50 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 1430 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:51.128243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.128909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:51.159719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.160171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.165368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.166177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.749340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:51.762185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8df67000-09d1-455e-af0c-192994583d3d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1518 microversion: 2.1 time: 0.638079 Jul 20 04:24:51.764309 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1433/2558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1518 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:51.774557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:51.775868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:51.793039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.795710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:51.797730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:51.808140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.110840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:52.123010 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a19d15e5-6cd4-483f-b7de-ad31fa0c365c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1485 microversion: 2.1 time: 0.357193 Jul 20 04:24:52.124288 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1434/2559] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:51 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1485 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:52.139623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-edf0ae1c-e136-4dc6-949c-6689637c5e66 req-14a25f29-722d-4f9f-b623-bc7f3a8209d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4720567-7f18-444e-a14d-b6eab7499465", "name": "network-vif-deleted", "tag": "51b49117-3255-4b11-ae1c-b490dd27fd94"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:52.166062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-edf0ae1c-e136-4dc6-949c-6689637c5e66 req-14a25f29-722d-4f9f-b623-bc7f3a8209d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.166482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-edf0ae1c-e136-4dc6-949c-6689637c5e66 req-14a25f29-722d-4f9f-b623-bc7f3a8209d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.193601 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-edf0ae1c-e136-4dc6-949c-6689637c5e66 req-14a25f29-722d-4f9f-b623-bc7f3a8209d3 service nova] Creating event network-vif-deleted:51b49117-3255-4b11-ae1c-b490dd27fd94 for instance c4720567-7f18-444e-a14d-b6eab7499465 on n-h1-764486-11 Jul 20 04:24:52.211775 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-edf0ae1c-e136-4dc6-949c-6689637c5e66 req-14a25f29-722d-4f9f-b623-bc7f3a8209d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083264 Jul 20 04:24:52.212721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1435/2560] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:52.222809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.227404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] [instance: c4720567-7f18-444e-a14d-b6eab7499465] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.247926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.249049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.250031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.250769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.277939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] HTTP exception thrown: Instance c4720567-7f18-444e-a14d-b6eab7499465 could not be found. Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Request method failure captured: Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 HTTP/1.1 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NS-d_OACYhHcMgo5Ex0meKU3jBGYqpkWM49f2RLKpD8hB5UQwkdsXQft5rLom3bUrzyA5x5tNDAdXq4gyJYmszIFW01U493p6d90n5lclbrMD_zJ1UtKuxAFcQs-6cEQBLjSZQTayjtCnWtAprKOkhQjdP6NH7Iu_18aZOg9N-b50 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5aed97a8de2a4a2faa4dc529e98342ae Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-LiveMigrationNegativeTest-1277426273 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aed97a8de2a4a2faa4dc529e98342ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aed97a8de2a4a2faa4dc529e98342ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aed97a8de2a4a2faa4dc529e98342ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aed97a8de2a4a2faa4dc529e98342ae", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-LiveMigrationNegativeTest-1277426273 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5aed97a8de2a4a2faa4dc529e98342ae Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1277426273 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-LiveMigrationNegativeTest-1277426273-project Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 90e97cf3519b4665aff6b4274c34a205 Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-LiveMigrationNegativeTest-1277426273-project Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c4720567-7f18-444e-a14d-b6eab7499465 could not be found. Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c4720567-7f18-444e-a14d-b6eab7499465'} Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4720567-7f18-444e-a14d-b6eab7499465 could not be found. Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4720567-7f18-444e-a14d-b6eab7499465 could not be found. Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:52.288888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4720567-7f18-444e-a14d-b6eab7499465 could not be found. Jul 20 04:24:52.292699 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.298318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] Returning 404 to user: Instance c4720567-7f18-444e-a14d-b6eab7499465 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:52.299979 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-320ae7a0-5322-49eb-9e57-b5a29ebaccbe tempest-LiveMigrationNegativeTest-1277426273 tempest-LiveMigrationNegativeTest-1277426273-project] 10.222.0.49 "GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465" status: 404 len: 111 microversion: 2.1 time: 0.085575 Jul 20 04:24:52.302245 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1436/2561] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/c4720567-7f18-444e-a14d-b6eab7499465 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:52.323449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:52.324049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] [instance: a0c9d50f-0551-4a8a-a7a1-3980daeae38e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:52.354114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.354580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.355372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:52.355815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:52.414735 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] HTTP exception thrown: Instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e could not be found. Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Request method failure captured: Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e HTTP/1.1 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14LsyRoNrDz-wkmhzYFFOsUu6uXDzVRTEhOCWTnZAXGD6fruBPAp7AZl_kjXG8ufcAMPsR6Ps7gBFYbQ0BfM5YHzOu6za6kIjYDYKPpNWyxgRbgAKILoxTqUEN3JYR3ZH9E3v3YYcCvezVQfeBwAkVUUUBAAbLhAe5KL2juFuZECvBM Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 833230d24aaa48f88a335662fa7ac92d Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListImageFiltersTestJSON-1492367117 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/833230d24aaa48f88a335662fa7ac92d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/833230d24aaa48f88a335662fa7ac92d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/833230d24aaa48f88a335662fa7ac92d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_833230d24aaa48f88a335662fa7ac92d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListImageFiltersTestJSON-1492367117 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 833230d24aaa48f88a335662fa7ac92d Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1492367117 Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListImageFiltersTestJSON-1492367117-project Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6502ad71bb4b4be39aa2d743d55e2a0f Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListImageFiltersTestJSON-1492367117-project Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e could not be found. Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a0c9d50f-0551-4a8a-a7a1-3980daeae38e'} Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e could not be found. Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e could not be found. Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:24:52.416301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e could not be found. Jul 20 04:24:52.420393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:24:52.427714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Returning 404 to user: Instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:24:52.428854 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01649021-648e-453d-9a92-ce39c2d8bf5f tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e" status: 404 len: 111 microversion: 2.1 time: 0.125572 Jul 20 04:24:52.430064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1437/2562] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:52 2022] GET /compute/v2.1/servers/a0c9d50f-0551-4a8a-a7a1-3980daeae38e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:24:52.442343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1063796747", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:52.549737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] validate_networks() for [('df7757b0-396b-4bf1-b000-1e40cba2840e', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:24:54.091365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:24:54.091980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:24:54.092294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:24:54.092914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:24:54.093327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:24:54.122692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.127028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.130259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:54.130726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:54.254201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Getting quotas for project dc99560066644ac58bff06cc8fb86577. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:24:54.279189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Getting quotas for user 100f850e2270414e8f8449695b53c2aa and project dc99560066644ac58bff06cc8fb86577. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:24:54.404594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:24:54.410355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:24:54.715240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-421213ac-d4f6-468f-b764-a5e28e0ee2ef tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.280850 Jul 20 04:24:54.734238 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1438/2563] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:24:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:24:54.754715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4a6888b-7d59-421a-82c0-763dff780798 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ae4ee50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:57.143027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4a6888b-7d59-421a-82c0-763dff780798 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/images/e7f740e4-a836-4560-8b6b-d97d4b37060a" status: 204 len: 0 microversion: 2.1 time: 2.406024 Jul 20 04:24:57.144234 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1439/2564] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:54 2022] DELETE /compute/v2.1/images/e7f740e4-a836-4560-8b6b-d97d4b37060a => generated 0 bytes in 2409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:24:57.150959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:57.151774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:57.169386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.172320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:57.175145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:57.176317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.099316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:58.113198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-095af7d1-ea7c-4696-b8d8-641e98d62220 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1524 microversion: 2.1 time: 0.966622 Jul 20 04:24:58.120690 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1440/2565] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:57 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1524 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:58.131888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-76841c26-0a6e-4355-bb8e-4e4eca9259f3 req-ca966f26-376c-4335-a212-95aa23fb7ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9d50f-0551-4a8a-a7a1-3980daeae38e", "name": "network-vif-deleted", "tag": "4df1235c-a17e-4f22-8936-39c43262a38e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:24:58.192505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76841c26-0a6e-4355-bb8e-4e4eca9259f3 req-ca966f26-376c-4335-a212-95aa23fb7ddf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.194257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76841c26-0a6e-4355-bb8e-4e4eca9259f3 req-ca966f26-376c-4335-a212-95aa23fb7ddf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.235927 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-76841c26-0a6e-4355-bb8e-4e4eca9259f3 req-ca966f26-376c-4335-a212-95aa23fb7ddf service nova] Creating event network-vif-deleted:4df1235c-a17e-4f22-8936-39c43262a38e for instance a0c9d50f-0551-4a8a-a7a1-3980daeae38e on n-h1-764486-11 Jul 20 04:24:58.244902 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-76841c26-0a6e-4355-bb8e-4e4eca9259f3 req-ca966f26-376c-4335-a212-95aa23fb7ddf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120266 Jul 20 04:24:58.246772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1441/2566] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:24:58.280202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:24:58.281294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:24:58.290676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.291344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:58.292455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:24:58.293060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:24:59.031386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:24:59.050595 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f380c9e4-c394-4ebf-b813-d067a17f4b94 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1274 microversion: 2.1 time: 0.790977 Jul 20 04:24:59.052911 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1442/2567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:58 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1274 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:24:59.074174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b42b52b0-a351-4174-9266-361b70985f81 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ae51940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:00.359337 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b42b52b0-a351-4174-9266-361b70985f81 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/images/e448d1d0-085a-43a6-bd5a-280c731623fb" status: 204 len: 0 microversion: 2.1 time: 1.297957 Jul 20 04:25:00.361932 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1443/2568] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:24:59 2022] DELETE /compute/v2.1/images/e448d1d0-085a-43a6-bd5a-280c731623fb => generated 0 bytes in 1308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:00.367148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a296da1e-f0f5-4613-b162-c0bb98a790c3 req-61c5cefb-8b07-4d56-bdf1-287c0b0808c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c", "name": "network-vif-unplugged", "status": "completed", "tag": "7df575d2-21ab-4c1a-a4cf-eccec78bdca5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:00.394771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a296da1e-f0f5-4613-b162-c0bb98a790c3 req-61c5cefb-8b07-4d56-bdf1-287c0b0808c3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.395723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a296da1e-f0f5-4613-b162-c0bb98a790c3 req-61c5cefb-8b07-4d56-bdf1-287c0b0808c3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:00.439165 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a296da1e-f0f5-4613-b162-c0bb98a790c3 req-61c5cefb-8b07-4d56-bdf1-287c0b0808c3 service nova] Creating event network-vif-unplugged:7df575d2-21ab-4c1a-a4cf-eccec78bdca5 for instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c on n-h1-764486-11 Jul 20 04:25:00.461811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a296da1e-f0f5-4613-b162-c0bb98a790c3 req-61c5cefb-8b07-4d56-bdf1-287c0b0808c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098466 Jul 20 04:25:00.465073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1444/2569] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:00.485863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:00.488700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:00.512345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.513274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:00.515017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:00.515620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.333639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:01.345640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f7d76c3-0065-4bd2-8946-e29ae1b3bc8b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1524 microversion: 2.1 time: 0.876899 Jul 20 04:25:01.358180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1445/2570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:00 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1524 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:01.375537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:01.378079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:01.404072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.408851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.414928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:01.416641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:01.988299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:01.996629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1aafdcd6-63e5-47d4-8e7c-942d8cc42426 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.636933 Jul 20 04:25:02.002053 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1446/2571] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:01 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:02.008640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-839b0054-7ac4-4774-8ea6-8c5437a5fc48 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] Calling method '.version_select at 0x7f838ae6c550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.400122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-839b0054-7ac4-4774-8ea6-8c5437a5fc48 tempest-ListImageFiltersTestJSON-1492367117 tempest-ListImageFiltersTestJSON-1492367117-project] 10.222.0.49 "DELETE /compute/v2.1/images/e97be782-5912-46ec-a349-21880b43dcf9" status: 204 len: 0 microversion: 2.1 time: 1.396846 Jul 20 04:25:03.401909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1447/2572] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:02 2022] DELETE /compute/v2.1/images/e97be782-5912-46ec-a349-21880b43dcf9 => generated 0 bytes in 1399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:03.408240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:03.409305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:03.432680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.436473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:03.437524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:03.441343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.004376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:04.032570 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a99ca34f-9525-44f6-b370-4f422421116d tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1524 microversion: 2.1 time: 0.623077 Jul 20 04:25:04.035983 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1448/2573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:03 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1524 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:04.076076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:04.080859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:04.136505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.137336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.144433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:04.147304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:04.292279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:04.381745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=26 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:04.995100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:05.010648 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-100b8c79-775e-4249-919f-dc8742f03417 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.958592 Jul 20 04:25:05.019314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1449/2574] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:04 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:05.673091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71033aa7-ad91-45c2-bb70-2589adaafcc1 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '.version_select at 0x7f838ae6cee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:05.841581 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71033aa7-ad91-45c2-bb70-2589adaafcc1 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b" status: 200 len: 371 microversion: 2.1 time: 0.815684 Jul 20 04:25:05.847987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1450/2575] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:25:05 2022] GET /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b => generated 371 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:06.042115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d790aec9-77cf-4673-ad41-c5c60e47a2d7 req-50beaf9c-3e99-4bae-87fd-184c068b40d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d07ae53-9535-4b5f-b8a7-4fdcedef4a65", "tag": "5b844067-fa30-4e38-a628-3289157e2446"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:06.055796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d790aec9-77cf-4673-ad41-c5c60e47a2d7 req-50beaf9c-3e99-4bae-87fd-184c068b40d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.059100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d790aec9-77cf-4673-ad41-c5c60e47a2d7 req-50beaf9c-3e99-4bae-87fd-184c068b40d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.084654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d790aec9-77cf-4673-ad41-c5c60e47a2d7 req-50beaf9c-3e99-4bae-87fd-184c068b40d3 service nova] Creating event network-changed:5b844067-fa30-4e38-a628-3289157e2446 for instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 on n-h1-764486-11 Jul 20 04:25:06.095030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d790aec9-77cf-4673-ad41-c5c60e47a2d7 req-50beaf9c-3e99-4bae-87fd-184c068b40d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250746 Jul 20 04:25:06.097674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1451/2576] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:06.110218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:06.116933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:06.133585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.134109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:06.134946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:06.135428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:07.796379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:07.799977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:07.821128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1772ec0c-1619-4382-9043-dbca45c37b6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1524 microversion: 2.1 time: 1.721994 Jul 20 04:25:07.841194 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1452/2577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:06 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1524 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:07.857962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb7c38b3-85ac-48e3-95e7-850ef558187d tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Action: 'update', calling method: .version_select at 0x7f838ae90670>, body: {"quota_set": {"ram": "5120"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:08.237270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb7c38b3-85ac-48e3-95e7-850ef558187d tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.241344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb7c38b3-85ac-48e3-95e7-850ef558187d tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.246915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb7c38b3-85ac-48e3-95e7-850ef558187d tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.247613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb7c38b3-85ac-48e3-95e7-850ef558187d tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.420392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb7c38b3-85ac-48e3-95e7-850ef558187d tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b" status: 200 len: 328 microversion: 2.1 time: 0.577753 Jul 20 04:25:08.428337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1453/2578] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:25:07 2022] PUT /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b => generated 328 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:08.443610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:08.444504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:08.463786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.464555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:08.468620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:08.469354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.294547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:09.318967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84e46c4d-755f-44ea-97ed-49287233f4cf tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.880357 Jul 20 04:25:09.322674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1454/2579] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:08 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:09.329090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2795a9e-b979-4cfa-96eb-32de33fd13b1 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.378973 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2795a9e-b979-4cfa-96eb-32de33fd13b1 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b" status: 202 len: 0 microversion: 2.1 time: 0.054425 Jul 20 04:25:09.379855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1455/2580] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:25:09 2022] DELETE /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:25:09.386397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a1a33ba9-5a97-4709-90f6-90facf73f491 req-db784fbc-7eb3-41d3-9fa1-9d2eccaab9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c", "name": "network-vif-plugged", "status": "completed", "tag": "7df575d2-21ab-4c1a-a4cf-eccec78bdca5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:09.407247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1a33ba9-5a97-4709-90f6-90facf73f491 req-db784fbc-7eb3-41d3-9fa1-9d2eccaab9ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.408860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1a33ba9-5a97-4709-90f6-90facf73f491 req-db784fbc-7eb3-41d3-9fa1-9d2eccaab9ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.435198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a1a33ba9-5a97-4709-90f6-90facf73f491 req-db784fbc-7eb3-41d3-9fa1-9d2eccaab9ce service nova] Creating event network-vif-plugged:7df575d2-21ab-4c1a-a4cf-eccec78bdca5 for instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c on n-h1-764486-11 Jul 20 04:25:09.448800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a1a33ba9-5a97-4709-90f6-90facf73f491 req-db784fbc-7eb3-41d3-9fa1-9d2eccaab9ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067276 Jul 20 04:25:09.449909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1456/2581] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:09.462221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:09.474640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:09.504417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.509021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:09.512747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:09.515416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:11.129349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:11.150599 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1dfdaf93-68b1-4905-8e12-e5eb342758e0 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1524 microversion: 2.1 time: 1.693245 Jul 20 04:25:11.162671 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1457/2582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:09 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1524 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:11.177096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02169188-54d0-45b1-b94f-e5f66b0e8e16 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '.version_select at 0x7f838ae90ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:11.703005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02169188-54d0-45b1-b94f-e5f66b0e8e16 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b" status: 200 len: 371 microversion: 2.1 time: 0.538764 Jul 20 04:25:11.703930 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1458/2583] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:25:11 2022] GET /compute/v2.1/os-quota-sets/bf91bde5bb654c60b7dc352b3281e16b => generated 371 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:11.710163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:11.711289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:11.719564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:11.720379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:11.723521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:11.725296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:12.286422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:12.301787 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-593129bf-d5f1-4eb3-a895-13dd86cf22c4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.594889 Jul 20 04:25:12.302735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1459/2584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:11 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:12.947198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a38d2ec0-4ec4-45a7-baa6-6afa658adefe tempest-ListImageFiltersNegativeTestJSON-1003315749 tempest-ListImageFiltersNegativeTestJSON-1003315749-project] Calling method '.version_select at 0x7f838aedeb80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:12.997827 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a38d2ec0-4ec4-45a7-baa6-6afa658adefe tempest-ListImageFiltersNegativeTestJSON-1003315749 tempest-ListImageFiltersNegativeTestJSON-1003315749-project] HTTP exception thrown: Image not found. Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a38d2ec0-4ec4-45a7-baa6-6afa658adefe tempest-ListImageFiltersNegativeTestJSON-1003315749 tempest-ListImageFiltersNegativeTestJSON-1003315749-project] Request method failure captured: Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/images/0b0d3a8e-fbe9-4a0a-bd62-13a9357af52f HTTP/1.1 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OmEVO8kzmYmvJ9TJ79AMWOmCRkSkVYc6Hz_6wEhSuC0iiVQjneJrWAVWIPxOSTIfXAVJznxfArm-D9yu92IifonWL48szImzcYBpitR8HqAVCCnEjCObDbUIvgwTs9g8DtZZXt0tcQr5fHBqWNwjSnVCSp-nvH7BCDyZXv3mPxMZo Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0d50320c95bf4c6993c9fe98229ff22a Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1003315749 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d50320c95bf4c6993c9fe98229ff22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d50320c95bf4c6993c9fe98229ff22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d50320c95bf4c6993c9fe98229ff22a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d50320c95bf4c6993c9fe98229ff22a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1003315749 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0d50320c95bf4c6993c9fe98229ff22a Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1003315749 Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListImageFiltersNegativeTestJSON-1003315749-project Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8f23dc691a4a466c8d98b91cd7db7b0b Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1003315749-project Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0b0d3a8e-fbe9-4a0a-bd62-13a9357af52f'} Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0b0d3a8e-fbe9-4a0a-bd62-13a9357af52f Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:25:13.000275 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0b0d3a8e-fbe9-4a0a-bd62-13a9357af52f could not be found. Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:25:13.005973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:13.014239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a38d2ec0-4ec4-45a7-baa6-6afa658adefe tempest-ListImageFiltersNegativeTestJSON-1003315749 tempest-ListImageFiltersNegativeTestJSON-1003315749-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:13.018750 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a38d2ec0-4ec4-45a7-baa6-6afa658adefe tempest-ListImageFiltersNegativeTestJSON-1003315749 tempest-ListImageFiltersNegativeTestJSON-1003315749-project] 10.222.0.49 "GET /compute/v2.1/images/0b0d3a8e-fbe9-4a0a-bd62-13a9357af52f" status: 404 len: 62 microversion: 2.1 time: 0.711235 Jul 20 04:25:13.019915 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1460/2585] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:25:12 2022] GET /compute/v2.1/images/0b0d3a8e-fbe9-4a0a-bd62-13a9357af52f => generated 62 bytes in 714 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:25:13.037431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09a0308b-1eb4-4f5a-a8ac-94f015ceb6fe tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '.version_select at 0x7f838aedeb80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.246015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:14.264100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09a0308b-1eb4-4f5a-a8ac-94f015ceb6fe tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb/defaults" status: 200 len: 371 microversion: 2.1 time: 1.238346 Jul 20 04:25:14.265772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1461/2586] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:25:13 2022] GET /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb/defaults => generated 371 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:14.304524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.305593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:14.333498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.334581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.335747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.338383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.794984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:14.817155 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ff0d1fe-022a-415a-8bd0-ee9b041a7dfd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1509 microversion: 2.1 time: 0.544586 Jul 20 04:25:14.820500 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1462/2587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:14.843739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:14.846302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:14.862219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.865291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:14.866278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:14.871689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:15.278934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:15.293943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2e624ff-b848-4f3d-a122-4f495a2cc81f tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.460374 Jul 20 04:25:15.300488 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1463/2588] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:14 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:16.302835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8547ffb8-c703-43d4-8679-21c32877b093 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Action: 'create', calling method: .version_select at 0x7f838af194c0>, body: {"keypair": {"name": "tempest-keypair-1016710672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4b8okya8k3I68bwt5oammt0NUjjXR/pHQlBSM6W2yAPBRr35QLDkcr5HVAZNzhMpkwFLu9tFN8svC6mlCOuit5+5NiSVAgVMm817iW8RBgrx0zLZvLp2WHto3QB1exKA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:16.354770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8547ffb8-c703-43d4-8679-21c32877b093 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Getting quotas for project 0e2aa7fa46ea48d4a3f2101ab14e95b6. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:16.377263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8547ffb8-c703-43d4-8679-21c32877b093 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Getting quotas for user 34cea7f926ea42e0afdf38dd49a07647 and project 0e2aa7fa46ea48d4a3f2101ab14e95b6. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8547ffb8-c703-43d4-8679-21c32877b093 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.172197 Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1464/2589] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:25:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:16.508383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.231576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:17.259993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8e1524c-a707-4b14-8535-6e7bfaed218c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 200 len: 1509 microversion: 2.1 time: 0.778368 Jul 20 04:25:17.262857 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1465/2590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:16 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 1509 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:17.273496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6504e7f-a5da-451e-9895-dabafa9b2cce tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Action: 'update', calling method: .version_select at 0x7f838af329d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:17.877796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6504e7f-a5da-451e-9895-dabafa9b2cce tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.881383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6504e7f-a5da-451e-9895-dabafa9b2cce tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:17.882280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6504e7f-a5da-451e-9895-dabafa9b2cce tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:17.882735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6504e7f-a5da-451e-9895-dabafa9b2cce tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.026335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6504e7f-a5da-451e-9895-dabafa9b2cce tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e" status: 200 len: 328 microversion: 2.1 time: 0.762290 Jul 20 04:25:18.030494 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1466/2591] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:25:17 2022] PUT /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e => generated 328 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:18.041954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:18.042704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:18.057898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.062099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.063115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.070474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.431756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:18.441706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19c318bc-fd5b-488a-a33c-b10e6fbe6383 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.408685 Jul 20 04:25:18.447001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1467/2592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:18 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:18.458577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:18.460326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:18.475611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.477828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.479619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:18.480073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:18.571481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:18.791841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95076207-45a0-4718-96c0-7030843060a7 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 204 len: 0 microversion: 2.1 time: 0.343015 Jul 20 04:25:18.793427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1468/2593] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:18 2022] DELETE /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:19.259620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-66200323", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "6a7d5756-dbcb-4fc1-b82b-4d203b7da75f"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:19.424637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] validate_networks() for [('6a7d5756-dbcb-4fc1-b82b-4d203b7da75f', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:21.042182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:21.043661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:21.044590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:21.045596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:21.046339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:21.079230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.080263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.082693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:21.084303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:21.173188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Getting quotas for project c3f6f7fc55ad48e8bf1059cddbd8cda3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:21.197329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Getting quotas for user 5b785bb011d542f2924363cb469c75b6 and project c3f6f7fc55ad48e8bf1059cddbd8cda3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:21.232295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:21.237743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:21.421898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-030cfecd-dd63-45aa-99cd-94fd06bfb971 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626610 Jul 20 04:25:21.422748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1469/2594] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:21.448518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6deab72f-9b5e-4f26-8e17-77ab1ab8e11b tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '.version_select at 0x7f838af78430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:22.221776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deab72f-9b5e-4f26-8e17-77ab1ab8e11b tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.222358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deab72f-9b5e-4f26-8e17-77ab1ab8e11b tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.228916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deab72f-9b5e-4f26-8e17-77ab1ab8e11b tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:22.231132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deab72f-9b5e-4f26-8e17-77ab1ab8e11b tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:22.372237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6deab72f-9b5e-4f26-8e17-77ab1ab8e11b tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e/detail" status: 200 len: 916 microversion: 2.1 time: 0.938523 Jul 20 04:25:22.372973 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1470/2595] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:25:21 2022] GET /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e/detail => generated 916 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:22.387245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1988397415", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "ae8e82e2-541d-4bad-b7ba-1a3c1e47e30c"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:32.218001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=32 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:32.279344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:32.281222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:32.428308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:35.737533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] validate_networks() for [('ae8e82e2-541d-4bad-b7ba-1a3c1e47e30c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:36.354306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:36.355152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:36.355796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:36.356455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:36.357307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:36.368593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.369277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.370324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.371068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.401044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Getting quotas for project 79c01dad88a044848fde724f2e610051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:36.407323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Getting quotas for user 6889981a862845ba8f1817d605db27db and project 79c01dad88a044848fde724f2e610051. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:36.424001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:36.426883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:36.507159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68b79bb7-f1ca-43a8-aece-df1b6c911e6f tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.132702 Jul 20 04:25:36.509161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1471/2596] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 14135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:36.905122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-821356b8-d031-43ea-a152-ba4f123b00e2 req-3e6790f0-32ec-46cb-a476-ad8af1d0f31f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d07ae53-9535-4b5f-b8a7-4fdcedef4a65", "name": "network-vif-plugged", "status": "completed", "tag": "5b844067-fa30-4e38-a628-3289157e2446"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:36.920848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-821356b8-d031-43ea-a152-ba4f123b00e2 req-3e6790f0-32ec-46cb-a476-ad8af1d0f31f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.922586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-821356b8-d031-43ea-a152-ba4f123b00e2 req-3e6790f0-32ec-46cb-a476-ad8af1d0f31f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.939138 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-821356b8-d031-43ea-a152-ba4f123b00e2 req-3e6790f0-32ec-46cb-a476-ad8af1d0f31f service nova] Creating event network-vif-plugged:5b844067-fa30-4e38-a628-3289157e2446 for instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 on n-h1-764486-11 Jul 20 04:25:36.947452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-821356b8-d031-43ea-a152-ba4f123b00e2 req-3e6790f0-32ec-46cb-a476-ad8af1d0f31f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436188 Jul 20 04:25:36.948603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1472/2597] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:36.958111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:36.962497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:36.974499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.975209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:36.977473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:36.978185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.301733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:37.320111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-394abc9c-eb05-405e-ae9d-5e3a60a79a1c tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1314 microversion: 2.1 time: 0.369864 Jul 20 04:25:37.328915 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1473/2598] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:36 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:37.339273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bd3a0a88-4c0a-455b-bc20-51c80fc6b3da req-270a5a0f-2373-4017-b0ea-112c64a96a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c", "name": "network-vif-deleted", "tag": "7df575d2-21ab-4c1a-a4cf-eccec78bdca5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:37.352081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bd3a0a88-4c0a-455b-bc20-51c80fc6b3da req-270a5a0f-2373-4017-b0ea-112c64a96a56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.353258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bd3a0a88-4c0a-455b-bc20-51c80fc6b3da req-270a5a0f-2373-4017-b0ea-112c64a96a56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.387934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bd3a0a88-4c0a-455b-bc20-51c80fc6b3da req-270a5a0f-2373-4017-b0ea-112c64a96a56 service nova] Creating event network-vif-deleted:7df575d2-21ab-4c1a-a4cf-eccec78bdca5 for instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c on n-h1-764486-11 Jul 20 04:25:37.394266 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bd3a0a88-4c0a-455b-bc20-51c80fc6b3da req-270a5a0f-2373-4017-b0ea-112c64a96a56 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063630 Jul 20 04:25:37.395374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1474/2599] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:37.401021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:37.402044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:37.412021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.412775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.413770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:37.414370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:37.635762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:37.646420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ace981a-319d-4ed1-bc53-766cbeca9e85 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1326 microversion: 2.1 time: 0.249552 Jul 20 04:25:37.655597 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1475/2600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:37 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:37.663832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Action: 'update', calling method: .version_select at 0x7f838aef64c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:38.016952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.018131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.021227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.021851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.091417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.091892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.092796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:38.093228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:38.162345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2aa2a171-279f-4cb7-a5af-f0bf652722aa tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e?user_id=603a6a6ea29a47e88565b21f1fcb6c68" status: 200 len: 328 microversion: 2.1 time: 0.508212 Jul 20 04:25:38.165268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1476/2601] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:25:37 2022] PUT /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e?user_id=603a6a6ea29a47e88565b21f1fcb6c68 => generated 328 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:38.616978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Calling method '.version_select at 0x7f838ae90310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:38.641202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:25:38.643894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Neutron security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:25:38.645794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] HTTP exception thrown: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.645794 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Request method failure captured: Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-groups/1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 HTTP/1.1 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14O-CRll9eZ_5FyuTXx_GqFeN9lEg6m4_4TyrnBvrrwUc-2O49SHDi0H0vuRU7_TvKbeKex5zLS43UV3gIJ86OHPAup-2rmyEtMsREYtWgdK6PafOjQezBDUQFY8hyPOORZHIfsBo_bmIGt8Rh1Pqg3lFQhtPkUh0M5k8nqxIJJbcdU Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e61c17a17bb4280bfd5120bb4fd7732", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 739e93c5bcb845f084fad2a01b1287f8 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1fbf2c30-4daf-4ce8-bbb6-22e662bc4264'} Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:25:38.649352 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] Jul 20 04:25:38.653437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:38.662796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Returning 404 to user: Security group 1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 does not exist Jul 20 04:25:38.662796 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-c2a603f0-bb7d-43c1-9e9f-631ef6595a70'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:38.667725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1bb26489-1331-42ac-930a-a8e0d395fe8b tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1fbf2c30-4daf-4ce8-bbb6-22e662bc4264" status: 404 len: 194 microversion: 2.1 time: 0.498494 Jul 20 04:25:38.669653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1477/2602] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:25:38 2022] DELETE /compute/v2.1/os-security-groups/1fbf2c30-4daf-4ce8-bbb6-22e662bc4264 => generated 194 bytes in 504 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:39.035519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c638682-b6e8-4391-ab0a-7ecc34e43ee8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Action: 'create', calling method: .version_select at 0x7f838aef6c10>, body: {"keypair": {"name": "tempest-keypair-876377569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMos7HMK3JrnDvWAcFT0Y9pmg3a++m0nFku4+Wsa7fcUdf6nuS/F1BtAIR+jN2SguhoBhcHLHM7JxhMmkbIcrklSFPUoq/yx9XmpO/bP/zowNnfHjzKIXCZ0+OAVuixzQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:39.094670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6c638682-b6e8-4391-ab0a-7ecc34e43ee8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Getting quotas for project 751cdde65a424133bbde626d3124896f. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:39.111395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6c638682-b6e8-4391-ab0a-7ecc34e43ee8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Getting quotas for user 822cb641dd2948a3abe5f6afe9c5b126 and project 751cdde65a424133bbde626d3124896f. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:39.165096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c638682-b6e8-4391-ab0a-7ecc34e43ee8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.493904 Jul 20 04:25:39.167323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1478/2603] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:25:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:39.174173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.175781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.185105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.185906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.186936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.187859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.286933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:39.301800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4637c5f7-bda5-429d-85c8-fe626f358143 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1276 microversion: 2.1 time: 0.132661 Jul 20 04:25:39.303382 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1479/2604] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:39.309657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c483344-70cf-4095-a0da-3bfb9dd6b721 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '.version_select at 0x7f838aecf160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.785111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c483344-70cf-4095-a0da-3bfb9dd6b721 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e?user_id=603a6a6ea29a47e88565b21f1fcb6c68" status: 200 len: 370 microversion: 2.1 time: 0.480329 Jul 20 04:25:39.785703 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1480/2605] 10.222.0.49 () {58 vars in 1322 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/os-quota-sets/9710b49e73f647549e6b1bbb30cd667e?user_id=603a6a6ea29a47e88565b21f1fcb6c68 => generated 370 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:39.803032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:39.805123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:39.820321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.821225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:39.822044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:39.823808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:40.122011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:40.136519 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cae73322-2d6e-40d0-82ec-40b0869e25da tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1500 microversion: 2.1 time: 0.344114 Jul 20 04:25:40.141179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1481/2606] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:39 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1500 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:40.150029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:40.151157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:40.169873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:40.171809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:40.173176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:40.178050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:40.999027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:41.009480 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-57bcd978-9a70-49e3-99c9-e6cfcbe9da05 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1326 microversion: 2.1 time: 0.866814 Jul 20 04:25:41.010645 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1482/2607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:40 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1326 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.022253 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0172127d-cf3e-4ba5-9ca7-19ae59b78018 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010386 Jul 20 04:25:41.023065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1483/2608] 10.222.0.49 () {58 vars in 1163 bytes} [Wed Jul 20 04:25:41 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:25:41.032827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b8219854-b0c9-43e5-93a0-9be141a6f390 req-177e744b-4c5e-4717-bc52-b8a2dcbfc2da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cace797-fc15-4ee9-b9d2-66f5a0fc84e5", "name": "network-vif-plugged", "status": "completed", "tag": "6a20e7c2-b9ee-4031-834a-9b24dd7a3061"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:41.054114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8219854-b0c9-43e5-93a0-9be141a6f390 req-177e744b-4c5e-4717-bc52-b8a2dcbfc2da service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.063497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8219854-b0c9-43e5-93a0-9be141a6f390 req-177e744b-4c5e-4717-bc52-b8a2dcbfc2da service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.076246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b8219854-b0c9-43e5-93a0-9be141a6f390 req-177e744b-4c5e-4717-bc52-b8a2dcbfc2da service nova] Creating event network-vif-plugged:6a20e7c2-b9ee-4031-834a-9b24dd7a3061 for instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 on n-h2-764486-11 Jul 20 04:25:41.084767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b8219854-b0c9-43e5-93a0-9be141a6f390 req-177e744b-4c5e-4717-bc52-b8a2dcbfc2da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055796 Jul 20 04:25:41.086072 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1484/2609] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:41.091636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-577abaab-92c6-43d2-8f75-fb403ddaa7eb req-411563f7-9b19-4d87-9ccc-1b2d6c43e25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cace797-fc15-4ee9-b9d2-66f5a0fc84e5", "tag": "6a20e7c2-b9ee-4031-834a-9b24dd7a3061"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:41.100793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-577abaab-92c6-43d2-8f75-fb403ddaa7eb req-411563f7-9b19-4d87-9ccc-1b2d6c43e25a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.101479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-577abaab-92c6-43d2-8f75-fb403ddaa7eb req-411563f7-9b19-4d87-9ccc-1b2d6c43e25a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.140589 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-577abaab-92c6-43d2-8f75-fb403ddaa7eb req-411563f7-9b19-4d87-9ccc-1b2d6c43e25a service nova] Creating event network-changed:6a20e7c2-b9ee-4031-834a-9b24dd7a3061 for instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 on n-h2-764486-11 Jul 20 04:25:41.147841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-577abaab-92c6-43d2-8f75-fb403ddaa7eb req-411563f7-9b19-4d87-9ccc-1b2d6c43e25a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060115 Jul 20 04:25:41.148677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1485/2610] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:41.158028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:41.161506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:41.182603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.183326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.184569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.187749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.256234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lazy-loading 'flavor' on Instance uuid 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:25:41.473397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-344c02de-5c70-4690-8e5f-e4546455a66d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "POST /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65/action" status: 200 len: 32 microversion: 2.1 time: 0.320981 Jul 20 04:25:41.483454 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1486/2611] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:25:41 2022] POST /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:25:41.496246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:41.499959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:41.522157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.523031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.523996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:41.524344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:41.842591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:41.855082 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b8c4aee-4d9b-4862-96cb-bcd20bdcece6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1318 microversion: 2.1 time: 0.369269 Jul 20 04:25:41.859588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1487/2612] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:41.867966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c846f626-0c58-4e0f-8823-7ffb636632b5 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Calling method '.version_select at 0x7f838aecf1f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.301145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c846f626-0c58-4e0f-8823-7ffb636632b5 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.439779 Jul 20 04:25:42.302527 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1488/2613] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:25:41 2022] GET /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb/defaults => generated 371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:42.312794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4186af4-61eb-4221-a275-0416ef72e5ed tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Calling method '.version_select at 0x7f838aedeaf0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.506959 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4186af4-61eb-4221-a275-0416ef72e5ed tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.202423 Jul 20 04:25:42.507559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1489/2614] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:42.512089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.512990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:42.521847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.522297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.523497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.524092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.713739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.723650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-784735e3-74c3-46f0-bdfb-948f8973827a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.215032 Jul 20 04:25:42.726243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1490/2615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:42.738522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:42.739535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:42.751740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.752882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.754083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:42.754613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:42.922156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:42.932921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c1767cf-e569-47ce-9f8a-69c5687bc2bc tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1326 microversion: 2.1 time: 0.205263 Jul 20 04:25:42.935701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1491/2616] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:42 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1326 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:42.941169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b77d7d90-419c-4f46-b74f-f3c02fc78bf3 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Action: 'update', calling method: .version_select at 0x7f838aef6940>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:43.254867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b77d7d90-419c-4f46-b74f-f3c02fc78bf3 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.255313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b77d7d90-419c-4f46-b74f-f3c02fc78bf3 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.256223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b77d7d90-419c-4f46-b74f-f3c02fc78bf3 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:43.256681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b77d7d90-419c-4f46-b74f-f3c02fc78bf3 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:43.337200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:43.473302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b77d7d90-419c-4f46-b74f-f3c02fc78bf3 tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb" status: 200 len: 329 microversion: 2.1 time: 0.535994 Jul 20 04:25:43.476505 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1492/2617] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Jul 20 04:25:42 2022] PUT /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb => generated 329 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:43.481882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1439803717", "imageRef": "9df46db3-328e-4825-81be-ffe807ae7978", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "569bbb67-82b1-4267-b573-05ee82c6bfb0"}], "security_groups": [{"name": "tempest-securitygroup--552354905"}], "key_name": "tempest-keypair-876377569", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:43.603243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] validate_networks() for [('569bbb67-82b1-4267-b573-05ee82c6bfb0', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:44.027002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:44.028044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:44.028703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:44.029221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:44.029770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:44.040114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.040775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.041687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.042197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.061368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Getting quotas for project 751cdde65a424133bbde626d3124896f. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:44.068000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Getting quotas for user 822cb641dd2948a3abe5f6afe9c5b126 and project 751cdde65a424133bbde626d3124896f. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:44.082594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:44.084896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9df46db3-328e-4825-81be-ffe807ae7978',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:44.133783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ddd332c-7c27-40b6-9669-050792eae683 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.658409 Jul 20 04:25:44.142519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1493/2618] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:44.147508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5b0d963-23b3-4ea5-a224-80309883052f tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Calling method '.version_select at 0x7f838aef6550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:44.302444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-f5b0d963-23b3-4ea5-a224-80309883052f tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:25:44.304997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f5b0d963-23b3-4ea5-a224-80309883052f tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 20 04:25:44.304997 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5b0d963-23b3-4ea5-a224-80309883052f tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Request method failure captured: Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-groups/76faa0d0-3926-4ea7-a703-633ae587e932 HTTP/1.1 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14O-CRll9eZ_5FyuTXx_GqFeN9lEg6m4_4TyrnBvrrwUc-2O49SHDi0H0vuRU7_TvKbeKex5zLS43UV3gIJ86OHPAup-2rmyEtMsREYtWgdK6PafOjQezBDUQFY8hyPOORZHIfsBo_bmIGt8Rh1Pqg3lFQhtPkUh0M5k8nqxIJJbcdU Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e61c17a17bb4280bfd5120bb4fd7732", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 739e93c5bcb845f084fad2a01b1287f8 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: exception: Insufficient rights for removing default security group. Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '76faa0d0-3926-4ea7-a703-633ae587e932'} Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:25:44.309296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] Jul 20 04:25:44.313632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:44.320678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5b0d963-23b3-4ea5-a224-80309883052f tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 20 04:25:44.320678 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-dbc4656b-d14a-46a9-84de-0652959b8ce7'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:44.321657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5b0d963-23b3-4ea5-a224-80309883052f tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/76faa0d0-3926-4ea7-a703-633ae587e932" status: 400 len: 182 microversion: 2.1 time: 0.177732 Jul 20 04:25:44.322280 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1494/2619] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:25:44 2022] DELETE /compute/v2.1/os-security-groups/76faa0d0-3926-4ea7-a703-633ae587e932 => generated 182 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:25:44.329299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:44.329299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:44.336597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.337070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.338072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.338604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.514523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:44.526370 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31137721-5034-4e02-9a51-f3806d13d6a6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1318 microversion: 2.1 time: 0.202962 Jul 20 04:25:44.528541 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1495/2620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:44 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:44.541858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-16f97922-659e-46d5-a3cb-fb94c70617f9 req-1a5a2e97-3c6d-4466-91ce-ff6d2cb4addb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96495c4e-74d8-43c0-8063-6ca98a7debf9", "tag": "ff81edba-0eb2-4bbe-88bf-556e02c1bdaa"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:44.571586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-16f97922-659e-46d5-a3cb-fb94c70617f9 req-1a5a2e97-3c6d-4466-91ce-ff6d2cb4addb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.572220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-16f97922-659e-46d5-a3cb-fb94c70617f9 req-1a5a2e97-3c6d-4466-91ce-ff6d2cb4addb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.592830 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-16f97922-659e-46d5-a3cb-fb94c70617f9 req-1a5a2e97-3c6d-4466-91ce-ff6d2cb4addb service nova] Creating event network-changed:ff81edba-0eb2-4bbe-88bf-556e02c1bdaa for instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 on n-h1-764486-11 Jul 20 04:25:44.598688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-16f97922-659e-46d5-a3cb-fb94c70617f9 req-1a5a2e97-3c6d-4466-91ce-ff6d2cb4addb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068294 Jul 20 04:25:44.599418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1496/2621] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:44.604830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-654d6c09-095a-445a-b337-001319017c8c tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Action: 'update', calling method: .version_select at 0x7f83982631f0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:44.953488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654d6c09-095a-445a-b337-001319017c8c tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.953947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654d6c09-095a-445a-b337-001319017c8c tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:44.954741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654d6c09-095a-445a-b337-001319017c8c tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:44.955916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654d6c09-095a-445a-b337-001319017c8c tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.327401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=25,nova_api:SELECT=64,nova_api:UPDATE=11 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:45.401791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:45.419855 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-654d6c09-095a-445a-b337-001319017c8c tempest-QuotasAdminTestJSON-1067004157 tempest-QuotasAdminTestJSON-1067004157-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb" status: 200 len: 329 microversion: 2.1 time: 0.819047 Jul 20 04:25:45.424509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1497/2622] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Jul 20 04:25:44 2022] PUT /compute/v2.1/os-quota-sets/8373891bfcce4456ab67d84d6b37e5eb => generated 329 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:45.444139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:45.445524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:45.453409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.453850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.454856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.455992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.763377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:45.766928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:45.793150 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55eaa70e-72b7-4ae5-9398-9b55314e51d9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.370828 Jul 20 04:25:45.796791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1498/2623] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:45 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:45.819157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:45.823011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:45.833889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.834649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:45.835631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:45.836262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.134387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:46.146793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ae5415e-07aa-4a11-872f-aad575606f16 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1526 microversion: 2.1 time: 0.341729 Jul 20 04:25:46.148442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1499/2624] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:45 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:46.163749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:46.166025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:46.184323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:46.186584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.188486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:46.190583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.304138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:46.312111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb23a7bc-3184-4bcd-ba45-f909e02b50cd tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1303 microversion: 2.1 time: 0.161714 Jul 20 04:25:46.312718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1500/2625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:46 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:46.327716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Calling method '.version_select at 0x7f838affed30>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:46.363377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:25:46.364305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Neutron security group ea633843-16c6-48f7-b189-53fb35852273 not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:25:46.365055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] HTTP exception thrown: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.365055 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Request method failure captured: Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-security-groups/ea633843-16c6-48f7-b189-53fb35852273 HTTP/1.1 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14O-CRll9eZ_5FyuTXx_GqFeN9lEg6m4_4TyrnBvrrwUc-2O49SHDi0H0vuRU7_TvKbeKex5zLS43UV3gIJ86OHPAup-2rmyEtMsREYtWgdK6PafOjQezBDUQFY8hyPOORZHIfsBo_bmIGt8Rh1Pqg3lFQhtPkUh0M5k8nqxIJJbcdU Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e61c17a17bb4280bfd5120bb4fd7732", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 739e93c5bcb845f084fad2a01b1287f8 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ea633843-16c6-48f7-b189-53fb35852273'} Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:25:46.367370 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] Jul 20 04:25:46.370897 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:46.377796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Returning 404 to user: Security group ea633843-16c6-48f7-b189-53fb35852273 does not exist Jul 20 04:25:46.377796 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-000dbb74-7255-40ec-bcb4-e9616a176d8a'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:46.378670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f0e9615-49d9-49cc-9ca2-283535ed7e98 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/ea633843-16c6-48f7-b189-53fb35852273" status: 404 len: 194 microversion: 2.1 time: 0.062364 Jul 20 04:25:46.384401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1501/2626] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:25:46 2022] GET /compute/v2.1/os-security-groups/ea633843-16c6-48f7-b189-53fb35852273 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:46.388389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:46.389087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:46.411942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:46.412554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:46.413224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:46.413667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.029198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:47.043089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1cdd192-c196-4ad6-b0db-33d4151daf65 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1318 microversion: 2.1 time: 0.658656 Jul 20 04:25:47.043897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1502/2627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:46 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:47.070341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:47.070966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:47.101582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.102062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.102966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.103490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.739696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:47.751197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f0859d4-0614-4c8d-b383-fe30388c3d3a tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1526 microversion: 2.1 time: 0.703330 Jul 20 04:25:47.756710 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1503/2628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:47 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1526 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:47.764272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Action: 'update', calling method: .version_select at 0x7f838af32670>, body: {"security_group": {"name": "tempest-sg-910255756", "description": "tempest-description-1298601710"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:47.789816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:25:47.790651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Neutron security group c7a89f16-2e23-45d6-a638-137f6924bd8f not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:25:47.791327 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] HTTP exception thrown: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.791327 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Request method failure captured: Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-security-groups/c7a89f16-2e23-45d6-a638-137f6924bd8f HTTP/1.1 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 101 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14O-CRll9eZ_5FyuTXx_GqFeN9lEg6m4_4TyrnBvrrwUc-2O49SHDi0H0vuRU7_TvKbeKex5zLS43UV3gIJ86OHPAup-2rmyEtMsREYtWgdK6PafOjQezBDUQFY8hyPOORZHIfsBo_bmIGt8Rh1Pqg3lFQhtPkUh0M5k8nqxIJJbcdU Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e61c17a17bb4280bfd5120bb4fd7732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e61c17a17bb4280bfd5120bb4fd7732", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5e61c17a17bb4280bfd5120bb4fd7732 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 739e93c5bcb845f084fad2a01b1287f8 Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2140441173-project Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: {"security_group": {"name": "tempest-sg-910255756", "description": "tempest-description-1298601710"}} Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c7a89f16-2e23-45d6-a638-137f6924bd8f', 'body': {'security_group': {'name': 'tempest-sg-910255756', 'description': 'tempest-description-1298601710'}}} Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:25:47.793530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] Jul 20 04:25:47.797994 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:47.804223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] Returning 404 to user: Security group c7a89f16-2e23-45d6-a638-137f6924bd8f does not exist Jul 20 04:25:47.804223 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-cac3fb26-31cb-400b-bc46-c17bdf1e7d87'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:47.805401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11eb0723-98bb-4c5a-b2bd-d89dc1a423f4 tempest-SecurityGroupsNegativeTestJSON-2140441173 tempest-SecurityGroupsNegativeTestJSON-2140441173-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/c7a89f16-2e23-45d6-a638-137f6924bd8f" status: 404 len: 194 microversion: 2.1 time: 0.047431 Jul 20 04:25:47.807255 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1504/2629] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Jul 20 04:25:47 2022] PUT /compute/v2.1/os-security-groups/c7a89f16-2e23-45d6-a638-137f6924bd8f => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:47.827147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:47.828179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:47.848023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.848821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:47.849851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:47.850496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.543762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:48.557001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cb96e79-a14e-450b-9396-2b5890c4bc75 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.744530 Jul 20 04:25:48.559414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1505/2630] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:47 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:48.573492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:48.576009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:48.595972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.602695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.605322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:48.609542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:48.975966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:48.988770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c2acaba-1c34-46ce-855f-cf610689722e tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.427922 Jul 20 04:25:48.992440 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1506/2631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:48 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:49.650013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:49.652937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:49.670375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.671884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.673575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.675181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.707479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] HTTP exception thrown: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Request method failure captured: Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 HTTP/1.1 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Os60qA4qNNl9ST9JhORGfOo3ATuY2y57a_VVgJVwEhhgTTaLKT4HrH24qGzpGGmlXZ3VYWTB9YBCVlQgRZZUt7zCELeHVaVawvCA79WrOLkzSwp1NIfVOFyvYaT3QoQvfuQDFflAft8iwZSgvCHby6z8Ym0fS-brTQSl3YoH9liTw Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2577aa43097a4585b9d7cd80bc21f70b Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1676991010 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2577aa43097a4585b9d7cd80bc21f70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2577aa43097a4585b9d7cd80bc21f70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2577aa43097a4585b9d7cd80bc21f70b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2577aa43097a4585b9d7cd80bc21f70b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1676991010 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2577aa43097a4585b9d7cd80bc21f70b Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1676991010 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1676991010-project Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: c27a1b9b6faf4c9fa64946fe2af62aa7 Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1676991010-project Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8cace797-fc15-4ee9-b9d2-66f5a0fc84e5'} Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:49.715363 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Returning 404 to user: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb737432-634d-4dfd-ad1c-751da0ac73cf tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 404 len: 111 microversion: 2.1 time: 0.723286 Jul 20 04:25:49.719937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1507/2632] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:48 2022] DELETE /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 111 bytes in 724 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:49.734376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:49.734976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:49.749359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.754716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:49.759438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:49.760102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.603961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:50.616027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbe7f665-6046-4b12-a44a-29e2349e576c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1318 microversion: 2.1 time: 0.889112 Jul 20 04:25:50.632286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1508/2633] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:49 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:50.637864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-013552d9-305e-4f6b-9c41-828ba166adf2 req-1952b99d-bf4f-4eff-a667-7ba16939ff58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96495c4e-74d8-43c0-8063-6ca98a7debf9", "name": "network-vif-plugged", "status": "completed", "tag": "ff81edba-0eb2-4bbe-88bf-556e02c1bdaa"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:50.663260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-013552d9-305e-4f6b-9c41-828ba166adf2 req-1952b99d-bf4f-4eff-a667-7ba16939ff58 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.667362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-013552d9-305e-4f6b-9c41-828ba166adf2 req-1952b99d-bf4f-4eff-a667-7ba16939ff58 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.693546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-013552d9-305e-4f6b-9c41-828ba166adf2 req-1952b99d-bf4f-4eff-a667-7ba16939ff58 service nova] Creating event network-vif-plugged:ff81edba-0eb2-4bbe-88bf-556e02c1bdaa for instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 on n-h1-764486-11 Jul 20 04:25:50.711766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-013552d9-305e-4f6b-9c41-828ba166adf2 req-1952b99d-bf4f-4eff-a667-7ba16939ff58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077663 Jul 20 04:25:50.714707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1509/2634] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:50.723131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-85a7468b-ca31-4082-a021-04c2d166cade req-639becdf-6e22-4512-8bff-a00dd972da54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c629e50b-7f00-4009-be8e-7f9e2e4a44e4", "tag": "ec964df8-77b9-411a-806e-1b65e0a7759e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:50.743764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-85a7468b-ca31-4082-a021-04c2d166cade req-639becdf-6e22-4512-8bff-a00dd972da54 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.744214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-85a7468b-ca31-4082-a021-04c2d166cade req-639becdf-6e22-4512-8bff-a00dd972da54 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.774088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-85a7468b-ca31-4082-a021-04c2d166cade req-639becdf-6e22-4512-8bff-a00dd972da54 service nova] Creating event network-changed:ec964df8-77b9-411a-806e-1b65e0a7759e for instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 on n-h2-764486-11 Jul 20 04:25:50.805184 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-85a7468b-ca31-4082-a021-04c2d166cade req-639becdf-6e22-4512-8bff-a00dd972da54 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088349 Jul 20 04:25:50.806410 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1510/2635] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:50.816880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:50.819187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:50.832607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.834244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:50.836844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:50.837918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:51.489043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:51.505126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e8bacf6-6ed9-409d-a70a-050d8293e1fd tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.696327 Jul 20 04:25:51.508016 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1511/2636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:50 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:51.523807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:51.525439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:51.541469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:51.542208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:51.545733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:51.547282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.301974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:52.326962 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e21233df-2175-470e-a3b9-e24a5ca94d9e tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1526 microversion: 2.1 time: 0.814820 Jul 20 04:25:52.336709 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1512/2637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:51 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1526 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:52.358371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.363813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:52.393955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.395949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.398339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.401821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.877626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:52.887659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed97ce17-6ec6-4f52-b04b-376b3cbb94a6 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.549723 Jul 20 04:25:52.893385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1513/2638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:52.904722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:52.911665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:52.926667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.929911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:52.931123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:52.931813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.339439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:53.351878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e892c7db-7a1a-406e-8ea6-53b8f39a128b tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1509 microversion: 2.1 time: 0.457390 Jul 20 04:25:53.354652 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1514/2639] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:52 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:53.377860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Action: 'update', calling method: >, body: {"server": {"name": "8cace797-fc15-4ee9-b9d2-66f5a0fc84e5_new"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:53.397516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:53.420518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.423799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.425136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.427276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.447607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] HTTP exception thrown: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Request method failure captured: Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 HTTP/1.1 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 64 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Os60qA4qNNl9ST9JhORGfOo3ATuY2y57a_VVgJVwEhhgTTaLKT4HrH24qGzpGGmlXZ3VYWTB9YBCVlQgRZZUt7zCELeHVaVawvCA79WrOLkzSwp1NIfVOFyvYaT3QoQvfuQDFflAft8iwZSgvCHby6z8Ym0fS-brTQSl3YoH9liTw Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2577aa43097a4585b9d7cd80bc21f70b Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1676991010 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2577aa43097a4585b9d7cd80bc21f70b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2577aa43097a4585b9d7cd80bc21f70b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2577aa43097a4585b9d7cd80bc21f70b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2577aa43097a4585b9d7cd80bc21f70b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1676991010 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2577aa43097a4585b9d7cd80bc21f70b Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1676991010 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1676991010-project Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: c27a1b9b6faf4c9fa64946fe2af62aa7 Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1676991010-project Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "8cace797-fc15-4ee9-b9d2-66f5a0fc84e5_new"}} Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8cace797-fc15-4ee9-b9d2-66f5a0fc84e5', 'body': {'server': {'name': '8cace797-fc15-4ee9-b9d2-66f5a0fc84e5_new'}}} Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:25:53.455086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:25:53.460588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:25:53.462760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] Returning 404 to user: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:25:53.463915 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d96ddd4c-1e23-45f4-b318-a1d955033c85 tempest-ServersNegativeTestMultiTenantJSON-1676991010 tempest-ServersNegativeTestMultiTenantJSON-1676991010-project] 10.222.0.49 "PUT /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 404 len: 111 microversion: 2.1 time: 0.107835 Jul 20 04:25:53.465184 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1515/2640] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:25:53 2022] PUT /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:25:53.471829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.473237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:53.482275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.494280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.496299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.497941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.901525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:53.916551 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a58c87b-554e-4611-b047-e303e1d2eab6 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.449413 Jul 20 04:25:53.917852 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1516/2641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:53.932798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:53.940707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:53.954713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.959408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:53.963404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:53.964475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.196045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:54.204991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b1a274f-6fd4-41c9-bb13-8af539167210 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1509 microversion: 2.1 time: 0.285820 Jul 20 04:25:54.217437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1517/2642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:53 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.227792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.228535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:54.249908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.250742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.251861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.253139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.313253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:25:54.413775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:54.505250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab4f93ef-01fe-4ad9-9fc0-bb9f8ed73f26 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 204 len: 0 microversion: 2.1 time: 0.285077 Jul 20 04:25:54.511841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1518/2643] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:25:54 2022] DELETE /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:25:54.547809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:54.553480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:54.566757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.567475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.568727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:54.569353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:54.834062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:54.852874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dffcea0c-7569-47cc-b681-22c30b992ff2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.331475 Jul 20 04:25:54.854034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1519/2644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:54 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:54.965372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=13 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:55.199760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fd55c30-39ae-488f-83d4-abf5fc376f9c tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Calling method '.version_select at 0x7f838aede0d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:55.308220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fd55c30-39ae-488f-83d4-abf5fc376f9c tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 371 microversion: 2.1 time: 0.452719 Jul 20 04:25:55.308951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1520/2645] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:25:54 2022] GET /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 371 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:55.314492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:55.316217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:55.325043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.325796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.326784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.327605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.419303 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba0509b4-2c06-4963-b412-c0a55a728fe4 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "PUT /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1081 microversion: 2.1 time: 0.108907 Jul 20 04:25:55.431942 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1521/2646] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:25:55 2022] PUT /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1081 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:55.438086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:55.438707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:55.453462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.453915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.454689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:55.455161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:55.761824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:55.771167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abdd948d-12bf-4c1b-835c-237901225466 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1532 microversion: 2.1 time: 0.338060 Jul 20 04:25:55.774741 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1522/2647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:55 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1532 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:55.779101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-904335452", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "065122ff-a446-449e-a7f2-08cafb33be03"}], "security_groups": [{"name": "tempest-securitygroup--1404828822"}], "key_name": "tempest-keypair-1016710672", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e8b0fbfa-4282-45b1-ade9-f16a54e11042", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:56.004524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] validate_networks() for [('065122ff-a446-449e-a7f2-08cafb33be03', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:25:57.190433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Getting quotas for project 0e2aa7fa46ea48d4a3f2101ab14e95b6. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:57.215009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Getting quotas for user 34cea7f926ea42e0afdf38dd49a07647 and project 0e2aa7fa46ea48d4a3f2101ab14e95b6. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:57.265292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:25:57.278122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:25:57.278822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:25:57.279407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:25:57.280199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:25:57.297266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.300368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.301594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.302377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.326274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Getting quotas for project 0e2aa7fa46ea48d4a3f2101ab14e95b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:25:57.332253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Getting quotas for user 34cea7f926ea42e0afdf38dd49a07647 and project 0e2aa7fa46ea48d4a3f2101ab14e95b6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:25:57.412073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:25:57.414891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8b0fbfa-4282-45b1-ade9-f16a54e11042',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:25:57.654880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b447e799-9766-4faa-a619-d184b3d990b2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.881294 Jul 20 04:25:57.656277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1523/2648] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:25:57.665979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:57.667058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:57.676809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.677399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.678283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:57.679037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:57.942095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:57.957821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad79e76c-976d-4ffe-a418-5408208fc3a2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.300382 Jul 20 04:25:57.963213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1524/2649] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:57 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:57.968060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c7ad657-3610-4e23-8921-7309ec9c6847 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Action: 'update', calling method: .version_select at 0x7f838aef6b80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:25:58.448969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c7ad657-3610-4e23-8921-7309ec9c6847 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.450119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c7ad657-3610-4e23-8921-7309ec9c6847 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.451135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c7ad657-3610-4e23-8921-7309ec9c6847 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.451582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c7ad657-3610-4e23-8921-7309ec9c6847 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.472472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:25:58.536389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c7ad657-3610-4e23-8921-7309ec9c6847 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 328 microversion: 2.1 time: 0.572008 Jul 20 04:25:58.537601 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1525/2650] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:25:57 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 328 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:25:58.542715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:58.543394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:58.550797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.551587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.552877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.553529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.751554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:58.761779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-423e3e49-b5f2-4582-96ff-4387e55daf57 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1507 microversion: 2.1 time: 0.223049 Jul 20 04:25:58.772944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1526/2651] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:58 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:58.777110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:58.777798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:58.785125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.785582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:58.788110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:58.788626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.028084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.037473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2f011a1-e22f-4647-afbd-317f8b972f9a tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.273364 Jul 20 04:25:59.038066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1527/2652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:58 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.046940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.056010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:59.066603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.067066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.067859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.068581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.279795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b785bb011d542f2924363cb469c75b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6f7fc55ad48e8bf1059cddbd8cda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.295203 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0717af2c-4d86-46eb-b0d8-a7e4f8b5021b tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 200 len: 1532 microversion: 2.1 time: 0.251867 Jul 20 04:25:59.300108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1528/2653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 1532 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.321943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:25:59.322588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:25:59.337292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.342814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.343946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:25:59.344771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:25:59.535705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:25:59.549316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b8193e2-44f7-482d-b662-2c6227d49ff7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1237 microversion: 2.1 time: 0.246527 Jul 20 04:25:59.552949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1529/2654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:25:59 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1237 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:25:59.954406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-915345671", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:00.046564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:00.763744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:00.766203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:00.767431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:00.769585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:00.771646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:00.797529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.800679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.803291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.804008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.832885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Getting quotas for project a2f91064e6fc4b1e91a44e70ad42b393. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:00.839530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Getting quotas for user cb2a9c4fd4af4420a527a29cf88f8e93 and project a2f91064e6fc4b1e91a44e70ad42b393. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:00.860106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.utils [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] cores quota exceeded for a2f91064e6fc4b1e91a44e70ad42b393, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:26:00.863411 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Request method failure captured: Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 144 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14PQoM-0dgA8b_shp2aRhGA7jDBgWUcg7ENngohFMf2SpL3PgdPojJI44mimNqbjB0kBF6C51rOArWvxamJoOuG0nM6PJYV9Y46FPm5EZMOzlGO_aRDvxxC7E4LGDsoUPXKGhh42QgXAoT1f0VPHVkM7ZTB7une-zji6wC-U_C4t5do Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2f91064e6fc4b1e91a44e70ad42b393", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cb2a9c4fd4af4420a527a29cf88f8e93 Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-915345671", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-915345671', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452'}}} Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:26:00.889107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 04:26:00.896489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:00.904019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:00.905172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7993639-0a1c-46c5-8c8a-2ece56a4601e tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.350984 Jul 20 04:26:00.911049 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1530/2655] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:25:59 2022] POST /compute/v2.1/servers => generated 111 bytes in 1357 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:00.918132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:00.919226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:00.928845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.929642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:00.930708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:00.931538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.429866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.444608 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3016b2a4-4f07-4ad0-bbe6-a18a17a5b131 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1507 microversion: 2.1 time: 0.529450 Jul 20 04:26:01.466671 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1531/2656] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:00 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.471820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:01.481468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:01.497795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.504689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.505940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.506528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.874975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:01.885159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4c2e7be-b471-411f-9885-a05508ed0e90 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.417107 Jul 20 04:26:01.898097 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1532/2657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:01.902610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-690079d7-86ef-43f0-9191-3a4e1695b894 req-ed568c82-fcfb-4778-9223-7286efd29e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cace797-fc15-4ee9-b9d2-66f5a0fc84e5", "name": "network-vif-deleted", "tag": "6a20e7c2-b9ee-4031-834a-9b24dd7a3061"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:01.920233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-690079d7-86ef-43f0-9191-3a4e1695b894 req-ed568c82-fcfb-4778-9223-7286efd29e94 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:01.920607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-690079d7-86ef-43f0-9191-3a4e1695b894 req-ed568c82-fcfb-4778-9223-7286efd29e94 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:01.941889 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-690079d7-86ef-43f0-9191-3a4e1695b894 req-ed568c82-fcfb-4778-9223-7286efd29e94 service nova] Creating event network-vif-deleted:6a20e7c2-b9ee-4031-834a-9b24dd7a3061 for instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 on n-h2-764486-11 Jul 20 04:26:01.972571 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-690079d7-86ef-43f0-9191-3a4e1695b894 req-ed568c82-fcfb-4778-9223-7286efd29e94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076868 Jul 20 04:26:01.974783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1533/2658] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:01.999817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.000560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.028171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.028562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.031140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.031592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.774722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:02.789420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a129dec-a1bf-4358-8171-66e28aa406f4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.813082 Jul 20 04:26:02.792589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1534/2659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:01 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:02.797496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.805904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] [instance: 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.817398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.817853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.818890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.819325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.856715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] HTTP exception thrown: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Request method failure captured: Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 HTTP/1.1 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OZf5MASeb1V9oUMW1zvw09aHghtEgFpRmD_Q41qml58-4dZVbyszA54g79grbrU5LCYjyvBk9mV3gNIeThRerSeGbz-xNIiM_ph-tAd00bhXR1E_Z-XlN032c5Q4JuvwDZv89pHHxNGr013tSHFcxx13fnuaUQCp9tijVRvE66qhQ Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c3f6f7fc55ad48e8bf1059cddbd8cda3 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-76874578 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c3f6f7fc55ad48e8bf1059cddbd8cda3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3f6f7fc55ad48e8bf1059cddbd8cda3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c3f6f7fc55ad48e8bf1059cddbd8cda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c3f6f7fc55ad48e8bf1059cddbd8cda3", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-76874578 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c3f6f7fc55ad48e8bf1059cddbd8cda3 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-76874578 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-76874578-project Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5b785bb011d542f2924363cb469c75b6 Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-76874578-project Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8cace797-fc15-4ee9-b9d2-66f5a0fc84e5'} Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.858719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] Returning 404 to user: Instance 8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:02.863912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07d2c092-5e1b-4744-a223-93cc6ea7baf3 tempest-ServersNegativeTestMultiTenantJSON-76874578 tempest-ServersNegativeTestMultiTenantJSON-76874578-project] 10.222.0.49 "GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5" status: 404 len: 111 microversion: 2.1 time: 0.068125 Jul 20 04:26:02.864882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1535/2660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/servers/8cace797-fc15-4ee9-b9d2-66f5a0fc84e5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:02.873554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:02.875455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:02.882546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.883076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:02.884186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:02.884766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.232745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:03.250982 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bb2c374-44fa-4b4b-9f44-f2335911ac9a tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1305 microversion: 2.1 time: 0.376241 Jul 20 04:26:03.252596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1536/2661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:02 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1305 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.265692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed70b41f-563b-42e6-b3c5-93f2d109404e tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Action: 'update', calling method: .version_select at 0x7f838aec3550>, body: {"quota_set": {"cores": 20}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:03.566799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed70b41f-563b-42e6-b3c5-93f2d109404e tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.567420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed70b41f-563b-42e6-b3c5-93f2d109404e tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.569621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed70b41f-563b-42e6-b3c5-93f2d109404e tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.571079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed70b41f-563b-42e6-b3c5-93f2d109404e tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.715829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed70b41f-563b-42e6-b3c5-93f2d109404e tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 329 microversion: 2.1 time: 0.461987 Jul 20 04:26:03.716444 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1537/2662] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:26:03 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 329 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:03.725653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:03.726837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:03.745620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.746069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.746854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.747722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.888956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:03.917597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec5018f4-8c65-4173-ad89-296e0419b9be tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "PUT /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1083 microversion: 2.1 time: 0.199936 Jul 20 04:26:03.921402 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1538/2663] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:26:03 2022] PUT /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1083 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:03.937097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:03.938092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:03.956149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.957511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:03.958358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:03.958794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:04.387683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:04.403719 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15925762-60dc-4380-885e-00a42c6ba4a3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.475780 Jul 20 04:26:04.404639 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1539/2664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:03 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:04.420696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e410b7e-f7f1-4fc8-a66e-5336d60acaca tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Calling method '.version_select at 0x7f838b044f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.063889 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e410b7e-f7f1-4fc8-a66e-5336d60acaca tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 371 microversion: 2.1 time: 0.656511 Jul 20 04:26:05.066277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1540/2665] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:26:04 2022] GET /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 371 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:05.075194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.077047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:05.087248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.088396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.089854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.092796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.414284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:05.429296 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba196397-9b76-4dd2-bd1a-a59c23203019 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.360491 Jul 20 04:26:05.430097 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1541/2666] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:05.445443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:05.451008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:05.470415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.471855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:05.472918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:05.473691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.016966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:06.036298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-969d2fe3-f4f8-4b2d-b00a-6d07e6b8a342 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1509 microversion: 2.1 time: 0.593834 Jul 20 04:26:06.037572 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1542/2667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:05 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1509 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:06.053879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ed38f465-59f4-4200-aa88-6657cbcf0e6d req-3ccc1b8d-a15b-4ac5-8491-85f2e7ad279f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0fde32-fb30-42e1-8f26-b6344000a6d9", "tag": "3b31a8aa-bdc3-47c7-a5c7-534e600398cb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:06.063775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed38f465-59f4-4200-aa88-6657cbcf0e6d req-3ccc1b8d-a15b-4ac5-8491-85f2e7ad279f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.064594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed38f465-59f4-4200-aa88-6657cbcf0e6d req-3ccc1b8d-a15b-4ac5-8491-85f2e7ad279f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.082241 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ed38f465-59f4-4200-aa88-6657cbcf0e6d req-3ccc1b8d-a15b-4ac5-8491-85f2e7ad279f service nova] Creating event network-changed:3b31a8aa-bdc3-47c7-a5c7-534e600398cb for instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 on n-h1-764486-11 Jul 20 04:26:06.093617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ed38f465-59f4-4200-aa88-6657cbcf0e6d req-3ccc1b8d-a15b-4ac5-8491-85f2e7ad279f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043659 Jul 20 04:26:06.094574 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1543/2668] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:06.127487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:06.128892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:06.146872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.147700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:06.151549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:06.152476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.055091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:07.070665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c82d1f92-a18b-4206-a8fd-7a766f3eee82 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1305 microversion: 2.1 time: 0.961332 Jul 20 04:26:07.080433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1544/2669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:06 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1305 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:07.088274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c080d5e6-e88b-4816-9143-552cf78722c1 req-9f8017cf-3ce9-42ab-afd0-f07040b373db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c629e50b-7f00-4009-be8e-7f9e2e4a44e4", "name": "network-vif-plugged", "status": "completed", "tag": "ec964df8-77b9-411a-806e-1b65e0a7759e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:07.097975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c080d5e6-e88b-4816-9143-552cf78722c1 req-9f8017cf-3ce9-42ab-afd0-f07040b373db service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.098429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c080d5e6-e88b-4816-9143-552cf78722c1 req-9f8017cf-3ce9-42ab-afd0-f07040b373db service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.122452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c080d5e6-e88b-4816-9143-552cf78722c1 req-9f8017cf-3ce9-42ab-afd0-f07040b373db service nova] Creating event network-vif-plugged:ec964df8-77b9-411a-806e-1b65e0a7759e for instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 on n-h2-764486-11 Jul 20 04:26:07.132430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c080d5e6-e88b-4816-9143-552cf78722c1 req-9f8017cf-3ce9-42ab-afd0-f07040b373db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048927 Jul 20 04:26:07.134389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1545/2670] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:07.151487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d0ffe91-69f2-492c-abcb-1bdb09952b4d tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Action: 'update', calling method: .version_select at 0x7f838ae901f0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:07.582053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe91-69f2-492c-abcb-1bdb09952b4d tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.583851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe91-69f2-492c-abcb-1bdb09952b4d tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.587739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe91-69f2-492c-abcb-1bdb09952b4d tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.588443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe91-69f2-492c-abcb-1bdb09952b4d tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.734550 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d0ffe91-69f2-492c-abcb-1bdb09952b4d tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 328 microversion: 2.1 time: 0.596577 Jul 20 04:26:07.746438 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1546/2671] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:26:07 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:07.753649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:07.754385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:07.769757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.770294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:07.774530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:07.775867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:08.049026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:08.062642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-98cd4e0f-f18a-403c-8eec-e1c70c9ed215 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.310134 Jul 20 04:26:08.063949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1547/2672] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:07 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:08.073286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:08.087958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:08.110172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:08.110798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:08.114635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:08.131775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:08.720425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:08.740134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37a0a998-4519-4952-a331-8376723e8dff tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1509 microversion: 2.1 time: 0.674196 Jul 20 04:26:08.743093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1548/2673] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:08 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1509 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:08.753259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:08.754054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:08.784806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:08.785492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:08.786434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:08.787017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.083085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:09.094970 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f419a455-68ec-4abf-9472-932808301e14 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1370 microversion: 2.1 time: 0.349364 Jul 20 04:26:09.105753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1549/2674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:08 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:09.115398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1367682084", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:09.213104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:09.828198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:09.828750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:09.829385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:09.829803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:09.831164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:09.863479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.864627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.865516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.866035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.879654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:09.888725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Getting quotas for project a2f91064e6fc4b1e91a44e70ad42b393. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:09.898480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Getting quotas for user cb2a9c4fd4af4420a527a29cf88f8e93 and project a2f91064e6fc4b1e91a44e70ad42b393. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:09.920551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.utils [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] instances quota exceeded for a2f91064e6fc4b1e91a44e70ad42b393, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:26:09.921556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Request method failure captured: Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 145 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14PQoM-0dgA8b_shp2aRhGA7jDBgWUcg7ENngohFMf2SpL3PgdPojJI44mimNqbjB0kBF6C51rOArWvxamJoOuG0nM6PJYV9Y46FPm5EZMOzlGO_aRDvxxC7E4LGDsoUPXKGhh42QgXAoT1f0VPHVkM7ZTB7une-zji6wC-U_C4t5do Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2f91064e6fc4b1e91a44e70ad42b393", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cb2a9c4fd4af4420a527a29cf88f8e93 Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1367682084", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1367682084', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452'}}} Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:26:09.925685 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 04:26:09.930057 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:09.934537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:09.935999 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edb1ed55-7cae-43a0-9c55-9d4ab4e25b9c tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.828552 Jul 20 04:26:09.936836 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1550/2675] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:09 2022] POST /compute/v2.1/servers => generated 119 bytes in 830 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:09.947178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:09.948179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:09.957536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.958827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:09.960798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:09.961629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.306971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:10.316336 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0371861-66e0-4afa-a71c-d8afc3d96bcc tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.374011 Jul 20 04:26:10.317050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1551/2676] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:09 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:10.328719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:10.329231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:10.336759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.337391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.338359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.339082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.382538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:10.490805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a711127-4c9e-448d-a280-9b2de2eee48c tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 204 len: 0 microversion: 2.1 time: 0.170003 Jul 20 04:26:10.497745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1552/2677] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:10 2022] DELETE /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:10.515873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:10.518061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:10.526531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.527369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.528605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:10.529537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:10.787840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:10.796792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-814efc66-2213-488e-82fc-685c5239498b tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.296666 Jul 20 04:26:10.798322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1553/2678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:10 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:10.813795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27244262-2864-40c7-ac92-484ac054ffbe tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Action: 'update', calling method: .version_select at 0x7f838b2319d0>, body: {"quota_set": {"instances": 10}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:11.047811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27244262-2864-40c7-ac92-484ac054ffbe tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.048645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27244262-2864-40c7-ac92-484ac054ffbe tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.049855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27244262-2864-40c7-ac92-484ac054ffbe tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.050364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27244262-2864-40c7-ac92-484ac054ffbe tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.133594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27244262-2864-40c7-ac92-484ac054ffbe tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 329 microversion: 2.1 time: 0.333032 Jul 20 04:26:11.135970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1554/2679] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:26:10 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 329 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:11.146497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.147652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:11.160027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.161341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.162318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.162914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.381422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:11.393913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25852a52-826d-44a3-9af4-0ae1dfcdfee2 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1556 microversion: 2.1 time: 0.255225 Jul 20 04:26:11.395031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1555/2680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:11 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:11.429816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.431017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:11.441789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.442620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.443872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.444898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.482220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:11.627277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:11.628842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Instance is already in deleting state, ignoring this request Jul 20 04:26:11.633657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3dffe270-cddf-48d7-8a28-becad8fd7084 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 204 len: 0 microversion: 2.1 time: 0.209235 Jul 20 04:26:11.638845 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1556/2681] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:11 2022] DELETE /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:11.646193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9febce91-8951-4216-96c8-5dd055110993 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Calling method '.version_select at 0x7f838bbc1310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.824579 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9febce91-8951-4216-96c8-5dd055110993 tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 371 microversion: 2.1 time: 0.180371 Jul 20 04:26:11.825224 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1557/2682] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:26:11 2022] GET /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:11.837930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:11.838311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:11.858235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.858616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:11.863296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:11.863296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.140729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:12.164419 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cfeeaf8b-5c36-41ef-9ea8-27a95858154d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.338027 Jul 20 04:26:12.174039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1558/2683] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:11 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:12.196340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:12.196886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:12.216508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.217184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.218173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.218771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.488398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c45bd19c-d6f4-4d8c-9715-a7f9068ef4ec tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.299848 Jul 20 04:26:12.489366 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1559/2684] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:26:12 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-interface => generated 285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:12.496052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:12.496715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:12.519931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.522522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:12.525253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:12.525718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.265254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6889981a862845ba8f1817d605db27db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79c01dad88a044848fde724f2e610051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.275708 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55895884-efb6-40dd-9308-b301b841609e tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 200 len: 1515 microversion: 2.1 time: 1.783360 Jul 20 04:26:14.277344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1560/2685] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:12 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 1515 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:14.289045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:14.296804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:14.311600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.312183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.313051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.313498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.748176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:14.755163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0650238-d013-4a7b-bd26-c8fa2e7cc7ae tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1486 microversion: 2.1 time: 0.476715 Jul 20 04:26:14.755755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1561/2686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:14 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1486 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:14.764999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8aa4dab8-91b5-433d-b5ed-38ff1a9c14de tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Action: 'update', calling method: .version_select at 0x7f838b2311f0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:14.872997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aa4dab8-91b5-433d-b5ed-38ff1a9c14de tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.873444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aa4dab8-91b5-433d-b5ed-38ff1a9c14de tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.874259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aa4dab8-91b5-433d-b5ed-38ff1a9c14de tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:14.874692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aa4dab8-91b5-433d-b5ed-38ff1a9c14de tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:14.993487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8aa4dab8-91b5-433d-b5ed-38ff1a9c14de tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 325 microversion: 2.1 time: 0.236474 Jul 20 04:26:14.994162 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1562/2687] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:26:14 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:15.000227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:15.000832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.013591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.014051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.016483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.018648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.610089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:15.623048 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40d6c843-c88f-4306-a6a4-4328839d92ca tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.626786 Jul 20 04:26:15.624070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1563/2688] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:14 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:15.633208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-28502c08-bc7a-4550-bbf7-14bc7df82874 req-07b46d01-dfb0-4992-9b84-aa914d704ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96495c4e-74d8-43c0-8063-6ca98a7debf9", "name": "network-vif-deleted", "tag": "ff81edba-0eb2-4bbe-88bf-556e02c1bdaa"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:15.655613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-28502c08-bc7a-4550-bbf7-14bc7df82874 req-07b46d01-dfb0-4992-9b84-aa914d704ed4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.656075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-28502c08-bc7a-4550-bbf7-14bc7df82874 req-07b46d01-dfb0-4992-9b84-aa914d704ed4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.670152 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-28502c08-bc7a-4550-bbf7-14bc7df82874 req-07b46d01-dfb0-4992-9b84-aa914d704ed4 service nova] Creating event network-vif-deleted:ff81edba-0eb2-4bbe-88bf-556e02c1bdaa for instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 on n-h1-764486-11 Jul 20 04:26:15.679619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-28502c08-bc7a-4550-bbf7-14bc7df82874 req-07b46d01-dfb0-4992-9b84-aa914d704ed4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054263 Jul 20 04:26:15.680231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1564/2689] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:15.692180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:15.695097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:15.709578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.710040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.716458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:15.717301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:15.881685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f14d83b8-8982-4549-8e67-e1d250238ed1 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "POST /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65/action" status: 202 len: 0 microversion: 2.1 time: 0.197857 Jul 20 04:26:15.883035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1565/2690] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:15 2022] POST /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:26:15.908859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-162560258", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:16.013804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:16.602949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:16.603651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:16.604232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:16.604761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:16.605429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:16.642302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=69 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:16.647862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.652233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.654798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.656451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.728841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Getting quotas for project a2f91064e6fc4b1e91a44e70ad42b393. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:16.738689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Getting quotas for user cb2a9c4fd4af4420a527a29cf88f8e93 and project a2f91064e6fc4b1e91a44e70ad42b393. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:16.770366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.utils [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] ram quota exceeded for a2f91064e6fc4b1e91a44e70ad42b393, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=123724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 04:26:16.771172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Request method failure captured: Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 144 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14PQoM-0dgA8b_shp2aRhGA7jDBgWUcg7ENngohFMf2SpL3PgdPojJI44mimNqbjB0kBF6C51rOArWvxamJoOuG0nM6PJYV9Y46FPm5EZMOzlGO_aRDvxxC7E4LGDsoUPXKGhh42QgXAoT1f0VPHVkM7ZTB7une-zji6wC-U_C4t5do Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2f91064e6fc4b1e91a44e70ad42b393", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cb2a9c4fd4af4420a527a29cf88f8e93 Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-162560258", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-162560258', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452'}}} Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:26:16.781127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 04:26:16.785819 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.789557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:16.790626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75b0352a-bafa-4822-849e-22cce888bbe3 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.906186 Jul 20 04:26:16.791398 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1566/2691] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:15 2022] POST /compute/v2.1/servers => generated 110 bytes in 908 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:16.802593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.803590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 96495c4e-74d8-43c0-8063-6ca98a7debf9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:16.821448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.822199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.824699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.826194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.856598 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] HTTP exception thrown: Instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 could not be found. Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Request method failure captured: Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 HTTP/1.1 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MiGh9x94FURVm3S16IGpj4KNnakU1if0OoY45U74gVWYwbhXurKgn9Ia1ugYFze0M1Q0kyOKxtMqw12r_FxbSgoOt8XD0uiwMh6yNohBKf_KMj32zPaU1qDv2yTGJAXpOio0q40-wBBjYLV7WsRNaN1eJKGWg34baosmPKo4-wfFw Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79c01dad88a044848fde724f2e610051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79c01dad88a044848fde724f2e610051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6889981a862845ba8f1817d605db27db Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 could not be found. Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '96495c4e-74d8-43c0-8063-6ca98a7debf9'} Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 could not be found. Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 could not be found. Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:16.858180 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 could not be found. Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Returning 404 to user: Instance 96495c4e-74d8-43c0-8063-6ca98a7debf9 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77852f42-3f5b-47af-a427-cc97cee63dcd tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9" status: 404 len: 111 microversion: 2.1 time: 0.064396 Jul 20 04:26:16.863464 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1567/2692] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/servers/96495c4e-74d8-43c0-8063-6ca98a7debf9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:16.882538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:16.883492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:16.890151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.890610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:16.891578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:16.892016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.191413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:17.205557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d13e3c52-3431-45a7-867c-6eeedfa3c7a5 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1494 microversion: 2.1 time: 0.344229 Jul 20 04:26:17.206863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1568/2693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:16 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1494 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:17.338584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3c57106c-ac6a-44d8-8426-2113139e1baf req-1ea6d850-04fc-4bcb-a906-99b6282f3fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c629e50b-7f00-4009-be8e-7f9e2e4a44e4", "tag": "ec964df8-77b9-411a-806e-1b65e0a7759e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:17.350919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3c57106c-ac6a-44d8-8426-2113139e1baf req-1ea6d850-04fc-4bcb-a906-99b6282f3fee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.351368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3c57106c-ac6a-44d8-8426-2113139e1baf req-1ea6d850-04fc-4bcb-a906-99b6282f3fee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.376218 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3c57106c-ac6a-44d8-8426-2113139e1baf req-1ea6d850-04fc-4bcb-a906-99b6282f3fee service nova] Creating event network-changed:ec964df8-77b9-411a-806e-1b65e0a7759e for instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 on n-h2-764486-11 Jul 20 04:26:17.391613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3c57106c-ac6a-44d8-8426-2113139e1baf req-1ea6d850-04fc-4bcb-a906-99b6282f3fee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181764 Jul 20 04:26:17.392276 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1569/2694] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:17.406902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.407872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:17.420875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.421321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.422112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.427630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.657350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:17.671145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-644f6f46-4450-434b-ac08-52becacb20b5 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.274820 Jul 20 04:26:17.675647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1570/2695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:17 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:17.687118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3b1801b-1634-4fce-ab08-efd9545856aa tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Action: 'update', calling method: .version_select at 0x7f838af19040>, body: {"quota_set": {"ram": 51200}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:17.841681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3b1801b-1634-4fce-ab08-efd9545856aa tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.842091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3b1801b-1634-4fce-ab08-efd9545856aa tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.845884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3b1801b-1634-4fce-ab08-efd9545856aa tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:17.846523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3b1801b-1634-4fce-ab08-efd9545856aa tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:17.901359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:17.969049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3b1801b-1634-4fce-ab08-efd9545856aa tempest-QuotasAdminNegativeTest-2050106425 tempest-QuotasAdminNegativeTest-2050106425-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 200 len: 329 microversion: 2.1 time: 0.292044 Jul 20 04:26:17.985537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1571/2696] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:26:17 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 329 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:17.994252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:17.994953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.005578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.010316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.015782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.015782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.047701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] HTTP exception thrown: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Request method failure captured: Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c HTTP/1.1 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MiGh9x94FURVm3S16IGpj4KNnakU1if0OoY45U74gVWYwbhXurKgn9Ia1ugYFze0M1Q0kyOKxtMqw12r_FxbSgoOt8XD0uiwMh6yNohBKf_KMj32zPaU1qDv2yTGJAXpOio0q40-wBBjYLV7WsRNaN1eJKGWg34baosmPKo4-wfFw Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79c01dad88a044848fde724f2e610051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79c01dad88a044848fde724f2e610051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6889981a862845ba8f1817d605db27db Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c'} Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:18.053669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.058151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.059140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Returning 404 to user: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:18.062749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9aaa37d-0097-4d1e-8124-54038d913964 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 404 len: 111 microversion: 2.1 time: 0.080023 Jul 20 04:26:18.062749 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1572/2697] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:17 2022] DELETE /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:18.076917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17995378-83e6-4f40-b42c-842925c61323 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Action: 'update', calling method: .version_select at 0x7f838b111430>, body: {"quota_set": {"ram": 0}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:18.084091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-17995378-83e6-4f40-b42c-842925c61323 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'cb2a9c4fd4af4420a527a29cf88f8e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f91064e6fc4b1e91a44e70ad42b393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17995378-83e6-4f40-b42c-842925c61323 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Request method failure captured: Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 HTTP/1.1 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 25 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14PQoM-0dgA8b_shp2aRhGA7jDBgWUcg7ENngohFMf2SpL3PgdPojJI44mimNqbjB0kBF6C51rOArWvxamJoOuG0nM6PJYV9Y46FPm5EZMOzlGO_aRDvxxC7E4LGDsoUPXKGhh42QgXAoT1f0VPHVkM7ZTB7une-zji6wC-U_C4t5do Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2f91064e6fc4b1e91a44e70ad42b393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2f91064e6fc4b1e91a44e70ad42b393", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2f91064e6fc4b1e91a44e70ad42b393 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1217992220 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cb2a9c4fd4af4420a527a29cf88f8e93 Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-QuotasAdminNegativeTest-1217992220-project Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: {"quota_set": {"ram": 0}} Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a2f91064e6fc4b1e91a44e70ad42b393', 'body': {'quota_set': {'ram': 0}}} Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:26:18.104461 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 04:26:18.108210 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.112866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17995378-83e6-4f40-b42c-842925c61323 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:18.113742 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17995378-83e6-4f40-b42c-842925c61323 tempest-QuotasAdminNegativeTest-1217992220 tempest-QuotasAdminNegativeTest-1217992220-project] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393" status: 403 len: 116 microversion: 2.1 time: 0.050799 Jul 20 04:26:18.118595 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1573/2698] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:26:18 2022] PUT /compute/v2.1/os-quota-sets/a2f91064e6fc4b1e91a44e70ad42b393 => generated 116 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:18.122746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:18.123376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.145290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.154184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.155283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.155882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.189017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] HTTP exception thrown: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Request method failure captured: Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c HTTP/1.1 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MiGh9x94FURVm3S16IGpj4KNnakU1if0OoY45U74gVWYwbhXurKgn9Ia1ugYFze0M1Q0kyOKxtMqw12r_FxbSgoOt8XD0uiwMh6yNohBKf_KMj32zPaU1qDv2yTGJAXpOio0q40-wBBjYLV7WsRNaN1eJKGWg34baosmPKo4-wfFw Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79c01dad88a044848fde724f2e610051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79c01dad88a044848fde724f2e610051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6889981a862845ba8f1817d605db27db Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c'} Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.191398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. Jul 20 04:26:18.196130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.202199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Returning 404 to user: Instance 4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:18.203360 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f0ddec9-9fb3-46e9-ad7f-05291f406b18 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c" status: 404 len: 111 microversion: 2.1 time: 0.087981 Jul 20 04:26:18.207939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1574/2699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:18 2022] GET /compute/v2.1/servers/4f6b9f87-8a8e-4c45-bb8e-a96d2c28704c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:18.215483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:18.219699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.231806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.237106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.239175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.240913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.279773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] HTTP exception thrown: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Request method failure captured: Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 HTTP/1.1 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MiGh9x94FURVm3S16IGpj4KNnakU1if0OoY45U74gVWYwbhXurKgn9Ia1ugYFze0M1Q0kyOKxtMqw12r_FxbSgoOt8XD0uiwMh6yNohBKf_KMj32zPaU1qDv2yTGJAXpOio0q40-wBBjYLV7WsRNaN1eJKGWg34baosmPKo4-wfFw Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79c01dad88a044848fde724f2e610051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79c01dad88a044848fde724f2e610051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6889981a862845ba8f1817d605db27db Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'abe55fb2-74aa-4293-b7f3-dcac8e43c130'} Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:18.286600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.290899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Returning 404 to user: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:18.293758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5fbe1263-f5b7-4c9f-be48-a75c38478bf6 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "DELETE /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 404 len: 111 microversion: 2.1 time: 0.082428 Jul 20 04:26:18.297438 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1575/2700] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:18 2022] DELETE /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:18.302930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:18.303658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.311491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.317787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.321588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.321588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.665915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:18.676380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b66cdd8-8cb3-4fe6-a2d8-6edce300ec9e tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1494 microversion: 2.1 time: 0.380378 Jul 20 04:26:18.682134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1576/2701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:18 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1494 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:18.688886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:18.711823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] [instance: abe55fb2-74aa-4293-b7f3-dcac8e43c130] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.720565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.721695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.722501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.722981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.773534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] HTTP exception thrown: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Request method failure captured: Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 HTTP/1.1 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14MiGh9x94FURVm3S16IGpj4KNnakU1if0OoY45U74gVWYwbhXurKgn9Ia1ugYFze0M1Q0kyOKxtMqw12r_FxbSgoOt8XD0uiwMh6yNohBKf_KMj32zPaU1qDv2yTGJAXpOio0q40-wBBjYLV7WsRNaN1eJKGWg34baosmPKo4-wfFw Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/79c01dad88a044848fde724f2e610051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/79c01dad88a044848fde724f2e610051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_79c01dad88a044848fde724f2e610051", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 79c01dad88a044848fde724f2e610051 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1351648514 Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 6889981a862845ba8f1817d605db27db Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-1351648514-project Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'abe55fb2-74aa-4293-b7f3-dcac8e43c130'} Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:18.779267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. Jul 20 04:26:18.784874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:18.785423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] Returning 404 to user: Instance abe55fb2-74aa-4293-b7f3-dcac8e43c130 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:18.786491 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d56f673c-0b61-40fe-b558-a0f8630e6545 tempest-ServerDiskConfigTestJSON-1351648514 tempest-ServerDiskConfigTestJSON-1351648514-project] 10.222.0.49 "GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130" status: 404 len: 111 microversion: 2.1 time: 0.102954 Jul 20 04:26:18.789497 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1577/2702] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:18 2022] GET /compute/v2.1/servers/abe55fb2-74aa-4293-b7f3-dcac8e43c130 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:18.796271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:18.797192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:18.829038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.834371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:18.838639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:18.839373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.297168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:19.311642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7232cd52-a556-4e1e-9a67-a2e65f66e8fd tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.520712 Jul 20 04:26:19.315559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1578/2703] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:18 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:19.698229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:19.699583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:19.711244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:19.713706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.715469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:19.717185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:19.956693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:19.966489 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9b04e45-294f-4571-878b-62fadca57c5a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1500 microversion: 2.1 time: 0.273179 Jul 20 04:26:19.967072 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1579/2704] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:19 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:19.990141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:19.991283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:20.004117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.004627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.005406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.009196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.059078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:20.099615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:20.227373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86d4e93f-e5a1-4220-b509-9aa5b59fa9d2 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 204 len: 0 microversion: 2.1 time: 0.240892 Jul 20 04:26:20.228716 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1580/2705] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:19 2022] DELETE /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:20.239649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:20.240724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:20.259605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.264013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.270768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.271844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.550628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:20.563663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52c578a6-0676-47f6-8b15-7a81db7c0a47 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.329465 Jul 20 04:26:20.564395 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1581/2706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:20 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:20.571753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:20.572578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:20.582264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.583026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:20.584040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:20.586521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:21.321016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:21.330177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb14d485-b150-434f-95df-73fe7d1fd4d2 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.763787 Jul 20 04:26:21.333268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1582/2707] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:20 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:21.345795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-90b1bc0e-a966-4354-a488-251de36a65e3 req-a558f7a5-cb0f-40a5-bed6-a8b06f211dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0fde32-fb30-42e1-8f26-b6344000a6d9", "name": "network-vif-plugged", "status": "completed", "tag": "3b31a8aa-bdc3-47c7-a5c7-534e600398cb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:21.373561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-90b1bc0e-a966-4354-a488-251de36a65e3 req-a558f7a5-cb0f-40a5-bed6-a8b06f211dcf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:21.384515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-90b1bc0e-a966-4354-a488-251de36a65e3 req-a558f7a5-cb0f-40a5-bed6-a8b06f211dcf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:21.406748 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-90b1bc0e-a966-4354-a488-251de36a65e3 req-a558f7a5-cb0f-40a5-bed6-a8b06f211dcf service nova] Creating event network-vif-plugged:3b31a8aa-bdc3-47c7-a5c7-534e600398cb for instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 on n-h1-764486-11 Jul 20 04:26:21.414333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-90b1bc0e-a966-4354-a488-251de36a65e3 req-a558f7a5-cb0f-40a5-bed6-a8b06f211dcf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079578 Jul 20 04:26:21.414876 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1583/2708] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:21.584295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:21.585299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:21.608870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:21.609693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:21.610733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:21.611391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:21.863468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:21.879662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b5e10b8-3ac2-4eef-9e8c-6b8413c698de tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.301195 Jul 20 04:26:21.880774 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1584/2709] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:21 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:22.352140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:22.353604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:22.365847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:22.372673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:22.374086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:22.376483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:22.663709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:22.680166 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4659cb53-d460-4908-8012-cf1ed011a800 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.333404 Jul 20 04:26:22.682418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1585/2710] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:22 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:22.899263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:22.900139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:22.925990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:22.928532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:22.929918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:22.930525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:23.190272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:23.202905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b9f9209-6569-4b46-b5b8-c7db8e2b4c14 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.308574 Jul 20 04:26:23.203503 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1586/2711] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:22 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:23.698341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:23.699881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:23.709370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:23.713423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:23.714550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:23.715002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.256693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:24.265844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc9a1011-7023-4253-a2d0-3be3070ec0ba tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1293 microversion: 2.1 time: 0.572043 Jul 20 04:26:24.273361 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1587/2712] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:23 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1293 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:24.297542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:24.298546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:24.329213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.333472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.334639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:24.338115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:24.866269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:24.876069 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08f8c4aa-f617-4238-8e03-59fc8737cc15 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 200 len: 1506 microversion: 2.1 time: 0.601524 Jul 20 04:26:24.884809 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1588/2713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:24 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 1506 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:25.201894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1551880603", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:25.311770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:25.773552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:25.773979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:25.774458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:25.774869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:25.775308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:25.797427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:25.798217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.801151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:25.802432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:25.888600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=21 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:25.932159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Getting quotas for project 5b4925333f5d430ca137781e7ad06c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:25.941005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Getting quotas for user 20f25a7fea804ebabdece373f26ff43d and project 5b4925333f5d430ca137781e7ad06c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:25.965577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:25.968709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:26.079131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-771c3248-2510-49d2-8ff9-786c742fd869 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.192854 Jul 20 04:26:26.083160 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1589/2714] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:26:26.088889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a8474554-fc3b-44ef-aaf6-a352625c4764 req-b3e23a3d-7d0d-4944-a8fe-6d958e5c8b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d07ae53-9535-4b5f-b8a7-4fdcedef4a65", "name": "network-vif-deleted", "tag": "5b844067-fa30-4e38-a628-3289157e2446"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:26.103456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a8474554-fc3b-44ef-aaf6-a352625c4764 req-b3e23a3d-7d0d-4944-a8fe-6d958e5c8b9f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.104245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a8474554-fc3b-44ef-aaf6-a352625c4764 req-b3e23a3d-7d0d-4944-a8fe-6d958e5c8b9f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.119346 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a8474554-fc3b-44ef-aaf6-a352625c4764 req-b3e23a3d-7d0d-4944-a8fe-6d958e5c8b9f service nova] Creating event network-vif-deleted:5b844067-fa30-4e38-a628-3289157e2446 for instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 on n-h1-764486-11 Jul 20 04:26:26.125796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a8474554-fc3b-44ef-aaf6-a352625c4764 req-b3e23a3d-7d0d-4944-a8fe-6d958e5c8b9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041135 Jul 20 04:26:26.127002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1590/2715] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:26.133522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:26.137338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:26.145792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.146609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.147509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.148053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.673609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:26.700793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f107b7ce-0932-4c76-a6a1-6523ba10db38 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1483 microversion: 2.1 time: 0.571672 Jul 20 04:26:26.704970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1591/2716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:26 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1483 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:26.731568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:26.736829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:26.758284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.760436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.762921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:26.764369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:26.812069 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] HTTP exception thrown: Instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 could not be found. Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Request method failure captured: Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 HTTP/1.1 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NeH1YnvMfOolnr0FwHoQWhFOtlZ61RZL2844B56wA_1qN8v6HeWREIu7PENO8gLO3zwq5TpCDWfhKDDZ-maEbdiz618TNA2U4rZtdsxFIQiiIvTk1IDrJzhHPurlPYnND0fEmyRvUz6KopQMX_reWTpWI_kcwmShgd9bAHDfQrf14 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: dc99560066644ac58bff06cc8fb86577 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueTestJSON-964271092 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dc99560066644ac58bff06cc8fb86577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc99560066644ac58bff06cc8fb86577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc99560066644ac58bff06cc8fb86577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dc99560066644ac58bff06cc8fb86577", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueTestJSON-964271092 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: dc99560066644ac58bff06cc8fb86577 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueTestJSON-964271092 Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueTestJSON-964271092-project Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 100f850e2270414e8f8449695b53c2aa Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueTestJSON-964271092-project Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 could not be found. Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5d07ae53-9535-4b5f-b8a7-4fdcedef4a65'} Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 could not be found. Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 could not be found. Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:26.816065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 could not be found. Jul 20 04:26:26.820284 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:26.828324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Returning 404 to user: Instance 5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:26.831832 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f95d455a-1698-44f0-83f6-2f246a0fc1a9 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65" status: 404 len: 111 microversion: 2.1 time: 0.107024 Jul 20 04:26:26.841416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1592/2717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:26 2022] GET /compute/v2.1/servers/5d07ae53-9535-4b5f-b8a7-4fdcedef4a65 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:26.866830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5512b11d-8dd1-4562-b4d9-ada6b0490d42 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:26.867452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5512b11d-8dd1-4562-b4d9-ada6b0490d42 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.076515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5512b11d-8dd1-4562-b4d9-ada6b0490d42 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:27.102591 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5512b11d-8dd1-4562-b4d9-ada6b0490d42 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1222 microversion: 2.1 time: 0.259896 Jul 20 04:26:27.103478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1593/2718] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:26 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1222 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:27.108795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.109851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.117197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.117939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.118892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.119536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.354644 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-820e2108-404c-4a0e-8465-6ff069585d4d tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249636 Jul 20 04:26:27.355330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1594/2719] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:26:27 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:27.359767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.372082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.382875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.386041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.391020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.392463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.463596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:26:27.705148 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ff8fe99-f688-49c8-88ae-67f820eabd9d tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "DELETE /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 204 len: 0 microversion: 2.1 time: 0.346933 Jul 20 04:26:27.711405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1595/2720] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:26:27 2022] DELETE /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:26:27.745459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:27.753567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:27.803999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.820198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:27.821413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:27.822059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:28.625488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:28.667060 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70bbb8f9-bc4b-40ac-81b3-c4fb9e1012d3 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1491 microversion: 2.1 time: 0.952978 Jul 20 04:26:28.668321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1596/2721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:27 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1491 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:28.684302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:28.686584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:28.699674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:28.701159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:28.702764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:28.704409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:28.838074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:28.849398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac560492-6964-4ec8-b498-84b419801eda tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1280 microversion: 2.1 time: 0.178647 Jul 20 04:26:28.851179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1597/2722] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:28 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:29.686437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:29.687967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:29.738380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.742587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:29.746652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:29.750777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:30.162276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:30.173504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:30.205264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffcf1544-43a1-48f6-a659-9195b5db083a tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1491 microversion: 2.1 time: 0.523168 Jul 20 04:26:30.209631 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1598/2723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:29 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1491 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:30.214959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:30.219093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:30.239075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:30.240526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:30.243116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:30.245765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:30.416323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:30.429265 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ee8dd35-a521-45db-999d-ccb66395c863 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1280 microversion: 2.1 time: 0.218288 Jul 20 04:26:30.430008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1599/2724] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:30 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:30.780964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:30.782409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:30.796713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:30.797374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:30.800536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:30.801357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.258857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:31.274202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7216921a-7003-4a04-aeeb-9ef78af645bb tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1483 microversion: 2.1 time: 0.496862 Jul 20 04:26:31.274202 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1600/2725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:30 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1483 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:31.280288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-61be5f6b-0da6-4a09-8003-1dc502a6cb2c req-084fd3e9-cd34-4023-867d-5440a857da7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0fde32-fb30-42e1-8f26-b6344000a6d9", "tag": "3b31a8aa-bdc3-47c7-a5c7-534e600398cb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:31.338082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-61be5f6b-0da6-4a09-8003-1dc502a6cb2c req-084fd3e9-cd34-4023-867d-5440a857da7b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.338518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-61be5f6b-0da6-4a09-8003-1dc502a6cb2c req-084fd3e9-cd34-4023-867d-5440a857da7b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.415946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-61be5f6b-0da6-4a09-8003-1dc502a6cb2c req-084fd3e9-cd34-4023-867d-5440a857da7b service nova] Creating event network-changed:3b31a8aa-bdc3-47c7-a5c7-534e600398cb for instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 on n-h1-764486-11 Jul 20 04:26:31.437028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-61be5f6b-0da6-4a09-8003-1dc502a6cb2c req-084fd3e9-cd34-4023-867d-5440a857da7b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161598 Jul 20 04:26:31.437785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1601/2726] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:31.465247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:31.481301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:31.498619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.516210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:31.520006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:31.522081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.117622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:32.135130 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1658218d-92f7-43ee-b3eb-22fd43e8d987 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1491 microversion: 2.1 time: 0.681975 Jul 20 04:26:32.136024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1602/2727] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:31 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1491 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:32.140723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:32.141335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:32.154396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.155123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:32.158909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:32.160876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.256237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:33.281921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb279595-12e0-4838-addd-9973dd1707c1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 1.144484 Jul 20 04:26:33.283179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1603/2728] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:32 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:33.294586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:33.297157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:33.323619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.327287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.328444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:33.329875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:33.490092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '100f850e2270414e8f8449695b53c2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc99560066644ac58bff06cc8fb86577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:33.506546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c64c8f8-2083-44fa-b25c-7ddb16b735eb tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 200 len: 1449 microversion: 2.1 time: 0.218020 Jul 20 04:26:33.507187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1604/2729] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:33 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 1449 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:34.116598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a1d84459-ccdf-4321-afe8-c303d310983c req-c3320f30-a78a-482f-8e70-0a5218983233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f7f87-2388-4131-99fa-1905c114302c", "name": "network-vif-deleted", "tag": "dbe5063c-f6e2-4367-8df9-d3524b37f76d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:34.137021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:34.203889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1d84459-ccdf-4321-afe8-c303d310983c req-c3320f30-a78a-482f-8e70-0a5218983233 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.207758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1d84459-ccdf-4321-afe8-c303d310983c req-c3320f30-a78a-482f-8e70-0a5218983233 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:34.279052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a1d84459-ccdf-4321-afe8-c303d310983c req-c3320f30-a78a-482f-8e70-0a5218983233 service nova] Creating event network-vif-deleted:dbe5063c-f6e2-4367-8df9-d3524b37f76d for instance 403f7f87-2388-4131-99fa-1905c114302c on n-h2-764486-11 Jul 20 04:26:34.297946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a1d84459-ccdf-4321-afe8-c303d310983c req-c3320f30-a78a-482f-8e70-0a5218983233 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186503 Jul 20 04:26:34.304520 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1605/2730] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:34.320006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:34.322067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:34.333541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.338324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:34.341391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:34.343356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.133298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:35.149252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-222386f5-7bb7-4649-9e20-86b2c699762b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 0.841083 Jul 20 04:26:35.150485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1606/2731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:34 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:35.162210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:35.165331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] [instance: 403f7f87-2388-4131-99fa-1905c114302c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:35.183524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.183792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.184614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:35.187868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:35.240828 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] HTTP exception thrown: Instance 403f7f87-2388-4131-99fa-1905c114302c could not be found. Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Request method failure captured: Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c HTTP/1.1 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14NeH1YnvMfOolnr0FwHoQWhFOtlZ61RZL2844B56wA_1qN8v6HeWREIu7PENO8gLO3zwq5TpCDWfhKDDZ-maEbdiz618TNA2U4rZtdsxFIQiiIvTk1IDrJzhHPurlPYnND0fEmyRvUz6KopQMX_reWTpWI_kcwmShgd9bAHDfQrf14 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: dc99560066644ac58bff06cc8fb86577 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueTestJSON-964271092 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dc99560066644ac58bff06cc8fb86577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc99560066644ac58bff06cc8fb86577"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc99560066644ac58bff06cc8fb86577"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dc99560066644ac58bff06cc8fb86577", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueTestJSON-964271092 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: dc99560066644ac58bff06cc8fb86577 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueTestJSON-964271092 Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueTestJSON-964271092-project Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 100f850e2270414e8f8449695b53c2aa Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueTestJSON-964271092-project Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 403f7f87-2388-4131-99fa-1905c114302c could not be found. Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '403f7f87-2388-4131-99fa-1905c114302c'} Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403f7f87-2388-4131-99fa-1905c114302c could not be found. Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403f7f87-2388-4131-99fa-1905c114302c could not be found. Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:35.245833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403f7f87-2388-4131-99fa-1905c114302c could not be found. Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Returning 404 to user: Instance 403f7f87-2388-4131-99fa-1905c114302c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c" status: 404 len: 111 microversion: 2.1 time: 0.097136 Jul 20 04:26:35.250291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1607/2732] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:35 2022] GET /compute/v2.1/servers/403f7f87-2388-4131-99fa-1905c114302c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:36.060000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:36.061792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77105184-9dc7-4644-aefa-2d7147ab9af4 tempest-ServerRescueTestJSON-964271092 tempest-ServerRescueTestJSON-964271092-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001852 Jul 20 04:26:36.069852 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1608/2733] 10.222.0.49 () {56 vars in 885 bytes} [Wed Jul 20 04:26:36 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:26:36.170523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:36.172089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:36.176650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:36.214664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.215847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.218157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.220242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.850457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:36.860031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21bacc86-2453-4e19-b16a-5b585e8cffed tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 0.696218 Jul 20 04:26:36.866829 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1609/2734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:36 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:36.875931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-80876ae2-442e-4951-9dd3-fcaa0880ab33 req-8c7f307a-0a7e-46ec-8248-ef62d4472986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e08561-4ac4-4d11-adb3-698c533a36e6", "tag": "4197c3a4-a049-4198-a66a-edf03d29a433"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:36.901707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-80876ae2-442e-4951-9dd3-fcaa0880ab33 req-8c7f307a-0a7e-46ec-8248-ef62d4472986 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:36.902537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-80876ae2-442e-4951-9dd3-fcaa0880ab33 req-8c7f307a-0a7e-46ec-8248-ef62d4472986 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:36.951641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-80876ae2-442e-4951-9dd3-fcaa0880ab33 req-8c7f307a-0a7e-46ec-8248-ef62d4472986 service nova] Creating event network-changed:4197c3a4-a049-4198-a66a-edf03d29a433 for instance 67e08561-4ac4-4d11-adb3-698c533a36e6 on n-h1-764486-11 Jul 20 04:26:36.972177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-80876ae2-442e-4951-9dd3-fcaa0880ab33 req-8c7f307a-0a7e-46ec-8248-ef62d4472986 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102277 Jul 20 04:26:36.975628 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1610/2735] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:37.879656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=21 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:37.885730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:37.886444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:37.917759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.919196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:37.920416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:37.937833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:38.595770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:38.609193 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8640d95-2e41-4659-a50b-e62e017d41b0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 0.730286 Jul 20 04:26:38.610027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1611/2736] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:37 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:39.637261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:39.638923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:39.649110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:39.650136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:39.651176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:39.651829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:40.364853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:40.376274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f32b7128-a80f-4f1c-8959-1dc27dd28f18 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 0.743666 Jul 20 04:26:40.377131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1612/2737] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:39 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:41.396783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:41.398537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:41.418947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.419863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:41.421857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:41.422479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.717043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:42.727099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f4b4db8-1601-46aa-a3f4-0f837d3b561e tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 1.335498 Jul 20 04:26:42.733137 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1613/2738] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:41 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:42.752046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6a2cc3b0-bdd8-49b9-8a4a-b8dcc328d19e req-12be056d-0268-4010-b827-c9edd09a04dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e08561-4ac4-4d11-adb3-698c533a36e6", "name": "network-vif-plugged", "status": "completed", "tag": "4197c3a4-a049-4198-a66a-edf03d29a433"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:42.788949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6a2cc3b0-bdd8-49b9-8a4a-b8dcc328d19e req-12be056d-0268-4010-b827-c9edd09a04dd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:42.789612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6a2cc3b0-bdd8-49b9-8a4a-b8dcc328d19e req-12be056d-0268-4010-b827-c9edd09a04dd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:42.802738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6a2cc3b0-bdd8-49b9-8a4a-b8dcc328d19e req-12be056d-0268-4010-b827-c9edd09a04dd service nova] Creating event network-vif-plugged:4197c3a4-a049-4198-a66a-edf03d29a433 for instance 67e08561-4ac4-4d11-adb3-698c533a36e6 on n-h1-764486-11 Jul 20 04:26:42.808261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6a2cc3b0-bdd8-49b9-8a4a-b8dcc328d19e req-12be056d-0268-4010-b827-c9edd09a04dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072857 Jul 20 04:26:42.809249 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1614/2739] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:43.751644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:43.753145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:43.765973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.770041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:43.771948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:43.773305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:44.806564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:44.825278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b47e992-aa46-40bf-ad88-705c35a6bfe8 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1322 microversion: 2.1 time: 1.072402 Jul 20 04:26:44.828734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1615/2740] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:43 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1322 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:45.194203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-739010474", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0bb864ab-a95a-442b-ab7c-f68bca103792"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:45.292577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] validate_networks() for [('0bb864ab-a95a-442b-ab7c-f68bca103792', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:47.794768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:47.795305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:47.795699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:47.796097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:47.796902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:47.826451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.834676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.835810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:47.836258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:47.925795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Getting quotas for project c9293b3300f84bc984d2c08a7238ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:47.945756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Getting quotas for user e127947e624943f2b9acce93ac3cf3d3 and project c9293b3300f84bc984d2c08a7238ecfb. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:47.972929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Going to run 3 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:47.977526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:48.056310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=aa60e7b1-76b3-4da0-9c64-e9a772b6df41,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:48.128786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:48.282827 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cda6204e-f542-4aae-a112-dc00c3600dd4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.427380 Jul 20 04:26:48.298706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1616/2741] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:26:48.312712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:48.313543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.333624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.334121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.337734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.338155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.837440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:48.851453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8e8e23e-6bbc-44cc-8eb1-6d7405aa75f2 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1472 microversion: 2.1 time: 0.550443 Jul 20 04:26:48.852752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1617/2742] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:48 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1472 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:48.867829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f313019f-0624-4364-be55-d61cc0af5d17"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:48.870111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:48.891744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.893756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:48.894864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:48.896761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.504574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6920247-a3c1-4763-964b-82e125140f39 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "POST /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649980 Jul 20 04:26:49.505641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1618/2743] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:26:48 2022] POST /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:49.539867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:49.555138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:49.558656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:26:49.649816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.650278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.666300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:49.669105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:49.757309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:49.827766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:26:49.989570 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff164bed-9c23-4264-ab6c-7b1d9cace1bb tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.479838 Jul 20 04:26:49.991916 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1619/2744] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:26:49 2022] GET /compute/v2.1/servers => generated 1015 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:50.730355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4723b83d-b419-41d4-bb73-0597fed1b94f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:50.730933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4723b83d-b419-41d4-bb73-0597fed1b94f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] [instance: 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:50.744811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4723b83d-b419-41d4-bb73-0597fed1b94f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] HTTP exception thrown: Instance 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b could not be found. Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4723b83d-b419-41d4-bb73-0597fed1b94f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Request method failure captured: Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/73ec2b84-b04d-4c1f-baa9-fc84983e8e5b/action HTTP/1.1 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pw2xYI2UETyqsAa8lEwpWkusfkGD7HkfpfleiO7QVxMeQeE3z8VMTwVAPknBffO2oBbWjL4FtFu1aGHkzeDPmGBNLfcEKOvlaPn91iXoegTgPwG9gFhXHy5FSObn81IEPgnXKuEAEoRzH3mTuhc71JP-pgSABxx_n5caYVsk8XBv8 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_195765775cff4b77a6699b9f447d1ce8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: db312e91096b4262b3afbdc4e39ba6a1 Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: {"migrate": {}} Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b could not be found. Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '73ec2b84-b04d-4c1f-baa9-fc84983e8e5b', 'body': {'migrate': {}}} Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b could not be found. Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b could not be found. Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:50.746584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:26:50.751521 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:26:50.751521 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:26:50.751521 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:26:50.751521 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:26:50.751521 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b could not be found. Jul 20 04:26:50.751521 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:26:50.774162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4723b83d-b419-41d4-bb73-0597fed1b94f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Returning 404 to user: Instance 73ec2b84-b04d-4c1f-baa9-fc84983e8e5b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:26:50.775288 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4723b83d-b419-41d4-bb73-0597fed1b94f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/73ec2b84-b04d-4c1f-baa9-fc84983e8e5b/action" status: 404 len: 111 microversion: 2.1 time: 0.777996 Jul 20 04:26:50.775783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1620/2745] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:26:49 2022] POST /compute/v2.1/servers/73ec2b84-b04d-4c1f-baa9-fc84983e8e5b/action => generated 111 bytes in 780 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:26:50.807178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:50.812451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:50.851248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.851706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:50.852532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:50.852973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.042828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:51.055106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3cd5ca54-33bf-42ca-bd9f-4002449e9bb4 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1218 microversion: 2.1 time: 0.265518 Jul 20 04:26:51.063253 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1621/2746] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:50 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1218 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:51.109293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-67151896", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:51.210148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:26:51.653567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:51.654093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:51.654643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:51.655130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:51.655468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:51.672540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.679960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.682762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:51.683435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:51.711646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Getting quotas for project 5b4925333f5d430ca137781e7ad06c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:51.727773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Getting quotas for user 20f25a7fea804ebabdece373f26ff43d and project 5b4925333f5d430ca137781e7ad06c7b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:51.775597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:51.786055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:51.939115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2ff82f8-3e95-4d72-b85b-0e76e9d3a0f6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834640 Jul 20 04:26:51.962976 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1622/2747] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:26:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:26:52.714315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2103843451", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": "none"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:26:52.953772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:26:52.957906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:26:52.961835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:26:52.964334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:26:52.966164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:26:52.996811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.000290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.002879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.004414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.102770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Getting quotas for project 048c3e35be7b4092ac420a7cd3bc263d. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:26:53.125745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Getting quotas for user 91180d97f6c3444ea48f972df1a72f30 and project 048c3e35be7b4092ac420a7cd3bc263d. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:26:53.178471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:26:53.192632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:26:53.363175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b91b4a3-f557-49d3-9830-fb4f7b5fc98d tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.392552 Jul 20 04:26:53.368161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1623/2748] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:26:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:26:53.376507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.377102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.394212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.394702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.396092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.396582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.649523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.663526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd3e5ac4-1c87-44da-a9ba-f7f32fb5a537 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1216 microversion: 2.1 time: 0.293211 Jul 20 04:26:53.674608 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1624/2749] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1216 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:53.676528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:53.677162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:53.687700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.688505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.696940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:53.698270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:53.903134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:53.932000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac8890a1-a4ef-4853-973a-b3e3f1aaa706 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1280 microversion: 2.1 time: 0.248161 Jul 20 04:26:53.943158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1625/2750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:54.375301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b74aee8-6404-4d0e-a65e-485713f92fd3 tempest-ExtensionsTest-710773795 tempest-ExtensionsTest-710773795-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.377210 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b74aee8-6404-4d0e-a65e-485713f92fd3 tempest-ExtensionsTest-710773795 tempest-ExtensionsTest-710773795-project] 10.222.0.49 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.430566 Jul 20 04:26:54.378100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1626/2751] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jul 20 04:26:53 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:26:54.386704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6aed872-84b8-411b-8ad8-4e629e2a0c49 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.387699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6aed872-84b8-411b-8ad8-4e629e2a0c49 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:54.583585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6aed872-84b8-411b-8ad8-4e629e2a0c49 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:54.603445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6aed872-84b8-411b-8ad8-4e629e2a0c49 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:54.609602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6aed872-84b8-411b-8ad8-4e629e2a0c49 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:54.614813 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6aed872-84b8-411b-8ad8-4e629e2a0c49 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1278 microversion: 2.57 time: 0.233650 Jul 20 04:26:54.617591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1627/2752] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:54.635903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19d6963b-9493-4b9d-bf47-dcab4eb1389a tempest-ExtensionsTest-710773795 tempest-ExtensionsTest-710773795-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.646935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19d6963b-9493-4b9d-bf47-dcab4eb1389a tempest-ExtensionsTest-710773795 tempest-ExtensionsTest-710773795-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.027063 Jul 20 04:26:54.660449 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1628/2753] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:26:54.687579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:54.687579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:54.717727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.720112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:54.724009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:54.725497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.236424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.251673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edcdaf64-e000-4963-9f40-f6d1b366a56f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1278 microversion: 2.1 time: 0.572361 Jul 20 04:26:55.254171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1629/2754] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:54 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1278 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:55.260764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.261664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:55.272301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.273361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.274406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.275103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.515542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:55.543924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-941c70c9-7baa-4697-b970-fbcb06d11d55 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1280 microversion: 2.1 time: 0.288478 Jul 20 04:26:55.557574 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1630/2755] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:55 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:55.635384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:55.636034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:55.667288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.668111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.675995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:55.676487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:55.998817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.014388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.017178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.019799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4595a6f5-49d6-4e82-b774-285496ce28eb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1348 microversion: 2.57 time: 0.388342 Jul 20 04:26:56.035788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1631/2756] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:55 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1348 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:56.272791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:56.273447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:56.296981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:26:56.307861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.311789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.315909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.317881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.650130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:56.673867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef965a12-bca2-47d2-a56f-1c67002b2ed9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1278 microversion: 2.1 time: 0.406008 Jul 20 04:26:56.676134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1632/2757] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:56 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1278 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:26:56.704129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:56.705304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:56.715837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.716613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:56.717599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:56.718811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.190532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.204885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61816ccd-7141-44a9-89d3-cc2f491c3d20 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.512253 Jul 20 04:26:57.207184 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1633/2758] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:56 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:57.220873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:57.222318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:57.240884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.241785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.250905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.254258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.566428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.607672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.614351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.621700 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a94db9c-2866-4543-9f4e-b1de0463c50b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1336 microversion: 2.57 time: 0.409094 Jul 20 04:26:57.623319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1634/2759] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:57 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1336 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:57.696740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:57.697792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:57.717230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.717862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.719028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:57.719753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:57.975133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:57.996475 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acb56734-537a-4e67-aa1f-12574994466b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1278 microversion: 2.1 time: 0.303123 Jul 20 04:26:58.011489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1635/2760] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:57 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:58.226544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:58.227491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:58.242889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.243820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:58.246364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:58.247000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.047150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.072496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e526c05-fafa-451e-95df-4bf7220724cc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.847386 Jul 20 04:26:59.074307 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1636/2761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:58 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:26:59.119971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:59.121336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:59.141122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.141935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.144618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.146242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.528681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.557077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.558886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.560252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52388a15-6e14-4b0c-b6fe-9881e6321d99 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1357 microversion: 2.57 time: 0.481240 Jul 20 04:26:59.577734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1637/2762] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1357 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:26:59.587102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:26:59.589452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:26:59.602144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.602602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.603398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:26:59.603842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:26:59.934918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:26:59.947496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42250c8c-a1ef-45d1-b51a-adf27697cde1 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.368063 Jul 20 04:26:59.951432 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1638/2763] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:00.170165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00fc99b8-6226-4f94-9ee5-528cce1d7bad tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] Calling method '.version_select at 0x7f838b0cc790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:00.271454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00fc99b8-6226-4f94-9ee5-528cce1d7bad tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098/defaults" status: 200 len: 371 microversion: 2.1 time: 0.318713 Jul 20 04:27:00.272582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1639/2764] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:26:59 2022] GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098/defaults => generated 371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:00.291216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:00.296012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:00.313378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.317634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.319946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.323319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.455928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:00.456936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:00.458111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:00.458969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:00.459591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:00.502337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:00.567889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:00.585356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.588006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.590216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.592302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.688601 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e72ae13f-4eb7-4261-93c1-5f7763b895b4 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "POST /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911/action" status: 202 len: 1138 microversion: 2.57 time: 0.412857 Jul 20 04:27:00.693083 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1640/2765] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Jul 20 04:27:00 2022] POST /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911/action => generated 1138 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:27:00.704382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:00.706955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:00.717443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.718343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:00.719414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:00.721848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.342467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.357366 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b9062bc-642b-47e9-8592-ac0c513f9182 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.662303 Jul 20 04:27:01.365059 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1641/2766] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:00 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:01.372503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdef2111-4b1d-4fc1-b60c-4acb54e12a24 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] Calling method '.version_select at 0x7f838ba0d8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.520309 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdef2111-4b1d-4fc1-b60c-4acb54e12a24 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098" status: 200 len: 371 microversion: 2.1 time: 0.149358 Jul 20 04:27:01.520309 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1642/2767] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:27:01 2022] GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098 => generated 371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:01.531814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.531814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:01.543039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.543502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.551163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.551625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.655925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.672290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.673868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.675131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ff728bc-953c-421d-8669-ccbce305cdeb tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.153756 Jul 20 04:27:01.675709 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1643/2768] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:01 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:01.686423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:01.686423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:01.689071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.689566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.690545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:01.691245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:01.954472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:01.975606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3664c61-ce85-4319-8d00-2d48ec0a28e6 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.297973 Jul 20 04:27:01.977384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1644/2769] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:01 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:01.983688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-611b2a16-4a72-4e1f-bcbc-d60984a87848 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] Calling method '.version_select at 0x7f8398943ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.085049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-611b2a16-4a72-4e1f-bcbc-d60984a87848 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098/defaults" status: 200 len: 371 microversion: 2.1 time: 0.104966 Jul 20 04:27:02.085975 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1645/2770] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:27:01 2022] GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098/defaults => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:02.103658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28ce82a8-1e34-40d0-b020-3dd37b2f2ce3 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] Calling method '.version_select at 0x7f838ba0daf0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.218286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28ce82a8-1e34-40d0-b020-3dd37b2f2ce3 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098" status: 200 len: 371 microversion: 2.1 time: 0.122321 Jul 20 04:27:02.220228 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1646/2771] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:02.242236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa2bb23d-096e-4279-b1c6-bd4d4911d741 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] Calling method '.version_select at 0x7f838bb29f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.336654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa2bb23d-096e-4279-b1c6-bd4d4911d741 tempest-QuotasTestJSON-2086222492 tempest-QuotasTestJSON-2086222492-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098?user_id=ee9dac987ed04797a5e618f8e21aa1c0" status: 200 len: 371 microversion: 2.1 time: 0.108441 Jul 20 04:27:02.343838 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1647/2772] 10.222.0.49 () {58 vars in 1322 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/os-quota-sets/53663ec7972b452db7de0d8932bf8098?user_id=ee9dac987ed04797a5e618f8e21aa1c0 => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:02.382400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.383034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.396030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.396630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.397543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.400532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.648853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:02.662538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90cdf912-7308-4f3a-9a0c-d489ef559b4b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.285374 Jul 20 04:27:02.663340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1648/2773] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:02.705667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.706324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:02.720823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.722779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.725220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.726236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.886238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:02.897678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:02.899484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:02.900925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4dcb8bdb-0c56-41b3-a2d9-0bd5693ac7fd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.211101 Jul 20 04:27:02.901963 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1649/2774] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:02.913580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8cdebc4e-6824-414f-9212-31e9b655b7a2 req-7c68b659-11f5-4aa0-8440-b27096e66c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa60e7b1-76b3-4da0-9c64-e9a772b6df41", "tag": "1a5f067e-af1c-4786-8e90-52a70f4ab69e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:02.924777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8cdebc4e-6824-414f-9212-31e9b655b7a2 req-7c68b659-11f5-4aa0-8440-b27096e66c7e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:02.925241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8cdebc4e-6824-414f-9212-31e9b655b7a2 req-7c68b659-11f5-4aa0-8440-b27096e66c7e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:02.949672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8cdebc4e-6824-414f-9212-31e9b655b7a2 req-7c68b659-11f5-4aa0-8440-b27096e66c7e service nova] Creating event network-changed:1a5f067e-af1c-4786-8e90-52a70f4ab69e for instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 on n-h2-764486-11 Jul 20 04:27:02.963288 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8cdebc4e-6824-414f-9212-31e9b655b7a2 req-7c68b659-11f5-4aa0-8440-b27096e66c7e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060045 Jul 20 04:27:02.964557 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1650/2775] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:02.996703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:02.998864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:03.008848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:03.013113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.018375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:03.020875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.091079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:03.712483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:03.725781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b336158-37a1-4a8c-8a37-a3c5278796da tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.735708 Jul 20 04:27:03.727020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1651/2776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:02 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:03.736295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:03.737528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:03.764791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:03.765389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:03.766251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:03.766689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.103494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:04.136515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d960c4d5-a790-484f-8f61-fe4d6dc36994 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.407274 Jul 20 04:27:04.138462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1652/2777] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:03 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:04.149384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:04.149932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:04.160592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.161967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.163000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.163935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.375817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:04.390492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:04.393007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:04.395983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb57d16e-c2e7-4b2e-bf44-8c225955e958 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.254480 Jul 20 04:27:04.414475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1653/2778] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:04 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:04.749498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:04.750990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:04.764958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.765540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:04.767008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:04.767461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.235035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:05.249823 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eef730b2-0198-44a4-802c-c5e38c8e9867 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.505598 Jul 20 04:27:05.264571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1654/2779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:04 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:05.279114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:05.279666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:05.294487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:05.294943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:05.301494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:05.304868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.404220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.417242 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d772c1e-b902-4a78-a390-9f268efd16c2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 1.151531 Jul 20 04:27:06.418162 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1655/2780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:05 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:06.455688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa9a86d-4109-4bcd-b7c9-b06421abd79b", "tag": "d10a94f7-1b43-4b89-9409-b50dec12da53"}, {"name": "network-changed", "server_uuid": "c71f4ced-677e-4edf-9679-d33e4e53368f", "tag": "87497f5e-9513-428f-923d-1245ea835779"}, {"name": "network-changed", "server_uuid": "09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c", "tag": "700e3628-c50e-4224-816b-05d00e66f7e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:06.489215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.492146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.538942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] Creating event network-changed:d10a94f7-1b43-4b89-9409-b50dec12da53 for instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b on n-h2-764486-11 Jul 20 04:27:06.540093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] Creating event network-changed:87497f5e-9513-428f-923d-1245ea835779 for instance c71f4ced-677e-4edf-9679-d33e4e53368f on n-h1-764486-11 Jul 20 04:27:06.542234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] Creating event network-changed:700e3628-c50e-4224-816b-05d00e66f7e1 for instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c on n-h1-764486-11 Jul 20 04:27:06.572681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c49b3d4f-574a-47ce-96ff-85445b0890fa req-12914bb4-fb8e-4fa0-a282-c4a7166b2bdb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.146510 Jul 20 04:27:06.574169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1656/2781] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:06.589026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:06.592737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:06.606978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.609850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.613738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.616106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.830610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.840401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.847499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:06.851162 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7fd86ba-4667-4a32-91fd-ef376059d9fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.274475 Jul 20 04:27:06.857857 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1657/2782] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:06 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:06.863718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:06.865183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:06.880415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.880998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:06.881703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:06.882086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.303779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:07.314989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e28f4bd-2a44-4df2-bda0-e267aac66216 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.455727 Jul 20 04:27:07.315991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1658/2783] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:06 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:07.456874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:07.458697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:07.472836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.473735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.475415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.476035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.705417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:07.715060 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-064298de-02f0-4e66-bd56-650887f6f389 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.275806 Jul 20 04:27:07.717117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1659/2784] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:07 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:07.879510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:07.880152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:07.893313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.893808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:07.894626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:07.895066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.037507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.052053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.070062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.074614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ee222c7-aba6-407a-a3f3-d3d13fcf5ecd tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.199178 Jul 20 04:27:08.075393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1660/2785] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:07 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:08.334621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:08.335760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:08.348261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.349261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.351427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.352618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.624508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:08.628752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:08.640531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c7083fff-da07-4129-aaa1-7c60830fdb3d tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.311711 Jul 20 04:27:08.641798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1661/2786] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:08 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:08.736765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:08.745178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:08.765777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.766748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:08.767855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:08.769547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.012867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.022015 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec49fa3c-8102-4072-8a6d-ec8216f9c1e0 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.291589 Jul 20 04:27:09.022640 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1662/2787] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:08 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:09.095153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.096639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.104553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.109799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.110625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.111075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.219591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.233016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.235454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.238454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6eafe111-40f3-4717-ad09-ebdb0d042516 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.146839 Jul 20 04:27:09.244485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1663/2788] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:09.291568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.292810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.300160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.301017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.302037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.302683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.335435 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee706dbd-123f-4c89-89cd-48ec6fc07097 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Jul 20 04:27:09.336804 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1664/2789] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:27:09.349785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.350377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.356848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.357857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.358842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.359471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.502890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lazy-loading 'services' on Instance uuid c629e50b-7f00-4009-be8e-7f9e2e4a44e4 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:09.662868 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96a41c4f-0c90-4af4-8f6b-f11bd7ef57e7 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments/f313019f-0624-4364-be55-d61cc0af5d17" status: 202 len: 0 microversion: 2.1 time: 0.319010 Jul 20 04:27:09.666734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1665/2790] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:27:09 2022] DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments/f313019f-0624-4364-be55-d61cc0af5d17 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:09.671476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:09.673502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:09.681910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.682552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.683712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:09.684248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:09.904015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:09.916579 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07f475c6-c63e-4776-bc52-68e6d0d91848 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.250767 Jul 20 04:27:09.917576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1666/2791] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:09 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:10.039922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:10.040492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:10.046798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.047246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.048008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.048673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.212800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.224502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6786f78a-3eef-4655-874a-eac7c784d2d5 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.188480 Jul 20 04:27:10.235381 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1667/2792] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:10 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:10.258094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:10.259061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:10.268276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.269134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.270220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.271639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.653349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.667993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.671367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:10.675491 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7589e2db-13e1-4a9b-af0f-a0e7c609ffc2 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.419360 Jul 20 04:27:10.690393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1668/2793] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:10 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:10.704674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0686a98d-f16a-4106-9ec9-52248081a33e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Action: 'create', calling method: .version_select at 0x7f838bab6820>, body: {"keypair": {"name": "tempest-keypair-1014130127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEFnjAOam+27ouQrZeGldF+y90de9ob+UorLwEjiuM9Bqa3mRJCATOHbEIwy5iTc0E+ikiXNtst8d+qI8dGuVJw6T1MMuK2yAd/kUbENqdoF45PQ/kHfDHnnzbF40kdJQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:10.770377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=29 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:10.774556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0686a98d-f16a-4106-9ec9-52248081a33e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Getting quotas for project af573ffe2b1941e3a69707ccf2e85682. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:10.795164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0686a98d-f16a-4106-9ec9-52248081a33e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Getting quotas for user 641b33d2365747b4a558b462a70501fa and project af573ffe2b1941e3a69707ccf2e85682. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:10.852273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0686a98d-f16a-4106-9ec9-52248081a33e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.158392 Jul 20 04:27:10.853241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1669/2794] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:27:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:27:10.935139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:10.935139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:10.942533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.943318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:10.943774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:10.944183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.513674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:11.522773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6767bb5a-a655-4912-afec-17dca56550c9 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.592498 Jul 20 04:27:11.529544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1670/2795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:10 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:27:11.547960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:11.551815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:11.570453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:11.574925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.580006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:11.582836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:11.590169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.025398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.049868 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1713b0fe-4c8a-44ae-a501-6d4de4a30655 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.515191 Jul 20 04:27:12.053578 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1671/2796] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:11 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:12.080149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b54c9ded-f3d4-431d-a761-5377ec1a1db7 req-8c138655-d519-4033-be41-1312ffb4b3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa60e7b1-76b3-4da0-9c64-e9a772b6df41", "name": "network-vif-plugged", "status": "completed", "tag": "1a5f067e-af1c-4786-8e90-52a70f4ab69e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:12.106388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b54c9ded-f3d4-431d-a761-5377ec1a1db7 req-8c138655-d519-4033-be41-1312ffb4b3ef service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.110728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b54c9ded-f3d4-431d-a761-5377ec1a1db7 req-8c138655-d519-4033-be41-1312ffb4b3ef service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.155414 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b54c9ded-f3d4-431d-a761-5377ec1a1db7 req-8c138655-d519-4033-be41-1312ffb4b3ef service nova] Creating event network-vif-plugged:1a5f067e-af1c-4786-8e90-52a70f4ab69e for instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 on n-h2-764486-11 Jul 20 04:27:12.165487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b54c9ded-f3d4-431d-a761-5377ec1a1db7 req-8c138655-d519-4033-be41-1312ffb4b3ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107578 Jul 20 04:27:12.171368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1672/2797] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:12.209666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.210589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.241074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.250374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.251653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.252126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.449647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.458427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.468608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.469978 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6bd333b9-d740-409b-96c8-4d5702dd5fd0 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.297155 Jul 20 04:27:12.479315 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1673/2798] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:12.497069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.520058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:12.521147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Searching by: {'deleted': False, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:12.541391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.542099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.543107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.548033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.624816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:27:12.698547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6a935de-aa44-4ddd-bb88-21615f15b467 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216141 Jul 20 04:27:12.700711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1674/2799] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:12.715941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:12.716676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:12.730755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.733829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:12.735105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:12.735830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:13.417322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:13.437509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93b93c76-0f5c-4283-8332-c62f2c5a0481 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.730173 Jul 20 04:27:13.438549 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1675/2800] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:12 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:13.456262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:13.461597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:13.464672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Searching by: {'deleted': False, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:13.474269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.476437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:13.477639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.478435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:13.516050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:27:13.596803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:13.609587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:13.615521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.168696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c9131b7-e64b-44f2-b362-eb624f0dc092 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.718194 Jul 20 04:27:14.169497 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1676/2801] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:27:13 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:14.175841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.176514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.195960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.196499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.197287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.197720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.462993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.480320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07e02c50-2be3-4a92-bb62-70578e528489 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.308349 Jul 20 04:27:14.482102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1677/2802] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:14.495963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.497967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.516810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.518980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.521785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.524534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.591412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:14.692344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.709847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.713482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:14.716201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01b9b19b-cb3e-48d0-bc1c-71bebbac199b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.231826 Jul 20 04:27:14.717153 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1678/2803] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:14.722489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0e092c2-5401-4436-b161-b67a7ca42a23 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.735170 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0e092c2-5401-4436-b161-b67a7ca42a23 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016577 Jul 20 04:27:14.736691 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1679/2804] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:14.742398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:14.743830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:14.754889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.755947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:14.757964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:14.758903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.266603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:15.278368 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ac33d6b-0673-4417-99fa-07b490463ba0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1320 microversion: 2.1 time: 0.539327 Jul 20 04:27:15.279677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1680/2805] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:14 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:15.284928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8c3b9daf-5ead-4a48-91eb-8852e0b0f37e req-9322c24b-3ccd-490d-ab68-0c8c537a0cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71f4ced-677e-4edf-9679-d33e4e53368f", "name": "network-vif-plugged", "status": "completed", "tag": "87497f5e-9513-428f-923d-1245ea835779"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:15.296478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8c3b9daf-5ead-4a48-91eb-8852e0b0f37e req-9322c24b-3ccd-490d-ab68-0c8c537a0cf2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.297084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8c3b9daf-5ead-4a48-91eb-8852e0b0f37e req-9322c24b-3ccd-490d-ab68-0c8c537a0cf2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.311724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8c3b9daf-5ead-4a48-91eb-8852e0b0f37e req-9322c24b-3ccd-490d-ab68-0c8c537a0cf2 service nova] Creating event network-vif-plugged:87497f5e-9513-428f-923d-1245ea835779 for instance c71f4ced-677e-4edf-9679-d33e4e53368f on n-h1-764486-11 Jul 20 04:27:15.318395 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8c3b9daf-5ead-4a48-91eb-8852e0b0f37e req-9322c24b-3ccd-490d-ab68-0c8c537a0cf2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Jul 20 04:27:15.319731 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1681/2806] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:15.326323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:15.326970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:15.337310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.337930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.338890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:15.339675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:15.392584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:15.540339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e070b15f-504e-43e0-a4bf-7d6cb0b07054 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 204 len: 0 microversion: 2.1 time: 0.218725 Jul 20 04:27:15.544422 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1682/2807] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:15 2022] DELETE /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:15.551726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1154016434", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "13a0893a-6bb5-4285-88ae-6257c848a6ed"}, {"port": "36018059-71b9-4780-a646-a5340eca8c36", "tag": "port-1"}, {"port": "49a5642b-8bc6-4f3a-a19b-7a26eb46e035", "tag": "port-2"}, {"uuid": "ef968bde-6da9-4638-be05-2833f160bbe8", "tag": "net-1"}, {"uuid": "ef968bde-6da9-4638-be05-2833f160bbe8"}, {"uuid": "1e76e8cf-38ab-421a-aaf4-28ec86b66885", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1e76e8cf-38ab-421a-aaf4-28ec86b66885", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bdd2e002-1ab6-4bb3-a888-5c0f7bfbd49b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c4b8ecac-1bf7-463f-8ef9-3c456e44da15", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "00463e79-2ef9-4278-ac05-0fb2f77f0ffc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1811923187"}], "key_name": "tempest-keypair-1014130127", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:15.750742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] validate_networks() for [('13a0893a-6bb5-4285-88ae-6257c848a6ed', None, None, None, None, None), (None, None, '36018059-71b9-4780-a646-a5340eca8c36', None, None, None), (None, None, '49a5642b-8bc6-4f3a-a19b-7a26eb46e035', None, None, None), ('ef968bde-6da9-4638-be05-2833f160bbe8', None, None, None, None, None), ('ef968bde-6da9-4638-be05-2833f160bbe8', None, None, None, None, None), ('1e76e8cf-38ab-421a-aaf4-28ec86b66885', '10.2.2.100', None, None, None, None), ('1e76e8cf-38ab-421a-aaf4-28ec86b66885', '10.2.2.200', None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:27:19.306756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:27:19.308583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:27:19.309280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:27:19.310304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:27:19.310916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:27:19.339939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.343176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.345680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:19.353540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:19.391166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Getting quotas for project af573ffe2b1941e3a69707ccf2e85682. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:27:19.400579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Getting quotas for user 641b33d2365747b4a558b462a70501fa and project af573ffe2b1941e3a69707ccf2e85682. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:27:19.648767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:27:19.657788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bdd2e002-1ab6-4bb3-a888-5c0f7bfbd49b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c4b8ecac-1bf7-463f-8ef9-3c456e44da15',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00463e79-2ef9-4278-ac05-0fb2f77f0ffc',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:27:20.242948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-551d6f81-ebd8-49a0-a82d-1edb48ca69a2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.695956 Jul 20 04:27:20.248435 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1683/2808] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Jul 20 04:27:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 4699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:27:20.249425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.250389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:20.261043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.261565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.262729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.263250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.600988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:20.610894 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-554fb395-9338-4557-a411-b62a5fa6fda3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.365708 Jul 20 04:27:20.612185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1684/2809] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:20.618918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.623986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:20.644583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.645287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.646237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.646835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.748303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:20.813671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c6c5776-c22f-45d2-a8b1-3a1254d0ffc7 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1252 microversion: 2.1 time: 0.198353 Jul 20 04:27:20.815531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1685/2810] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:20.829590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:20.829590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:20.872675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.874157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:20.876135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:20.876714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.054704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.092731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.094712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.100100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8e47487-9c75-4dff-a367-4b2178d53588 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.282977 Jul 20 04:27:21.101080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1686/2811] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:20 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:21.106416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:21.108145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:21.126060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.131721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.139612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.144725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.494466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.512393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b3570a4-9ebf-4709-aa55-d767e309465c tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1470 microversion: 2.1 time: 0.406453 Jul 20 04:27:21.516054 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1687/2812] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:21 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:21.529959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b12f7bf6-2867-43ae-90d0-8355a241723f req-b1c5f245-fa86-4296-94c2-6d559a2c62db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa9a86d-4109-4bcd-b7c9-b06421abd79b", "name": "network-vif-plugged", "status": "completed", "tag": "d10a94f7-1b43-4b89-9409-b50dec12da53"}, {"server_uuid": "09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c", "name": "network-vif-plugged", "status": "completed", "tag": "700e3628-c50e-4224-816b-05d00e66f7e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:21.551708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b12f7bf6-2867-43ae-90d0-8355a241723f req-b1c5f245-fa86-4296-94c2-6d559a2c62db service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.552242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b12f7bf6-2867-43ae-90d0-8355a241723f req-b1c5f245-fa86-4296-94c2-6d559a2c62db service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.575277 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b12f7bf6-2867-43ae-90d0-8355a241723f req-b1c5f245-fa86-4296-94c2-6d559a2c62db service nova] Creating event network-vif-plugged:d10a94f7-1b43-4b89-9409-b50dec12da53 for instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b on n-h2-764486-11 Jul 20 04:27:21.575938 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b12f7bf6-2867-43ae-90d0-8355a241723f req-b1c5f245-fa86-4296-94c2-6d559a2c62db service nova] Creating event network-vif-plugged:700e3628-c50e-4224-816b-05d00e66f7e1 for instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c on n-h1-764486-11 Jul 20 04:27:21.589633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b12f7bf6-2867-43ae-90d0-8355a241723f req-b1c5f245-fa86-4296-94c2-6d559a2c62db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071797 Jul 20 04:27:21.590394 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1688/2813] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:21.614217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:21.618922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:21.630870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.631324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.632155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.632621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.711159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62f71703-04d0-40fe-ad6f-5fab520924b4 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119329 Jul 20 04:27:21.712789 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1689/2814] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:21 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:21.742095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-054e89e1-75a8-4530-9236-0aeb08f85188 req-1edcdcd6-04c7-4535-9056-62fc2fbd5fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0fde32-fb30-42e1-8f26-b6344000a6d9", "name": "network-vif-deleted", "tag": "3b31a8aa-bdc3-47c7-a5c7-534e600398cb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:21.763927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-054e89e1-75a8-4530-9236-0aeb08f85188 req-1edcdcd6-04c7-4535-9056-62fc2fbd5fd9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.764395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-054e89e1-75a8-4530-9236-0aeb08f85188 req-1edcdcd6-04c7-4535-9056-62fc2fbd5fd9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.792231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-054e89e1-75a8-4530-9236-0aeb08f85188 req-1edcdcd6-04c7-4535-9056-62fc2fbd5fd9 service nova] Creating event network-vif-deleted:3b31a8aa-bdc3-47c7-a5c7-534e600398cb for instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 on n-h1-764486-11 Jul 20 04:27:21.799576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-054e89e1-75a8-4530-9236-0aeb08f85188 req-1edcdcd6-04c7-4535-9056-62fc2fbd5fd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084854 Jul 20 04:27:21.801029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1690/2815] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:21.809265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:21.810388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:21.817331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.818853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.820661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.821363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.944299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.978383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.980958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:21.982402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21d4f3c8-ce7c-49a7-8b5f-f9804817e82c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1576 microversion: 2.32 time: 0.177884 Jul 20 04:27:21.992372 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1691/2816] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:21 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:21.992372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:21.992372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:21.998103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.998103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:21.998413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:21.998949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.038986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lazy-loading 'flavor' on Instance uuid c71f4ced-677e-4edf-9679-d33e4e53368f {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:22.193030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9d713b4-7ca3-4f5b-97eb-f4053fb80c8c tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f/action" status: 202 len: 0 microversion: 2.1 time: 0.208129 Jul 20 04:27:22.195725 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1692/2817] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:21 2022] POST /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:22.204534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.206327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.217105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.218613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.219589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.220242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.470466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.482014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9cbfda57-681a-48db-aaf4-08e0d2ae3476 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1322 microversion: 2.1 time: 0.284322 Jul 20 04:27:22.483102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1693/2818] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:22.497863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.506172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.517801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.518835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.520080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.520893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.600501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-619208d7-2867-437a-97ab-31649549f3af tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114751 Jul 20 04:27:22.605544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1694/2819] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:22.625257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.629072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.643578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.644041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.647190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.647586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.709345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:22.775875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.785357 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05403f62-2ae6-44b5-b5cd-022183016210 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1252 microversion: 2.1 time: 0.182541 Jul 20 04:27:22.786333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1695/2820] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1252 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:22.792606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.793547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.801076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.801783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.802762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.803532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.875631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.889884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.891740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:22.893952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b6210d3-4753-4185-ad96-1bddadb42e3c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.106431 Jul 20 04:27:22.894785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1696/2821] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:22.900737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:22.902070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:22.923295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.924049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:22.929262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:22.930327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.475594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bceef85c-7066-486b-b746-47facae3cf2b tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1631 microversion: 2.1 time: 0.577164 Jul 20 04:27:23.490491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1697/2822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:22 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1631 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:23.501056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.507560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:23.515511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.525893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.526884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.527440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.571755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:23.747538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ece358c7-5a9a-4703-bbf6-817315c96e09 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 204 len: 0 microversion: 2.1 time: 0.248485 Jul 20 04:27:23.749681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1698/2823] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:23 2022] DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:23.766168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.767565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:23.779297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.780250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.782180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.784335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.899739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:23.940586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:23.943193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:23.945869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-001d660c-0b2e-4569-8021-56e30679ecc3 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1594 microversion: 2.32 time: 0.191944 Jul 20 04:27:23.947635 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1699/2824] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:23 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1594 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:23.956555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:23.958966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:23.970877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.972310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:23.974205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:23.975431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.214953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.246323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e5f2f02-7a97-4531-8c55-8de489ba02b6 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1515 microversion: 2.1 time: 0.297223 Jul 20 04:27:24.250418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1700/2825] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:23 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:24.272167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:24.273280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:24.297029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.297593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.298570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.299229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.514800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.525374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c646696-0942-4f00-be7b-2187dd0301b5 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1681 microversion: 2.1 time: 0.273547 Jul 20 04:27:24.526328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1701/2826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:24 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:24.531291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:24.532144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:24.542441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.543163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.544165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.544813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.671282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cea7f926ea42e0afdf38dd49a07647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa7fa46ea48d4a3f2101ab14e95b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.681867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0a00b50-ab78-48ed-ba93-b5a9e1d1b924 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 200 len: 1252 microversion: 2.1 time: 0.154190 Jul 20 04:27:24.683039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1702/2827] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:24 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 1252 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:24.687886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:24.688783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:24.697849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.698558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.699947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.700715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.804031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.815010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.817326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:24.818125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ecbaace5-d156-4da5-8510-15841d99d45c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.133921 Jul 20 04:27:24.824399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1703/2828] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:24 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:24.837010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:24.838072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:24.856109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.858366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:24.861605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:24.862498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.093658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.102436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5efe23de-142b-4e83-a77a-03ea5709cc04 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c" status: 200 len: 1515 microversion: 2.1 time: 0.281613 Jul 20 04:27:25.113369 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1704/2829] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:24 2022] GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:25.117658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:25.118285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:25.128040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.128625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.129438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.129893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.314397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-343fe544-4aad-4fea-ae6e-6f34dabad26e tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1614 microversion: 2.1 time: 0.209811 Jul 20 04:27:25.315092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1705/2830] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:25 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1614 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:25.323387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:25.324957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:25.327056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:25.346919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.347389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.348201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.348679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.564701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.576878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.579008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:25.581093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e21b4bb6-9bcc-4cbe-91d7-d9f4f1ff3208 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1662 microversion: 2.32 time: 0.264240 Jul 20 04:27:25.601753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1706/2831] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:25 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1662 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:25.601753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:25.601753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:25.619303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.620034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:25.622894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:25.623577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.037867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:26.054163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4bec091a-ea21-4b27-a78f-443e9e8d9cba tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 200 len: 1515 microversion: 2.1 time: 0.461007 Jul 20 04:27:26.066970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1707/2832] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:25 2022] GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:26.070430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:26.071074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.079141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.079594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.080982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.081422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.255302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] HTTP exception thrown: Cannot 'migrate' instance c71f4ced-677e-4edf-9679-d33e4e53368f while it is in vm_state suspended Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Request method failure captured: Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f/action HTTP/1.1 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pw2xYI2UETyqsAa8lEwpWkusfkGD7HkfpfleiO7QVxMeQeE3z8VMTwVAPknBffO2oBbWjL4FtFu1aGHkzeDPmGBNLfcEKOvlaPn91iXoegTgPwG9gFhXHy5FSObn81IEPgnXKuEAEoRzH3mTuhc71JP-pgSABxx_n5caYVsk8XBv8 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_195765775cff4b77a6699b9f447d1ce8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: db312e91096b4262b3afbdc4e39ba6a1 Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: {"migrate": {}} Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'migrate' instance c71f4ced-677e-4edf-9679-d33e4e53368f while it is in vm_state suspended Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c71f4ced-677e-4edf-9679-d33e4e53368f', 'body': {'migrate': {}}} Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c71f4ced-677e-4edf-9679-d33e4e53368f in vm_state suspended. Cannot resize while the instance is in this state. Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:26.257105 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance c71f4ced-677e-4edf-9679-d33e4e53368f while it is in vm_state suspended Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance c71f4ced-677e-4edf-9679-d33e4e53368f while it is in vm_state suspended Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Returning 409 to user: Cannot 'migrate' instance c71f4ced-677e-4edf-9679-d33e4e53368f while it is in vm_state suspended {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c0b698a-b3f9-4b3b-afa2-92195f431ba7 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f/action" status: 409 len: 148 microversion: 2.1 time: 0.194916 Jul 20 04:27:26.261701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1708/2833] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:26 2022] POST /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f/action => generated 148 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:27:26.277321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.278980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.291995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.296042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.296951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.297337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.544939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:26.560117 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a211dea-9599-4920-a8f9-f196af8c5f22 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1681 microversion: 2.1 time: 0.295880 Jul 20 04:27:26.574242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1709/2834] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:26.579351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.579970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] [instance: 0e0fde32-fb30-42e1-8f26-b6344000a6d9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.587660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.588900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.589843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.590428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.609980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] HTTP exception thrown: Instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 could not be found. Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Request method failure captured: Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 HTTP/1.1 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OpbUlV725wjEWkj62yjK9A03pmsBcttyARjKQm9Ov3KNyDyjXzwnWECJdFMzLt5_wLOBpU0kPSuJlZHzAsz0hll0GxVcYt7B6O51O5M_ZXYcGaU-1FXAHCGRd-2a96nGWRz8x36z9DCrh713IxzsKpqDoQmInB1aZnBdNQOJTjZA8 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0e2aa7fa46ea48d4a3f2101ab14e95b6 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestBootFromVolume-671419203 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0e2aa7fa46ea48d4a3f2101ab14e95b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e2aa7fa46ea48d4a3f2101ab14e95b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0e2aa7fa46ea48d4a3f2101ab14e95b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0e2aa7fa46ea48d4a3f2101ab14e95b6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestBootFromVolume-671419203 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0e2aa7fa46ea48d4a3f2101ab14e95b6 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestBootFromVolume-671419203 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestBootFromVolume-671419203-project Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 34cea7f926ea42e0afdf38dd49a07647 Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestBootFromVolume-671419203-project Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 could not be found. Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0e0fde32-fb30-42e1-8f26-b6344000a6d9'} Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 could not be found. Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 could not be found. Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:26.612414 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 could not be found. Jul 20 04:27:26.617390 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:26.621652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Returning 404 to user: Instance 0e0fde32-fb30-42e1-8f26-b6344000a6d9 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:26.622807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aff0747b-1757-4542-8c2c-1abeb63fd224 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9" status: 404 len: 111 microversion: 2.1 time: 0.047652 Jul 20 04:27:26.623878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1710/2835] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/0e0fde32-fb30-42e1-8f26-b6344000a6d9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:26.633476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.633476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.664576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.665627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.668503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.671664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.751517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:26.836141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:26.855972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:26.856144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:26.859234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7bd61688-748c-4237-ab39-0721d9c553c3 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.232808 Jul 20 04:27:26.861491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1711/2836] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:26 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:26.867930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:26.868632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:26.877316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.878276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.880466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:26.881403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:26.921019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:27.086914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f0678ab-8238-4f54-b52a-1cd139278af3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 204 len: 0 microversion: 2.1 time: 0.221156 Jul 20 04:27:27.088859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1712/2837] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:26 2022] DELETE /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:27.113500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af81ab3e-4503-48af-b8f6-fac19e1d708f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af81ab3e-4503-48af-b8f6-fac19e1d708f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Request method failure captured: Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6/action HTTP/1.1 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 39 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pw2xYI2UETyqsAa8lEwpWkusfkGD7HkfpfleiO7QVxMeQeE3z8VMTwVAPknBffO2oBbWjL4FtFu1aGHkzeDPmGBNLfcEKOvlaPn91iXoegTgPwG9gFhXHy5FSObn81IEPgnXKuEAEoRzH3mTuhc71JP-pgSABxx_n5caYVsk8XBv8 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_195765775cff4b77a6699b9f447d1ce8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: db312e91096b4262b3afbdc4e39ba6a1 Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: {"os-resetState": {"state": "invalid"}} Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '67e08561-4ac4-4d11-adb3-698c533a36e6', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:27.121402 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 04:27:27.126383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:27.130989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af81ab3e-4503-48af-b8f6-fac19e1d708f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:27.131904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af81ab3e-4503-48af-b8f6-fac19e1d708f tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6/action" status: 400 len: 144 microversion: 2.1 time: 0.040672 Jul 20 04:27:27.140457 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1713/2838] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:27 2022] POST /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6/action => generated 144 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:27.162993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:27.173161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:27.204504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:27.204962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.208242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:27.208743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.583882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.598296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.600768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:27.602453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d02b88da-97b6-407f-b4b7-98e2bd13b9bc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1709 microversion: 2.32 time: 0.461944 Jul 20 04:27:27.603785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1714/2839] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:27 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1709 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:27.639146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4ee939f-197a-4186-bc33-364a6c4c55a3 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] Calling method '.version_select at 0x7f838bf671f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:27.687833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4ee939f-197a-4186-bc33-364a6c4c55a3 tempest-ServersTestBootFromVolume-671419203 tempest-ServersTestBootFromVolume-671419203-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016710672" status: 202 len: 0 microversion: 2.1 time: 0.080600 Jul 20 04:27:27.694164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1715/2840] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016710672 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:27.707749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:27.709099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:27.728509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:27.729165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:27.730042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:27.731879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.088776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.128912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36ee3d50-73b2-473e-9e6c-55c0e804a0d8 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 200 len: 1521 microversion: 2.1 time: 0.429518 Jul 20 04:27:28.145596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1716/2841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:27 2022] GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:28.153190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62da458a-22f7-438a-8d93-e5d01ae92f70 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62da458a-22f7-438a-8d93-e5d01ae92f70 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Request method failure captured: Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6/action HTTP/1.1 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 31 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pw2xYI2UETyqsAa8lEwpWkusfkGD7HkfpfleiO7QVxMeQeE3z8VMTwVAPknBffO2oBbWjL4FtFu1aGHkzeDPmGBNLfcEKOvlaPn91iXoegTgPwG9gFhXHy5FSObn81IEPgnXKuEAEoRzH3mTuhc71JP-pgSABxx_n5caYVsk8XBv8 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_195765775cff4b77a6699b9f447d1ce8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: db312e91096b4262b3afbdc4e39ba6a1 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: {"os-resetState": {"state": 1}} Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '67e08561-4ac4-4d11-adb3-698c533a36e6', 'body': {'os-resetState': {'state': 1}}} Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 1 Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:27:28.160697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 04:27:28.167107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.169085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62da458a-22f7-438a-8d93-e5d01ae92f70 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:28.170697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62da458a-22f7-438a-8d93-e5d01ae92f70 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6/action" status: 400 len: 120 microversion: 2.1 time: 0.023397 Jul 20 04:27:28.171588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1717/2842] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:27:28 2022] POST /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6/action => generated 120 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:28.178984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.180191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.192545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.192545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.192545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.192545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.500992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822cb641dd2948a3abe5f6afe9c5b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751cdde65a424133bbde626d3124896f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.516976 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b500db0-bdcd-4990-b4f7-815387c6b5f8 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 200 len: 1614 microversion: 2.1 time: 0.342395 Jul 20 04:27:28.520676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1718/2843] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 1614 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:28.533572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.535290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.552649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.553250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.554170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.554802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.818428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.837713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.839526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:28.840954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fc3ee4a-87c7-4a92-a50a-861667d772fc tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.319045 Jul 20 04:27:28.841678 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1719/2844] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:28.852143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f0a831c1-85d7-4075-b2e2-6a06195bd06e req-eac94ddd-bb97-4f23-93a4-9b622052c076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c629e50b-7f00-4009-be8e-7f9e2e4a44e4", "name": "network-vif-deleted", "tag": "ec964df8-77b9-411a-806e-1b65e0a7759e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:28.868641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0a831c1-85d7-4075-b2e2-6a06195bd06e req-eac94ddd-bb97-4f23-93a4-9b622052c076 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.871190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0a831c1-85d7-4075-b2e2-6a06195bd06e req-eac94ddd-bb97-4f23-93a4-9b622052c076 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.897153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f0a831c1-85d7-4075-b2e2-6a06195bd06e req-eac94ddd-bb97-4f23-93a4-9b622052c076 service nova] Creating event network-vif-deleted:ec964df8-77b9-411a-806e-1b65e0a7759e for instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 on n-h2-764486-11 Jul 20 04:27:28.910998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f0a831c1-85d7-4075-b2e2-6a06195bd06e req-eac94ddd-bb97-4f23-93a4-9b622052c076 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067874 Jul 20 04:27:28.915795 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1720/2845] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:28.928918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16f0f2e9-b42c-4533-8081-39f41b7648e4 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:28.930159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16f0f2e9-b42c-4533-8081-39f41b7648e4 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Failed to fetch instance by id 999 {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:27:28.930944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-16f0f2e9-b42c-4533-8081-39f41b7648e4 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16f0f2e9-b42c-4533-8081-39f41b7648e4 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Request method failure captured: Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 37 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pw2xYI2UETyqsAa8lEwpWkusfkGD7HkfpfleiO7QVxMeQeE3z8VMTwVAPknBffO2oBbWjL4FtFu1aGHkzeDPmGBNLfcEKOvlaPn91iXoegTgPwG9gFhXHy5FSObn81IEPgnXKuEAEoRzH3mTuhc71JP-pgSABxx_n5caYVsk8XBv8 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/195765775cff4b77a6699b9f447d1ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_195765775cff4b77a6699b9f447d1ce8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 195765775cff4b77a6699b9f447d1ce8 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1799800658 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: db312e91096b4262b3afbdc4e39ba6a1 Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1799800658-project-admin Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: {"os-resetState": {"state": "error"}} Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 999 could not be found. Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:28.941512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:28.946320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:28.946320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 04:27:28.946320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:28.947965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16f0f2e9-b42c-4533-8081-39f41b7648e4 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:28.949200 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16f0f2e9-b42c-4533-8081-39f41b7648e4 tempest-ServersAdminNegativeTestJSON-1799800658 tempest-ServersAdminNegativeTestJSON-1799800658-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.032063 Jul 20 04:27:28.950402 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1721/2846] 10.222.0.49 () {60 vars in 1178 bytes} [Wed Jul 20 04:27:28 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:27:28.956071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:28.959850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:28.974853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.975868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:28.978990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:28.979494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.378920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:29.412607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=11 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:29.449842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:29.468087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:29.469951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:29.476630 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f94446a-2459-4c98-8ff0-73e63f102500 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1756 microversion: 2.32 time: 0.519632 Jul 20 04:27:29.477477 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1722/2847] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:28 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1756 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:29.494392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:29.495071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:29.515187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.515769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.516675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.517278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.588668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:29.771397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-866196df-7a73-4834-963a-791b13fa222b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 204 len: 0 microversion: 2.1 time: 0.289507 Jul 20 04:27:29.772193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1723/2848] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:29 2022] DELETE /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:29.792590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:29.794177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:29.821995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.822459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:29.824012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:29.824485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.397699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.413699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47d4b4f9-2fdc-4b14-a8be-8f6e1490f244 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 200 len: 1521 microversion: 2.1 time: 0.635087 Jul 20 04:27:30.414299 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1724/2849] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:29 2022] GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:30.428135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.428783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.444020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.444749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.445531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.445965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.472395 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] HTTP exception thrown: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Request method failure captured: Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 HTTP/1.1 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OJKvNWoHcDYBg-OejUGRbcRfmLDGzf3kqRr_YegR7iUOemz-hPXEnCdscS28CaRX4sjvorVPH6cXgFmgcahkguOO_Z0iIi7y_kjGrC4_wG9NsJMhbOAnDq4ZYku7ixoHwi2TBAPTSDUo2Y3hz_Gezt3WpPemLn4vYfOr8jEZvrzdk Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 751cdde65a424133bbde626d3124896f Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/751cdde65a424133bbde626d3124896f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/751cdde65a424133bbde626d3124896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/751cdde65a424133bbde626d3124896f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_751cdde65a424133bbde626d3124896f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 751cdde65a424133bbde626d3124896f Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachSCSIVolumeTestJSON-1523818572-project Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 822cb641dd2948a3abe5f6afe9c5b126 Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1523818572-project Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c629e50b-7f00-4009-be8e-7f9e2e4a44e4'} Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:30.474338 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Returning 404 to user: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42f3e7ca-23de-4bfd-89f9-a9f44919e461 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 404 len: 111 microversion: 2.1 time: 0.060522 Jul 20 04:27:30.483393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1725/2850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:30 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:30.493799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.494417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.512032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.512509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.513292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.513728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.787758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.804745 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5aee6fef-f1e3-4233-bb0c-751e00b5f1ea tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1467 microversion: 2.1 time: 0.327292 Jul 20 04:27:30.805653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1726/2851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:30 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:30.819001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:30.819866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:30.837001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.838303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.839279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:30.839871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:30.973792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.989482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.991002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:30.992181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf825897-cf1d-4684-9ca5-8f042203f58c tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1366 microversion: 2.57 time: 0.185390 Jul 20 04:27:30.993104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1727/2852] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:30 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:31.004808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f1eb583-45fe-47aa-95f1-c91212155d6c tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '.version_select at 0x7f838ba96f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.044229 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f1eb583-45fe-47aa-95f1-c91212155d6c tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876377569" status: 202 len: 0 microversion: 2.1 time: 0.050069 Jul 20 04:27:31.045014 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1728/2853] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:27:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876377569 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:27:31.050178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.051001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:31.068175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.068824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.070012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.070600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.703385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:31.727358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:31.754928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:31.761222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47053c61-66e4-47ee-bc33-4f9bcba31e1e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1756 microversion: 2.32 time: 0.711466 Jul 20 04:27:31.781118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1729/2854] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1756 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:31.796399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:31.800421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:31.824290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.837578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.839751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.840447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.930538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:31.931098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:31.931576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lazy-loading 'fault' on Instance uuid aa60e7b1-76b3-4da0-9c64-e9a772b6df41 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:32.254421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:32.257106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:32.274521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-787bf261-ee46-45a9-b97d-c586be66eac9 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 200 len: 1312 microversion: 2.1 time: 0.491354 Jul 20 04:27:32.275405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1730/2855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:31 2022] GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:32.295177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-11ebe607-e14d-4cbd-94a1-bcd72762ddeb req-2a2a4bee-4d62-45ad-b302-7c8ddab0dd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa60e7b1-76b3-4da0-9c64-e9a772b6df41", "name": "network-vif-deleted", "tag": "1a5f067e-af1c-4786-8e90-52a70f4ab69e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:32.337207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-11ebe607-e14d-4cbd-94a1-bcd72762ddeb req-2a2a4bee-4d62-45ad-b302-7c8ddab0dd74 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.340981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-11ebe607-e14d-4cbd-94a1-bcd72762ddeb req-2a2a4bee-4d62-45ad-b302-7c8ddab0dd74 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.382147 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-11ebe607-e14d-4cbd-94a1-bcd72762ddeb req-2a2a4bee-4d62-45ad-b302-7c8ddab0dd74 service nova] Creating event network-vif-deleted:1a5f067e-af1c-4786-8e90-52a70f4ab69e for instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 on n-h2-764486-11 Jul 20 04:27:32.393589 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-11ebe607-e14d-4cbd-94a1-bcd72762ddeb req-2a2a4bee-4d62-45ad-b302-7c8ddab0dd74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105438 Jul 20 04:27:32.398541 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1731/2856] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:32.413170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:32.414830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:32.425483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.426070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:32.427036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:32.427852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.043411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.053296 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dbd4d803-6543-4885-aef8-cbcd007ae7d0 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 200 len: 1467 microversion: 2.1 time: 1.650794 Jul 20 04:27:34.056518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1732/2857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:32 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 1467 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:34.071160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.071886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:34.084692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.094027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.095204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.096009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.575501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.594389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.614382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:34.616122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3946ad1-aca5-42bf-a1f2-981abfa39966 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1372 microversion: 2.57 time: 0.557742 Jul 20 04:27:34.617271 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1733/2858] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1372 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:34.622080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:34.626633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:34.641734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.646788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:34.648733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:34.649222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.640137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.658840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.663151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:35.665594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8c4a16e-a1ce-4ac0-bc42-4fedfb3d3f8c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1803 microversion: 2.32 time: 1.047192 Jul 20 04:27:35.678173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1734/2859] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:34 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1803 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:35.686586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.687207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.704719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.707430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.709320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.710305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.741159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] HTTP exception thrown: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 HTTP/1.1 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'aa60e7b1-76b3-4da0-9c64-e9a772b6df41'} Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:35.743132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:35.747351 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.749243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 404 to user: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:35.750404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34416383-1e17-48e5-b31a-9c6391676d44 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 404 len: 111 microversion: 2.1 time: 0.071172 Jul 20 04:27:35.751182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1735/2860] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:35.757935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8cb2564e-061c-4297-a14f-e97d85afb61a req-a7103d49-4e73-461f-b66e-838c6a4483e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71f4ced-677e-4edf-9679-d33e4e53368f", "name": "network-vif-deleted", "tag": "87497f5e-9513-428f-923d-1245ea835779"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:35.767463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8cb2564e-061c-4297-a14f-e97d85afb61a req-a7103d49-4e73-461f-b66e-838c6a4483e6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.768821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8cb2564e-061c-4297-a14f-e97d85afb61a req-a7103d49-4e73-461f-b66e-838c6a4483e6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.783396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8cb2564e-061c-4297-a14f-e97d85afb61a req-a7103d49-4e73-461f-b66e-838c6a4483e6 service nova] Creating event network-vif-deleted:87497f5e-9513-428f-923d-1245ea835779 for instance c71f4ced-677e-4edf-9679-d33e4e53368f on n-h1-764486-11 Jul 20 04:27:35.792243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8cb2564e-061c-4297-a14f-e97d85afb61a req-a7103d49-4e73-461f-b66e-838c6a4483e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Jul 20 04:27:35.793635 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1736/2861] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:35.799467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.800650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: c71f4ced-677e-4edf-9679-d33e4e53368f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.807844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.808609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.809816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.810455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.829851 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] HTTP exception thrown: Instance c71f4ced-677e-4edf-9679-d33e4e53368f could not be found. Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Request method failure captured: Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f HTTP/1.1 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pv-TpdZZlXSaBZFFIgdoAW2CDhcZRc1CASadKypTPtFRgXd2HRyogDQMXUke-MneMaiPQRvbSS6Tv89V43cwfxGOHySqKAWGNO4bA2Gbdxf1IM-v6N2en1A0Zu6kIHM0Pmz3-m88C7v7TbRhbFWfNxi0bAUdm0bx0WQF-WBEo4L9o Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5b4925333f5d430ca137781e7ad06c7b Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1150535466 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b4925333f5d430ca137781e7ad06c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b4925333f5d430ca137781e7ad06c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b4925333f5d430ca137781e7ad06c7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b4925333f5d430ca137781e7ad06c7b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1150535466 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5b4925333f5d430ca137781e7ad06c7b Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1150535466 Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1150535466-project Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 20f25a7fea804ebabdece373f26ff43d Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1150535466-project Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c71f4ced-677e-4edf-9679-d33e4e53368f could not be found. Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c71f4ced-677e-4edf-9679-d33e4e53368f'} Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71f4ced-677e-4edf-9679-d33e4e53368f could not be found. Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71f4ced-677e-4edf-9679-d33e4e53368f could not be found. Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.832719 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71f4ced-677e-4edf-9679-d33e4e53368f could not be found. Jul 20 04:27:35.836684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:35.839021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Returning 404 to user: Instance c71f4ced-677e-4edf-9679-d33e4e53368f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:35.840164 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0bb73451-6e17-4d3b-8a34-e5f7a750d12b tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f" status: 404 len: 111 microversion: 2.1 time: 0.045148 Jul 20 04:27:35.841376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1737/2862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/c71f4ced-677e-4edf-9679-d33e4e53368f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:35.847608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:35.848849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:35.857119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.857877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:35.859015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:35.859723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.151062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.162741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.191415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.193994 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d5f8a4d-6a75-4448-b2d6-bb54237ba2f7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1372 microversion: 2.57 time: 0.350592 Jul 20 04:27:36.196294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1738/2863] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:35 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:36.219425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.240424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:36.241317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:36.270742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.271197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.272002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.272481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.503425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-514c2205-76c9-435e-86f0-35ef6c1d3d3b tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.296344 Jul 20 04:27:36.504680 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1739/2864] 10.222.0.49 () {58 vars in 1229 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:36.512115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.513077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:36.520774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.521559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.522689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.523726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.569414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:36.865952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85787967-e396-439f-8a17-c768cb3b1833 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "DELETE /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 204 len: 0 microversion: 2.1 time: 0.359505 Jul 20 04:27:36.873518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1740/2865] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:36 2022] DELETE /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:36.903008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a815847-e94e-456f-9bf0-43097c3f8e16 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a815847-e94e-456f-9bf0-43097c3f8e16 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:27:36.919056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 04:27:36.925119 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:36.931808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a815847-e94e-456f-9bf0-43097c3f8e16 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:36.933405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a815847-e94e-456f-9bf0-43097c3f8e16 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.056745 Jul 20 04:27:36.942892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1741/2866] 10.222.0.49 () {58 vars in 1181 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:36.954065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:36.955271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:36.967809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.969237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:36.970255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:36.971937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.558752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:37.592292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:37.593844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:37.611841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a051849-7664-4651-9619-c5383354cb32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1803 microversion: 2.32 time: 0.667126 Jul 20 04:27:37.629306 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1742/2867] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:36 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1803 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:37.650958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:37.651567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:37.669236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.669708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:37.670506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:37.670940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.189261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.200738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1140f05a-f846-4598-b90c-5dbbf83a7f1f tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1478 microversion: 2.1 time: 0.570086 Jul 20 04:27:38.217683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1743/2868] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:37 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1478 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:38.239032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:38.253535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.254436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:38.283581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.284401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.286573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.289471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.405702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:27:38.477856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcb22877-d246-48f4-ae84-188115c20445 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.257369 Jul 20 04:27:38.484719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1744/2869] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:27:38 2022] GET /compute/v2.1/servers => generated 681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:38.490296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:38.491482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:38.501716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.502288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.503155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.503657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.673616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.691279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.695030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.700874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb7279ab-f49c-4e9f-b894-cb05447799d7 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1357 microversion: 2.57 time: 0.217203 Jul 20 04:27:38.706647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1745/2870] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:38 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:38.719994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:38.743872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:38.744344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.servers [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Removing options 'limit' from query {{(pid=123724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:27:38.745080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:38.770390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.770989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.772189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.776005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.892173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:27:38.944318 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86a89ad4-7900-46b2-886b-8ade3b017f79 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.235831 Jul 20 04:27:38.945979 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1746/2871] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Jul 20 04:27:38 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:38.960952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:38.963533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:38.984180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.984180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:38.988646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:38.990408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.887872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.898957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.908791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:39.910214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba98b636-8eff-4688-930d-d2e5e2ba3007 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1850 microversion: 2.32 time: 0.963188 Jul 20 04:27:39.910823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1747/2872] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:38 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1850 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:39.936611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:39.937129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:39.939228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:39.956687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.957146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:39.958004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:39.958444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.025658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:40.082323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:40.199513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-368527f8-4f0a-4810-bb6b-a6e85c19de01 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 204 len: 0 microversion: 2.57 time: 0.276325 Jul 20 04:27:40.200047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1748/2873] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:27:39 2022] DELETE /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:27:40.210801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c6183a3-33f6-4b3c-b01c-83c8b8e85ed7 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c6183a3-33f6-4b3c-b01c-83c8b8e85ed7 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '-1' Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:27:40.215605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 04:27:40.220936 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.227143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c6183a3-33f6-4b3c-b01c-83c8b8e85ed7 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:40.228083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c6183a3-33f6-4b3c-b01c-83c8b8e85ed7 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.026892 Jul 20 04:27:40.233230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1749/2874] 10.222.0.49 () {58 vars in 1141 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:40.242334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.243461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:40.260644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.261378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.263367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.264007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.496795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f25a7fea804ebabdece373f26ff43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4925333f5d430ca137781e7ad06c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.511046 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-051f4f93-968b-4ab2-ac8e-ee76d2467949 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 200 len: 1436 microversion: 2.1 time: 0.273162 Jul 20 04:27:40.515200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1750/2875] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 1436 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:40.525838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.535219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:40.542127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.542841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.543821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.553863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.699481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.711391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.722885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.758241 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1863cb4a-0348-4eba-948e-19dfd5020f70 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1363 microversion: 2.57 time: 0.241213 Jul 20 04:27:40.761813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1751/2876] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:40.785925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a5a68ae-ae40-44e3-a1ff-61d828d33714 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a5a68ae-ae40-44e3-a1ff-61d828d33714 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'testing' Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 04:27:40.791365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 04:27:40.797080 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:40.803368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a5a68ae-ae40-44e3-a1ff-61d828d33714 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:40.804527 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a5a68ae-ae40-44e3-a1ff-61d828d33714 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.039908 Jul 20 04:27:40.814034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1752/2877] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:40.825098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cd728552-2d02-48be-a825-c031084ed54f req-65fea591-150f-4363-bb66-1f1ff449be42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e08561-4ac4-4d11-adb3-698c533a36e6", "name": "network-vif-deleted", "tag": "4197c3a4-a049-4198-a66a-edf03d29a433"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:40.847539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cd728552-2d02-48be-a825-c031084ed54f req-65fea591-150f-4363-bb66-1f1ff449be42 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:40.848157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cd728552-2d02-48be-a825-c031084ed54f req-65fea591-150f-4363-bb66-1f1ff449be42 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:40.874612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cd728552-2d02-48be-a825-c031084ed54f req-65fea591-150f-4363-bb66-1f1ff449be42 service nova] Creating event network-vif-deleted:4197c3a4-a049-4198-a66a-edf03d29a433 for instance 67e08561-4ac4-4d11-adb3-698c533a36e6 on n-h1-764486-11 Jul 20 04:27:40.881853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cd728552-2d02-48be-a825-c031084ed54f req-65fea591-150f-4363-bb66-1f1ff449be42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065393 Jul 20 04:27:40.885262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1753/2878] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:40.905646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b7f8cff-0052-476f-86b6-47e015a7593c tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.910333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b7f8cff-0052-476f-86b6-47e015a7593c tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:40.911113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b7f8cff-0052-476f-86b6-47e015a7593c tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:40.954102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.servers [None req-8b7f8cff-0052-476f-86b6-47e015a7593c tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Flavor 'non_existing_flavor' could not be found {{(pid=123724) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 20 04:27:40.955647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b7f8cff-0052-476f-86b6-47e015a7593c tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.068918 Jul 20 04:27:40.956466 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1754/2879] 10.222.0.49 () {58 vars in 1177 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:40.974615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:40.985535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.000086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.006775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.009815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.020599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.497384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.515645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.518613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.523617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cc17611-37b6-404b-affd-8100b2281d78 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1850 microversion: 2.32 time: 0.565642 Jul 20 04:27:41.536218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1755/2880] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:40 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1850 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:41.541598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.557176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.558316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:41.575311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.576048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.577131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.577922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.735470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e6d2b6f-1ac4-435a-9e79-2d49b7878774 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.197789 Jul 20 04:27:41.736558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1756/2881] 10.222.0.49 () {58 vars in 1173 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:41.756253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.757303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] [instance: 67e08561-4ac4-4d11-adb3-698c533a36e6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:41.766977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.767702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.769018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.769717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.797615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] HTTP exception thrown: Instance 67e08561-4ac4-4d11-adb3-698c533a36e6 could not be found. Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Request method failure captured: Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 HTTP/1.1 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pv-TpdZZlXSaBZFFIgdoAW2CDhcZRc1CASadKypTPtFRgXd2HRyogDQMXUke-MneMaiPQRvbSS6Tv89V43cwfxGOHySqKAWGNO4bA2Gbdxf1IM-v6N2en1A0Zu6kIHM0Pmz3-m88C7v7TbRhbFWfNxi0bAUdm0bx0WQF-WBEo4L9o Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5b4925333f5d430ca137781e7ad06c7b Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1150535466 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b4925333f5d430ca137781e7ad06c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b4925333f5d430ca137781e7ad06c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b4925333f5d430ca137781e7ad06c7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b4925333f5d430ca137781e7ad06c7b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1150535466 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5b4925333f5d430ca137781e7ad06c7b Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1150535466 Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1150535466-project Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 20f25a7fea804ebabdece373f26ff43d Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1150535466-project Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 67e08561-4ac4-4d11-adb3-698c533a36e6 could not be found. Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '67e08561-4ac4-4d11-adb3-698c533a36e6'} Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e08561-4ac4-4d11-adb3-698c533a36e6 could not be found. Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e08561-4ac4-4d11-adb3-698c533a36e6 could not be found. Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:41.801767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e08561-4ac4-4d11-adb3-698c533a36e6 could not be found. Jul 20 04:27:41.807176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:41.809412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] Returning 404 to user: Instance 67e08561-4ac4-4d11-adb3-698c533a36e6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:41.810637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc2d5c18-d658-4aed-8717-80a59daaa201 tempest-ServersAdminNegativeTestJSON-1150535466 tempest-ServersAdminNegativeTestJSON-1150535466-project] 10.222.0.49 "GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6" status: 404 len: 111 microversion: 2.1 time: 0.072301 Jul 20 04:27:41.815416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1757/2882] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers/67e08561-4ac4-4d11-adb3-698c533a36e6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:41.840748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:41.853092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:41.854107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:41.865681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.867378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:41.870847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:41.872318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.011869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a33936e-169d-4c1f-80c9-b7f1eae1bf84 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.194622 Jul 20 04:27:42.020011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1758/2883] 10.222.0.49 () {58 vars in 1183 bytes} [Wed Jul 20 04:27:41 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:42.025655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.027252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:42.034964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.035762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.036760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.037848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.174328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.201384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.215598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.231193 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe94ccc2-1d9d-49d8-9043-34de340d5f0f tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1363 microversion: 2.57 time: 0.207548 Jul 20 04:27:42.243663 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1759/2884] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:42.259765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.275836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.276642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:42.306634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.310048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.312379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.313967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.385736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:27:42.506345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:42.528825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.529314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:42.955231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a97ab47-6f86-4baa-a685-ae27ea8b628f tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.709613 Jul 20 04:27:42.969102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1760/2885] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:42.977942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:42.977942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:42.995483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:42.996430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.000443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.001028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.418584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.432138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.433997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.435842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd42799f-68d0-404d-abb2-bc4b23423c73 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1850 microversion: 2.32 time: 0.465665 Jul 20 04:27:43.437199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1761/2886] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:42 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1850 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:43.443726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21602ff2-12a8-46b0-8a70-49d4d4fd36f2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.447895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21602ff2-12a8-46b0-8a70-49d4d4fd36f2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.449320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21602ff2-12a8-46b0-8a70-49d4d4fd36f2 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010836 Jul 20 04:27:43.450146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1762/2887] 10.222.0.49 () {58 vars in 1177 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:27:43.466744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.483081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:43.510159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.512453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.515448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.517065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.576801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.577263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.577718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lazy-loading 'fault' on Instance uuid 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:27:43.680438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.719034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.726284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91180d97f6c3444ea48f972df1a72f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048c3e35be7b4092ac420a7cd3bc263d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.729487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ae85dc2-3cb0-4dfc-a6e3-ec0a09640c4b tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 200 len: 1368 microversion: 2.57 time: 0.270264 Jul 20 04:27:43.746070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1763/2888] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:43.758409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ecad3eeb-9a3f-47c8-a2d2-10f7df907d47 req-ab474207-a7b0-40b6-9ae5-81eb58b4d88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "d3cf2916-8fe8-4548-8f60-ba2b57714d64"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:43.770497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ecad3eeb-9a3f-47c8-a2d2-10f7df907d47 req-ab474207-a7b0-40b6-9ae5-81eb58b4d88d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.771725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ecad3eeb-9a3f-47c8-a2d2-10f7df907d47 req-ab474207-a7b0-40b6-9ae5-81eb58b4d88d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.790980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ecad3eeb-9a3f-47c8-a2d2-10f7df907d47 req-ab474207-a7b0-40b6-9ae5-81eb58b4d88d service nova] Creating event network-changed:d3cf2916-8fe8-4548-8f60-ba2b57714d64 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:27:43.801341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ecad3eeb-9a3f-47c8-a2d2-10f7df907d47 req-ab474207-a7b0-40b6-9ae5-81eb58b4d88d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053200 Jul 20 04:27:43.802727 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1764/2889] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:43.810623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:43.814317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:43.815857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Searching by: {'deleted': False, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:27:43.852625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.853457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.865080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:43.867829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:43.950104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:27:44.036782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a06bc5c-b9bd-44d0-b4ce-4f7a528995d1 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.231741 Jul 20 04:27:44.039512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1765/2890] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:27:43 2022] GET /compute/v2.1/servers => generated 681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:44.057221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.058981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.066496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.075176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.076307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.079776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.106158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] HTTP exception thrown: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 HTTP/1.1 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'aa60e7b1-76b3-4da0-9c64-e9a772b6df41'} Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:44.108743 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:44.114369 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:44.117184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 404 to user: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:44.118327 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53a563b4-1124-4551-b05c-3e7cd12c1cdc tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "DELETE /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 404 len: 111 microversion: 2.1 time: 0.067943 Jul 20 04:27:44.122651 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1766/2891] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:44 2022] DELETE /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:44.129918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.130680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.137247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.137971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.138908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.139499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.174421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:44.327718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d60168e8-e776-4d81-aa3b-cb467374b7fa tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "DELETE /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c" status: 204 len: 0 microversion: 2.1 time: 0.203345 Jul 20 04:27:44.332814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1767/2892] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:44 2022] DELETE /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:44.347502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.349569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.369013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.371642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.372748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.373403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.453482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:27:44.535266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:44.634633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c020024b-5b7e-46bc-90d8-fb617e262291 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 204 len: 0 microversion: 2.1 time: 0.299468 Jul 20 04:27:44.636764 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1768/2893] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:44 2022] DELETE /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:27:44.649414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:44.652757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:44.673414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.674225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:44.686153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:44.687859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:45.925874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.955731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.958010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:45.959874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2870522-8d0d-4471-b963-7e483196b46c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1850 microversion: 2.32 time: 1.320524 Jul 20 04:27:45.960723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1769/2894] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:44 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1850 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:45.980588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:45.984802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: aa60e7b1-76b3-4da0-9c64-e9a772b6df41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:46.020969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.021582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.022225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.022804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.104132 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] HTTP exception thrown: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 HTTP/1.1 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'aa60e7b1-76b3-4da0-9c64-e9a772b6df41'} Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:46.115528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. Jul 20 04:27:46.126365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.132847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 404 to user: Instance aa60e7b1-76b3-4da0-9c64-e9a772b6df41 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:46.137295 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76848014-bee7-45f3-965e-969a4d2bd591 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41" status: 404 len: 111 microversion: 2.1 time: 0.163141 Jul 20 04:27:46.156378 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1770/2895] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:45 2022] GET /compute/v2.1/servers/aa60e7b1-76b3-4da0-9c64-e9a772b6df41 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:46.183704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.187555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] [instance: 5c4bfd19-2f4c-400d-8dee-e45fc2c77911] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:46.251035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.274431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.277019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.279599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.334698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] HTTP exception thrown: Instance 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 could not be found. Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Request method failure captured: Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 HTTP/1.1 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QLROBJqsu7RO7D8vAQqxg0Ei86bR1ZkFYNUgtdYEH-5T7yWKAirjxjji6E_uNZQJfLLIaDbuuipCC-4qLFzkauI5Yrj8lfLMJX1cKHus_H3MDijD3yR2jlcoxbiQFA7PwOTH5q9gel54ZnhNaJSHT0AU3TqMERYdWXiwWBU-fLaOg Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.57 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 048c3e35be7b4092ac420a7cd3bc263d Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerShowV257Test-2016265227 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/048c3e35be7b4092ac420a7cd3bc263d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/048c3e35be7b4092ac420a7cd3bc263d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/048c3e35be7b4092ac420a7cd3bc263d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_048c3e35be7b4092ac420a7cd3bc263d", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerShowV257Test-2016265227 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 048c3e35be7b4092ac420a7cd3bc263d Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerShowV257Test-2016265227 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerShowV257Test-2016265227-project Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 91180d97f6c3444ea48f972df1a72f30 Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerShowV257Test-2016265227-project Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 could not be found. Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5c4bfd19-2f4c-400d-8dee-e45fc2c77911'} Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 could not be found. Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 could not be found. Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:46.342827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 could not be found. Jul 20 04:27:46.347523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:46.354783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] Returning 404 to user: Instance 5c4bfd19-2f4c-400d-8dee-e45fc2c77911 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:46.356956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2bcbb83c-4cc8-41af-b8d1-4f21e3227374 tempest-ServerShowV257Test-2016265227 tempest-ServerShowV257Test-2016265227-project] 10.222.0.49 "GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911" status: 404 len: 111 microversion: 2.57 time: 0.198783 Jul 20 04:27:46.362568 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1771/2896] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/5c4bfd19-2f4c-400d-8dee-e45fc2c77911 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:46.376681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.378172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:46.395765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.399513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.400835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:46.403108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:46.865597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:46.881224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b010ec2-a8df-40ca-b03c-c6bab3374bb3 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c" status: 200 len: 1521 microversion: 2.1 time: 0.515022 Jul 20 04:27:46.883596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1772/2897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:46.991536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:46.993561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.009952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.010967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.011946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.017291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.803720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.815885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.839330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:47.841671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00b94635-4137-47a0-8bc0-dcc48e9c47d6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1871 microversion: 2.32 time: 0.854420 Jul 20 04:27:47.845376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1773/2898] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:46 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1871 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:47.899808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:47.900509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:47.920619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.925071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:47.928380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:47.931782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.538183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:48.551231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fca0249-0b36-47a2-a49c-5cb9078de030 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c" status: 200 len: 1479 microversion: 2.1 time: 0.654584 Jul 20 04:27:48.552455 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1774/2899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:47 2022] GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c => generated 1479 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:48.562641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-415cdc82-c0ab-4c4b-9e51-0bc9e2c950c9 req-5cf8a33b-53bf-4389-bafb-c9f12dd27dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c", "name": "network-vif-deleted", "tag": "700e3628-c50e-4224-816b-05d00e66f7e1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:48.587242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-415cdc82-c0ab-4c4b-9e51-0bc9e2c950c9 req-5cf8a33b-53bf-4389-bafb-c9f12dd27dbc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.588116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-415cdc82-c0ab-4c4b-9e51-0bc9e2c950c9 req-5cf8a33b-53bf-4389-bafb-c9f12dd27dbc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.621944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-415cdc82-c0ab-4c4b-9e51-0bc9e2c950c9 req-5cf8a33b-53bf-4389-bafb-c9f12dd27dbc service nova] Creating event network-vif-deleted:700e3628-c50e-4224-816b-05d00e66f7e1 for instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c on n-h1-764486-11 Jul 20 04:27:48.635230 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-415cdc82-c0ab-4c4b-9e51-0bc9e2c950c9 req-5cf8a33b-53bf-4389-bafb-c9f12dd27dbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077486 Jul 20 04:27:48.639893 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1775/2900] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:48.862342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:48.863523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:48.873652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.882711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:48.885051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:48.886592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.592546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.609392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.613043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:49.617413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4704c24d-c85d-4bdd-9e63-0a31c90b29d5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1871 microversion: 2.32 time: 0.760302 Jul 20 04:27:49.619812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1776/2901] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:48 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1871 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:49.642867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:49.645096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:49.671674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.672130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.675563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.675854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.724562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] HTTP exception thrown: Instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c could not be found. Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c HTTP/1.1 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c could not be found. Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c'} Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c could not be found. Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c could not be found. Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:49.733531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c could not be found. Jul 20 04:27:49.738157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:49.740725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 404 to user: Instance 09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:49.745941 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78ea9e9f-3848-42de-9432-29d3b89e34dd tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c" status: 404 len: 111 microversion: 2.1 time: 0.119270 Jul 20 04:27:49.746695 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1777/2902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:49 2022] GET /compute/v2.1/servers/09c31e0c-d8ea-4aa1-b2f4-ef812bcc8e1c => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:49.760990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:49.761994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:49.773830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.775992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:49.783773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:49.784498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.325685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e127947e624943f2b9acce93ac3cf3d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9293b3300f84bc984d2c08a7238ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:50.335904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06672a98-75b9-46c7-9c62-af10172bc602 tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 200 len: 1521 microversion: 2.1 time: 0.583700 Jul 20 04:27:50.339983 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1778/2903] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:49 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:50.352313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.354629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.368638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.381258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.382574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.383823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.423771 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] HTTP exception thrown: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Request method failure captured: Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 HTTP/1.1 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OJKvNWoHcDYBg-OejUGRbcRfmLDGzf3kqRr_YegR7iUOemz-hPXEnCdscS28CaRX4sjvorVPH6cXgFmgcahkguOO_Z0iIi7y_kjGrC4_wG9NsJMhbOAnDq4ZYku7ixoHwi2TBAPTSDUo2Y3hz_Gezt3WpPemLn4vYfOr8jEZvrzdk Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 751cdde65a424133bbde626d3124896f Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/751cdde65a424133bbde626d3124896f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/751cdde65a424133bbde626d3124896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/751cdde65a424133bbde626d3124896f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_751cdde65a424133bbde626d3124896f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 751cdde65a424133bbde626d3124896f Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachSCSIVolumeTestJSON-1523818572-project Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 822cb641dd2948a3abe5f6afe9c5b126 Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1523818572-project Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c629e50b-7f00-4009-be8e-7f9e2e4a44e4'} Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:50.427132 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.432712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Returning 404 to user: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:50.435588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed064301-a699-4f3e-8799-404c44429132 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 404 len: 111 microversion: 2.1 time: 0.083853 Jul 20 04:27:50.440240 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1779/2904] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:27:50 2022] DELETE /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:50.450589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.451240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] [instance: c629e50b-7f00-4009-be8e-7f9e2e4a44e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.467691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.468486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.469633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.472795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.515809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] HTTP exception thrown: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Request method failure captured: Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 HTTP/1.1 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14OJKvNWoHcDYBg-OejUGRbcRfmLDGzf3kqRr_YegR7iUOemz-hPXEnCdscS28CaRX4sjvorVPH6cXgFmgcahkguOO_Z0iIi7y_kjGrC4_wG9NsJMhbOAnDq4ZYku7ixoHwi2TBAPTSDUo2Y3hz_Gezt3WpPemLn4vYfOr8jEZvrzdk Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 751cdde65a424133bbde626d3124896f Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/751cdde65a424133bbde626d3124896f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/751cdde65a424133bbde626d3124896f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/751cdde65a424133bbde626d3124896f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_751cdde65a424133bbde626d3124896f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 751cdde65a424133bbde626d3124896f Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1523818572 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachSCSIVolumeTestJSON-1523818572-project Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 822cb641dd2948a3abe5f6afe9c5b126 Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1523818572-project Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c629e50b-7f00-4009-be8e-7f9e2e4a44e4'} Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:50.528000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] Returning 404 to user: Instance c629e50b-7f00-4009-be8e-7f9e2e4a44e4 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08b745ac-d56a-4ad0-8ef2-fd69dffca842 tempest-AttachSCSIVolumeTestJSON-1523818572 tempest-AttachSCSIVolumeTestJSON-1523818572-project] 10.222.0.49 "GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4" status: 404 len: 111 microversion: 2.1 time: 0.088280 Jul 20 04:27:50.532892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1780/2905] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:50 2022] GET /compute/v2.1/servers/c629e50b-7f00-4009-be8e-7f9e2e4a44e4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:50.639669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:50.640248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:50.660645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.661107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:50.669346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:50.669921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:51.955008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:51.972937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:51.974525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:51.975874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68ac1b12-d8af-42e7-acbd-98e80aa3ec0c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1892 microversion: 2.32 time: 1.341231 Jul 20 04:27:51.999933 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1781/2906] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:50 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1892 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:52.012538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-450f8119-e231-4921-8311-1b8daf573303 req-0a690acc-4a26-4516-acf7-d86b5babc805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "36018059-71b9-4780-a646-a5340eca8c36"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:52.030037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-450f8119-e231-4921-8311-1b8daf573303 req-0a690acc-4a26-4516-acf7-d86b5babc805 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.030839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-450f8119-e231-4921-8311-1b8daf573303 req-0a690acc-4a26-4516-acf7-d86b5babc805 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.043297 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-450f8119-e231-4921-8311-1b8daf573303 req-0a690acc-4a26-4516-acf7-d86b5babc805 service nova] Creating event network-changed:36018059-71b9-4780-a646-a5340eca8c36 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:27:52.062256 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-450f8119-e231-4921-8311-1b8daf573303 req-0a690acc-4a26-4516-acf7-d86b5babc805 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058215 Jul 20 04:27:52.065203 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1782/2907] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:52.497097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:52.636301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Action: 'update', calling method: .version_select at 0x7f8398757b80>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:52.637713 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:52.637713 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:52.639279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.639914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.664786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.665716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.683469 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] HTTP exception thrown: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Request method failure captured: Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 HTTP/1.1 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 56 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RHlz0vebzuNG5r2oTzSi3iwhkoEakXxmVh7y1irFoduiW_DOPVpVAhxk_aw-AN27ctCSo6Vvh4c_qhPohvUyDaBtqTtQkws-bb969JmQm5UN1a8KKYeo-BmJrckTq39c_R-LkWB9Kse1-0qBz5MxuosC1FD0ELC10rs425kQzRYG0 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3d4212e4c20745e69492b0aa70f3f194 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d4212e4c20745e69492b0aa70f3f194", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3d4212e4c20745e69492b0aa70f3f194 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 3a9524f8fe304e35ac59de5f7d4327ab Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: exception: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:52.685727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.691446 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.693943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Returning 404 to user: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:52.695305 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e9c325d-df49-4c77-a216-de9dde3e28a9 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0" status: 404 len: 110 microversion: 2.53 time: 0.627529 Jul 20 04:27:52.696527 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1783/2908] 10.222.0.49 () {62 vars in 1308 bytes} [Wed Jul 20 04:27:52 2022] PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 => generated 110 bytes in 630 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:52.702390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.703690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] [instance: 7aa9a86d-4109-4bcd-b7c9-b06421abd79b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:52.721477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.722206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.723337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.724016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.747438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] HTTP exception thrown: Instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b could not be found. Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Request method failure captured: Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b HTTP/1.1 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14QESSSMXtGDvJqNriXaaVjcK_NgT9ctoyeKqk204wF7Kxls74f7dJSyhfYhiKhxwNJY1niFYWXnEsnpb1gxApgNuM1TjvOsC-3fkEuyV66MHUHyvqUIx8veS7uATvW_XwuDWpdiyEf9swzex11cmwQmXwGClyqF_rC7Xy9HrrslOPk Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9293b3300f84bc984d2c08a7238ecfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9293b3300f84bc984d2c08a7238ecfb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c9293b3300f84bc984d2c08a7238ecfb Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1916171534 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e127947e624943f2b9acce93ac3cf3d3 Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServersNegativeTestJSON-1916171534-project Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b could not be found. Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7aa9a86d-4109-4bcd-b7c9-b06421abd79b'} Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b could not be found. Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b could not be found. Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.749546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b could not be found. Jul 20 04:27:52.755282 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.758627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] Returning 404 to user: Instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:52.759978 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-146bed8b-194c-43d5-ab38-44b42138a1ca tempest-ListServersNegativeTestJSON-1916171534 tempest-ListServersNegativeTestJSON-1916171534-project] 10.222.0.49 "GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b" status: 404 len: 111 microversion: 2.1 time: 0.062209 Jul 20 04:27:52.761158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1784/2909] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/servers/7aa9a86d-4109-4bcd-b7c9-b06421abd79b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:27:52.768390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Action: 'update', calling method: .version_select at 0x7f839ccedaf0>, body: {"status": "disabled"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:52.774692 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:52.774692 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:52.777165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.777616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.792817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.793539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.812679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] HTTP exception thrown: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Request method failure captured: Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 HTTP/1.1 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 22 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RHlz0vebzuNG5r2oTzSi3iwhkoEakXxmVh7y1irFoduiW_DOPVpVAhxk_aw-AN27ctCSo6Vvh4c_qhPohvUyDaBtqTtQkws-bb969JmQm5UN1a8KKYeo-BmJrckTq39c_R-LkWB9Kse1-0qBz5MxuosC1FD0ELC10rs425kQzRYG0 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3d4212e4c20745e69492b0aa70f3f194 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d4212e4c20745e69492b0aa70f3f194", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3d4212e4c20745e69492b0aa70f3f194 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 3a9524f8fe304e35ac59de5f7d4327ab Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: {"status": "disabled"} Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: exception: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0', 'body': {'status': 'disabled'}} Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:52.815713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Returning 404 to user: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d936865b-e373-4089-9a08-cee4b4963627 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0" status: 404 len: 110 microversion: 2.53 time: 0.056631 Jul 20 04:27:52.820818 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1785/2910] 10.222.0.49 () {62 vars in 1308 bytes} [Wed Jul 20 04:27:52 2022] PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:52.834923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Action: 'update', calling method: .version_select at 0x7f838b878790>, body: {"status": "enabled"} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:52.838579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.839042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.858475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.858939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.873516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] HTTP exception thrown: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Request method failure captured: Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 HTTP/1.1 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 21 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RHlz0vebzuNG5r2oTzSi3iwhkoEakXxmVh7y1irFoduiW_DOPVpVAhxk_aw-AN27ctCSo6Vvh4c_qhPohvUyDaBtqTtQkws-bb969JmQm5UN1a8KKYeo-BmJrckTq39c_R-LkWB9Kse1-0qBz5MxuosC1FD0ELC10rs425kQzRYG0 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3d4212e4c20745e69492b0aa70f3f194 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3d4212e4c20745e69492b0aa70f3f194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3d4212e4c20745e69492b0aa70f3f194", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3d4212e4c20745e69492b0aa70f3f194 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776 Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 3a9524f8fe304e35ac59de5f7d4327ab Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: {"status": "enabled"} Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: exception: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0', 'body': {'status': 'enabled'}} Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:27:52.878508 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. Jul 20 04:27:52.883783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:52.887934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Returning 404 to user: Service ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:52.889133 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02f9a326-7d67-4b12-958e-8eb1e62e2c24 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0" status: 404 len: 110 microversion: 2.53 time: 0.062696 Jul 20 04:27:52.889926 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1786/2911] 10.222.0.49 () {62 vars in 1308 bytes} [Wed Jul 20 04:27:52 2022] PUT /compute/v2.1/os-services/ac2ef16a-cfe1-4e4b-9475-c18e1bbe9ed0 => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:52.906590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f9699b0-11d2-428a-9a4a-a3e0c0ac1f9e tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.909299 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:52.909299 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:52.911072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9699b0-11d2-428a-9a4a-a3e0c0ac1f9e tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.919760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9699b0-11d2-428a-9a4a-a3e0c0ac1f9e tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.921104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9699b0-11d2-428a-9a4a-a3e0c0ac1f9e tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:52.921820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9699b0-11d2-428a-9a4a-a3e0c0ac1f9e tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:52.969351 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f9699b0-11d2-428a-9a4a-a3e0c0ac1f9e tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.066489 Jul 20 04:27:52.981193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1787/2912] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:52.993789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29ce0bb1-3ec5-4425-8377-594c73e4b9ec tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:52.998719 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:52.998719 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:53.011009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29ce0bb1-3ec5-4425-8377-594c73e4b9ec tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.011507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29ce0bb1-3ec5-4425-8377-594c73e4b9ec tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.012327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29ce0bb1-3ec5-4425-8377-594c73e4b9ec tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.017148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29ce0bb1-3ec5-4425-8377-594c73e4b9ec tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.055761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29ce0bb1-3ec5-4425-8377-594c73e4b9ec tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.065644 Jul 20 04:27:53.056414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1788/2913] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jul 20 04:27:52 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:53.073905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:53.074529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:53.091056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.091822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.092850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.093522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.940129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.956057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.957771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:53.965357 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09c61fa3-34b3-457f-bd75-2cd2b18e945e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1892 microversion: 2.32 time: 0.905304 Jul 20 04:27:53.966244 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1789/2914] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:53 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1892 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:53.971169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe03a667-d61d-40d6-a6bc-4ca9bfe8f015 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:53.978315 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:53.978315 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:53.980160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe03a667-d61d-40d6-a6bc-4ca9bfe8f015 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.983950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe03a667-d61d-40d6-a6bc-4ca9bfe8f015 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:53.985265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe03a667-d61d-40d6-a6bc-4ca9bfe8f015 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:53.989491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe03a667-d61d-40d6-a6bc-4ca9bfe8f015 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.022715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:54.047319 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe03a667-d61d-40d6-a6bc-4ca9bfe8f015 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.079649 Jul 20 04:27:54.048279 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1790/2915] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Jul 20 04:27:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:54.065197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e1057b2-5187-449a-ab0e-bbbcc7dd2dcc tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.069463 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:54.069463 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:54.071909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e1057b2-5187-449a-ab0e-bbbcc7dd2dcc tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.072755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e1057b2-5187-449a-ab0e-bbbcc7dd2dcc tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.074186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e1057b2-5187-449a-ab0e-bbbcc7dd2dcc tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.074819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e1057b2-5187-449a-ab0e-bbbcc7dd2dcc tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.122051 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e1057b2-5187-449a-ab0e-bbbcc7dd2dcc tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-764486-11&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.062738 Jul 20 04:27:54.123257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1791/2916] 10.222.0.49 () {60 vars in 1236 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/os-services?host=n-d-764486-11&binary=xxx => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:54.145545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16f874f0-d7ee-4f3d-91a4-2007095d9ec4 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.147065 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:54.147065 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:54.152266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f874f0-d7ee-4f3d-91a4-2007095d9ec4 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.152960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f874f0-d7ee-4f3d-91a4-2007095d9ec4 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.154386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f874f0-d7ee-4f3d-91a4-2007095d9ec4 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.155676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16f874f0-d7ee-4f3d-91a4-2007095d9ec4 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.234280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16f874f0-d7ee-4f3d-91a4-2007095d9ec4 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.094309 Jul 20 04:27:54.236414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1792/2917] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:27:54.247982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0c2049bd-6d99-4cc3-b6ab-f728d88148cb req-897eb97c-7648-4989-adf7-a141457ec1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa9a86d-4109-4bcd-b7c9-b06421abd79b", "name": "network-vif-deleted", "tag": "d10a94f7-1b43-4b89-9409-b50dec12da53"}, {"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "49a5642b-8bc6-4f3a-a19b-7a26eb46e035"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:54.264685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0c2049bd-6d99-4cc3-b6ab-f728d88148cb req-897eb97c-7648-4989-adf7-a141457ec1fd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.265468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0c2049bd-6d99-4cc3-b6ab-f728d88148cb req-897eb97c-7648-4989-adf7-a141457ec1fd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.282561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0c2049bd-6d99-4cc3-b6ab-f728d88148cb req-897eb97c-7648-4989-adf7-a141457ec1fd service nova] Creating event network-vif-deleted:d10a94f7-1b43-4b89-9409-b50dec12da53 for instance 7aa9a86d-4109-4bcd-b7c9-b06421abd79b on n-h2-764486-11 Jul 20 04:27:54.283974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0c2049bd-6d99-4cc3-b6ab-f728d88148cb req-897eb97c-7648-4989-adf7-a141457ec1fd service nova] Creating event network-changed:49a5642b-8bc6-4f3a-a19b-7a26eb46e035 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:27:54.300923 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0c2049bd-6d99-4cc3-b6ab-f728d88148cb req-897eb97c-7648-4989-adf7-a141457ec1fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058375 Jul 20 04:27:54.303360 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1793/2918] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:54.317712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a11e246-7313-418e-8296-0976aa6f7f49 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.326626 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:54.326626 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:54.328442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a11e246-7313-418e-8296-0976aa6f7f49 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.329202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a11e246-7313-418e-8296-0976aa6f7f49 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.330297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a11e246-7313-418e-8296-0976aa6f7f49 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:54.330906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a11e246-7313-418e-8296-0976aa6f7f49 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:54.357689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a11e246-7313-418e-8296-0976aa6f7f49 tempest-ServicesAdminNegativeV253TestJSON-629532776 tempest-ServicesAdminNegativeV253TestJSON-629532776-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.052973 Jul 20 04:27:54.358810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1794/2919] 10.222.0.49 () {60 vars in 1238 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:27:54.633268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4080ed5-ef9a-4f31-8aef-56f544668e42 tempest-ServicesAdminNegativeV253TestJSON-2028287628 tempest-ServicesAdminNegativeV253TestJSON-2028287628-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.634946 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:27:54.634946 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:27:54.635678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4080ed5-ef9a-4f31-8aef-56f544668e42 tempest-ServicesAdminNegativeV253TestJSON-2028287628 tempest-ServicesAdminNegativeV253TestJSON-2028287628-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '73c06f18721f41a8986fb465a5d68efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4669c2d73af34e0b98c3cb9849413919', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4080ed5-ef9a-4f31-8aef-56f544668e42 tempest-ServicesAdminNegativeV253TestJSON-2028287628 tempest-ServicesAdminNegativeV253TestJSON-2028287628-project] Request method failure captured: Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RFB9IgistaoBV5hdt2fMPqPaKEdye6apT3cAYx1ZGoQJGWr1D2SotwO_MwJii9A-Y7I-F4Y8NYr9POl7GBKbXDE0nPI7bJjcQGkLF3kLGUU63Hiid_q_vp0LEE4TDpeT8hEfXmG9c0E0Zvti_MmnBND9VkO2xSTT3ApDoEjvX_-ZE Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4669c2d73af34e0b98c3cb9849413919 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2028287628 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4669c2d73af34e0b98c3cb9849413919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4669c2d73af34e0b98c3cb9849413919"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4669c2d73af34e0b98c3cb9849413919"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4669c2d73af34e0b98c3cb9849413919", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2028287628 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4669c2d73af34e0b98c3cb9849413919 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2028287628 Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2028287628-project Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73c06f18721f41a8986fb465a5d68efc Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2028287628-project Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: action_args: {} Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:27:54.637551 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4080ed5-ef9a-4f31-8aef-56f544668e42 tempest-ServicesAdminNegativeV253TestJSON-2028287628 tempest-ServicesAdminNegativeV253TestJSON-2028287628-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:27:54.646062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4080ed5-ef9a-4f31-8aef-56f544668e42 tempest-ServicesAdminNegativeV253TestJSON-2028287628 tempest-ServicesAdminNegativeV253TestJSON-2028287628-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.271055 Jul 20 04:27:54.653196 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1795/2920] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:27:54.987853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:54.988552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:55.005472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.014928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.018567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:55.028624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:55.647663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.663376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.671005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:55.673664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b84410d5-80ff-46fb-a65f-965826464ea4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1892 microversion: 2.32 time: 0.691682 Jul 20 04:27:55.677199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1796/2921] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:54 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1892 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:56.696473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:56.697711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:56.717607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.718397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.721218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:56.724552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:56.842657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:27:57.469593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.491928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.494442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:27:57.496986 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f95a5525-7192-4947-91bd-5d15537f21ea tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1892 microversion: 2.32 time: 0.806055 Jul 20 04:27:57.499629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1797/2922] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:56 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1892 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:27:57.837920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffc6a850-88af-4403-aace-de8aae74fad4 tempest-ComputeTenantNetworksTest-1489264690 tempest-ComputeTenantNetworksTest-1489264690-project] Calling method '.version_select at 0x7f839cef8310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:59.711688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffc6a850-88af-4403-aace-de8aae74fad4 tempest-ComputeTenantNetworksTest-1489264690 tempest-ComputeTenantNetworksTest-1489264690-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 2.209426 Jul 20 04:27:59.714431 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1798/2923] 10.222.0.49 () {58 vars in 1157 bytes} [Wed Jul 20 04:27:57 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:59.741016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f3f7be98-6277-41df-829a-f9b264253486 req-13aec1c9-e18d-4e5a-b696-c94f7d547e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "198632a3-4238-4993-a9be-014d0029fb9b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:27:59.793861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f3f7be98-6277-41df-829a-f9b264253486 req-13aec1c9-e18d-4e5a-b696-c94f7d547e25 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.795314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f3f7be98-6277-41df-829a-f9b264253486 req-13aec1c9-e18d-4e5a-b696-c94f7d547e25 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.872595 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f3f7be98-6277-41df-829a-f9b264253486 req-13aec1c9-e18d-4e5a-b696-c94f7d547e25 service nova] Creating event network-changed:198632a3-4238-4993-a9be-014d0029fb9b for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:27:59.894622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f3f7be98-6277-41df-829a-f9b264253486 req-13aec1c9-e18d-4e5a-b696-c94f7d547e25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178167 Jul 20 04:27:59.923964 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1799/2924] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:27:59.945255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:27:59.947853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:27:59.960664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.961544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:27:59.962558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:27:59.963141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:00.353922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:00.370916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:00.393381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:00.406037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e755de0a-dda1-4d5c-bc55-01457f1f5b00 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.470868 Jul 20 04:28:00.408971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1800/2925] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:27:59 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:00.427745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a58cbd01-f135-414d-92b9-11529efe57f9 tempest-ComputeTenantNetworksTest-1489264690 tempest-ComputeTenantNetworksTest-1489264690-project] Calling method '.version_select at 0x7f838ae510d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:00.693916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a58cbd01-f135-414d-92b9-11529efe57f9 tempest-ComputeTenantNetworksTest-1489264690 tempest-ComputeTenantNetworksTest-1489264690-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks/3e146e48-0216-4b12-ab5e-b28226ca89b0" status: 200 len: 139 microversion: 2.1 time: 0.282223 Jul 20 04:28:00.694559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1801/2926] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 04:28:00 2022] GET /compute/v2.1/os-tenant-networks/3e146e48-0216-4b12-ab5e-b28226ca89b0 => generated 139 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:01.429807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:01.430424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:01.443173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.443968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.445593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:01.446195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:01.924542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.963548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.968492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:01.971341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f40e083-93ce-4297-9bf8-b9fc3aaf4f3c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.547327 Jul 20 04:28:01.973379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1802/2927] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:01 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:02.587190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3d0d9651-d518-4033-a034-ec15cdc60073 req-ae8735e9-1edc-47ee-aa19-3878b1b4d5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "ac4c775a-afe5-4a70-93a2-194e076db607"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:02.610445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d0d9651-d518-4033-a034-ec15cdc60073 req-ae8735e9-1edc-47ee-aa19-3878b1b4d5d8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:02.611964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d0d9651-d518-4033-a034-ec15cdc60073 req-ae8735e9-1edc-47ee-aa19-3878b1b4d5d8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:02.632408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3d0d9651-d518-4033-a034-ec15cdc60073 req-ae8735e9-1edc-47ee-aa19-3878b1b4d5d8 service nova] Creating event network-changed:ac4c775a-afe5-4a70-93a2-194e076db607 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:28:02.638068 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3d0d9651-d518-4033-a034-ec15cdc60073 req-ae8735e9-1edc-47ee-aa19-3878b1b4d5d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057164 Jul 20 04:28:02.639175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1803/2928] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:28:03.001574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:03.005428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:03.038239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.039118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:03.041267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:03.042168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:04.337373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=32 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:04.529329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:04.547021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:04.549334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:04.550596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.557947 Jul 20 04:28:04.565537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1804/2929] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:02 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:05.382611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.384629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002280 Jul 20 04:28:05.396017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1805/2930] 10.222.0.49 () {56 vars in 885 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:28:05.397851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.403809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.006023 Jul 20 04:28:05.404486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1806/2931] 10.222.0.49 () {54 vars in 1034 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 20 04:28:05.415154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.416442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001695 Jul 20 04:28:05.424266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1807/2932] 10.222.0.49 () {54 vars in 1040 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/v2.1/ => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:05.425924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.432325 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcf317c7-549d-4e00-9d0e-38a0ef03a969 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006587 Jul 20 04:28:05.442519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1808/2933] 10.222.0.49 () {56 vars in 885 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:28:05.457413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2d728026-990e-4969-99d1-99619aaad713 req-f332803f-d684-4cc0-94b9-ace8cdd57bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "3c2ef8d6-0f79-4743-a086-f9636a7204fb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:05.500394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2d728026-990e-4969-99d1-99619aaad713 req-f332803f-d684-4cc0-94b9-ace8cdd57bc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.502916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2d728026-990e-4969-99d1-99619aaad713 req-f332803f-d684-4cc0-94b9-ace8cdd57bc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:05.522401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2d728026-990e-4969-99d1-99619aaad713 req-f332803f-d684-4cc0-94b9-ace8cdd57bc8 service nova] Creating event network-changed:3c2ef8d6-0f79-4743-a086-f9636a7204fb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:28:05.528653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2d728026-990e-4969-99d1-99619aaad713 req-f332803f-d684-4cc0-94b9-ace8cdd57bc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076694 Jul 20 04:28:05.530993 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1809/2934] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:05.571549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:05.572827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:05.589191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.589692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:05.590631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:05.591186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:06.265816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.284761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.288031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:06.292135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ab4930a-f870-46cf-a6c9-1402ee0c599f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.725700 Jul 20 04:28:06.295230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1810/2935] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:05 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:07.313059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:07.315114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:07.333554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.334005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:07.334804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:07.335245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.174353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.235858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.249061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:09.256040 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e567d20-7317-42a5-b7a8-6e756782ed9e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.944885 Jul 20 04:28:09.259790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1811/2936] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:07 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:09.288407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3d7a8c62-d033-4722-a76e-1e02c55fcd45 req-2ebd7589-bd3e-4ff8-b306-805e12856db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "485f9778-c6c3-483a-8360-17c1418b6beb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:09.301759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d7a8c62-d033-4722-a76e-1e02c55fcd45 req-2ebd7589-bd3e-4ff8-b306-805e12856db0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:09.309475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d7a8c62-d033-4722-a76e-1e02c55fcd45 req-2ebd7589-bd3e-4ff8-b306-805e12856db0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:09.342751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3d7a8c62-d033-4722-a76e-1e02c55fcd45 req-2ebd7589-bd3e-4ff8-b306-805e12856db0 service nova] Creating event network-changed:485f9778-c6c3-483a-8360-17c1418b6beb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:28:09.353904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3d7a8c62-d033-4722-a76e-1e02c55fcd45 req-2ebd7589-bd3e-4ff8-b306-805e12856db0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090010 Jul 20 04:28:09.363005 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1812/2937] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:10.299926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:10.301846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:10.318386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.319249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:10.320672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:10.321277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:11.177307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.197635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.211486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:11.213916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f5b19d6-ba33-4f83-8009-f6c92febd2f0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.926176 Jul 20 04:28:11.214851 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1813/2938] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:10 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:12.244751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:12.246084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:12.275553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.279325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:12.284014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:12.284607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:13.147915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:13.162291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:13.170748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:13.176311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e65d653-1092-4f91-a175-8959ce9e64fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.940936 Jul 20 04:28:13.177935 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1814/2939] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:12 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:14.200667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:14.203311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:14.221064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.221884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.222862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:14.223275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:14.906013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.929220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.931440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:14.933726 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-714d8f10-0127-40ff-bfdd-4184d880bfff tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.741354 Jul 20 04:28:14.938460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1815/2940] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:14 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:15.479311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-50349741", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "d06a6770-f3aa-4c8c-99f7-e76cffbe1ea4"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:15.591782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] validate_networks() for [('d06a6770-f3aa-4c8c-99f7-e76cffbe1ea4', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:18.292251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:18.297433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:18.300648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:18.301434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:18.302010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:18.327735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.328134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.333450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.337169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.384694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Getting quotas for project b5b4a487f7484425b7912069e6a6e8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:18.396441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Getting quotas for user 62babe8c798840fb87304a0677903410 and project b5b4a487f7484425b7912069e6a6e8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:18.412113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:18.415592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:18.531775 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63d41362-df6b-4090-9e9a-4e31e7a7da68 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.551731 Jul 20 04:28:18.541034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1816/2941] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:28:18.553213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:18.554414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:18.578481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.584613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:18.590109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:18.590753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.138480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.157141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.159552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.160840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a89cf145-6a44-491a-be69-650ef06e568e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.617408 Jul 20 04:28:20.166324 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1817/2942] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:18 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:20.177962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:20.182964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:20.199841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.200598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.201555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:20.202172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:20.383293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.415459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.425978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:20.434209 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e9f93c11-c269-4428-906e-dd658b3be948 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1309 microversion: 2.21 time: 0.264603 Jul 20 04:28:20.449369 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1818/2943] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:20 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:21.186063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.186726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.224020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.224502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.225309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.225753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.752797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.769695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.771366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:21.773913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b270c408-92ec-46f1-b7cf-f4e12efd5c75 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.593706 Jul 20 04:28:21.774788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1819/2944] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:21.790578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:21.791394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:21.804340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.805198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:21.806332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:21.807904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.037093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.051837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.054734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:22.056903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30368018-af7c-420e-bfa7-ae7f445f77e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1315 microversion: 2.21 time: 0.280909 Jul 20 04:28:22.058155 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1820/2945] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:21 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:22.795102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:22.795811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:22.811327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.811793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:22.812628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:22.813069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.381886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.392173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.394330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.395550 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-238bfd89-688f-46d7-a49f-493df9bb2edf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.605939 Jul 20 04:28:23.411487 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1821/2946] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:22 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:23.429861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:23.435684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:23.452145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.452644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.453612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:23.454212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:23.738539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.768407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.770455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:23.771917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-911316e4-3076-4fff-a19b-deafc61f8f89 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1315 microversion: 2.21 time: 0.358844 Jul 20 04:28:23.772926 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1822/2947] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:23 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:24.420075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:24.420824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:24.424259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:24.468329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.468780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.469849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:24.470485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:24.529464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:25.743869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.753706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.755216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:25.769450 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0040555d-9f75-4484-b0f8-90b55ce100cf tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.344528 Jul 20 04:28:25.770159 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1823/2948] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:24 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:25.790001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:25.790622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:25.800489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.800880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:25.801672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:25.802111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.515835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.529198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.552780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:26.554139 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd4c3b48-8b79-45aa-96d2-d3fb5f0b5561 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.782999 Jul 20 04:28:26.555521 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1824/2949] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:25 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:26.790508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:26.791253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:26.806589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.810369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:26.811567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:26.815255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.312923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:27.333805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:27.336143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:27.340773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a114b9fd-1673-4039-b158-eb0ea7cc1837 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.554458 Jul 20 04:28:27.344191 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1825/2950] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:26 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:27.573976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:27.574608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:27.588072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.588559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:27.589348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:27.592011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.014801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.023930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.034523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.041831 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-559092fb-96ce-479f-90a6-4c6b893f84e6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.472512 Jul 20 04:28:28.053503 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1826/2951] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:27 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:28.358537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:28.363450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:28.364139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:28.373952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:28.377056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.378097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:28.385323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:28.459860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:28.776979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.786878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.799938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:28.801554 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b11509c6-69fe-4fd6-bdb8-cb89dedd4ea0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.443776 Jul 20 04:28:28.805318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1827/2952] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:28 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:29.062542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.063342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.074360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.083023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.084088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.084690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.838492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.902391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.909388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:29.910864 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5e46416-8f18-41a2-98a3-84e8e9fabf23 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.852587 Jul 20 04:28:29.929217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1828/2953] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:29.944054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:29.947279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:29.963730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.964178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:29.968838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:29.969285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:30.924401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:30.939880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:30.942219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:30.943924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-968f236b-36bc-42c4-89ed-7b581946b2ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.013211 Jul 20 04:28:30.945538 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1829/2954] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:29 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:30.953199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c7b9386a-1ebe-4cf1-b742-267950601e26 req-66f7b50d-fe6f-4974-998e-3c9371717c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa6757e-65ad-41c6-9c6f-6b850acf155a", "tag": "ea1f8405-0fe8-4717-8aee-186f4d95ccb1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:30.968699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c7b9386a-1ebe-4cf1-b742-267950601e26 req-66f7b50d-fe6f-4974-998e-3c9371717c51 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:30.970043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c7b9386a-1ebe-4cf1-b742-267950601e26 req-66f7b50d-fe6f-4974-998e-3c9371717c51 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:30.992837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c7b9386a-1ebe-4cf1-b742-267950601e26 req-66f7b50d-fe6f-4974-998e-3c9371717c51 service nova] Creating event network-changed:ea1f8405-0fe8-4717-8aee-186f4d95ccb1 for instance cfa6757e-65ad-41c6-9c6f-6b850acf155a on n-h2-764486-11 Jul 20 04:28:31.001546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c7b9386a-1ebe-4cf1-b742-267950601e26 req-66f7b50d-fe6f-4974-998e-3c9371717c51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053431 Jul 20 04:28:31.003052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1830/2955] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:31.013480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:31.015446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:31.031777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:31.032759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.034202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:31.034823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:31.685352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:31.695357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:31.697447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:31.699021 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6064bdf7-55d7-4f86-9d36-260a25301d71 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.694318 Jul 20 04:28:31.700177 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1831/2956] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:31 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:31.967821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:31.970057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:32.000515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.001288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.002839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.003446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.384159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.415964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.419124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:32.420814 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e78cb716-a890-4b23-9de8-4c66070f787e tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.460674 Jul 20 04:28:32.422207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1832/2957] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:31 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:28:32.808663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d33f87c-3bb1-4e65-b990-4eb931e6d1e7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: .version_select at 0x7f838ae78b80>, body: {"keypair": {"name": "tempest-keypair-2081859508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnD5EQPkBzFu6WLI4/ppmIklP8EhNpOPRpkedv2Tf3m/f+RL95neDtKIncxKtp3PoGHxm5KuCMEO5rvyEEZG8XX4DcBzQInlFw0hk4X1FLiVuSgrVa/x6V/tn679GuArg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:32.857432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2d33f87c-3bb1-4e65-b990-4eb931e6d1e7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for project fc0218fbb8d349c1a01636234437d7f8. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:32.870120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2d33f87c-3bb1-4e65-b990-4eb931e6d1e7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for user 79561d22ff3f40739c9515a85b78d561 and project fc0218fbb8d349c1a01636234437d7f8. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:32.947686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d33f87c-3bb1-4e65-b990-4eb931e6d1e7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.516209 Jul 20 04:28:32.950792 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1833/2958] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:28:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:32.961228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:32.962812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:32.971933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.973943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:32.975198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:32.979494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.432657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.445806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.449740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.460980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c0c327b-644f-4f75-9ac0-aa21bfa1c128 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.507167 Jul 20 04:28:33.462254 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1834/2959] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:32 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:33.468049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:33.469419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:33.479597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.480572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.481524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:33.482122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:33.787472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.819818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.823877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:33.826089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-742601c8-73ec-4bd5-8d28-0229554780ae tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.362236 Jul 20 04:28:33.829329 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1835/2960] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:33 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:34.482388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:34.482994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:34.490353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.491155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:34.492120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:34.493046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.190919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.224986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.238012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:35.242140 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c261ceb-2f84-4338-9739-58111463aedd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.763540 Jul 20 04:28:35.248645 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1836/2961] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:34 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:35.275186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:35.275933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:35.294063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.294738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:35.295682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:35.297911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.062368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.077828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.079340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.081074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63b54fea-0c12-4e67-a83c-04d080cc7706 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.830235 Jul 20 04:28:36.092048 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1837/2962] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:35 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:36.261537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:36.262150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:36.279458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.279993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.280825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:36.281450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:36.543738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.557334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.564200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:36.568940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d26696c4-3a64-4562-a57e-f6381326b4a5 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.311462 Jul 20 04:28:36.570756 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1838/2963] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:36 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:37.106631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:37.109941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:37.130520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.145278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:37.146440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:37.147049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.704765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.723077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.727508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:38.728876 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4d0c9a6-5e02-4230-aa78-299497167c15 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.633209 Jul 20 04:28:38.745546 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1839/2964] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:37 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:38.761037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:38.762013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:38.776290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.777506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:38.794512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:38.795500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:39.852834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.869287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.870944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:39.872179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd05bd7a-46ce-4ad8-81d3-753afba7b541 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 1.125525 Jul 20 04:28:39.873386 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1840/2965] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:38 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:40.135216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1716943958", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "890af10e-a67d-412b-8eb5-458666aafa66"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:40.200987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] validate_networks() for [('890af10e-a67d-412b-8eb5-458666aafa66', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:41.554293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:41.555564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:41.556756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:41.557419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:41.558009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:41.588956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.597044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.600189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:41.600976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:41.681476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Getting quotas for project bc7717080c394206a0dede2aaf54b38a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:41.697968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Getting quotas for user 5b1847082a384d369c4186f10ac84e2a and project bc7717080c394206a0dede2aaf54b38a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:41.739350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Going to run 2 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:41.742025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dd158482-1fa5-434d-abb2-a593a37f5ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:41.843906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=dd158482-1fa5-434d-abb2-a593a37f5ec4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:42.019871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be0b71dc-35ff-404d-a85e-953a6922bf12 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.145104 Jul 20 04:28:42.020984 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1841/2966] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:42.036102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:42.036770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:42.049217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.052410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.053570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:42.056915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:42.132115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:43.810110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.828643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.833363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:43.836280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c087bd9-8064-4066-8475-7079af7ef9a9 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 1.813049 Jul 20 04:28:43.851821 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1842/2967] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:42 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:43.864428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1937770189", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12b10d7a-3706-4719-af72-2f1054872ab5"}], "security_groups": [{"name": "tempest-securitygroup--689278026"}], "key_name": "tempest-keypair-2081859508", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:44.300090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] validate_networks() for [('12b10d7a-3706-4719-af72-2f1054872ab5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:28:45.841970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:28:45.843334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:28:45.844029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:28:45.844649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:28:45.847344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:28:45.867275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.868950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.872999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:45.874008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:45.910430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for project fc0218fbb8d349c1a01636234437d7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:28:45.919324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for user 79561d22ff3f40739c9515a85b78d561 and project fc0218fbb8d349c1a01636234437d7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:28:45.939749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:28:45.942703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:28:46.018005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ceb3492-ec6e-42bd-93aa-7548671717a0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.164601 Jul 20 04:28:46.018989 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1843/2968] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:28:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:28:46.025014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.026074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:46.040161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.043770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.044652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.045115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.584407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.601557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.609113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.611823 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0d6d7c8-c2d2-4073-9f8a-f7a35bac36bc tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.591661 Jul 20 04:28:46.613238 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1844/2969] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:46.634453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.644695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:46.646788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Searching by: {'deleted': False, 'project_id': 'bc7717080c394206a0dede2aaf54b38a'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:28:46.658080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.659119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.660581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.662257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.722231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:28:46.789806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0114a07-7716-48ce-bdc0-f176a5d2c147 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.162071 Jul 20 04:28:46.796433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1845/2970] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers => generated 677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:46.802854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:46.804165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:46.816103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.819358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:46.820907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:46.822315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.289327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.315695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.332735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.341418 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c4aec43-f1f3-493f-8414-a5f9ccac47de tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.540174 Jul 20 04:28:47.346630 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1846/2971] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:46 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:47.368879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.373528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.396790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.397469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.402236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.405814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.563848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.580839 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9de617de-ee8f-4107-b9d3-447e78eaedfb tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1290 microversion: 2.1 time: 0.231716 Jul 20 04:28:47.585701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1847/2972] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1290 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.595632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.596249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.604198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.604748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.613583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.614450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.752381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:47.781464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23bd595f-ed0c-4215-8560-b5e7f2cc6a15 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1278 microversion: 2.1 time: 0.192372 Jul 20 04:28:47.782373 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1848/2973] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:47.796200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:47.802738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:47.814171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.826095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:47.830224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:47.831899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.216057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:48.226310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:48.228800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:48.230626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-beddb788-d0ca-4e81-aea9-ad7c4cfbb0cd tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.438468 Jul 20 04:28:48.231496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1849/2974] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:47 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:48.365030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:48.365977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:48.384073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.384864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:48.388049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:48.389086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.073269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.084600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.086957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.088504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8ef29a9-262f-4d0e-803c-caadf09fed5d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.729375 Jul 20 04:28:49.089630 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1850/2975] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:48 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:49.095019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:49.097212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:49.103869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:49.105903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.107147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.108190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:49.109334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:49.232975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:49.254210 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aae6cc47-12af-42bc-963b-57db5a1544fc tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1296 microversion: 2.1 time: 0.163162 Jul 20 04:28:49.254807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1851/2976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:49 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:49.377487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17866cdc-4eca-4c2c-adf7-d90004dd7874 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Action: 'create', calling method: .version_select at 0x7f839ce60ee0>, body: {"pool": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:52.637883 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17866cdc-4eca-4c2c-adf7-d90004dd7874 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.375068 Jul 20 04:28:52.638504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1852/2977] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:28:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:52.648745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:52.650238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:52.686290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.687407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:52.692443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:52.693273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.067203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:53.079270 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e4371ea-0dd8-47ec-99cb-f3d07d50f915 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1320 microversion: 2.1 time: 0.439358 Jul 20 04:28:53.082790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1853/2978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:52 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:53.091558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:53.092588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:53.137417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.138719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.140779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.143487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.480763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:53.493390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:53.500523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:53.506592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b15eee3-9e9a-481d-be8a-01aa490982d0 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1357 microversion: 2.21 time: 0.419616 Jul 20 04:28:53.508418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1854/2979] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:53 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1357 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:53.518609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:53.519509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:53.553881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.554510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.555372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:53.555821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:53.968749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.011807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.016313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.020271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b107120-2af4-4808-96a2-647ce20346c6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.506664 Jul 20 04:28:54.028107 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1855/2980] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:53 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:54.033969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:54.040105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:54.058236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.059075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.063037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.066794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.568800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:54.577193 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-020bf033-daf3-48e6-9101-1c84f4ca69e5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1363 microversion: 2.1 time: 0.547438 Jul 20 04:28:54.578104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1856/2981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:54 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:54.583344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ef4dcc43-e988-4766-a863-9f428d5b4a2f req-aa8499cd-cae7-4a9d-bd0b-26ef800afa16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa6757e-65ad-41c6-9c6f-6b850acf155a", "name": "network-vif-plugged", "status": "completed", "tag": "ea1f8405-0fe8-4717-8aee-186f4d95ccb1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:54.605661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ef4dcc43-e988-4766-a863-9f428d5b4a2f req-aa8499cd-cae7-4a9d-bd0b-26ef800afa16 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:54.607351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ef4dcc43-e988-4766-a863-9f428d5b4a2f req-aa8499cd-cae7-4a9d-bd0b-26ef800afa16 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:54.654478 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ef4dcc43-e988-4766-a863-9f428d5b4a2f req-aa8499cd-cae7-4a9d-bd0b-26ef800afa16 service nova] Creating event network-vif-plugged:ea1f8405-0fe8-4717-8aee-186f4d95ccb1 for instance cfa6757e-65ad-41c6-9c6f-6b850acf155a on n-h2-764486-11 Jul 20 04:28:54.706463 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ef4dcc43-e988-4766-a863-9f428d5b4a2f req-aa8499cd-cae7-4a9d-bd0b-26ef800afa16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127027 Jul 20 04:28:54.711362 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1857/2982] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:54.717358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb35d179-c2a8-4cdf-b0a2-4bae1c42abe0 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Action: 'create', calling method: .version_select at 0x7f838bf67c10>, body: {"pool": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:55.932377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=16 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:56.684918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:28:58.636542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb35d179-c2a8-4cdf-b0a2-4bae1c42abe0 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.922665 Jul 20 04:28:58.637998 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1858/2983] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:28:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:58.644153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:58.646389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:58.657153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:58.657883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:58.659269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:58.659975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.214799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:59.258617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34a1816a-913f-4981-b02b-cbf9eac14d98 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1320 microversion: 2.1 time: 0.618718 Jul 20 04:28:59.260975 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1859/2984] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:28:58 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:28:59.287496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b320885f-2d64-4abb-82ac-871c63970e9d req-5d439a98-f8da-4511-95c6-53079d1c0615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd158482-1fa5-434d-abb2-a593a37f5ec4", "tag": "032bf8a6-6b32-47e9-9e94-34685161c2b6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:28:59.310054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b320885f-2d64-4abb-82ac-871c63970e9d req-5d439a98-f8da-4511-95c6-53079d1c0615 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.310906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b320885f-2d64-4abb-82ac-871c63970e9d req-5d439a98-f8da-4511-95c6-53079d1c0615 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.328657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b320885f-2d64-4abb-82ac-871c63970e9d req-5d439a98-f8da-4511-95c6-53079d1c0615 service nova] Creating event network-changed:032bf8a6-6b32-47e9-9e94-34685161c2b6 for instance dd158482-1fa5-434d-abb2-a593a37f5ec4 on n-h1-764486-11 Jul 20 04:28:59.342689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b320885f-2d64-4abb-82ac-871c63970e9d req-5d439a98-f8da-4511-95c6-53079d1c0615 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077180 Jul 20 04:28:59.344035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1860/2985] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:28:59.359230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:59.361449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:59.380708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.381933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.384238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.386348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.786336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:59.799290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:59.802262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62babe8c798840fb87304a0677903410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b4a487f7484425b7912069e6a6e8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:28:59.803840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4419d436-ed03-4a76-975d-7fd81703ca6b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 200 len: 1550 microversion: 2.21 time: 0.458325 Jul 20 04:28:59.805126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1861/2986] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:59 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 1550 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:28:59.821627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:28:59.822270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:28:59.832732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.833190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:28:59.834191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:28:59.835299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.220917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.227283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:00.231913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.234205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.235739 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-572df079-d0fc-46a4-9a4f-8b32843a67fb tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.429339 Jul 20 04:29:00.237024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1862/2987] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:28:59 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:00.242731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:00.243743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:00.260435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.261072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.262156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:00.262607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:00.569820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:00.583581 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93f48caf-b484-42b2-bfa1-4cfa73c5a149 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1363 microversion: 2.1 time: 0.345150 Jul 20 04:29:00.584189 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1863/2988] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:00 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:00.983130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce4c7901-86af-4730-9cf6-0d9803ed56f9 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Action: 'create', calling method: .version_select at 0x7f839cceda60>, body: {"keypair": {"name": "tempest-keypair-603903968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu6yMjsBB2j4YnCUrE55X1rbi54HJH79HXrIGbkuirah1KizpIspOqOsB6iKppy8JffpB6tzcReQCQ37M3EAgEdL/TARsA93GGa5A4zJOHC2NgatBscIKGyJGeNye2kUg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:01.004426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ce4c7901-86af-4730-9cf6-0d9803ed56f9 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Getting quotas for project 5d7695d44e6643a99987228be8b509e8. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:01.011190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ce4c7901-86af-4730-9cf6-0d9803ed56f9 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Getting quotas for user 0f3881c5b1d04353801b73c6ba3d181e and project 5d7695d44e6643a99987228be8b509e8. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:01.050143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce4c7901-86af-4730-9cf6-0d9803ed56f9 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.464284 Jul 20 04:29:01.051859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1864/2989] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:29:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:01.059177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-554d4d72-e464-45fd-a3ea-0f54dc66aaa4 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Action: 'create', calling method: .version_select at 0x7f838ae78ca0>, body: {"pool": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:06.504116 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-554d4d72-e464-45fd-a3ea-0f54dc66aaa4 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.449385 Jul 20 04:29:06.510087 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1865/2990] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:29:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:06.517445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.518201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.531326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.532167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.536951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.537707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.629528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:06.819381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09a70c52-1ae4-4006-af57-ec99e4874efa tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 204 len: 0 microversion: 2.21 time: 0.307609 Jul 20 04:29:06.824679 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1866/2991] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:06 2022] DELETE /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:29:06.851263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:06.853576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:06.874450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.875212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:06.880271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:06.883475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.234714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.246929 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1506e188-e748-4064-a398-befb1a65c41e tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1320 microversion: 2.1 time: 0.406346 Jul 20 04:29:07.253521 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1867/2992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:06 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:07.262090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.265911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.286630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.287402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.291575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.292175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.698429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.719360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.719360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:07.719360 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e1f3f99f-2132-485a-8e48-d8d32d8f07cc tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.459455 Jul 20 04:29:07.719360 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1868/2993] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:07.720892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2abb3bce-f55b-4cfe-8e7a-c7939652639f req-11bf02fd-3392-4268-9087-616ca029645a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdc8764-b87a-4da4-9271-a7bfaf065cf6", "tag": "5a451a15-5ca6-4d64-b3ba-7a5d520f3460"}, {"name": "network-changed", "server_uuid": "41bb7e90-bb7b-4f99-8e8e-e9cf980b0410", "tag": "9c809395-72c8-4622-a76f-06be38cc94f8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:07.731157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2abb3bce-f55b-4cfe-8e7a-c7939652639f req-11bf02fd-3392-4268-9087-616ca029645a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.731706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2abb3bce-f55b-4cfe-8e7a-c7939652639f req-11bf02fd-3392-4268-9087-616ca029645a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.756765 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2abb3bce-f55b-4cfe-8e7a-c7939652639f req-11bf02fd-3392-4268-9087-616ca029645a service nova] Creating event network-changed:5a451a15-5ca6-4d64-b3ba-7a5d520f3460 for instance bfdc8764-b87a-4da4-9271-a7bfaf065cf6 on n-h2-764486-11 Jul 20 04:29:07.757663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2abb3bce-f55b-4cfe-8e7a-c7939652639f req-11bf02fd-3392-4268-9087-616ca029645a service nova] Creating event network-changed:9c809395-72c8-4622-a76f-06be38cc94f8 for instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 on n-h1-764486-11 Jul 20 04:29:07.766340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2abb3bce-f55b-4cfe-8e7a-c7939652639f req-11bf02fd-3392-4268-9087-616ca029645a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049775 Jul 20 04:29:07.767131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1869/2994] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:07.772968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:07.774567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:07.781527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.782308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:07.783359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:07.784012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.013788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:08.025144 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-710ec2e4-0af2-4994-bcd3-d159ce1133f1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1363 microversion: 2.1 time: 0.256454 Jul 20 04:29:08.025966 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1870/2995] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:07 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:08.031479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ceb5a1ee-c1dd-45b6-8179-e10946195d3f req-bdaaa33a-4d0f-46a5-be42-01bccb783b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "485f9778-c6c3-483a-8360-17c1418b6beb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:08.041366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ceb5a1ee-c1dd-45b6-8179-e10946195d3f req-bdaaa33a-4d0f-46a5-be42-01bccb783b59 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.042157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ceb5a1ee-c1dd-45b6-8179-e10946195d3f req-bdaaa33a-4d0f-46a5-be42-01bccb783b59 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.061345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ceb5a1ee-c1dd-45b6-8179-e10946195d3f req-bdaaa33a-4d0f-46a5-be42-01bccb783b59 service nova] Creating event network-vif-plugged:485f9778-c6c3-483a-8360-17c1418b6beb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:08.069302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ceb5a1ee-c1dd-45b6-8179-e10946195d3f req-bdaaa33a-4d0f-46a5-be42-01bccb783b59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041812 Jul 20 04:29:08.070998 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1871/2996] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:08.077494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1796240973", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "6aaf3845-c506-48f1-ad9e-18c700075575"}], "security_groups": [{"name": "tempest-securitygroup--1138296302"}], "key_name": "tempest-keypair-603903968", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:08.233508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] validate_networks() for [('6aaf3845-c506-48f1-ad9e-18c700075575', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:08.773721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:08.774288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:08.774906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:08.775499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:08.776059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:08.791592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.792419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.794129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:08.794875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:08.816146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Getting quotas for project 5d7695d44e6643a99987228be8b509e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:08.822205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Getting quotas for user 0f3881c5b1d04353801b73c6ba3d181e and project 5d7695d44e6643a99987228be8b509e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:08.838551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:08.842132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:08.911163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e47c1018-7bca-4965-8b18-18478952538f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.838616 Jul 20 04:29:08.912796 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1872/2997] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:29:08.917773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd263e48-7214-4431-95e7-af3d50607f9d tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Action: 'create', calling method: .version_select at 0x7f838ab80af0>, body: {"pool": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:12.379222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd263e48-7214-4431-95e7-af3d50607f9d tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.465192 Jul 20 04:29:12.380272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1873/2998] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:29:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:12.386035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.386827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.404691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.406268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.408233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.409263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.444266 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] HTTP exception thrown: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Request method failure captured: Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a HTTP/1.1 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Rejkviqg4HMA-MWePOEcetlkqiiPDNv0i4BaFwPg-vZvOTWbsNw3jwLlAcJr3n5Cz2CIB7zluZxoPAPH1X8HNmf6_ubLybdsTT1Jih8Wy4TH9XcDh4Taptm0rpyOHJ3_Nn0ZYfZSb6bJE_O_Y_FJmTvZ4pgRwuW15c3FLQVYyDauo Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b5b4a487f7484425b7912069e6a6e8c2 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5b4a487f7484425b7912069e6a6e8c2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b5b4a487f7484425b7912069e6a6e8c2 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsV221TestJSON-1341939355-project Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 62babe8c798840fb87304a0677903410 Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsV221TestJSON-1341939355-project Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'cfa6757e-65ad-41c6-9c6f-6b850acf155a'} Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:12.446924 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:12.452207 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:12.452896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Returning 404 to user: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:12.453230 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41f25840-3c1b-4b58-8b50-087d3a7909ac tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 404 len: 111 microversion: 2.21 time: 0.071203 Jul 20 04:29:12.457616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1874/2999] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:12.474275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.474895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.486095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.486550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.487336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.487869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.749247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:12.764385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54a21b4c-0ffc-4183-ba4f-b2d666df1e07 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1320 microversion: 2.1 time: 0.304645 Jul 20 04:29:12.765803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1875/3000] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:12.772589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:12.773284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:12.780814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.781264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:12.782040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:12.782529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.088201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.104520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.107294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.108658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2cb39e7d-496a-4480-8bb8-8a57daf6934d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.341802 Jul 20 04:29:13.112684 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1876/3001] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:12 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:13.155742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.156625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:13.163790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.164235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.165114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.165544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.688802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:13.701555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8e4fceb-79cd-4980-8844-7a9f94ec971b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1367 microversion: 2.1 time: 0.586476 Jul 20 04:29:13.702936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1877/3002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:13.709092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:13.710082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:13.718543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.719329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:13.721041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:13.721738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.007410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:14.026025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c998a762-a346-4c8b-b18d-27fdc3111991 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1363 microversion: 2.1 time: 0.321438 Jul 20 04:29:14.030657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1878/3003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:13 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:14.038958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-02f27448-c175-46df-a2d8-ab2fff837761 req-e99a3af4-c7e3-4d2f-b1c9-d11753d85c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "3c2ef8d6-0f79-4743-a086-f9636a7204fb"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "36018059-71b9-4780-a646-a5340eca8c36"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.051392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-02f27448-c175-46df-a2d8-ab2fff837761 req-e99a3af4-c7e3-4d2f-b1c9-d11753d85c29 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.052880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-02f27448-c175-46df-a2d8-ab2fff837761 req-e99a3af4-c7e3-4d2f-b1c9-d11753d85c29 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.074848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-02f27448-c175-46df-a2d8-ab2fff837761 req-e99a3af4-c7e3-4d2f-b1c9-d11753d85c29 service nova] Creating event network-vif-plugged:3c2ef8d6-0f79-4743-a086-f9636a7204fb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:14.075797 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-02f27448-c175-46df-a2d8-ab2fff837761 req-e99a3af4-c7e3-4d2f-b1c9-d11753d85c29 service nova] Creating event network-vif-plugged:36018059-71b9-4780-a646-a5340eca8c36 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:14.085400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-02f27448-c175-46df-a2d8-ab2fff837761 req-e99a3af4-c7e3-4d2f-b1c9-d11753d85c29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052630 Jul 20 04:29:14.086636 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1879/3004] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:14.097870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-74a26762-5b84-4807-bca8-a8e3d3f0fe8b req-27f2a01f-99c4-4c43-a325-0f28d634ce79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa6757e-65ad-41c6-9c6f-6b850acf155a", "name": "network-vif-deleted", "tag": "ea1f8405-0fe8-4717-8aee-186f4d95ccb1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:14.115662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-74a26762-5b84-4807-bca8-a8e3d3f0fe8b req-27f2a01f-99c4-4c43-a325-0f28d634ce79 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.116460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-74a26762-5b84-4807-bca8-a8e3d3f0fe8b req-27f2a01f-99c4-4c43-a325-0f28d634ce79 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.434867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-74a26762-5b84-4807-bca8-a8e3d3f0fe8b req-27f2a01f-99c4-4c43-a325-0f28d634ce79 service nova] Creating event network-vif-deleted:ea1f8405-0fe8-4717-8aee-186f4d95ccb1 for instance cfa6757e-65ad-41c6-9c6f-6b850acf155a on n-h2-764486-11 Jul 20 04:29:14.442640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-74a26762-5b84-4807-bca8-a8e3d3f0fe8b req-27f2a01f-99c4-4c43-a325-0f28d634ce79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.353009 Jul 20 04:29:14.444334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1880/3005] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:14.452607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27752977-9db0-4840-821e-1e6987d2b915 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f838bcdd820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.683544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27752977-9db0-4840-821e-1e6987d2b915 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/756539de-c54f-4ede-870a-80fb34b9b2a5" status: 200 len: 142 microversion: 2.1 time: 0.237303 Jul 20 04:29:14.684267 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1881/3006] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/os-floating-ips/756539de-c54f-4ede-870a-80fb34b9b2a5 => generated 142 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:14.689576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '.version_select at 0x7f839cef8c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.690645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:14.702031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.703476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.708304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.709082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.834339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fbf2b62b-23aa-4d1e-b3fb-27df5b6a5d1f tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.148082 Jul 20 04:29:14.843227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1882/3007] 10.222.0.49 () {60 vars in 1336 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a/os-instance-actions => generated 611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:29:14.851518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:14.852142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:14.859666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.860118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:14.861501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:14.861937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.100086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.110084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f6bcc52-6a5f-4206-aebe-1b8d7333afc7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1320 microversion: 2.1 time: 0.266886 Jul 20 04:29:15.110717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1883/3008] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:14 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:15.123252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:15.123937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:15.143233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.143727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.144574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:15.145367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:15.428659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.439551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.441880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:15.445654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-586c5432-18f3-4640-ab4d-f61de5ed65db tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.331051 Jul 20 04:29:15.445654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1884/3009] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:15 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:15.449583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e82da575-4dd0-402b-a4dc-c1464f058849 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f838b2f43a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.578859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e82da575-4dd0-402b-a4dc-c1464f058849 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/756539de-c54f-4ede-870a-80fb34b9b2a5" status: 202 len: 0 microversion: 2.1 time: 1.133275 Jul 20 04:29:16.579504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1885/3010] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:29:15 2022] DELETE /compute/v2.1/os-floating-ips/756539de-c54f-4ede-870a-80fb34b9b2a5 => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:29:16.589525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:16.591256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:16.608780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.609234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:16.610019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:16.616060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.005114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.012160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:17.015268 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5262a973-ede9-45d0-9d59-662af57648cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1367 microversion: 2.1 time: 0.434435 Jul 20 04:29:17.016218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1886/3011] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:16 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:17.022814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.023660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.035742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.036302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.037504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.038043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.054753 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] HTTP exception thrown: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Request method failure captured: Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a HTTP/1.1 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Rejkviqg4HMA-MWePOEcetlkqiiPDNv0i4BaFwPg-vZvOTWbsNw3jwLlAcJr3n5Cz2CIB7zluZxoPAPH1X8HNmf6_ubLybdsTT1Jih8Wy4TH9XcDh4Taptm0rpyOHJ3_Nn0ZYfZSb6bJE_O_Y_FJmTvZ4pgRwuW15c3FLQVYyDauo Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b5b4a487f7484425b7912069e6a6e8c2 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5b4a487f7484425b7912069e6a6e8c2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b5b4a487f7484425b7912069e6a6e8c2 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsV221TestJSON-1341939355-project Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 62babe8c798840fb87304a0677903410 Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsV221TestJSON-1341939355-project Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'cfa6757e-65ad-41c6-9c6f-6b850acf155a'} Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:17.057106 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:17.061396 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:17.064921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Returning 404 to user: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:17.066039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b1c868d-794a-4ac3-a1d2-7e4b100be05b tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 404 len: 111 microversion: 2.21 time: 0.047523 Jul 20 04:29:17.067169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1887/3012] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:17 2022] DELETE /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:17.072627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.073870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.085629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.086877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.087918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.088594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.435909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:17.448190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-469f4a2a-f147-48fc-9fb6-5128e55c28aa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1363 microversion: 2.1 time: 0.379706 Jul 20 04:29:17.449609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1888/3013] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:17.471570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:17.473198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:17.483421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.487284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:17.488795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:17.489490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.257695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.265918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-917ca28e-fdef-4f8f-a1f0-107d16f32d64 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1320 microversion: 2.1 time: 0.814992 Jul 20 04:29:18.267885 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1889/3014] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:17 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1320 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:18.276656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "d3cf2916-8fe8-4548-8f60-ba2b57714d64"}, {"server_uuid": "bfdc8764-b87a-4da4-9271-a7bfaf065cf6", "name": "network-vif-plugged", "status": "completed", "tag": "5a451a15-5ca6-4d64-b3ba-7a5d520f3460"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "ac4c775a-afe5-4a70-93a2-194e076db607"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "198632a3-4238-4993-a9be-014d0029fb9b"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-plugged", "status": "completed", "tag": "49a5642b-8bc6-4f3a-a19b-7a26eb46e035"}, {"server_uuid": "41bb7e90-bb7b-4f99-8e8e-e9cf980b0410", "name": "network-vif-plugged", "status": "completed", "tag": "9c809395-72c8-4622-a76f-06be38cc94f8"}, {"server_uuid": "dd158482-1fa5-434d-abb2-a593a37f5ec4", "name": "network-vif-plugged", "status": "completed", "tag": "032bf8a6-6b32-47e9-9e94-34685161c2b6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:18.289508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.290330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.318953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:d3cf2916-8fe8-4548-8f60-ba2b57714d64 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:18.319524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:5a451a15-5ca6-4d64-b3ba-7a5d520f3460 for instance bfdc8764-b87a-4da4-9271-a7bfaf065cf6 on n-h2-764486-11 Jul 20 04:29:18.326022 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:ac4c775a-afe5-4a70-93a2-194e076db607 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:18.326951 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:198632a3-4238-4993-a9be-014d0029fb9b for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:18.327687 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:49a5642b-8bc6-4f3a-a19b-7a26eb46e035 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:18.328261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:9c809395-72c8-4622-a76f-06be38cc94f8 for instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 on n-h1-764486-11 Jul 20 04:29:18.329219 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] Creating event network-vif-plugged:032bf8a6-6b32-47e9-9e94-34685161c2b6 for instance dd158482-1fa5-434d-abb2-a593a37f5ec4 on n-h1-764486-11 Jul 20 04:29:18.351406 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dabe8c57-cd8b-43af-9699-5144686eb88f req-8bd07812-6180-4a72-a7d7-ba21a09f5e85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.081545 Jul 20 04:29:18.352807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1890/3015] 10.222.0.49 () {64 vars in 1318 bytes} [Wed Jul 20 04:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:18.363383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:18.364391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:18.367164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:18.374601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.375367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.378411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:18.379426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:18.805887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:18.830649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:18.858261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.868513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.881363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:18.887428 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd7b237e-550a-465c-bd57-5295de559ad6 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.528460 Jul 20 04:29:18.889021 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1891/3016] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:18.895554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0bcedf3-4bff-41b1-a83d-38a6ef3f15ec tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f838b8361f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.210364 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0bcedf3-4bff-41b1-a83d-38a6ef3f15ec tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.319415 Jul 20 04:29:19.213834 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1892/3017] 10.222.0.49 () {58 vars in 1163 bytes} [Wed Jul 20 04:29:18 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:19.221715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fb549acd-6405-4c6a-a55a-4084e1a17308 req-9ac1ad9c-ba9e-4f82-8adf-694833235fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35349313-cc85-4329-90f0-4a66910e3ddc", "tag": "ed2ea321-1ec5-48fd-abbe-4686182f3487"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:19.241311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fb549acd-6405-4c6a-a55a-4084e1a17308 req-9ac1ad9c-ba9e-4f82-8adf-694833235fae service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.242061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fb549acd-6405-4c6a-a55a-4084e1a17308 req-9ac1ad9c-ba9e-4f82-8adf-694833235fae service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.257084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fb549acd-6405-4c6a-a55a-4084e1a17308 req-9ac1ad9c-ba9e-4f82-8adf-694833235fae service nova] Creating event network-changed:ed2ea321-1ec5-48fd-abbe-4686182f3487 for instance 35349313-cc85-4329-90f0-4a66910e3ddc on n-h2-764486-11 Jul 20 04:29:19.263998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fb549acd-6405-4c6a-a55a-4084e1a17308 req-9ac1ad9c-ba9e-4f82-8adf-694833235fae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048124 Jul 20 04:29:19.265999 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1893/3018] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:19.292581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.293967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] [instance: cfa6757e-65ad-41c6-9c6f-6b850acf155a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.305969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.306440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.309174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.309832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.331826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] HTTP exception thrown: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Request method failure captured: Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a HTTP/1.1 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Rejkviqg4HMA-MWePOEcetlkqiiPDNv0i4BaFwPg-vZvOTWbsNw3jwLlAcJr3n5Cz2CIB7zluZxoPAPH1X8HNmf6_ubLybdsTT1Jih8Wy4TH9XcDh4Taptm0rpyOHJ3_Nn0ZYfZSb6bJE_O_Y_FJmTvZ4pgRwuW15c3FLQVYyDauo Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b5b4a487f7484425b7912069e6a6e8c2 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b5b4a487f7484425b7912069e6a6e8c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b5b4a487f7484425b7912069e6a6e8c2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b5b4a487f7484425b7912069e6a6e8c2 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1341939355 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsV221TestJSON-1341939355-project Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 62babe8c798840fb87304a0677903410 Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsV221TestJSON-1341939355-project Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'cfa6757e-65ad-41c6-9c6f-6b850acf155a'} Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.334251 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. Jul 20 04:29:19.339411 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:19.341509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] Returning 404 to user: Instance cfa6757e-65ad-41c6-9c6f-6b850acf155a could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:19.342777 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b766347-d1ae-4dad-bc41-825de045b8c6 tempest-InstanceActionsV221TestJSON-1341939355 tempest-InstanceActionsV221TestJSON-1341939355-project] 10.222.0.49 "GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a" status: 404 len: 111 microversion: 2.21 time: 0.074579 Jul 20 04:29:19.343539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1894/3019] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/cfa6757e-65ad-41c6-9c6f-6b850acf155a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:19.349566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.350465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.358744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.358744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.359404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.360026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.725992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:19.740212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d559a1f8-4b36-4fab-b391-7c12446e4091 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1367 microversion: 2.1 time: 0.395248 Jul 20 04:29:19.740844 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1895/3020] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:19.745621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:19.746278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:19.771985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.772467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:19.773255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:19.773691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.272720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:20.285988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b7fbf01-9f0b-4484-92ab-52557028eeb3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1363 microversion: 2.1 time: 0.543747 Jul 20 04:29:20.286823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1896/3021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:19 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:20.294391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2c5d482-0a23-4943-ae53-a91371e501cc tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f838bcddc10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.663661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2c5d482-0a23-4943-ae53-a91371e501cc tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.374923 Jul 20 04:29:20.664251 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1897/3022] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:20.678461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:20.679568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:20.689276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.690012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:20.690962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:20.691580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.000149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.018566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e599c1e-f611-463d-96cb-10149427c671 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 200 len: 1507 microversion: 2.1 time: 0.353047 Jul 20 04:29:21.021294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1898/3023] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:20 2022] GET /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:21.028540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:21.029388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:21.038683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.039390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.040383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.040993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.825900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.857857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.859398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:21.860701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce1774a2-be3d-4be8-830e-fa3d05565333 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1880 microversion: 2.32 time: 0.837253 Jul 20 04:29:21.861290 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1899/3024] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:21 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1880 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:21.875922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0afc4015-3498-4550-b311-67e9b33f68f4 req-78c819d9-8f2e-4700-941f-7209880e26c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35349313-cc85-4329-90f0-4a66910e3ddc", "name": "network-vif-plugged", "status": "completed", "tag": "ed2ea321-1ec5-48fd-abbe-4686182f3487"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:21.896737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0afc4015-3498-4550-b311-67e9b33f68f4 req-78c819d9-8f2e-4700-941f-7209880e26c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:21.897191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0afc4015-3498-4550-b311-67e9b33f68f4 req-78c819d9-8f2e-4700-941f-7209880e26c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:21.915808 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0afc4015-3498-4550-b311-67e9b33f68f4 req-78c819d9-8f2e-4700-941f-7209880e26c1 service nova] Creating event network-vif-plugged:ed2ea321-1ec5-48fd-abbe-4686182f3487 for instance 35349313-cc85-4329-90f0-4a66910e3ddc on n-h2-764486-11 Jul 20 04:29:21.925067 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0afc4015-3498-4550-b311-67e9b33f68f4 req-78c819d9-8f2e-4700-941f-7209880e26c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062450 Jul 20 04:29:21.925970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1900/3025] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:21.931531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1dea7dff-38a7-4782-86cd-fee214733355 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f838b8238b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.209948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1dea7dff-38a7-4782-86cd-fee214733355 tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/acbef1b5-7cb9-41af-849f-e769c8238381" status: 202 len: 0 microversion: 2.1 time: 2.281980 Jul 20 04:29:24.210868 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1901/3026] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:29:21 2022] DELETE /compute/v2.1/os-floating-ips/acbef1b5-7cb9-41af-849f-e769c8238381 => generated 0 bytes in 2284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:29:24.218094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:24.219077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:24.243157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.246353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:24.248767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:24.250702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.253491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.265420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e14ee947-e62a-448c-8baa-0aaae0df1332 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1556 microversion: 2.1 time: 1.052942 Jul 20 04:29:25.270061 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1902/3027] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:24 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1556 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:25.283171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:25.284020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dd158482-1fa5-434d-abb2-a593a37f5ec4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:25.292793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.293455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.294970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.295586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.572389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.590027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cfd6291f-ff1c-46a4-8b31-f1ff0522849f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dd158482-1fa5-434d-abb2-a593a37f5ec4" status: 200 len: 1508 microversion: 2.1 time: 0.317842 Jul 20 04:29:25.603460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1903/3028] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:25 2022] GET /compute/v2.1/servers/dd158482-1fa5-434d-abb2-a593a37f5ec4 => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:25.610539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:25.611786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:25.621361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.622228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.623273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:25.623978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:25.953894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:25.966475 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25da9038-0c3b-454b-84e2-a90b9d839f62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1548 microversion: 2.1 time: 0.361873 Jul 20 04:29:25.983762 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1904/3029] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:25 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1548 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:25.998154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:25.999605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:26.018865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.019642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.020771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:26.022397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:26.382886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.417727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.420061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:26.422225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69e07667-5281-45b9-abd8-3df254bc2a51 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 2834 microversion: 2.32 time: 0.437257 Jul 20 04:29:26.423413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1905/3030] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:25 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 2834 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:26.429960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f48c4528-a73e-4532-bf8d-0590812ad86e tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f839802d430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:27.970261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f48c4528-a73e-4532-bf8d-0590812ad86e tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/4e590372-fc26-445f-b0f5-ac3e7fa145f4" status: 202 len: 0 microversion: 2.1 time: 1.545029 Jul 20 04:29:27.970878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1906/3031] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:29:26 2022] DELETE /compute/v2.1/os-floating-ips/4e590372-fc26-445f-b0f5-ac3e7fa145f4 => generated 0 bytes in 1547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:29:27.975788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:27.976500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:27.999091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.000003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.001170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.006774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.173386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b83fc459-241c-44e5-9914-e54d538ad4c5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200770 Jul 20 04:29:28.174133 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1907/3032] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:29:27 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:28.179200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:28.179910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dd158482-1fa5-434d-abb2-a593a37f5ec4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:28.192842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.193384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.194401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.195030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.228844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dd158482-1fa5-434d-abb2-a593a37f5ec4] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:28.351149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-094e3608-4c9b-46f9-ad7b-559cb247596a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd158482-1fa5-434d-abb2-a593a37f5ec4" status: 204 len: 0 microversion: 2.1 time: 0.175249 Jul 20 04:29:28.352149 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1908/3033] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:28 2022] DELETE /compute/v2.1/servers/dd158482-1fa5-434d-abb2-a593a37f5ec4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:28.359807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:28.359807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:28.375607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.376658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.381870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.383169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.407559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:28.649378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9416a208-c717-4adb-868c-c078c7091c7d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295645 Jul 20 04:29:28.651502 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1909/3034] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:29:28 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:28.659130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:28.659700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:28.680157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.681262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.682841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:28.685936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:28.972469 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54d3fec4-8bb3-4b41-b3c0-c87895123276 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.319658 Jul 20 04:29:28.973220 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1910/3035] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:29:28 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812/os-interface => generated 1831 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:28.979319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5edc86f5-efaf-4a4d-a237-e5ec3f5a76bc tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] Calling method '.version_select at 0x7f838b86fc10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:32.379540 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5edc86f5-efaf-4a4d-a237-e5ec3f5a76bc tempest-FloatingIPDetailsTestJSON-1133624538 tempest-FloatingIPDetailsTestJSON-1133624538-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/896b95d6-2aaa-4983-9393-f9ee97a548b8" status: 202 len: 0 microversion: 2.1 time: 3.404980 Jul 20 04:29:32.381122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1911/3036] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:29:28 2022] DELETE /compute/v2.1/os-floating-ips/896b95d6-2aaa-4983-9393-f9ee97a548b8 => generated 0 bytes in 3407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:29:32.393443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:32.394298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:32.424723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.425579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.426774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:32.427392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:32.493883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: bfdc8764-b87a-4da4-9271-a7bfaf065cf6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:32.648251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03ddbc84-71f5-40a1-9d02-23b41e725771 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6" status: 204 len: 0 microversion: 2.1 time: 0.265421 Jul 20 04:29:32.660065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1912/3037] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:29:32 2022] DELETE /compute/v2.1/servers/bfdc8764-b87a-4da4-9271-a7bfaf065cf6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:29:32.954608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-477138338", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": "none"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:33.106017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:33.106831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:33.107800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:33.109082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:33.110407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:33.149123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.155366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.157697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.158782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.194459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Getting quotas for project 9e0383dee8874c7c825a9db4463eaa7e. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:33.204830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Getting quotas for user 2aa07bcbfe874679ab4ae86722e88ced and project 9e0383dee8874c7c825a9db4463eaa7e. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:33.232965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:33.236769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:33.302893 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd0f3593-bda3-4c5b-a264-c286fe5ab7b3 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.640843 Jul 20 04:29:33.307039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1913/3038] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:29:33.319295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4d06e74a-6d8a-4f5c-a146-4f3496cf54c7 req-51d40f9e-bf72-42c4-9547-e59c335b9f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "tag": "d3cf2916-8fe8-4548-8f60-ba2b57714d64"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:33.332581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4d06e74a-6d8a-4f5c-a146-4f3496cf54c7 req-51d40f9e-bf72-42c4-9547-e59c335b9f21 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.335815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4d06e74a-6d8a-4f5c-a146-4f3496cf54c7 req-51d40f9e-bf72-42c4-9547-e59c335b9f21 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.384223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4d06e74a-6d8a-4f5c-a146-4f3496cf54c7 req-51d40f9e-bf72-42c4-9547-e59c335b9f21 service nova] Creating event network-changed:d3cf2916-8fe8-4548-8f60-ba2b57714d64 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:29:33.393086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4d06e74a-6d8a-4f5c-a146-4f3496cf54c7 req-51d40f9e-bf72-42c4-9547-e59c335b9f21 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084448 Jul 20 04:29:33.400239 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1914/3039] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:33.406272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8d82d96d-2682-481d-b4cd-25cfbf824275 req-5b140334-a3a8-4ae2-b989-934c60f81912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35349313-cc85-4329-90f0-4a66910e3ddc", "tag": "ed2ea321-1ec5-48fd-abbe-4686182f3487"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:33.455356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8d82d96d-2682-481d-b4cd-25cfbf824275 req-5b140334-a3a8-4ae2-b989-934c60f81912 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:33.456154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8d82d96d-2682-481d-b4cd-25cfbf824275 req-5b140334-a3a8-4ae2-b989-934c60f81912 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:33.469210 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8d82d96d-2682-481d-b4cd-25cfbf824275 req-5b140334-a3a8-4ae2-b989-934c60f81912 service nova] Creating event network-changed:ed2ea321-1ec5-48fd-abbe-4686182f3487 for instance 35349313-cc85-4329-90f0-4a66910e3ddc on n-h2-764486-11 Jul 20 04:29:33.475611 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8d82d96d-2682-481d-b4cd-25cfbf824275 req-5b140334-a3a8-4ae2-b989-934c60f81912 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073409 Jul 20 04:29:33.476994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1915/3040] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:33.483349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1817254024", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "890af10e-a67d-412b-8eb5-458666aafa66"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:33.561374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] validate_networks() for [('890af10e-a67d-412b-8eb5-458666aafa66', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:29:35.430856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:29:35.432853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:29:35.433885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:29:35.434599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:29:35.435848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:29:35.457217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.460977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.474486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.476595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.521672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Getting quotas for project bc7717080c394206a0dede2aaf54b38a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:35.540922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Getting quotas for user 5b1847082a384d369c4186f10ac84e2a and project bc7717080c394206a0dede2aaf54b38a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:35.565585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Going to run 2 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:29:35.569815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:35.664037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=003e17d3-75c9-47da-a1d5-8036fd1d27b1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:29:35.766771 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e9cf0147-b568-4fe3-9c07-f45bdf78fe7d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.287069 Jul 20 04:29:35.769511 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1916/3041] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:29:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 2290 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:29:35.784114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:35.786905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:35.808287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.808814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:35.809604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:35.810121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.210845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.225445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.228250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.229495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8076d9a3-1a01-40bd-811e-828dc30bb182 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 200 len: 1338 microversion: 2.47 time: 0.458801 Jul 20 04:29:36.230068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1917/3042] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:35 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 1338 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:36.254176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d01d3695-a2eb-48d8-80dd-08eccc8b74a2 req-3c2d281d-003a-4b31-98c5-c38960573dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd158482-1fa5-434d-abb2-a593a37f5ec4", "name": "network-vif-deleted", "tag": "032bf8a6-6b32-47e9-9e94-34685161c2b6"}, {"name": "network-changed", "server_uuid": "41bb7e90-bb7b-4f99-8e8e-e9cf980b0410", "tag": "9c809395-72c8-4622-a76f-06be38cc94f8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:36.275367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d01d3695-a2eb-48d8-80dd-08eccc8b74a2 req-3c2d281d-003a-4b31-98c5-c38960573dc3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.275813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d01d3695-a2eb-48d8-80dd-08eccc8b74a2 req-3c2d281d-003a-4b31-98c5-c38960573dc3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.303438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d01d3695-a2eb-48d8-80dd-08eccc8b74a2 req-3c2d281d-003a-4b31-98c5-c38960573dc3 service nova] Creating event network-vif-deleted:032bf8a6-6b32-47e9-9e94-34685161c2b6 for instance dd158482-1fa5-434d-abb2-a593a37f5ec4 on n-h1-764486-11 Jul 20 04:29:36.303965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d01d3695-a2eb-48d8-80dd-08eccc8b74a2 req-3c2d281d-003a-4b31-98c5-c38960573dc3 service nova] Creating event network-changed:9c809395-72c8-4622-a76f-06be38cc94f8 for instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 on n-h1-764486-11 Jul 20 04:29:36.327045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d01d3695-a2eb-48d8-80dd-08eccc8b74a2 req-3c2d281d-003a-4b31-98c5-c38960573dc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084363 Jul 20 04:29:36.328044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1918/3043] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:36.350167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:36.364957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.367364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Searching by: {'deleted': False, 'project_id': 'bc7717080c394206a0dede2aaf54b38a'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:29:36.389662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.390469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.391598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.392291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.440569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:29:36.492220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bcf8ebd5-4980-4f1b-b9b4-f8c6229e7b1d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1005 microversion: 2.1 time: 0.150397 Jul 20 04:29:36.523273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1919/3044] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:29:36 2022] GET /compute/v2.1/servers => generated 1005 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:36.529816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7483890b-39c2-457d-a167-8210c8a0360b req-fe81fa7d-22ce-4aa3-9643-f7a3392cf340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdc8764-b87a-4da4-9271-a7bfaf065cf6", "name": "network-vif-deleted", "tag": "5a451a15-5ca6-4d64-b3ba-7a5d520f3460"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:36.551807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7483890b-39c2-457d-a167-8210c8a0360b req-fe81fa7d-22ce-4aa3-9643-f7a3392cf340 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:36.557106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7483890b-39c2-457d-a167-8210c8a0360b req-fe81fa7d-22ce-4aa3-9643-f7a3392cf340 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:36.576129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7483890b-39c2-457d-a167-8210c8a0360b req-fe81fa7d-22ce-4aa3-9643-f7a3392cf340 service nova] Creating event network-vif-deleted:5a451a15-5ca6-4d64-b3ba-7a5d520f3460 for instance bfdc8764-b87a-4da4-9271-a7bfaf065cf6 on n-h2-764486-11 Jul 20 04:29:36.583602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7483890b-39c2-457d-a167-8210c8a0360b req-fe81fa7d-22ce-4aa3-9643-f7a3392cf340 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058452 Jul 20 04:29:36.586249 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1920/3045] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:36.593205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9225f72-e47d-444e-8e7e-ab04153247fb tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:36.594068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9225f72-e47d-444e-8e7e-ab04153247fb tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:36.878285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f9225f72-e47d-444e-8e7e-ab04153247fb tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:36.887025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9225f72-e47d-444e-8e7e-ab04153247fb tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1218 microversion: 2.1 time: 0.299139 Jul 20 04:29:36.897138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1921/3046] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:36 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:37.247952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:37.248589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.259537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.259991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.275502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.275971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.495297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.506352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.507869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:37.509293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1010feda-55ac-4376-aebb-27eefb937beb tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 200 len: 1338 microversion: 2.47 time: 0.265230 Jul 20 04:29:37.510047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1922/3047] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:37 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 1338 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:29:37.917796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:37.918833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:37.927420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:37.950187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.956548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:37.959070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:37.960850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.265734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.283061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9c6a93b-c094-4668-b84d-4ded1ba30ec7 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1270 microversion: 2.1 time: 0.366611 Jul 20 04:29:38.293721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1923/3048] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:37 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1270 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:38.529960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:38.531298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:38.538899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:38.539573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.540616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:38.541219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.764663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.783528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.785432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:38.786843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c9d3f1b-6faa-4745-957a-9d06b434c8b5 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 200 len: 1359 microversion: 2.47 time: 0.261739 Jul 20 04:29:38.792401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1924/3049] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:38 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:29:38.807119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-609724715"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:38.808613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:38.816318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:38.817419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:38.817912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:38.818699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.165832 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-647a12a8-ab7e-4fd1-9413-de15e499bb7f tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "POST /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad/action" status: 202 len: 52 microversion: 2.47 time: 0.362233 Jul 20 04:29:39.171785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1925/3050] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:29:38 2022] POST /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad/action => generated 52 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:29:39.205279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.206045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:39.216575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.217038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.218270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.218876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.256074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:29:39.387525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9d0e551-0d84-4bc0-9c42-fbf20689d793 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 204 len: 0 microversion: 2.47 time: 0.194836 Jul 20 04:29:39.388515 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1926/3051] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:39 2022] DELETE /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:29:39.396019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.396905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:39.403252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.403699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.404944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.404944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.579786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.588860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:39.609871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ab77205-a0d0-4862-b026-3853d48a96c8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1276 microversion: 2.1 time: 0.219092 Jul 20 04:29:39.616994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1927/3052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:39 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:39.627918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:39.628603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:39.638845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.639003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.641162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:39.641162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:39.777402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.787030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.788721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:39.790021 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed81f6f6-9724-4c51-b5f3-94bbd773eab0 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 200 len: 1365 microversion: 2.47 time: 0.173078 Jul 20 04:29:39.790778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1928/3053] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:39 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:40.629401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:40.630096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:40.647280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.650458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.651840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.652279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.806793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.822020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e28067c7-5fe2-4abe-907d-9623d6675a90 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1276 microversion: 2.1 time: 0.197426 Jul 20 04:29:40.825462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1929/3054] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:40 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:40.837418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:40.838416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:40.849984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.850749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.851789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:40.852457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:40.958731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.969560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.971416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:40.972956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6586bded-8aa3-4d3c-a2a0-1e7e48476a9b tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 200 len: 1365 microversion: 2.47 time: 0.146454 Jul 20 04:29:40.973922 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1930/3055] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:40 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:41.859821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:41.865448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:41.939305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.943364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:41.947814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:41.953186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.165085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.186304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99148907-ef78-4fb1-919d-8e3a0d115e01 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 1.348783 Jul 20 04:29:43.190757 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1931/3056] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:41 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:43.206407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:43.207313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:43.265546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.266027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.268761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.269438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.345876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.346579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.347604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lazy-loading 'fault' on Instance uuid 49039b57-19a8-4589-8ac8-fe7dafd61aad {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:29:43.535240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.543526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.545649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2aa07bcbfe874679ab4ae86722e88ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0383dee8874c7c825a9db4463eaa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:43.547322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56377942-191c-4a76-8df4-b55ca5edb824 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 200 len: 1370 microversion: 2.47 time: 0.350588 Jul 20 04:29:43.549068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1932/3057] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:43 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 1370 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:29:43.799978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9cdf504c-edec-41ac-992f-f79df552ef43 req-6128d0bb-95b4-48e3-b40b-ad131b519d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003e17d3-75c9-47da-a1d5-8036fd1d27b1", "tag": "6019cb1f-2a1c-4350-a740-39ed87c75f7e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:43.841095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9cdf504c-edec-41ac-992f-f79df552ef43 req-6128d0bb-95b4-48e3-b40b-ad131b519d86 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:43.842350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9cdf504c-edec-41ac-992f-f79df552ef43 req-6128d0bb-95b4-48e3-b40b-ad131b519d86 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:43.948620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9cdf504c-edec-41ac-992f-f79df552ef43 req-6128d0bb-95b4-48e3-b40b-ad131b519d86 service nova] Creating event network-changed:6019cb1f-2a1c-4350-a740-39ed87c75f7e for instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 on n-h2-764486-11 Jul 20 04:29:43.984497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9cdf504c-edec-41ac-992f-f79df552ef43 req-6128d0bb-95b4-48e3-b40b-ad131b519d86 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192194 Jul 20 04:29:43.986509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1933/3058] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:44.209907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:44.211356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:44.240545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.243040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.245172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.245624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.768252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:44.779402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b63c1010-9253-4906-8d9e-b27e898f601a tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.578030 Jul 20 04:29:44.780343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1934/3059] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:44 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:44.787771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:44.788408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] [instance: 49039b57-19a8-4589-8ac8-fe7dafd61aad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:44.803703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.804432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.805774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:44.806479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:44.852486 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] HTTP exception thrown: Instance 49039b57-19a8-4589-8ac8-fe7dafd61aad could not be found. Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Request method failure captured: Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad HTTP/1.1 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14SppB95Q1LwBXvL-D4GANpW41-bNHT3op3vF6pwmyEIIC6vYJ7qEXNQOruk_2pHHFHfiJZkKfTiLRSUUoXL7OL-Hq97IaFTjx9HTJDKi3u2vyJT81UpHJaMyAC1GG71gMehii6UItG6OCfs1AWW2n8-9Y2lS71SfPuRWqXvthK1uOE Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9e0383dee8874c7c825a9db4463eaa7e Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAaction247Test-1674574768 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9e0383dee8874c7c825a9db4463eaa7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9e0383dee8874c7c825a9db4463eaa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9e0383dee8874c7c825a9db4463eaa7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9e0383dee8874c7c825a9db4463eaa7e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAaction247Test-1674574768 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9e0383dee8874c7c825a9db4463eaa7e Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAaction247Test-1674574768 Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAaction247Test-1674574768-project Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 2aa07bcbfe874679ab4ae86722e88ced Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAaction247Test-1674574768-project Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 49039b57-19a8-4589-8ac8-fe7dafd61aad could not be found. Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '49039b57-19a8-4589-8ac8-fe7dafd61aad'} Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49039b57-19a8-4589-8ac8-fe7dafd61aad could not be found. Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49039b57-19a8-4589-8ac8-fe7dafd61aad could not be found. Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:29:44.854684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49039b57-19a8-4589-8ac8-fe7dafd61aad could not be found. Jul 20 04:29:44.860689 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:29:44.863885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] Returning 404 to user: Instance 49039b57-19a8-4589-8ac8-fe7dafd61aad could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:29:44.865903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-467b2f47-3a74-46b3-b0c1-4457c30577a2 tempest-ServersAaction247Test-1674574768 tempest-ServersAaction247Test-1674574768-project] 10.222.0.49 "GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad" status: 404 len: 111 microversion: 2.47 time: 0.084452 Jul 20 04:29:44.871023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1935/3060] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:29:44 2022] GET /compute/v2.1/servers/49039b57-19a8-4589-8ac8-fe7dafd61aad => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:29:45.800004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:45.801621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:45.819586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.820418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:45.822755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:45.824225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.300151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:46.309274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68393c34-3019-4bbd-86bf-c2f9d552ff8d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.515620 Jul 20 04:29:46.309858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1936/3061] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:45 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:29:46.315720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-60c53b27-0c0a-4318-9703-afb8386ab0c0 req-1298293d-ff4c-4623-9db5-43d87c8ff49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb6d436-7894-4de1-aba7-61fdabf955df", "tag": "f8532726-b015-47be-895e-ef7a70b8ce24"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:46.325254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-60c53b27-0c0a-4318-9703-afb8386ab0c0 req-1298293d-ff4c-4623-9db5-43d87c8ff49d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:46.325972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-60c53b27-0c0a-4318-9703-afb8386ab0c0 req-1298293d-ff4c-4623-9db5-43d87c8ff49d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:46.338493 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-60c53b27-0c0a-4318-9703-afb8386ab0c0 req-1298293d-ff4c-4623-9db5-43d87c8ff49d service nova] Creating event network-changed:f8532726-b015-47be-895e-ef7a70b8ce24 for instance dfb6d436-7894-4de1-aba7-61fdabf955df on n-h2-764486-11 Jul 20 04:29:46.343523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-60c53b27-0c0a-4318-9703-afb8386ab0c0 req-1298293d-ff4c-4623-9db5-43d87c8ff49d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032256 Jul 20 04:29:46.344738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1937/3062] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:47.330133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:47.331864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:47.340376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:47.342868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:47.345472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.346131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.347693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:47.348655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:47.628119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:47.643240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4773f6d2-f5fa-41ed-baf8-bba8aaf88e19 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.319556 Jul 20 04:29:47.644497 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1938/3063] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:47 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:48.663067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:48.663946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:48.673708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.674783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.675836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:48.676673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:48.852299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:48.862260 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8947e1f-8282-45f2-9c87-41f0f3819d4d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.204178 Jul 20 04:29:48.864303 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1939/3064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:48 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:49.885395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:49.886737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:49.907777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.908586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:49.913579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:49.914207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:50.322480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:50.330176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-604611c7-8584-403c-9c5c-77cc97a707c3 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.452313 Jul 20 04:29:50.330783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1940/3065] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:49 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:50.501679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ba14435-fcf9-4638-b166-fa37ae4aaab2 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f839ce8b310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:50.570898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ba14435-fcf9-4638-b166-fa37ae4aaab2 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0" status: 200 len: 637 microversion: 2.1 time: 0.076297 Jul 20 04:29:50.579004 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1941/3066] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:29:50 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0 => generated 637 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:50.584740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5805db45-ca2e-4bac-a727-9dfcb369f7a6 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f83980f41f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:50.676935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5805db45-ca2e-4bac-a727-9dfcb369f7a6 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:50.694161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5805db45-ca2e-4bac-a727-9dfcb369f7a6 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:51.201261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5805db45-ca2e-4bac-a727-9dfcb369f7a6 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.620758 Jul 20 04:29:51.202573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1942/3067] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:50 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:29:51.213203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aeb94893-aed4-466d-aae0-5b42d968694f tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f838b85a8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.852609 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aeb94893-aed4-466d-aae0-5b42d968694f tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "DELETE /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.643233 Jul 20 04:29:51.856687 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1943/3068] 10.222.0.49 () {58 vars in 1295 bytes} [Wed Jul 20 04:29:51 2022] DELETE /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata/os_version => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:29:51.862701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:51.864211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:51.883587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.884265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:51.885493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:51.888400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:52.237567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:52.249444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e4670e6-2e25-4658-ab48-2a73742175c5 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.391053 Jul 20 04:29:52.250759 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1944/3069] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:51 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:52.263730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e91fe324-e1bb-42c2-883a-a56659bc2733 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f839ce8b4c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:52.335814 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e91fe324-e1bb-42c2-883a-a56659bc2733 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 37 microversion: 2.1 time: 0.083494 Jul 20 04:29:52.341652 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1945/3070] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:29:52 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:52.366724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8b92d18-3fc3-4351-811e-3961a357ff42 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f838ba10940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:52.448059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d8b92d18-3fc3-4351-811e-3961a357ff42 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:52.457738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d8b92d18-3fc3-4351-811e-3961a357ff42 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:53.220244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8b92d18-3fc3-4351-811e-3961a357ff42 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.875000 Jul 20 04:29:53.220906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1946/3071] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:52 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:53.232434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05992ff3-377a-47ef-b79e-8230d83e709d tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f839ce8b4c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.294254 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05992ff3-377a-47ef-b79e-8230d83e709d tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.067719 Jul 20 04:29:53.295013 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1947/3072] 10.222.0.49 () {58 vars in 1289 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata/os_distro => generated 33 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:53.304986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:53.305644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:53.317363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.318074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.319370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:53.319977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:53.632215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:53.651235 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89168e63-fc86-4997-8a5d-2ba5bb1f0fa8 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.355083 Jul 20 04:29:53.654737 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1948/3073] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:53 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:53.665416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7364bf2-0d35-4020-8ac6-9ba14c102223 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f83980d34c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:53.789780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f7364bf2-0d35-4020-8ac6-9ba14c102223 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:53.817601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f7364bf2-0d35-4020-8ac6-9ba14c102223 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:54.372220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7364bf2-0d35-4020-8ac6-9ba14c102223 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.714957 Jul 20 04:29:54.373870 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1949/3074] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:53 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:54.383654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f69e1bb5-8c45-49f1-a22f-2a0264c3450d tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f839ce8b160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:54.439163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f69e1bb5-8c45-49f1-a22f-2a0264c3450d tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.059758 Jul 20 04:29:54.440491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1950/3075] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:29:54 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:29:54.450686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c045718-8979-4099-b9da-add50a45a531 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f838b9c0430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:54.524855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9c045718-8979-4099-b9da-add50a45a531 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:54.537164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9c045718-8979-4099-b9da-add50a45a531 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:55.014412 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c045718-8979-4099-b9da-add50a45a531 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.568022 Jul 20 04:29:55.015464 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1951/3076] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:54 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:29:55.029073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-45783118-160d-4f6f-b5c0-7c01d09cc1d2 req-41263b17-9d64-4578-b4f7-2e2c57a69a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003e17d3-75c9-47da-a1d5-8036fd1d27b1", "name": "network-vif-plugged", "status": "completed", "tag": "6019cb1f-2a1c-4350-a740-39ed87c75f7e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:55.050393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45783118-160d-4f6f-b5c0-7c01d09cc1d2 req-41263b17-9d64-4578-b4f7-2e2c57a69a45 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.053234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45783118-160d-4f6f-b5c0-7c01d09cc1d2 req-41263b17-9d64-4578-b4f7-2e2c57a69a45 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.078215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-45783118-160d-4f6f-b5c0-7c01d09cc1d2 req-41263b17-9d64-4578-b4f7-2e2c57a69a45 service nova] Creating event network-vif-plugged:6019cb1f-2a1c-4350-a740-39ed87c75f7e for instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 on n-h2-764486-11 Jul 20 04:29:55.097319 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-45783118-160d-4f6f-b5c0-7c01d09cc1d2 req-41263b17-9d64-4578-b4f7-2e2c57a69a45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068703 Jul 20 04:29:55.103816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1952/3077] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:55.123275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:55.124001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:55.141653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.143685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.147292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:55.148560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:55.583917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:55.598596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28997fbe-30b3-4f8a-8a7d-dea8641a210d tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.494360 Jul 20 04:29:55.601749 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1953/3078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:55 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:55.607345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e2c3bdc-81f5-4d8d-8c2f-cbcac3c1d8a4 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f838bd204c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:55.695616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3e2c3bdc-81f5-4d8d-8c2f-cbcac3c1d8a4 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:55.708856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3e2c3bdc-81f5-4d8d-8c2f-cbcac3c1d8a4 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:56.194569 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e2c3bdc-81f5-4d8d-8c2f-cbcac3c1d8a4 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 64 microversion: 2.1 time: 0.592946 Jul 20 04:29:56.196159 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1954/3079] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:55 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 64 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:56.208587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3173eb63-1b9a-42ba-b97e-2ba0e87cfd2c tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f83982833a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:56.275181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3173eb63-1b9a-42ba-b97e-2ba0e87cfd2c tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 64 microversion: 2.1 time: 0.073973 Jul 20 04:29:56.280721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1955/3080] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:29:56 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 64 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:56.288328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-769de080-bc78-4bc6-ab0b-4c7a52c94e19 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f83980334c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:56.358500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-769de080-bc78-4bc6-ab0b-4c7a52c94e19 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:56.367137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-769de080-bc78-4bc6-ab0b-4c7a52c94e19 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:57.064522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-769de080-bc78-4bc6-ab0b-4c7a52c94e19 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.781491 Jul 20 04:29:57.065173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1956/3081] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:56 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:57.073932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:57.074561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:57.076695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:57.090848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.091311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.092125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:57.101232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:57.418415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:57.429988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a80ed9dd-4068-4c34-8b97-0fcf57c1cf47 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.363496 Jul 20 04:29:57.432132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1957/3082] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:57 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:57.440277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33408c3f-cab6-4f00-8b85-ffe9a203d467 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update', calling method: .version_select at 0x7f838b9c08b0>, body: {"meta": {"os_version": "alt"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:57.536405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-33408c3f-cab6-4f00-8b85-ffe9a203d467 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:57.549951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-33408c3f-cab6-4f00-8b85-ffe9a203d467 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:58.031126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33408c3f-cab6-4f00-8b85-ffe9a203d467 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.597568 Jul 20 04:29:58.031817 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1958/3083] 10.222.0.49 () {60 vars in 1312 bytes} [Wed Jul 20 04:29:57 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata/os_version => generated 31 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:58.040696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-86eecdbd-8cd4-4082-bdda-a3903667a487 req-6e49f49e-f2a5-428e-b09d-256c5b42e3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb6d436-7894-4de1-aba7-61fdabf955df", "name": "network-vif-plugged", "status": "completed", "tag": "f8532726-b015-47be-895e-ef7a70b8ce24"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:58.051125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-86eecdbd-8cd4-4082-bdda-a3903667a487 req-6e49f49e-f2a5-428e-b09d-256c5b42e3a2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.051844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-86eecdbd-8cd4-4082-bdda-a3903667a487 req-6e49f49e-f2a5-428e-b09d-256c5b42e3a2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.065033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-86eecdbd-8cd4-4082-bdda-a3903667a487 req-6e49f49e-f2a5-428e-b09d-256c5b42e3a2 service nova] Creating event network-vif-plugged:f8532726-b015-47be-895e-ef7a70b8ce24 for instance dfb6d436-7894-4de1-aba7-61fdabf955df on n-h2-764486-11 Jul 20 04:29:58.072280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-86eecdbd-8cd4-4082-bdda-a3903667a487 req-6e49f49e-f2a5-428e-b09d-256c5b42e3a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 Jul 20 04:29:58.073343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1959/3084] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:58.273181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd489868-0c9d-46c6-a989-cfccff5eab69 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Action: 'create', calling method: .version_select at 0x7f838ba10ca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2038093335", "policies": ["affinity"]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:58.298989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bd489868-0c9d-46c6-a989-cfccff5eab69 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:58.307526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bd489868-0c9d-46c6-a989-cfccff5eab69 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:58.379506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bd489868-0c9d-46c6-a989-cfccff5eab69 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:58.386249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bd489868-0c9d-46c6-a989-cfccff5eab69 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:58.416500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd489868-0c9d-46c6-a989-cfccff5eab69 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.340964 Jul 20 04:29:58.417126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1960/3085] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Jul 20 04:29:58 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:58.445619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fbc63b1-95a5-462a-ab55-3e843eb1a822 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f838ba10550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.511045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fbc63b1-95a5-462a-ab55-3e843eb1a822 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 58 microversion: 2.1 time: 0.087329 Jul 20 04:29:58.511606 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1961/3086] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 58 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:58.521574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-242a564c-9170-4c79-8f5a-5728d081fa63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Action: 'create', calling method: .version_select at 0x7f838bebe700>, body: {"server_group": {"name": "tempest-server-group-1070514384", "policies": ["affinity"]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:58.544756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-242a564c-9170-4c79-8f5a-5728d081fa63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:58.557435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-242a564c-9170-4c79-8f5a-5728d081fa63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:58.635083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-242a564c-9170-4c79-8f5a-5728d081fa63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:58.645141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-242a564c-9170-4c79-8f5a-5728d081fa63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:58.662345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-242a564c-9170-4c79-8f5a-5728d081fa63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.148964 Jul 20 04:29:58.664274 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1962/3087] 10.222.0.49 () {60 vars in 1172 bytes} [Wed Jul 20 04:29:58 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:58.681420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:29:58.682237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:29:58.691695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.692159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.693020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:29:58.693455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:29:58.713583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:58.867288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:29:58.878664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-947df8b4-d1f1-4540-9f66-1a77b2d0b17f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1318 microversion: 2.1 time: 0.212250 Jul 20 04:29:58.879284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1963/3088] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:29:58 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:29:58.884030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9136d602-86e5-486d-9890-1feb1a3a87d3 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'update_all', calling method: .version_select at 0x7f839802d820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:58.944214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9136d602-86e5-486d-9890-1feb1a3a87d3 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:58.952955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9136d602-86e5-486d-9890-1feb1a3a87d3 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:59.510744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9136d602-86e5-486d-9890-1feb1a3a87d3 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 61 microversion: 2.1 time: 0.629751 Jul 20 04:29:59.515779 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1964/3089] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:29:58 2022] PUT /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 61 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:29:59.518048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3ffb0dd-e692-4d64-ab48-a02141817bd1 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Action: 'create', calling method: .version_select at 0x7f83980d35e0>, body: {"server_group": {"name": "tempest-server-group-1070514384", "policies": ["affinity"]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:59.565501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a3ffb0dd-e692-4d64-ab48-a02141817bd1 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:59.579260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a3ffb0dd-e692-4d64-ab48-a02141817bd1 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:59.659688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a3ffb0dd-e692-4d64-ab48-a02141817bd1 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:59.667114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a3ffb0dd-e692-4d64-ab48-a02141817bd1 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:29:59.670551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:29:59.686098 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3ffb0dd-e692-4d64-ab48-a02141817bd1 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.173054 Jul 20 04:29:59.691302 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1965/3090] 10.222.0.49 () {60 vars in 1172 bytes} [Wed Jul 20 04:29:59 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:29:59.696404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68450651-66ee-4c5f-a417-642779c75c9f tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Action: 'create', calling method: .version_select at 0x7f838bcc0d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:29:59.781002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-68450651-66ee-4c5f-a417-642779c75c9f tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:29:59.791908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-68450651-66ee-4c5f-a417-642779c75c9f tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Getting quotas for user 000551b8ef674b749c6cc1db350e4a53 and project 9f9f1e351ca64c1687196929157a3253. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:00.255314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68450651-66ee-4c5f-a417-642779c75c9f tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "POST /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 85 microversion: 2.1 time: 0.566329 Jul 20 04:30:00.255918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1966/3091] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Jul 20 04:29:59 2022] POST /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 85 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:30:00.261202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d61a926-9f6d-43d4-9f24-370067907d63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.294035 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d61a926-9f6d-43d4-9f24-370067907d63 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/ac37c2c9-1dc6-41fd-998a-3c7270e852fc" status: 204 len: 0 microversion: 2.1 time: 0.036714 Jul 20 04:30:00.295205 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1967/3092] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:00 2022] DELETE /compute/v2.1/os-server-groups/ac37c2c9-1dc6-41fd-998a-3c7270e852fc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:00.302964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.303602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.311618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.312612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.314448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.315867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.554171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.568106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06e3cab2-0df4-4404-b779-036232b12258 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 200 len: 1505 microversion: 2.1 time: 0.270851 Jul 20 04:30:00.569199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1968/3093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.575894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c4c8364-f7aa-491e-9d49-f177a9385c51 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] Calling method '.version_select at 0x7f839ce06c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.629018 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c4c8364-f7aa-491e-9d49-f177a9385c51 tempest-ImagesMetadataTestJSON-1732487708 tempest-ImagesMetadataTestJSON-1732487708-project] 10.222.0.49 "GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata" status: 200 len: 85 microversion: 2.1 time: 0.058253 Jul 20 04:30:00.629816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1969/3094] 10.222.0.49 () {58 vars in 1259 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/images/6102a331-ff6d-484c-b9f8-afbeef7ad9d0/metadata => generated 85 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:30:00.639880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-feae4285-d777-4468-b606-361bb25bf0cb tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.662420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-feae4285-d777-4468-b606-361bb25bf0cb tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.027513 Jul 20 04:30:00.663753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1970/3095] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:00.670131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:00.670951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:00.682329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.683005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.684109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:00.684739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:00.939053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:00.950696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0cacf69f-b454-40be-aff6-f48dcde05279 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1" status: 200 len: 1506 microversion: 2.1 time: 0.285820 Jul 20 04:30:00.951297 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1971/3096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:00 2022] GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:00.971054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9850e7f-fbc8-432c-b254-6c9ff0fbc723 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.023380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9850e7f-fbc8-432c-b254-6c9ff0fbc723 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/f38856ab-e6cc-48ec-8122-553e3c2b07a9" status: 204 len: 0 microversion: 2.1 time: 0.069600 Jul 20 04:30:01.024316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1972/3097] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:00 2022] DELETE /compute/v2.1/os-server-groups/f38856ab-e6cc-48ec-8122-553e3c2b07a9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:01.034265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.035034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.045596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.046853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.049462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.050341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.102963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:01.299122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e44b70a0-51b0-4aa9-ac60-57b994b95f97 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "DELETE /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1" status: 204 len: 0 microversion: 2.1 time: 0.272697 Jul 20 04:30:01.299993 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1973/3098] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:01 2022] DELETE /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:01.320375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-583da378-0e25-40c0-97cb-99999d27e5c4 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.349090 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-583da378-0e25-40c0-97cb-99999d27e5c4 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042831 Jul 20 04:30:01.352926 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1974/3099] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:01.369967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:01.370858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:01.379390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.380110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.381888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:01.382547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:01.419315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:01.739316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9b34393-cb6e-49e7-8a8b-b518f86213f9 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 204 len: 0 microversion: 2.1 time: 0.382405 Jul 20 04:30:01.741550 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1975/3100] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:01 2022] DELETE /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:01.760743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0757a86-3db2-4545-b173-2c45c38559e7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Action: 'create', calling method: .version_select at 0x7f83986d98b0>, body: {"server_group": {"name": "tempest-server-group-1144329339", "policies": ["affinity"]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:01.880804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f0757a86-3db2-4545-b173-2c45c38559e7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:01.895888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f0757a86-3db2-4545-b173-2c45c38559e7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:02.054422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f0757a86-3db2-4545-b173-2c45c38559e7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:02.090389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f0757a86-3db2-4545-b173-2c45c38559e7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:02.134597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0757a86-3db2-4545-b173-2c45c38559e7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.387837 Jul 20 04:30:02.135877 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1976/3101] 10.222.0.49 () {60 vars in 1172 bytes} [Wed Jul 20 04:30:01 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:02.161159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.161979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.190952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.191446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.192298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.203463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.553022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:02.568539 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6169493e-8361-412d-ac87-6e90ecf3105c tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1" status: 200 len: 1512 microversion: 2.1 time: 0.431606 Jul 20 04:30:02.569364 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1977/3102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:02.583707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6e0fe05-a55f-4dbe-9549-b918a9188fff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.657037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6e0fe05-a55f-4dbe-9549-b918a9188fff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/d359f3e7-75c9-4e1d-b803-dafbe0379a1f" status: 204 len: 0 microversion: 2.1 time: 0.085450 Jul 20 04:30:02.657569 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1978/3103] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:02 2022] DELETE /compute/v2.1/os-server-groups/d359f3e7-75c9-4e1d-b803-dafbe0379a1f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:02.674957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.675524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:02.709409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.712177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.713695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:02.717247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:02.791899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e16037ce-414a-43fc-8dbf-ce0cc64f4ad4 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/ips" status: 200 len: 144 microversion: 2.1 time: 0.108187 Jul 20 04:30:02.805531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1979/3104] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/ips => generated 144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:02.819796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42603913-04c7-4914-b5a8-b437d20089f0 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:02.862272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42603913-04c7-4914-b5a8-b437d20089f0 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043385 Jul 20 04:30:02.865843 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1980/3105] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:02 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:02.890245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-347be4d1-ca06-40a8-b939-ae0a5c49717f tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Action: 'create', calling method: .version_select at 0x7f838ba74dc0>, body: {"server_group": {"name": "tempest-server-group-1888440533", "policies": ["anti-affinity"]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:02.929545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-347be4d1-ca06-40a8-b939-ae0a5c49717f tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:02.947508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-347be4d1-ca06-40a8-b939-ae0a5c49717f tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:02.956685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:03.025406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-347be4d1-ca06-40a8-b939-ae0a5c49717f tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:03.035528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-347be4d1-ca06-40a8-b939-ae0a5c49717f tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:03.109323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-347be4d1-ca06-40a8-b939-ae0a5c49717f tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.233407 Jul 20 04:30:03.110601 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1981/3106] 10.222.0.49 () {60 vars in 1172 bytes} [Wed Jul 20 04:30:02 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:03.123978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-229988a7-994c-44cc-9c79-4bb84333aad8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.162045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-229988a7-994c-44cc-9c79-4bb84333aad8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/8e8d38fa-e638-45f3-8622-52c3a498591c" status: 204 len: 0 microversion: 2.1 time: 0.045505 Jul 20 04:30:03.163092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1982/3107] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:03 2022] DELETE /compute/v2.1/os-server-groups/8e8d38fa-e638-45f3-8622-52c3a498591c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:30:03.179128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c7c576f-cb18-4c11-947f-8b55076750eb tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:03.194274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c7c576f-cb18-4c11-947f-8b55076750eb tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027029 Jul 20 04:30:03.195867 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1983/3108] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:03 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:03.383150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-861719928", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "b84f1456-78d2-45a6-b383-e08041393528"}]}, "os:scheduler_hints": {"group": "fa5d1122-ff67-4f99-9999-1c3619e24074"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:03.486018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] validate_networks() for [('b84f1456-78d2-45a6-b383-e08041393528', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:05.141370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:05.142071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:05.142358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:05.142775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:05.143194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:05.185731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.186274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.187235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.199611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.270974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:05.280680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:05.312485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:05.319552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:05.403622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=123724) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 04:30:05.457064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_group_members'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:05.485769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_group_members'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:05.631912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_group_members'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:05.656287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Getting quotas for user e67348f58081484f9a203c144065d962 and project 4c1e751676344df9b8ff13cde66ecde4. Resources: {'server_group_members'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:05.807829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba0303df-0e0d-46dc-adce-f9949cf6adcf tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.430127 Jul 20 04:30:05.814218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1984/3109] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:05.823049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:05.844085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:05.866525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.873327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.874849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.876602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.946543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:05.947394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:05.948106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lazy-loading 'fault' on Instance uuid 003e17d3-75c9-47da-a1d5-8036fd1d27b1 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:06.607322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1847082a384d369c4186f10ac84e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc7717080c394206a0dede2aaf54b38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:06.625587 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-912916b4-0bce-4735-885b-8779df749329 tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1" status: 200 len: 1308 microversion: 2.1 time: 0.806586 Jul 20 04:30:06.636083 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1985/3110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:05 2022] GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1 => generated 1308 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:06.971969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-78edb7b8-9145-41ed-8b5c-a8398edfe7b9 req-5d542c93-bbf6-4e54-b53d-b289a6710725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003e17d3-75c9-47da-a1d5-8036fd1d27b1", "name": "network-vif-deleted", "tag": "6019cb1f-2a1c-4350-a740-39ed87c75f7e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:06.982917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-78edb7b8-9145-41ed-8b5c-a8398edfe7b9 req-5d542c93-bbf6-4e54-b53d-b289a6710725 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:06.995647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-78edb7b8-9145-41ed-8b5c-a8398edfe7b9 req-5d542c93-bbf6-4e54-b53d-b289a6710725 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.033720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-78edb7b8-9145-41ed-8b5c-a8398edfe7b9 req-5d542c93-bbf6-4e54-b53d-b289a6710725 service nova] Creating event network-vif-deleted:6019cb1f-2a1c-4350-a740-39ed87c75f7e for instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 on n-h2-764486-11 Jul 20 04:30:07.045222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-78edb7b8-9145-41ed-8b5c-a8398edfe7b9 req-5d542c93-bbf6-4e54-b53d-b289a6710725 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407220 Jul 20 04:30:07.046812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1986/3111] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:07.055458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcda8bd2-3d83-4c41-a874-04d825744bc0 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.059966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dcda8bd2-3d83-4c41-a874-04d825744bc0 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.232949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dcda8bd2-3d83-4c41-a874-04d825744bc0 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:07.247993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcda8bd2-3d83-4c41-a874-04d825744bc0 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1212 microversion: 2.1 time: 0.199533 Jul 20 04:30:07.248676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1987/3112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1212 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:07.257739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f15d688a-ecc0-4a6e-8d38-ac77827aa0ab"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:07.258822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.287577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.288073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.289072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.289516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.884406 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b970d386-758d-4a97-8ff6-322861e90e17 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632324 Jul 20 04:30:07.885778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1988/3113] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:30:07 2022] POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:07.897034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:07.898466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: 003e17d3-75c9-47da-a1d5-8036fd1d27b1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:07.908676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.910594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:07.927590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:07.928218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.057059 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] HTTP exception thrown: Instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 could not be found. Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Request method failure captured: Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1 HTTP/1.1 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14R2UvEVifBNNzy_bSvJ1uKu5rToSc4hKyTrX1hEv-XMD89YbhAkOb84xgvOrlMLdpkBrMGyJpKSapAESBJQw7HiUTL4llagVNLaKuldjwX6ZeDYrcNX574tn1j1ZecofD6GCDWHhH4PrcNUhDQ6XI2lhyWXJQw8_ofsLKd863IbiCM Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: bc7717080c394206a0dede2aaf54b38a Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateTestJSON-659435131 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc7717080c394206a0dede2aaf54b38a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc7717080c394206a0dede2aaf54b38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc7717080c394206a0dede2aaf54b38a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc7717080c394206a0dede2aaf54b38a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateTestJSON-659435131 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: bc7717080c394206a0dede2aaf54b38a Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateTestJSON-659435131 Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateTestJSON-659435131-project Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5b1847082a384d369c4186f10ac84e2a Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateTestJSON-659435131-project Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 could not be found. Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '003e17d3-75c9-47da-a1d5-8036fd1d27b1'} Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 could not be found. Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 could not be found. Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:08.063543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 could not be found. Jul 20 04:30:08.071280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.106389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Returning 404 to user: Instance 003e17d3-75c9-47da-a1d5-8036fd1d27b1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:08.115339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b31299e-ad09-40e2-85e6-e0565ddb39ed tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1" status: 404 len: 111 microversion: 2.1 time: 0.221059 Jul 20 04:30:08.117786 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1989/3114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:07 2022] GET /compute/v2.1/servers/003e17d3-75c9-47da-a1d5-8036fd1d27b1 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:08.160047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.161435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] [instance: dfb6d436-7894-4de1-aba7-61fdabf955df] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.202764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.205600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.210738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.212584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.309927 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] HTTP exception thrown: Instance dfb6d436-7894-4de1-aba7-61fdabf955df could not be found. Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Request method failure captured: Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df HTTP/1.1 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14R2UvEVifBNNzy_bSvJ1uKu5rToSc4hKyTrX1hEv-XMD89YbhAkOb84xgvOrlMLdpkBrMGyJpKSapAESBJQw7HiUTL4llagVNLaKuldjwX6ZeDYrcNX574tn1j1ZecofD6GCDWHhH4PrcNUhDQ6XI2lhyWXJQw8_ofsLKd863IbiCM Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: bc7717080c394206a0dede2aaf54b38a Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-MultipleCreateTestJSON-659435131 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc7717080c394206a0dede2aaf54b38a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc7717080c394206a0dede2aaf54b38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc7717080c394206a0dede2aaf54b38a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc7717080c394206a0dede2aaf54b38a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-MultipleCreateTestJSON-659435131 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: bc7717080c394206a0dede2aaf54b38a Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-MultipleCreateTestJSON-659435131 Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-MultipleCreateTestJSON-659435131-project Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5b1847082a384d369c4186f10ac84e2a Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-MultipleCreateTestJSON-659435131-project Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance dfb6d436-7894-4de1-aba7-61fdabf955df could not be found. Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'dfb6d436-7894-4de1-aba7-61fdabf955df'} Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb6d436-7894-4de1-aba7-61fdabf955df could not be found. Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb6d436-7894-4de1-aba7-61fdabf955df could not be found. Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:08.316929 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb6d436-7894-4de1-aba7-61fdabf955df could not be found. Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] Returning 404 to user: Instance dfb6d436-7894-4de1-aba7-61fdabf955df could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83d6c346-2bb8-45c0-b24d-94ef4843777f tempest-MultipleCreateTestJSON-659435131 tempest-MultipleCreateTestJSON-659435131-project] 10.222.0.49 "GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df" status: 404 len: 111 microversion: 2.1 time: 0.197919 Jul 20 04:30:08.322863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1990/3115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/dfb6d436-7894-4de1-aba7-61fdabf955df => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:08.350435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:08.353132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.392621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.399759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.403646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.405821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.593376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:08.607974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89bc5c5e-fbf6-41c4-9499-76e501525d89 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1270 microversion: 2.1 time: 0.270673 Jul 20 04:30:08.613869 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1991/3116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:08 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1270 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:08.685889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bf4f728-d235-4849-8ec0-222d5befb515"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:08.687375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:08.700344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.700974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.704770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:08.705337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:08.973290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:09.211586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52734d78-9192-456a-b40a-e3530e84e596 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "POST /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.529548 Jul 20 04:30:09.218269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1992/3117] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:30:08 2022] POST /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:09.242774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3dc9f6db-eab7-49d7-a106-a119da2113fb req-a8d0eeac-4378-4dcd-9f4c-66ba992c6dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb6d436-7894-4de1-aba7-61fdabf955df", "name": "network-vif-deleted", "tag": "f8532726-b015-47be-895e-ef7a70b8ce24"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:09.267173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3dc9f6db-eab7-49d7-a106-a119da2113fb req-a8d0eeac-4378-4dcd-9f4c-66ba992c6dfb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.267621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3dc9f6db-eab7-49d7-a106-a119da2113fb req-a8d0eeac-4378-4dcd-9f4c-66ba992c6dfb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.296794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3dc9f6db-eab7-49d7-a106-a119da2113fb req-a8d0eeac-4378-4dcd-9f4c-66ba992c6dfb service nova] Creating event network-vif-deleted:f8532726-b015-47be-895e-ef7a70b8ce24 for instance dfb6d436-7894-4de1-aba7-61fdabf955df on n-h2-764486-11 Jul 20 04:30:09.302890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3dc9f6db-eab7-49d7-a106-a119da2113fb req-a8d0eeac-4378-4dcd-9f4c-66ba992c6dfb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082236 Jul 20 04:30:09.303514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1993/3118] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:09.631163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:09.632027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:09.646630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.647526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.658215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:09.658685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:09.832457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:09.845592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7e0d36a-35e1-49d6-b194-12552c1b58a3 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1270 microversion: 2.1 time: 0.213574 Jul 20 04:30:09.846269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1994/3119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:09 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:10.864120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:10.864856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:10.879745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.882010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:10.884543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:10.886593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:11.628595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:11.651803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3492c586-6455-46c5-8edd-7694c3dcf2ad tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.792300 Jul 20 04:30:11.652883 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1995/3120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:10 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:12.478939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:12.479719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:12.492944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:12.523463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.526629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:12.528037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:12.532974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.691572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.716771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.721210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:13.723955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-781da937-c5a6-40d2-97b0-2dc262a17534 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 2952 microversion: 2.32 time: 1.294504 Jul 20 04:30:13.728703 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1996/3121] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:30:12 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 2952 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:13.755902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:13.764797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:13.793044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.793856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:13.794957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:13.795564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.869921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:14.886930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0012058-2585-4bc0-8b87-a46fb47ccf0a tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 1.149109 Jul 20 04:30:14.887658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1997/3122] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:13 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:14.921004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:14.922021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:14.933477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.933942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:14.934733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:14.942344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.225103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:15.842436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00362a9f-e8f9-4afe-8e52-b06f7624d35b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.953593 Jul 20 04:30:15.843031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1998/3123] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:30:14 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812/os-interface => generated 1831 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:30:15.855563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f7d117c8-9055-49ba-bec6-02b78015feb6 req-6cd0b3aa-bc28-4c13-b858-d312b9c2f5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9314efd-9b07-408e-9726-d427a0f152e3", "tag": "6b6a496a-25de-4380-a638-b48ba182e776"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:15.878856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f7d117c8-9055-49ba-bec6-02b78015feb6 req-6cd0b3aa-bc28-4c13-b858-d312b9c2f5a8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.888335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f7d117c8-9055-49ba-bec6-02b78015feb6 req-6cd0b3aa-bc28-4c13-b858-d312b9c2f5a8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.922654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f7d117c8-9055-49ba-bec6-02b78015feb6 req-6cd0b3aa-bc28-4c13-b858-d312b9c2f5a8 service nova] Creating event network-changed:6b6a496a-25de-4380-a638-b48ba182e776 for instance e9314efd-9b07-408e-9726-d427a0f152e3 on n-h2-764486-11 Jul 20 04:30:15.934330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f7d117c8-9055-49ba-bec6-02b78015feb6 req-6cd0b3aa-bc28-4c13-b858-d312b9c2f5a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084379 Jul 20 04:30:15.934977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 1999/3124] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:15.965954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:15.966727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:15.997052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.997501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:15.998507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:15.999126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:16.352941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:16.364025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eef1218d-2609-4ffc-b534-2eb1a54a5f3e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.423966 Jul 20 04:30:16.364726 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2000/3125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:15 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:17.391086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:17.391786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:17.395354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=92 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:17.412838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.423317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:17.424517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:17.425129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:18.010991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:18.025464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf25785b-c051-4935-bdfd-9b5673a018c2 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.638659 Jul 20 04:30:18.026075 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2001/3126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:17 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:19.043321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:19.045070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:19.059765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.060535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.063142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:19.063780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:19.900103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:19.931413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b90eb6b5-1900-49ce-8add-51991da3a5ea tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.892866 Jul 20 04:30:19.948995 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2002/3127] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:19 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:20.967520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:20.968177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:20.981497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.981953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:20.982748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:20.983185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:21.691389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:21.712013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8330e602-480a-45ff-811f-d3ddcb96d20c tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.749110 Jul 20 04:30:21.713767 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2003/3128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:20 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:22.730051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:22.730760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:22.759124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.770100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:22.771409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:22.776935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:23.266132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:23.274365 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28da5daf-409c-4502-babe-8365ecf69289 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.548511 Jul 20 04:30:23.281335 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2004/3129] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:22 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:23.727069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-607985323", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "109649da-9a7a-4452-acba-cc48e048c55a"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:23.879722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] validate_networks() for [('109649da-9a7a-4452-acba-cc48e048c55a', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:26.028598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:26.029876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:26.030515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:26.031288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:26.031892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:26.048948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.050189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.052128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.053394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.112243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:26.121630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for user 4fc1acc695b0455cbe8f6ef66145c8aa and project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:26.161677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:26.163960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:26.295137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd27906a-9dba-4399-862e-c5fd5739cf5b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.723360 Jul 20 04:30:26.295487 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2005/3130] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:30:26.314314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.322769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:26.343835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.344529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.352216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:26.353341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:26.840056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:26.850420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16a33890-4ec7-4c34-85c7-d06592d7e795 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.553783 Jul 20 04:30:26.851067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2006/3131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:26.872514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c1d1332-f171-41cd-ab81-a416cf673f71 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:26.874021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c1d1332-f171-41cd-ab81-a416cf673f71 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.048260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c1d1332-f171-41cd-ab81-a416cf673f71 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:27.069529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c1d1332-f171-41cd-ab81-a416cf673f71 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1207 microversion: 2.1 time: 0.213957 Jul 20 04:30:27.076771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2007/3132] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:26 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1207 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:27.269157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e3c06591-b950-49e7-9378-02be55488f34 req-07d02436-2cdb-4b4b-8cdc-b1eaddfb699f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9314efd-9b07-408e-9726-d427a0f152e3", "name": "network-vif-plugged", "status": "completed", "tag": "6b6a496a-25de-4380-a638-b48ba182e776"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:27.290857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e3c06591-b950-49e7-9378-02be55488f34 req-07d02436-2cdb-4b4b-8cdc-b1eaddfb699f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.291299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e3c06591-b950-49e7-9378-02be55488f34 req-07d02436-2cdb-4b4b-8cdc-b1eaddfb699f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.327662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e3c06591-b950-49e7-9378-02be55488f34 req-07d02436-2cdb-4b4b-8cdc-b1eaddfb699f service nova] Creating event network-vif-plugged:6b6a496a-25de-4380-a638-b48ba182e776 for instance e9314efd-9b07-408e-9726-d427a0f152e3 on n-h2-764486-11 Jul 20 04:30:27.339251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e3c06591-b950-49e7-9378-02be55488f34 req-07d02436-2cdb-4b4b-8cdc-b1eaddfb699f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074645 Jul 20 04:30:27.354792 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2008/3133] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:27.871285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:27.871988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:27.898210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.898665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:27.899452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:27.899884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.610092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:28.619825 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16428005-4019-4dce-9e92-beeb243b7cfe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1312 microversion: 2.1 time: 0.753549 Jul 20 04:30:28.621399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2009/3134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:27 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1312 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:28.635402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:28.636052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:28.653545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.654022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.654819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:28.655262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:28.864143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:28.880573 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a15fb56c-35df-4443-a2a2-7b4dbece2bc0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1265 microversion: 2.1 time: 0.256473 Jul 20 04:30:28.880573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2010/3135] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:28 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:29.642131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:29.644188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:29.656757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.657466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:29.658944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:29.662456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.920218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:30.929233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a97ce36b-6564-4e2b-b146-758ca5c026d7 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1497 microversion: 2.1 time: 1.295182 Jul 20 04:30:30.929937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2011/3136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:29 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1497 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:30.940027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:30.948842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:30.960076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.960966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.962108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:30.962743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:30.995553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:31.185228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:31.204975 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4501c52b-7aac-409b-9b73-3c859341dbbe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1265 microversion: 2.1 time: 0.269328 Jul 20 04:30:31.207912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2012/3137] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:30 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:31.215203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0336eae8-12e8-4802-a71c-2cd599a323f9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:31.231398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0336eae8-12e8-4802-a71c-2cd599a323f9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.235461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0336eae8-12e8-4802-a71c-2cd599a323f9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.294479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0336eae8-12e8-4802-a71c-2cd599a323f9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:30:31.386273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0336eae8-12e8-4802-a71c-2cd599a323f9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action" status: 202 len: 0 microversion: 2.1 time: 0.176287 Jul 20 04:30:31.386915 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2013/3138] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:31 2022] POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:31.402032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92b74ab8-54f2-4bfd-8c00-625834a73960 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:31.423904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_groups [None req-92b74ab8-54f2-4bfd-8c00-625834a73960 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Querying cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) for 1 instances {{(pid=123724) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:30:31.425171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92b74ab8-54f2-4bfd-8c00-625834a73960 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.425814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92b74ab8-54f2-4bfd-8c00-625834a73960 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.487906 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92b74ab8-54f2-4bfd-8c00-625834a73960 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/fa5d1122-ff67-4f99-9999-1c3619e24074" status: 200 len: 222 microversion: 2.1 time: 0.096156 Jul 20 04:30:31.495088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2014/3139] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:30:31 2022] GET /compute/v2.1/os-server-groups/fa5d1122-ff67-4f99-9999-1c3619e24074 => generated 222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:31.502016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:31.502760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:31.515859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.517744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:31.518768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:31.519781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.126025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:32.134750 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13466768-8172-4a6f-b1c8-053fb25ec523 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.638231 Jul 20 04:30:32.148424 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2015/3140] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:31 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:32.161741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:32.162172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:32.173878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.176768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.183604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.184071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.227266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:30:32.338743 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b395c58b-f189-401b-9bf8-e1258462e8cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 204 len: 0 microversion: 2.1 time: 0.186085 Jul 20 04:30:32.339274 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2016/3141] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:32 2022] DELETE /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:32.349091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:32.350136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:32.361082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.361660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:32.362549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:32.363859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.152421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.173096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e198c4f-b6d9-4e9a-9264-b399da0dbff3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.824144 Jul 20 04:30:33.174067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2017/3142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:32 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:33.197461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.199762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:33.210929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.214809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.216679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.219588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.706176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:33.727588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23bc7252-5a93-4826-bbaf-0a1de7950c5e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1503 microversion: 2.1 time: 0.537338 Jul 20 04:30:33.728835 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2018/3143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:33.753995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:33.755786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:33.771220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.774800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:33.799690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:33.802081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.371423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:34.387931 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4d0ee4b-4754-471f-bbc2-56ee0eea95d7 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.643606 Jul 20 04:30:34.388683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2019/3144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:33 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.394360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:34.395064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:34.411604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.412061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.424665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.425131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:34.890349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:34.905128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f09ff180-e474-46af-b6cc-a0cba4f7da81 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.510683 Jul 20 04:30:34.906029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2020/3145] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:34 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:34.921164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cbde6105-18d5-476c-b2f2-2abf5113d802 req-f97da416-124b-4d7a-a30d-4c2641677670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe68d5b7-3c53-4581-be34-866b5c03ab5d", "tag": "6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:34.965284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cbde6105-18d5-476c-b2f2-2abf5113d802 req-f97da416-124b-4d7a-a30d-4c2641677670 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:34.965866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cbde6105-18d5-476c-b2f2-2abf5113d802 req-f97da416-124b-4d7a-a30d-4c2641677670 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.009952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cbde6105-18d5-476c-b2f2-2abf5113d802 req-f97da416-124b-4d7a-a30d-4c2641677670 service nova] Creating event network-changed:6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1 for instance fe68d5b7-3c53-4581-be34-866b5c03ab5d on n-h1-764486-11 Jul 20 04:30:35.021455 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cbde6105-18d5-476c-b2f2-2abf5113d802 req-f97da416-124b-4d7a-a30d-4c2641677670 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109373 Jul 20 04:30:35.026619 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2021/3146] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:35.032262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:35.039308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:35.056021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.057802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.058913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:35.060464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:35.787882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e67348f58081484f9a203c144065d962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1e751676344df9b8ff13cde66ecde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:35.799246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67eff4e9-291c-4868-b019-7f2900d8faff tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 200 len: 1461 microversion: 2.1 time: 0.770408 Jul 20 04:30:35.799246 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2022/3147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:35 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 1461 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:36.092419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:36.232054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3d519d10-6f10-418d-913f-7d62fb965b72"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:36.233883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:36.270893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.273868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.275009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.279246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.558952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] HTTP exception thrown: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Request method failure captured: Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments/7bf4f728-d235-4849-8ec0-222d5befb515 HTTP/1.1 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 74 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14SIzrw72PvDC4MxOG5uC08YvbTT6PRXZUztxojFMVr9xOZS562G5iEv08RUod03eP2ltnb703tum4jEEd-OCIJciRJnCG1JDYA2ptVmgAB_VmrSudmXqXoRX3j2WnNGfvWdlXE3qaMEq7tmXEnZGS0oSLlSdNeXyTFa6vaWWVMi4QM Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 922706e2cacd4168be0d6bd1dabbc87b Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesAdminNegativeTest-545099211 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/922706e2cacd4168be0d6bd1dabbc87b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/922706e2cacd4168be0d6bd1dabbc87b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/922706e2cacd4168be0d6bd1dabbc87b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_922706e2cacd4168be0d6bd1dabbc87b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesAdminNegativeTest-545099211 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 922706e2cacd4168be0d6bd1dabbc87b Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-545099211 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesAdminNegativeTest-545099211-project-admin Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b88eefb77ee94a7eba6ccde9147a73c3 Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesAdminNegativeTest-545099211-project-admin Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: {"volumeAttachment": {"volumeId": "3d519d10-6f10-418d-913f-7d62fb965b72"}} Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '35349313-cc85-4329-90f0-4a66910e3ddc', 'id': '7bf4f728-d235-4849-8ec0-222d5befb515', 'body': {'volumeAttachment': {'volumeId': '3d519d10-6f10-418d-913f-7d62fb965b72'}}} Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. (HTTP 404) (Request-ID: req-91dba247-72c2-4a7b-82f6-e3a18b9bd5d0) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:30:36.607571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Returning 400 to user: Volume 3d519d10-6f10-418d-913f-7d62fb965b72 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:36.613824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e853af7-e129-4141-8560-e5db5325271d tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments/7bf4f728-d235-4849-8ec0-222d5befb515" status: 400 len: 107 microversion: 2.1 time: 0.809140 Jul 20 04:30:36.618044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2023/3148] 10.222.0.49 () {60 vars in 1432 bytes} [Wed Jul 20 04:30:35 2022] PUT /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments/7bf4f728-d235-4849-8ec0-222d5befb515 => generated 107 bytes in 815 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:30:36.620477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:36.620477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:36.642712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.648695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:36.649942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:36.650974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.067077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:37.159813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.172034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9ec1aa3-7f89-4b45-b52a-4def8d8a6dc2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.556367 Jul 20 04:30:37.172984 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2024/3149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:36 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:37.181144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.182313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.203363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.204129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.205154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.205996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.570777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:37.599689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e1169103-7d20-4f3e-acb6-4de0cc485699 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.424012 Jul 20 04:30:37.601596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2025/3150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:37 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:37.620059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-729e7962-991f-45ce-84f1-83d32dbd3246 req-72a806a7-593c-4a37-a008-0ea187cc92d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9314efd-9b07-408e-9726-d427a0f152e3", "name": "network-vif-deleted", "tag": "6b6a496a-25de-4380-a638-b48ba182e776"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:37.643783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-729e7962-991f-45ce-84f1-83d32dbd3246 req-72a806a7-593c-4a37-a008-0ea187cc92d5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.645086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-729e7962-991f-45ce-84f1-83d32dbd3246 req-72a806a7-593c-4a37-a008-0ea187cc92d5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.665480 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-729e7962-991f-45ce-84f1-83d32dbd3246 req-72a806a7-593c-4a37-a008-0ea187cc92d5 service nova] Creating event network-vif-deleted:6b6a496a-25de-4380-a638-b48ba182e776 for instance e9314efd-9b07-408e-9726-d427a0f152e3 on n-h2-764486-11 Jul 20 04:30:37.691833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-729e7962-991f-45ce-84f1-83d32dbd3246 req-72a806a7-593c-4a37-a008-0ea187cc92d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083275 Jul 20 04:30:37.696344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2026/3151] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:37.717842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:37.719596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:37.754608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.755394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:37.757874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:37.765431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.018087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lazy-loading 'services' on Instance uuid 35349313-cc85-4329-90f0-4a66910e3ddc {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:30:38.167387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:38.208911 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33792c9d-5dad-4eb0-9bd0-e05518838639 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "DELETE /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments/7bf4f728-d235-4849-8ec0-222d5befb515" status: 202 len: 0 microversion: 2.1 time: 0.496831 Jul 20 04:30:38.218091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2027/3152] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:30:37 2022] DELETE /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments/7bf4f728-d235-4849-8ec0-222d5befb515 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:38.242042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.245231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:38.267602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.270515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.279356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.280093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.360290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 HTTP/1.1 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e9314efd-9b07-408e-9726-d427a0f152e3'} Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:38.362530 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:38.367341 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:38.369521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:38.375693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21bc70ee-ac8f-4d47-9cb6-896bc528c90e tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 404 len: 111 microversion: 2.1 time: 0.149643 Jul 20 04:30:38.377001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2028/3153] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:38.404006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.408721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:38.439886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.441655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.442442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:38.450874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:38.944285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:38.964142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c167f937-de1d-46bd-a30f-c6136dbe22d5 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.585591 Jul 20 04:30:38.965113 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2029/3154] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:38.973465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:38.982445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:39.003029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.003638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.004922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.009544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.085579 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56ada984-a5cf-4e16-9f1d-ea45f39dcc12 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118854 Jul 20 04:30:39.086863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2030/3155] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:38 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:39.094524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d928368b-fad3-406b-ad77-822a57c303a8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:39.134377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_groups [None req-d928368b-fad3-406b-ad77-822a57c303a8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Querying cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) for 1 instances {{(pid=123724) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:30:39.135226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d928368b-fad3-406b-ad77-822a57c303a8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.135679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d928368b-fad3-406b-ad77-822a57c303a8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.177298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d928368b-fad3-406b-ad77-822a57c303a8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.087662 Jul 20 04:30:39.188839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2031/3156] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:30:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:39.195273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:39.196221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:39.203576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.204423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.205558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.206333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.815355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:39.825293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f488f5ab-db95-4672-ba75-c520ba0168ff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.634412 Jul 20 04:30:39.828748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2032/3157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:39 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:39.838676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58917982-9cbb-4430-930b-2628a44b0a68 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:39.857213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:39.885848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_groups [None req-58917982-9cbb-4430-930b-2628a44b0a68 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Querying cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) for 1 instances {{(pid=123724) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 04:30:39.886673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58917982-9cbb-4430-930b-2628a44b0a68 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.887284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58917982-9cbb-4430-930b-2628a44b0a68 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.909510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58917982-9cbb-4430-930b-2628a44b0a68 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/fa5d1122-ff67-4f99-9999-1c3619e24074" status: 200 len: 184 microversion: 2.1 time: 0.079242 Jul 20 04:30:39.913538 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2033/3158] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:30:39 2022] GET /compute/v2.1/os-server-groups/fa5d1122-ff67-4f99-9999-1c3619e24074 => generated 184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:39.926772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:39.927139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:39.945506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.945950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:39.946741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:39.947184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.004084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 HTTP/1.1 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e9314efd-9b07-408e-9726-d427a0f152e3'} Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:40.005975 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:40.010642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0b7b072-6437-4d70-aba6-d09e95e7c8a5 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 404 len: 111 microversion: 2.1 time: 0.086146 Jul 20 04:30:40.013046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2034/3159] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:30:39 2022] DELETE /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:40.018511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.021891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.035261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.035736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.038497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.038969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.497453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:40.507862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f982b9a2-7e76-4416-8929-85762a1927ac tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.493654 Jul 20 04:30:40.512457 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2035/3160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:40.523205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.525741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] [instance: e9314efd-9b07-408e-9726-d427a0f152e3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.547821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.548399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.552754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.553214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.580042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 HTTP/1.1 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e9314efd-9b07-408e-9726-d427a0f152e3'} Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.581708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance e9314efd-9b07-408e-9726-d427a0f152e3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0d2a4e7-4523-4771-9434-afe2652b7efe tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3" status: 404 len: 111 microversion: 2.1 time: 0.069453 Jul 20 04:30:40.586910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2036/3161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/e9314efd-9b07-408e-9726-d427a0f152e3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:40.593766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.595023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.603744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.604196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.607533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.608049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.697550 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed8ce1a4-0cb1-4840-8b2e-61b4f51b2d08 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107274 Jul 20 04:30:40.702276 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2037/3162] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:40.708300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc3eb9d6-ec21-4d4c-b554-969aca43b8d8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.719042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-fc3eb9d6-ec21-4d4c-b554-969aca43b8d8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance group 8e8d38fa-e638-45f3-8622-52c3a498591c could not be found. Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc3eb9d6-ec21-4d4c-b554-969aca43b8d8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-server-groups/8e8d38fa-e638-45f3-8622-52c3a498591c HTTP/1.1 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance group 8e8d38fa-e638-45f3-8622-52c3a498591c could not be found. Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8e8d38fa-e638-45f3-8622-52c3a498591c'} Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8e8d38fa-e638-45f3-8622-52c3a498591c could not be found. Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8e8d38fa-e638-45f3-8622-52c3a498591c could not be found. Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.738611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8e8d38fa-e638-45f3-8622-52c3a498591c could not be found. Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc3eb9d6-ec21-4d4c-b554-969aca43b8d8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance group 8e8d38fa-e638-45f3-8622-52c3a498591c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc3eb9d6-ec21-4d4c-b554-969aca43b8d8 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/8e8d38fa-e638-45f3-8622-52c3a498591c" status: 404 len: 117 microversion: 2.1 time: 0.037410 Jul 20 04:30:40.743707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2038/3163] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:40 2022] DELETE /compute/v2.1/os-server-groups/8e8d38fa-e638-45f3-8622-52c3a498591c => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:40.759075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b7beca1-1a12-43f2-aaee-a348ac8a00cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.777274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6b7beca1-1a12-43f2-aaee-a348ac8a00cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance group d359f3e7-75c9-4e1d-b803-dafbe0379a1f could not be found. Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b7beca1-1a12-43f2-aaee-a348ac8a00cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-server-groups/d359f3e7-75c9-4e1d-b803-dafbe0379a1f HTTP/1.1 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance group d359f3e7-75c9-4e1d-b803-dafbe0379a1f could not be found. Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd359f3e7-75c9-4e1d-b803-dafbe0379a1f'} Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d359f3e7-75c9-4e1d-b803-dafbe0379a1f could not be found. Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d359f3e7-75c9-4e1d-b803-dafbe0379a1f could not be found. Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.781862 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d359f3e7-75c9-4e1d-b803-dafbe0379a1f could not be found. Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b7beca1-1a12-43f2-aaee-a348ac8a00cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance group d359f3e7-75c9-4e1d-b803-dafbe0379a1f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b7beca1-1a12-43f2-aaee-a348ac8a00cd tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/d359f3e7-75c9-4e1d-b803-dafbe0379a1f" status: 404 len: 117 microversion: 2.1 time: 0.038407 Jul 20 04:30:40.786563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2039/3164] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:40 2022] DELETE /compute/v2.1/os-server-groups/d359f3e7-75c9-4e1d-b803-dafbe0379a1f => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:40.800958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4272052e-a2a3-4363-a103-2cc62e0a8904 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.815719 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4272052e-a2a3-4363-a103-2cc62e0a8904 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance group f38856ab-e6cc-48ec-8122-553e3c2b07a9 could not be found. Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4272052e-a2a3-4363-a103-2cc62e0a8904 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-server-groups/f38856ab-e6cc-48ec-8122-553e3c2b07a9 HTTP/1.1 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance group f38856ab-e6cc-48ec-8122-553e3c2b07a9 could not be found. Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f38856ab-e6cc-48ec-8122-553e3c2b07a9'} Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f38856ab-e6cc-48ec-8122-553e3c2b07a9 could not be found. Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f38856ab-e6cc-48ec-8122-553e3c2b07a9 could not be found. Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.818128 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.822786 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.822786 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.822786 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:40.822786 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:40.822786 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f38856ab-e6cc-48ec-8122-553e3c2b07a9 could not be found. Jul 20 04:30:40.822786 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.827476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4272052e-a2a3-4363-a103-2cc62e0a8904 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance group f38856ab-e6cc-48ec-8122-553e3c2b07a9 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:40.830752 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4272052e-a2a3-4363-a103-2cc62e0a8904 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/f38856ab-e6cc-48ec-8122-553e3c2b07a9" status: 404 len: 117 microversion: 2.1 time: 0.039489 Jul 20 04:30:40.832071 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2040/3165] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:40 2022] DELETE /compute/v2.1/os-server-groups/f38856ab-e6cc-48ec-8122-553e3c2b07a9 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:40.845939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a37307d5-0b5a-419e-af34-5798fce12e75 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.863226 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a37307d5-0b5a-419e-af34-5798fce12e75 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] HTTP exception thrown: Instance group ac37c2c9-1dc6-41fd-998a-3c7270e852fc could not be found. Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a37307d5-0b5a-419e-af34-5798fce12e75 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Request method failure captured: Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-server-groups/ac37c2c9-1dc6-41fd-998a-3c7270e852fc HTTP/1.1 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TFa89w8avo4BpQ0fvl4_qZUhsZODAgDhYuEWUgJrEhDOa0HR3Kch_wMzCMdMDsvbJ3x6ezoAeFmGEHVdkcWFQVZx_OuCyDueMFLKZ_4tD3A87FZ7MfJWNM4Z-xZALQmX_21z2Orc7BPrp3xkd7d9EYQashwqnBthAytHpt3XYGtsw Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c1e751676344df9b8ff13cde66ecde4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c1e751676344df9b8ff13cde66ecde4", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 4c1e751676344df9b8ff13cde66ecde4 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroupTestJSON-1186361278 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e67348f58081484f9a203c144065d962 Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroupTestJSON-1186361278-project Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance group ac37c2c9-1dc6-41fd-998a-3c7270e852fc could not be found. Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ac37c2c9-1dc6-41fd-998a-3c7270e852fc'} Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ac37c2c9-1dc6-41fd-998a-3c7270e852fc could not be found. Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ac37c2c9-1dc6-41fd-998a-3c7270e852fc could not be found. Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.865404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ac37c2c9-1dc6-41fd-998a-3c7270e852fc could not be found. Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a37307d5-0b5a-419e-af34-5798fce12e75 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Returning 404 to user: Instance group ac37c2c9-1dc6-41fd-998a-3c7270e852fc could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:30:40.870070 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a37307d5-0b5a-419e-af34-5798fce12e75 tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/ac37c2c9-1dc6-41fd-998a-3c7270e852fc" status: 404 len: 117 microversion: 2.1 time: 0.033380 Jul 20 04:30:40.872988 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2041/3166] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:40 2022] DELETE /compute/v2.1/os-server-groups/ac37c2c9-1dc6-41fd-998a-3c7270e852fc => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:30:40.886185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:40.889712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:40.906641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.907743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:40.909915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:40.910850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.523378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:41.543119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abb25e6f-f181-4237-8db1-ec4a9a665823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.668883 Jul 20 04:30:41.553368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2042/3167] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:40 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:41.569695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe1945d9-38c6-40e8-ba35-6389e65de3ab tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.652059 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe1945d9-38c6-40e8-ba35-6389e65de3ab tempest-ServerGroupTestJSON-1186361278 tempest-ServerGroupTestJSON-1186361278-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/fa5d1122-ff67-4f99-9999-1c3619e24074" status: 204 len: 0 microversion: 2.1 time: 0.106767 Jul 20 04:30:41.653018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2043/3168] 10.222.0.49 () {58 vars in 1265 bytes} [Wed Jul 20 04:30:41 2022] DELETE /compute/v2.1/os-server-groups/fa5d1122-ff67-4f99-9999-1c3619e24074 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:30:41.659635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:41.663530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:41.687029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.687757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:41.688798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:41.689426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.198460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:42.212922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-684d9c58-40f4-4fd1-a15c-faf8b4591a15 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.558542 Jul 20 04:30:42.229314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2044/3169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:41 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:42.234841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.248094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.270928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.271800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.273281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.277047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.350943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2fe9d8a-3f44-4a6d-a159-2d7e3c451119 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119939 Jul 20 04:30:42.351959 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2045/3170] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:42.560296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:42.560957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:42.567435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.567891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:42.568717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:42.569223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.246691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:43.261942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a774dbb-29df-413e-977a-7530a407b195 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.704947 Jul 20 04:30:43.262058 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2046/3171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:42 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:43.267331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.268058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.285817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.286276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.287071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.287511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.641502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:43.652841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61bf69bb-4345-4f45-a9a2-c9a8e92f4c8e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.389681 Jul 20 04:30:43.666199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2047/3172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:43.671904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:43.674608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:43.691742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.692503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.693644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:43.697181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:43.785084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d4f306e-846f-4aef-925e-71e3ef166ff5 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117109 Jul 20 04:30:43.785959 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2048/3173] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:43 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:44.278927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:44.279539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:44.302876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.303515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.304502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.305101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.805491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:44.821727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7932f489-8990-4b71-936d-492b444d5ad1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.542114 Jul 20 04:30:44.823044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2049/3174] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:44 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:44.835754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:44.844515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:44.859474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.862643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:44.864112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:44.868667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.329071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:45.371100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9212c477-7b06-43c4-94f7-4a37c563d6b9 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.537191 Jul 20 04:30:45.372073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2050/3175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:44 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:45.387282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.388238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:45.403708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.413928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.415216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.415826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.514731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a6f4839-c42a-4f7a-b313-50a891e709f4 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141053 Jul 20 04:30:45.517365 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2051/3176] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:45.844107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:45.845515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:45.860938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.864497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:45.865468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:45.866088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.124727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.135851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:46.140585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fbd480c2-c56d-40a4-b1df-62917f0b01b2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.304554 Jul 20 04:30:46.148321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2052/3177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:45 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:46.374210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3d0f2cc7-9bee-4dac-8405-5a57c2863d0f req-3d1509d1-c743-4371-82f3-4fe4d8e67476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe68d5b7-3c53-4581-be34-866b5c03ab5d", "name": "network-vif-plugged", "status": "completed", "tag": "6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:46.390071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d0f2cc7-9bee-4dac-8405-5a57c2863d0f req-3d1509d1-c743-4371-82f3-4fe4d8e67476 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.393991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d0f2cc7-9bee-4dac-8405-5a57c2863d0f req-3d1509d1-c743-4371-82f3-4fe4d8e67476 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.415371 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3d0f2cc7-9bee-4dac-8405-5a57c2863d0f req-3d1509d1-c743-4371-82f3-4fe4d8e67476 service nova] Creating event network-vif-plugged:6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1 for instance fe68d5b7-3c53-4581-be34-866b5c03ab5d on n-h1-764486-11 Jul 20 04:30:46.421761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3d0f2cc7-9bee-4dac-8405-5a57c2863d0f req-3d1509d1-c743-4371-82f3-4fe4d8e67476 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154917 Jul 20 04:30:46.423104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2053/3178] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:46.450194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.451462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.464298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.465170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.466199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.466958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.779043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:46.792659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7628a9d9-c2ba-490c-acb9-65c2630e6570 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1722 microversion: 2.1 time: 0.367953 Jul 20 04:30:46.797080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2054/3179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:46.806686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:46.813164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:46.833931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.838581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:46.840610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:46.844943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.002687 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be1de68d-925e-4994-8aa3-54a51738f3cc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199032 Jul 20 04:30:47.008803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2055/3180] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:46 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:47.249547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13e5ad79-6285-4b16-93aa-c04ab43ae2a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'create', calling method: .version_select at 0x7f838b2315e0>, body: {"keypair": {"name": "tempest-keypair-1451666475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExhvNVo5lzKI3BdSfDPnaN77QtOnKAvlr4po0Z62LySr5WCriddC9JACCw5le2RTYDgTlT9/f/BDGXwEfE3I1MNvk5Or5/gl0c8bvUOE55aXbuXhY15zDGVUrZ+QVUWFw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:47.281407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-13e5ad79-6285-4b16-93aa-c04ab43ae2a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for project 9ee53c54f478471c951962c22855b465. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:47.298289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-13e5ad79-6285-4b16-93aa-c04ab43ae2a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for user 4d4ae756d3714b598164985ed7d7876c and project 9ee53c54f478471c951962c22855b465. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:47.349919 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13e5ad79-6285-4b16-93aa-c04ab43ae2a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226858 Jul 20 04:30:47.351325 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2056/3181] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:30:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:30:47.361863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.363291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:47.383916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.385565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.386650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.389578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.694458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:47.707603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-441cf0bd-73b5-47bf-bfc7-c7570c5bd07f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1307 microversion: 2.1 time: 0.350451 Jul 20 04:30:47.708654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2057/3182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:47.815017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:47.816091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:47.826686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.829899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:47.834803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:47.835499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.071574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.081519 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6fe3522-8c55-4b21-a106-0ccb499399b1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1699 microversion: 2.1 time: 0.271923 Jul 20 04:30:48.093898 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2058/3183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:47 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1699 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:48.100494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:48.101842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:48.109186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.109858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.110837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.111457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.167434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f49755d-c687-4a01-a1d9-22b9103fe51b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070903 Jul 20 04:30:48.168486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2059/3184] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:30:48 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:30:48.175118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f89df94-f678-42a5-ae4e-357039132b62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:48.182675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f89df94-f678-42a5-ae4e-357039132b62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.183448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f89df94-f678-42a5-ae4e-357039132b62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.226534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f89df94-f678-42a5-ae4e-357039132b62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:30:48.353376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f89df94-f678-42a5-ae4e-357039132b62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action" status: 202 len: 0 microversion: 2.1 time: 0.181808 Jul 20 04:30:48.360162 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2060/3185] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:48 2022] POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:48.370012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:48.378508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:48.413917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.416205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.419569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:48.421888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:48.659796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:48.668365 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9b51024-0aad-4146-9854-7caef3c16cd0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1708 microversion: 2.1 time: 0.305212 Jul 20 04:30:48.680434 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2061/3186] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:48 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1708 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:48.680434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1420533591", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "6aaf3845-c506-48f1-ad9e-18c700075575"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:48.766917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] validate_networks() for [('6aaf3845-c506-48f1-ad9e-18c700075575', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:49.289576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:49.290279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:49.290623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:49.291100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:49.291581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:49.304900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.305419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.306298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.306753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.332859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Getting quotas for project 5d7695d44e6643a99987228be8b509e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:49.339579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Getting quotas for user 0f3881c5b1d04353801b73c6ba3d181e and project 5d7695d44e6643a99987228be8b509e8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:49.357878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:49.386131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:49.455241 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fba0c88c-0f61-453d-8afa-ed1f7cfb4c98 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782078 Jul 20 04:30:49.456010 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2062/3187] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:49.461091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.461718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.469816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.470188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.471024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.471395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.739649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:49.755838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e370ef9-2c3f-487e-82e2-1584e0da9cee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1488 microversion: 2.1 time: 0.298476 Jul 20 04:30:49.756444 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2063/3188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1488 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:49.773632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-791000bf-d9c4-4358-9269-a6a4aa87709f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.774558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-791000bf-d9c4-4358-9269-a6a4aa87709f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.867852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-791000bf-d9c4-4358-9269-a6a4aa87709f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:49.888594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-791000bf-d9c4-4358-9269-a6a4aa87709f tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1218 microversion: 2.1 time: 0.125656 Jul 20 04:30:49.889796 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2064/3189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:49.895483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:49.896474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:49.921480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.923046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:49.924277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:49.925099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.417094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:50.427978 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bab85afb-4eda-45cd-a6be-dc18f3116b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1708 microversion: 2.1 time: 0.536237 Jul 20 04:30:50.441057 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2065/3190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:49 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1708 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:50.451311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:50.452062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:50.465700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:50.470012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.471397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.473206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.473957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.593110 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19c067cd-216c-40e7-9c88-8e1ff93aec8d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d/action" status: 202 len: 0 microversion: 2.1 time: 0.149538 Jul 20 04:30:50.595206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2066/3191] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:50 2022] POST /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:30:50.625907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:50.627262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:50.639387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.642200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:50.644717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:50.647647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.458922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:51.469050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f85703b-c0fa-43d9-b038-8e63abe2e949 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1493 microversion: 2.1 time: 0.858608 Jul 20 04:30:51.470345 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2067/3192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:50 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1493 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:51.475545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:51.476969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:51.484264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.485308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.486384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.487245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.596671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:51.607364 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a26c39f-ca4a-4d14-99a7-eabd4dfd81da tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1276 microversion: 2.1 time: 0.134167 Jul 20 04:30:51.609337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2068/3193] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:51 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:51.616702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:51.616702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:51.636021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.636975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:51.639474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:51.641131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.084832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:52.093890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e991a961-9f9e-44d4-be55-77a0c543c08a tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1712 microversion: 2.1 time: 0.483343 Jul 20 04:30:52.094480 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2069/3194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:51 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1712 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:52.488195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:52.488953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:52.501288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:52.501745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.502546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:52.502984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:52.950105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:52.955368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:30:52.990333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed7eb216-e5c9-4c13-815a-2a659650ab65 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 200 len: 1473 microversion: 2.1 time: 0.505194 Jul 20 04:30:52.997407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2070/3195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:52 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 1473 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:53.011439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:53.013245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:53.023900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.024505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.025453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.026301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.381255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:53.390754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01f5e9d2-6421-460d-b2e4-029246914d76 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.389374 Jul 20 04:30:53.391809 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2071/3196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:52 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:53.396775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-971672499"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:53.398284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:53.405158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.405658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.406444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:53.407058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:53.816028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cdd9285-79be-4fc8-9263-7fc3cea0c56d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d/action" status: 202 len: 0 microversion: 2.1 time: 0.422672 Jul 20 04:30:53.817242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2072/3197] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:30:53.828892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-173228274", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99a89468-e93b-45f5-b6e7-131721ce1601"}], "security_groups": [{"name": "tempest-securitygroup--1616625600"}], "key_name": "tempest-keypair-1451666475", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:54.093280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] validate_networks() for [('99a89468-e93b-45f5-b6e7-131721ce1601', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:30:55.077936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:30:55.078981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:30:55.079465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:30:55.080076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:30:55.080513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:30:55.091074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.091816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.093123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.093725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.125606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:30:55.132816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for user 4d4ae756d3714b598164985ed7d7876c and project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:30:55.149693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:30:55.158571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:30:55.213740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8eb6f63-795d-4f44-9421-cfe12a355171 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.389787 Jul 20 04:30:55.214760 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2073/3198] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:30:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:30:55.219984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71b2d5cc-8b23-4d6c-a579-2b49968522b3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b0f4310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:55.276979 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71b2d5cc-8b23-4d6c-a579-2b49968522b3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.061065 Jul 20 04:30:55.277910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2074/3199] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:55 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:55.283279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:55.283893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:55.291410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.291888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.292899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.293334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.497183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:55.506574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35a507e1-c604-4839-8c4e-2add8d7c3284 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.227459 Jul 20 04:30:55.516738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2075/3200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:55 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:55.524749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9cc6a5c-5720-4f9a-96e0-79e9cf752eaa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:55.525373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9cc6a5c-5720-4f9a-96e0-79e9cf752eaa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:55.779965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9cc6a5c-5720-4f9a-96e0-79e9cf752eaa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:55.789131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9cc6a5c-5720-4f9a-96e0-79e9cf752eaa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1238 microversion: 2.1 time: 0.268552 Jul 20 04:30:55.791782 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2076/3201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:55 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1238 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:55.809009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a363db42-6852-40f8-9cfb-d4ad88344948 req-18ed5bd1-3d68-472e-b2bd-d8e2b386d0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8afcee-7f43-4305-909c-ded31656dee1", "tag": "27f8cb2f-603c-4eb9-bb1b-3fea8fa59a1a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:30:55.832261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a363db42-6852-40f8-9cfb-d4ad88344948 req-18ed5bd1-3d68-472e-b2bd-d8e2b386d0b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:55.832735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a363db42-6852-40f8-9cfb-d4ad88344948 req-18ed5bd1-3d68-472e-b2bd-d8e2b386d0b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:55.855670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a363db42-6852-40f8-9cfb-d4ad88344948 req-18ed5bd1-3d68-472e-b2bd-d8e2b386d0b4 service nova] Creating event network-changed:27f8cb2f-603c-4eb9-bb1b-3fea8fa59a1a for instance 9a8afcee-7f43-4305-909c-ded31656dee1 on n-h2-764486-11 Jul 20 04:30:55.868397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a363db42-6852-40f8-9cfb-d4ad88344948 req-18ed5bd1-3d68-472e-b2bd-d8e2b386d0b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074905 Jul 20 04:30:55.869615 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2077/3202] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:30:56.291843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6eac7c7-307b-4bed-8618-5aff6f8835d7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b111940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:56.363572 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6eac7c7-307b-4bed-8618-5aff6f8835d7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.076685 Jul 20 04:30:56.369832 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2078/3203] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:56 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:56.527338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:56.528319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:56.543104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:56.544246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:56.546126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:56.547917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:56.959283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:56.991542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13b2d501-c53c-4c93-a185-9b0f6dddf271 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.471265 Jul 20 04:30:57.010875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2079/3204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:56 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:57.010875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.010875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:57.021474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.022175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.023280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:57.023949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:57.198274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:57.207488 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ebe86c7-0966-4995-ab64-8e493d7227b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1290 microversion: 2.1 time: 0.204218 Jul 20 04:30:57.211820 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2080/3205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1290 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:57.391884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d639ca6-61ea-4458-8f36-4b1d8c32b6e6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b044af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:57.505872 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d639ca6-61ea-4458-8f36-4b1d8c32b6e6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.132338 Jul 20 04:30:57.509230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2081/3206] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:57 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:58.021623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.022669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:58.033525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.035506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.036652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.037378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.339582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:58.350839 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a284ca5-1cca-4b7e-8a16-7df7a93c05ad tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.334262 Jul 20 04:30:58.354041 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2082/3207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:30:58.382186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.383749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:58.417616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.418366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.427278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:58.428576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:58.570563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:58.585762 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c91dae0d-cec5-4476-bca3-3c80adea95d6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1296 microversion: 2.1 time: 0.226534 Jul 20 04:30:58.597269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2083/3208] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1296 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:58.609913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdc43b2a-b330-4cf3-b553-938c71015f1a tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aede040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:58.685788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdc43b2a-b330-4cf3-b553-938c71015f1a tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.087183 Jul 20 04:30:58.687773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2084/3209] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:30:58 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:59.372802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:59.374186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:59.389323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.390580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.391522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.399108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.779440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:30:59.790707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bfa6d061-8b91-4e4a-bec4-e2faa7346ae8 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.422961 Jul 20 04:30:59.793699 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2085/3210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:59 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:30:59.817820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:30:59.819714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:30:59.842510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.848083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:30:59.849639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:30:59.851653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.070139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.090640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8927735-ce30-440c-8346-cbe3862a197f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1296 microversion: 2.1 time: 1.294142 Jul 20 04:31:01.094957 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2086/3211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:30:59 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1296 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:01.113624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-650b7344-ec3e-4760-b010-5dbb906385fd tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f8398263a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:01.218312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-650b7344-ec3e-4760-b010-5dbb906385fd tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.120400 Jul 20 04:31:01.219219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2087/3212] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:01 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:01.231091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:01.232082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:01.240603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.241370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.243541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:01.244153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:01.557740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:01.567114 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f64c250b-79bc-4922-b383-ee359dead779 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.345335 Jul 20 04:31:01.569088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2088/3213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:01 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:02.111517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:02.114026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:02.128509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.132004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.133901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.134515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.617489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:02.636608 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5ee5609-8c16-43df-a1be-567f912c9cf9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.529314 Jul 20 04:31:02.645195 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2089/3214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:02 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:02.660804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3c7c342-5ffb-4b20-8106-f5eab3990363 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838bcc0d30>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:02.752401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3c7c342-5ffb-4b20-8106-f5eab3990363 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.104511 Jul 20 04:31:02.753762 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2090/3215] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:02 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:02.768706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:02.777436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:02.795320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.796927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:02.797947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:02.800102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.118615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:03.155088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-894285b4-f12d-42e6-bb9c-216ab5aa9f52 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.391637 Jul 20 04:31:03.165338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2091/3216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:02 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:03.531582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-af809713-39fe-44ba-ba5f-d98e99ec6e2e req-c4aa724f-6f1b-4e0c-9398-886731e103a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe68d5b7-3c53-4581-be34-866b5c03ab5d", "name": "network-vif-plugged", "status": "completed", "tag": "6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:03.542031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-af809713-39fe-44ba-ba5f-d98e99ec6e2e req-c4aa724f-6f1b-4e0c-9398-886731e103a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.542474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-af809713-39fe-44ba-ba5f-d98e99ec6e2e req-c4aa724f-6f1b-4e0c-9398-886731e103a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.606861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-af809713-39fe-44ba-ba5f-d98e99ec6e2e req-c4aa724f-6f1b-4e0c-9398-886731e103a0 service nova] Creating event network-vif-plugged:6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1 for instance fe68d5b7-3c53-4581-be34-866b5c03ab5d on n-h1-764486-11 Jul 20 04:31:03.641002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-af809713-39fe-44ba-ba5f-d98e99ec6e2e req-c4aa724f-6f1b-4e0c-9398-886731e103a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108931 Jul 20 04:31:03.643100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2092/3217] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:03.662718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:03.663429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:03.690169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.699454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:03.704725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:03.706337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.594724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:04.604138 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23c41f87-fc19-47d3-a6b5-ce4431bbbe89 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.945822 Jul 20 04:31:04.610061 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2093/3218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:03 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:04.629851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd354751-40a5-46b8-8710-89db838f0808 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b111e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:04.752029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd354751-40a5-46b8-8710-89db838f0808 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.140321 Jul 20 04:31:04.759571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2094/3219] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:04 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:04.777758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:04.781518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:04.823200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.826857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:04.830545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:04.833770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.113459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:05.666171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:05.677221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b442f17-7f6e-42b8-9090-9d5c8c819080 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.916068 Jul 20 04:31:05.677826 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2095/3220] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:04 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:05.695962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-efe98a82-7083-47ec-aed5-3f66e5a3e138 req-6aa98b20-395c-4da6-a9c3-20e0405c302c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:05.740942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-efe98a82-7083-47ec-aed5-3f66e5a3e138 req-6aa98b20-395c-4da6-a9c3-20e0405c302c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.741581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-efe98a82-7083-47ec-aed5-3f66e5a3e138 req-6aa98b20-395c-4da6-a9c3-20e0405c302c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.768488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:05.770477 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-efe98a82-7083-47ec-aed5-3f66e5a3e138 req-6aa98b20-395c-4da6-a9c3-20e0405c302c service nova] Creating event network-changed:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:31:05.789166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=20 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:05.797050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-efe98a82-7083-47ec-aed5-3f66e5a3e138 req-6aa98b20-395c-4da6-a9c3-20e0405c302c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110353 Jul 20 04:31:05.798336 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2096/3221] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:05.810488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:05.815683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:05.834077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.834903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:05.836101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:05.837226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.274508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:06.294831 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f41fe821-fc83-4b9a-9f76-7a60730532a3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.486104 Jul 20 04:31:06.307163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2097/3222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:05 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:06.324036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f395aca7-c449-4a0d-9956-37009a917251 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838af19ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:06.401733 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f395aca7-c449-4a0d-9956-37009a917251 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.087769 Jul 20 04:31:06.410656 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2098/3223] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:06 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:06.416052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-348ac4d3-25f1-471f-b20a-9878d1d9be23 req-25bc24ba-de2f-4ac8-9fee-7d5b74563529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8afcee-7f43-4305-909c-ded31656dee1", "name": "network-vif-plugged", "status": "completed", "tag": "27f8cb2f-603c-4eb9-bb1b-3fea8fa59a1a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:06.432292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-348ac4d3-25f1-471f-b20a-9878d1d9be23 req-25bc24ba-de2f-4ac8-9fee-7d5b74563529 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.432806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-348ac4d3-25f1-471f-b20a-9878d1d9be23 req-25bc24ba-de2f-4ac8-9fee-7d5b74563529 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.446725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-348ac4d3-25f1-471f-b20a-9878d1d9be23 req-25bc24ba-de2f-4ac8-9fee-7d5b74563529 service nova] Creating event network-vif-plugged:27f8cb2f-603c-4eb9-bb1b-3fea8fa59a1a for instance 9a8afcee-7f43-4305-909c-ded31656dee1 on n-h2-764486-11 Jul 20 04:31:06.452100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-348ac4d3-25f1-471f-b20a-9878d1d9be23 req-25bc24ba-de2f-4ac8-9fee-7d5b74563529 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039673 Jul 20 04:31:06.453127 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2099/3224] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:06.700700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:06.701411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:06.725540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.726426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:06.728392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:06.734609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.227863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:07.253138 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4848b049-581b-48f8-be78-588a15811dd2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.558335 Jul 20 04:31:07.255357 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2100/3225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:06 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:07.314543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:07.315804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:07.341175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.342262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.344140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:07.344714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:07.818164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:07.833786 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b823763b-d518-4809-9454-f59eb4324008 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.522427 Jul 20 04:31:07.835825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2101/3226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:07 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:07.846279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-352d198e-acfc-41b6-a16a-ff17e55eecc8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f83985ce670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:07.920281 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-352d198e-acfc-41b6-a16a-ff17e55eecc8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.080713 Jul 20 04:31:07.929742 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2102/3227] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:07 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:08.271556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:08.272177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:08.281881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.285949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:08.286955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:08.288791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:09.062373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:09.079543 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-789ddb25-2932-4d5c-8db6-29fa50d5f1c6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1318 microversion: 2.1 time: 0.809895 Jul 20 04:31:09.092284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2103/3228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:08 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:09.103360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:09.115268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:09.124082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:09.125137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:09.127337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:09.128526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.175684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.193809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55aa3a0a-1feb-48bd-83a6-e06e42a6d880 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 1.099324 Jul 20 04:31:10.207979 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2104/3229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:09 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.224548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7037dbe7-5d5e-4fa9-bb24-018b5234f63c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b001430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.306323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7037dbe7-5d5e-4fa9-bb24-018b5234f63c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.095767 Jul 20 04:31:10.307123 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2105/3230] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:10.312291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:10.323608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:10.343403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.344388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.345364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:10.345993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:10.830504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:10.844941 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1da1c8fa-224b-417c-813e-dae637d6e4a2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1507 microversion: 2.1 time: 0.536476 Jul 20 04:31:10.854074 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2106/3231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:10 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:11.211680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:11.212322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:11.222545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.230944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.231874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:11.232426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:11.683351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:11.713397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6b98276-2b5f-46e8-a788-4daaeb1edefa tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.489295 Jul 20 04:31:11.716392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2107/3232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:11 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:11.770960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7966e57d-161b-4060-9dd4-95d149e6ee1f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b0f4940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:11.909934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7966e57d-161b-4060-9dd4-95d149e6ee1f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.184248 Jul 20 04:31:11.911163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2108/3233] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:11 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:12.750882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:12.752395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:12.773930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.782610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:12.785058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:12.789753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:13.505795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:13.535131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88342157-1e04-46f4-a4ab-42cd89aaf6bc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.796148 Jul 20 04:31:13.536152 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2109/3234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:12 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:13.544028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b014b94-6776-4bbe-aaf4-4ecac632552b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b001ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:13.613909 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b014b94-6776-4bbe-aaf4-4ecac632552b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.075784 Jul 20 04:31:13.616504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2110/3235] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:13 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:14.553182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.554053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:14.570909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.571686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.573528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:14.574199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:14.779397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:14.794007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0d0b8bc-39ec-4553-9d88-1b02bb5d19b1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.246197 Jul 20 04:31:14.802347 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2111/3236] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:14.808368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f14507c-1ad1-465e-a6e0-6beeae535d95 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b078550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:14.879311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f14507c-1ad1-465e-a6e0-6beeae535d95 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.074672 Jul 20 04:31:14.885365 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2112/3237] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:14 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:15.071251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-265045071", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:15.174750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] validate_networks() for [('429715de-ec28-45fd-a3e3-caa2b81dd5a3', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:15.858372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:15.859434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:15.859434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:15.860118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:15.860818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:15.876960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.878427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.879473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:15.880149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:15.904580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Getting quotas for project 7ab13306842c4d9bac8dfa88a31073eb. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:15.911917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Getting quotas for user 559b4846a0ac4ec6a24836f47ea282c5 and project 7ab13306842c4d9bac8dfa88a31073eb. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:15.927550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:15.930545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:15.976670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:16.003871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b01e376e-f1d9-4faa-9f01-bdca97e14df8 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120733 Jul 20 04:31:16.005413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2113/3238] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:16.011970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "47da2667-0282-45d5-9305-069309bbaf6c"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:16.013444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.022313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.023114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.024086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.024727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.091873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] HTTP exception thrown: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Request method failure captured: Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1/os-volume_attachments/33124068-c3a6-4dd2-b981-6bec4d1ac94f HTTP/1.1 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 74 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14SIzrw72PvDC4MxOG5uC08YvbTT6PRXZUztxojFMVr9xOZS562G5iEv08RUod03eP2ltnb703tum4jEEd-OCIJciRJnCG1JDYA2ptVmgAB_VmrSudmXqXoRX3j2WnNGfvWdlXE3qaMEq7tmXEnZGS0oSLlSdNeXyTFa6vaWWVMi4QM Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 922706e2cacd4168be0d6bd1dabbc87b Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesAdminNegativeTest-545099211 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/922706e2cacd4168be0d6bd1dabbc87b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/922706e2cacd4168be0d6bd1dabbc87b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/922706e2cacd4168be0d6bd1dabbc87b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_922706e2cacd4168be0d6bd1dabbc87b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesAdminNegativeTest-545099211 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 922706e2cacd4168be0d6bd1dabbc87b Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-545099211 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesAdminNegativeTest-545099211-project-admin Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b88eefb77ee94a7eba6ccde9147a73c3 Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesAdminNegativeTest-545099211-project-admin Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: {"volumeAttachment": {"volumeId": "47da2667-0282-45d5-9305-069309bbaf6c"}} Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '9a8afcee-7f43-4305-909c-ded31656dee1', 'id': '33124068-c3a6-4dd2-b981-6bec4d1ac94f', 'body': {'volumeAttachment': {'volumeId': '47da2667-0282-45d5-9305-069309bbaf6c'}}} Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. (HTTP 404) (Request-ID: req-e574e1a0-d743-4f08-9f2a-82c1def89cff) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:31:16.094457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. Jul 20 04:31:16.100010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:16.105040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] Returning 404 to user: Volume 33124068-c3a6-4dd2-b981-6bec4d1ac94f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:16.106156 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9781ba7d-f2f2-42aa-9a73-480e1679f387 tempest-VolumesAdminNegativeTest-545099211 tempest-VolumesAdminNegativeTest-545099211-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1/os-volume_attachments/33124068-c3a6-4dd2-b981-6bec4d1ac94f" status: 404 len: 109 microversion: 2.1 time: 0.099406 Jul 20 04:31:16.106908 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2114/3239] 10.222.0.49 () {60 vars in 1432 bytes} [Wed Jul 20 04:31:16 2022] PUT /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1/os-volume_attachments/33124068-c3a6-4dd2-b981-6bec4d1ac94f => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:16.113229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d1b381ca-1973-4255-95f5-97375cc0c109 req-4bc41ce6-6032-4c7d-9128-a769e88d20b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-plugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:16.130636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d1b381ca-1973-4255-95f5-97375cc0c109 req-4bc41ce6-6032-4c7d-9128-a769e88d20b7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.131165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d1b381ca-1973-4255-95f5-97375cc0c109 req-4bc41ce6-6032-4c7d-9128-a769e88d20b7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.170207 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d1b381ca-1973-4255-95f5-97375cc0c109 req-4bc41ce6-6032-4c7d-9128-a769e88d20b7 service nova] Creating event network-vif-plugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:31:16.178267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d1b381ca-1973-4255-95f5-97375cc0c109 req-4bc41ce6-6032-4c7d-9128-a769e88d20b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068999 Jul 20 04:31:16.179215 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2115/3240] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:16.188713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.189560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.198494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.199473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.199959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:16.200414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:16.454590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.465194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6eebb68f-73d2-4bb4-a225-7caa76c23fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.284726 Jul 20 04:31:16.466241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2116/3241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.472732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae315e9d-3627-4dc9-89e7-36e8955990f9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838af78700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.540662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae315e9d-3627-4dc9-89e7-36e8955990f9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.073170 Jul 20 04:31:16.544651 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2117/3242] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:16.552455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7b704c7-b4f1-4ee7-9928-07c396b582a1 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:16.554466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7b704c7-b4f1-4ee7-9928-07c396b582a1 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:16.661975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7b704c7-b4f1-4ee7-9928-07c396b582a1 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:16.680748 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7b704c7-b4f1-4ee7-9928-07c396b582a1 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1223 microversion: 2.1 time: 0.135750 Jul 20 04:31:16.682848 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2118/3243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:16 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:17.482108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:17.484454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:17.508605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.517236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.524852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:17.525697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:17.909447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:17.923322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31a01caf-0c9f-4129-a546-2b6e0ab1cfba tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1364 microversion: 2.1 time: 0.445618 Jul 20 04:31:17.925571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2119/3244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1364 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:17.932247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b92afaff-da55-4ee6-91aa-5a2a71befcc4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838af78f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.096458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b92afaff-da55-4ee6-91aa-5a2a71befcc4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.168216 Jul 20 04:31:18.097841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2120/3245] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:17 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:18.120599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.123154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.150547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.150811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.156651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.157124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.345912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:18.355220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6681188-aa05-4223-a429-72ba2a24d07d tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1283 microversion: 2.1 time: 0.255416 Jul 20 04:31:18.355931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2121/3246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:18.947387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:18.947995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:18.966265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.971438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:18.975301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:18.975805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.776675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:19.790008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06d19e8d-79fd-4415-ab2b-8437c412989f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1552 microversion: 2.1 time: 0.849866 Jul 20 04:31:19.790972 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2122/3247] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:18 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1552 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:19.814184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d501e12b-deb7-484c-a556-ddcd60c9d1d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838ba56940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.907389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d501e12b-deb7-484c-a556-ddcd60c9d1d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.114965 Jul 20 04:31:19.908853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2123/3248] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:19.930381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:19.931014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:19.948391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.949711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:19.950563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:19.951010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.115929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:20.129019 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-449a6777-345a-4b36-ba60-bf4b88d05054 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1281 microversion: 2.1 time: 0.216481 Jul 20 04:31:20.140624 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2124/3249] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:19 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:20.153008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:20.157321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:20.175514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.176265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.177468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:20.179231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:20.408171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8598fcc8-b546-423f-9e8b-ae1ffa2be6a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.266417 Jul 20 04:31:20.414522 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2125/3250] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/os-interface => generated 285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:20.924817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9fc7527-849c-43ec-9e73-2cd301fd49f0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838ae7f790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.021697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9fc7527-849c-43ec-9e73-2cd301fd49f0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.102667 Jul 20 04:31:21.023902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2126/3251] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:20 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:21.146457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:21.147535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:21.160788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.161512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.162304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:21.162914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:21.169795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:21.924551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:21.938240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6312fe77-62da-4505-bf0e-89aee9fa9e6f tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.796131 Jul 20 04:31:21.941509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2127/3252] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:21 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:22.037463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19d2f9ce-6ce5-4aae-a4a9-61ea22c5e7d0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b0f4af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.121161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19d2f9ce-6ce5-4aae-a4a9-61ea22c5e7d0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.088749 Jul 20 04:31:22.127450 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2128/3253] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:22.133149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.133780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.144964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.145419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.146283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.146668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.213896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:22.381570 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a5b3abba-134f-40ee-a50e-93145dc73850 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 204 len: 0 microversion: 2.1 time: 0.257899 Jul 20 04:31:22.382733 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2129/3254] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:22 2022] DELETE /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:22.402329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:22.403268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:22.413667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.414444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:22.415739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:22.416381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.413724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:23.433172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d14d567b-5899-4cc5-8cfa-7494951a1ad2 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1513 microversion: 2.1 time: 1.044368 Jul 20 04:31:23.433816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2130/3255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:22 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1513 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:23.474910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:23.475571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:23.514553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.515004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:23.515792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:23.516225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.140792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:24.156064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-813b63b1-33ad-4b37-8d87-93e1e004b129 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.690047 Jul 20 04:31:24.160717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2131/3256] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:23 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:24.165862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5cc82060-904b-4207-a32c-4ea0f9a6aa53 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b09c0d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.275203 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5cc82060-904b-4207-a32c-4ea0f9a6aa53 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.113017 Jul 20 04:31:24.276434 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2132/3257] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:24.452647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:24.454025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:24.471342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.472637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:24.474553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:24.478712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.517142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.547582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75df40fa-99a2-48f8-a127-2f55384ef0bf tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1513 microversion: 2.1 time: 1.098480 Jul 20 04:31:25.552616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2133/3258] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:24 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1513 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:25.575875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0dd6b9ed-a617-4aa2-a53d-9127814006a7 req-3b8003b5-1d5d-4c6d-8ac8-9ff4af2ac58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc23e01-5283-47e1-bb83-c24d83e311eb", "tag": "46ea50e9-231d-4b08-9cc5-abaf8df464df"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:25.609471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0dd6b9ed-a617-4aa2-a53d-9127814006a7 req-3b8003b5-1d5d-4c6d-8ac8-9ff4af2ac58b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.610195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0dd6b9ed-a617-4aa2-a53d-9127814006a7 req-3b8003b5-1d5d-4c6d-8ac8-9ff4af2ac58b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.625763 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0dd6b9ed-a617-4aa2-a53d-9127814006a7 req-3b8003b5-1d5d-4c6d-8ac8-9ff4af2ac58b service nova] Creating event network-changed:46ea50e9-231d-4b08-9cc5-abaf8df464df for instance fcc23e01-5283-47e1-bb83-c24d83e311eb on n-h1-764486-11 Jul 20 04:31:25.632780 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0dd6b9ed-a617-4aa2-a53d-9127814006a7 req-3b8003b5-1d5d-4c6d-8ac8-9ff4af2ac58b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074825 Jul 20 04:31:25.634740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2134/3259] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:25.642663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:25.643955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:25.651469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.652319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.653390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:25.654294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:25.893388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:25.936343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:25.952150 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e27c1b1-f2f6-43c0-8133-9225d84974ce tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.315282 Jul 20 04:31:25.965088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2135/3260] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:25.972161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12ea72c4-725c-41b7-882d-30cdde5a1c79 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f83981a08b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:26.071800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12ea72c4-725c-41b7-882d-30cdde5a1c79 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1411 microversion: 2.1 time: 0.112868 Jul 20 04:31:26.072997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2136/3261] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:25 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:26.570312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:26.573262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:26.588616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.589530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.595000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:26.598855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:26.690109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:26.927657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:26.941658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1002e45-3bbe-449e-ac69-45ee54720e5e tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 200 len: 1513 microversion: 2.1 time: 0.375662 Jul 20 04:31:26.943833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2137/3262] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:26 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:26.979289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:26.979912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:27.011981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.012623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.016111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:27.016766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:27.452106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:27.461899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0485e91c-a4bf-42a3-8fbe-38fa858c5337 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.491835 Jul 20 04:31:27.463631 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2138/3263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:26 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:27.469587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e6a0c5e-73ef-43e7-917c-af83b92091ef tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b9561f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.536101 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e6a0c5e-73ef-43e7-917c-af83b92091ef tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1420 microversion: 2.1 time: 0.071140 Jul 20 04:31:27.543773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2139/3264] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:27.550076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b76e168-8ee4-4b37-a100-4bf0d5c30b13 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b00ac10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:27.612314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b76e168-8ee4-4b37-a100-4bf0d5c30b13 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 200 len: 1420 microversion: 2.1 time: 0.067046 Jul 20 04:31:27.617105 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2140/3265] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:31:27 2022] GET /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:27.631835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5661887a-9d72-4d6b-8725-cd7b4379ae04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838af78430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.291522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5661887a-9d72-4d6b-8725-cd7b4379ae04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 204 len: 0 microversion: 2.1 time: 0.669013 Jul 20 04:31:28.292115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2141/3266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:27 2022] DELETE /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:31:28.298198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-37a6ccf6-8b25-466b-8671-11a45d984ccb req-f4b07279-1606-4c40-ab07-63534511a4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}, {"server_uuid": "9a8afcee-7f43-4305-909c-ded31656dee1", "name": "network-vif-deleted", "tag": "27f8cb2f-603c-4eb9-bb1b-3fea8fa59a1a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:28.310329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-37a6ccf6-8b25-466b-8671-11a45d984ccb req-f4b07279-1606-4c40-ab07-63534511a4b8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.310861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-37a6ccf6-8b25-466b-8671-11a45d984ccb req-f4b07279-1606-4c40-ab07-63534511a4b8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.327922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-37a6ccf6-8b25-466b-8671-11a45d984ccb req-f4b07279-1606-4c40-ab07-63534511a4b8 service nova] Creating event network-changed:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:31:28.328711 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-37a6ccf6-8b25-466b-8671-11a45d984ccb req-f4b07279-1606-4c40-ab07-63534511a4b8 service nova] Creating event network-vif-deleted:27f8cb2f-603c-4eb9-bb1b-3fea8fa59a1a for instance 9a8afcee-7f43-4305-909c-ded31656dee1 on n-h2-764486-11 Jul 20 04:31:28.337614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-37a6ccf6-8b25-466b-8671-11a45d984ccb req-f4b07279-1606-4c40-ab07-63534511a4b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042996 Jul 20 04:31:28.337614 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2142/3267] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:28.343695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.344558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 9a8afcee-7f43-4305-909c-ded31656dee1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:28.352640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.353211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.354132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.354677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.377072 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] HTTP exception thrown: Instance 9a8afcee-7f43-4305-909c-ded31656dee1 could not be found. Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Request method failure captured: Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 HTTP/1.1 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RyJ3L5750NEYSukhs-z3yoe2vs5GMXEGTDpwKb5u3nTa21E28gHyiqtTiuJN015AvDB2-Jw7QqgJDN2TYf3ZpdENV5mCEaO8OiSNASaZfUElLv5z2meeqqy7d0bS4n9LqfJy9pzkDAlufuT05TdyJ33hhlamktc27LKo-_FZgIP_I Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5d7695d44e6643a99987228be8b509e8 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesAdminNegativeTest-399927879 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5d7695d44e6643a99987228be8b509e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5d7695d44e6643a99987228be8b509e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5d7695d44e6643a99987228be8b509e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5d7695d44e6643a99987228be8b509e8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesAdminNegativeTest-399927879 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5d7695d44e6643a99987228be8b509e8 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-399927879 Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesAdminNegativeTest-399927879-project Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 0f3881c5b1d04353801b73c6ba3d181e Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesAdminNegativeTest-399927879-project Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9a8afcee-7f43-4305-909c-ded31656dee1 could not be found. Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9a8afcee-7f43-4305-909c-ded31656dee1'} Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8afcee-7f43-4305-909c-ded31656dee1 could not be found. Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8afcee-7f43-4305-909c-ded31656dee1 could not be found. Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:28.379086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8afcee-7f43-4305-909c-ded31656dee1 could not be found. Jul 20 04:31:28.384753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:28.386171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Returning 404 to user: Instance 9a8afcee-7f43-4305-909c-ded31656dee1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:28.387217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef7233f1-ae0d-40d6-923d-43753874ffbc tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1" status: 404 len: 111 microversion: 2.1 time: 0.048426 Jul 20 04:31:28.388388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2143/3268] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:28 2022] GET /compute/v2.1/servers/9a8afcee-7f43-4305-909c-ded31656dee1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:28.397557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.398247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:28.408715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.409349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.410337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.410942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.466433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:28.616265 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0444778-7214-4233-bb2f-2ac69e2d7953 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 204 len: 0 microversion: 2.1 time: 0.225576 Jul 20 04:31:28.617222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2144/3269] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:28 2022] DELETE /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:28.630855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:28.632099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:28.639856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.640649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.641893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:28.652793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:28.983031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:28.992691 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8a86ab3-b788-4ed5-98a9-a03663690a28 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.374089 Jul 20 04:31:28.995531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2145/3270] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:28 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:29.004872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1331669378", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "109649da-9a7a-4452-acba-cc48e048c55a"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:29.105516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] validate_networks() for [('109649da-9a7a-4452-acba-cc48e048c55a', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:31:30.248791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:30.249999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:30.250676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:30.251260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:30.251875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:30.267466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.270424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.275122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.275758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.320164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:30.333418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for user 4fc1acc695b0455cbe8f6ef66145c8aa and project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:30.362382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:30.364646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:30.481610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50d21579-f1a1-4458-a73e-f4fda917c75b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484575 Jul 20 04:31:30.496262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2146/3271] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:31:30.502058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:30.504150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:30.526512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.526974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:30.537122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:30.537834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.220444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.229470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b66405ae-3577-44ca-b5eb-a441c11f3aec tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.731871 Jul 20 04:31:31.232319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2147/3272] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:30 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:31.246466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9863fd60-0776-4acb-a934-ada5114c2b4e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.247434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9863fd60-0776-4acb-a934-ada5114c2b4e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.634157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9863fd60-0776-4acb-a934-ada5114c2b4e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:31.643933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9863fd60-0776-4acb-a934-ada5114c2b4e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1208 microversion: 2.1 time: 0.410065 Jul 20 04:31:31.646138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2148/3273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:31 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1208 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:31.652604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:31.653274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:31.660626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.661221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.662114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:31.663418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:31.809535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lazy-loading 'services' on Instance uuid 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:31:31.821341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:31.974840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-240371c0-eccd-484f-9ed8-56ebc1ad367d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-volume_attachments/f15d688a-ecc0-4a6e-8d38-ac77827aa0ab" status: 202 len: 0 microversion: 2.1 time: 0.326532 Jul 20 04:31:31.975740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2149/3274] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:31:31 2022] DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-volume_attachments/f15d688a-ecc0-4a6e-8d38-ac77827aa0ab => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:32.252697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:32.253411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:32.260748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.261340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.262148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.262575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.705517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:32.715714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f11762a-20dc-4b43-8a7d-8b08b3e57d61 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.470231 Jul 20 04:31:32.727569 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2150/3275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:32 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:32.867586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-11263190-e89c-43a0-b31f-4bae220784a7 req-b2d318eb-a79f-4bd6-a57a-3706ef16c54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe68d5b7-3c53-4581-be34-866b5c03ab5d", "name": "network-vif-deleted", "tag": "6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:32.885260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-11263190-e89c-43a0-b31f-4bae220784a7 req-b2d318eb-a79f-4bd6-a57a-3706ef16c54e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.885712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-11263190-e89c-43a0-b31f-4bae220784a7 req-b2d318eb-a79f-4bd6-a57a-3706ef16c54e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.914676 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-11263190-e89c-43a0-b31f-4bae220784a7 req-b2d318eb-a79f-4bd6-a57a-3706ef16c54e service nova] Creating event network-vif-deleted:6bd3e05c-67c9-41dc-a782-c6eb1b9b87d1 for instance fe68d5b7-3c53-4581-be34-866b5c03ab5d on n-h1-764486-11 Jul 20 04:31:32.919912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-11263190-e89c-43a0-b31f-4bae220784a7 req-b2d318eb-a79f-4bd6-a57a-3706ef16c54e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190782 Jul 20 04:31:32.920659 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2151/3276] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:32.930523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:32.944726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:32.981195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.981976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:32.983010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:32.983639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.141566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:33.152003 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-197a680b-ad01-4a6c-9856-2dc7fa0507fa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1266 microversion: 2.1 time: 0.229150 Jul 20 04:31:33.163825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2152/3277] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:32 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:33.735043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:33.735815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:33.749179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.749946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:33.753601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:33.756460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.382385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:34.396374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8ac0ffc-87dd-46e0-b6ca-c54ff37b1d30 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 0.665580 Jul 20 04:31:34.402499 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2153/3278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:33 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:34.416732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:34.417842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.445693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.455183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.456368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.456994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.545668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:34.799236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d302e1b1-06df-4614-9f8d-f9e96935016b tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "DELETE /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 204 len: 0 microversion: 2.1 time: 0.394305 Jul 20 04:31:34.800101 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2154/3279] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:34 2022] DELETE /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:34.818935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:34.822798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:34.844852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:34.849569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.853623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:34.856143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:34.861259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.421368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:35.432995 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b976282b-c050-4864-ae06-805d6e05c9ed tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1308 microversion: 2.1 time: 0.627871 Jul 20 04:31:35.448685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2155/3280] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:34 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:35.468027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:35.468768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:35.490228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.497756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:35.499031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:35.500899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.044753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:36.059062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5deb690b-167e-4f96-b303-f1bac2b0e201 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1680 microversion: 2.1 time: 0.602551 Jul 20 04:31:36.059730 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2156/3281] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:35 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1680 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:36.064537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-721f3279-f2b4-4848-9c73-b1f1c066c423 req-4ce5d370-678a-4794-866e-1f0dd2810302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc23e01-5283-47e1-bb83-c24d83e311eb", "name": "network-vif-plugged", "status": "completed", "tag": "46ea50e9-231d-4b08-9cc5-abaf8df464df"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:36.084716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-721f3279-f2b4-4848-9c73-b1f1c066c423 req-4ce5d370-678a-4794-866e-1f0dd2810302 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.085816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-721f3279-f2b4-4848-9c73-b1f1c066c423 req-4ce5d370-678a-4794-866e-1f0dd2810302 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.109032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-721f3279-f2b4-4848-9c73-b1f1c066c423 req-4ce5d370-678a-4794-866e-1f0dd2810302 service nova] Creating event network-vif-plugged:46ea50e9-231d-4b08-9cc5-abaf8df464df for instance fcc23e01-5283-47e1-bb83-c24d83e311eb on n-h1-764486-11 Jul 20 04:31:36.121142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-721f3279-f2b4-4848-9c73-b1f1c066c423 req-4ce5d370-678a-4794-866e-1f0dd2810302 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054947 Jul 20 04:31:36.122142 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2157/3282] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:36.149028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:36.149753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:36.173425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.178004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:36.178689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:36.181314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.339535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:37.359104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14121734-c911-452d-8391-785dd6c3ae8c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1323 microversion: 2.1 time: 1.235476 Jul 20 04:31:37.360902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2158/3283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:36 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1323 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:37.367968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:37.369043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:37.378823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.379689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:37.381209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:37.382297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.103501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:38.113391 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02fa261e-3032-42e3-a83f-0f57b7a0f8fb tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1308 microversion: 2.1 time: 0.750308 Jul 20 04:31:38.126185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2159/3284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:37 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:38.132219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:38.133092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:38.141746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.142452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:38.143453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:38.144068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.037859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.049502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0b21875-3fad-420b-8643-2eb461cf2c30 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1680 microversion: 2.1 time: 0.921600 Jul 20 04:31:39.052287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2160/3285] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:38 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1680 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:39.061849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.068518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.081778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.082314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.083152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.083713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.812045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:39.822076 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84cd4302-35b6-416e-a41b-45fc8fe41e68 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1517 microversion: 2.1 time: 0.768252 Jul 20 04:31:39.823327 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2161/3286] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1517 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:39.832248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c21906c4-af58-40fa-98b3-40ce4757cab8 req-b9ab018e-c8b7-492a-a3f2-c8066053fe84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c459f8cc-daf3-41d4-b848-cd2adfd63b6b", "tag": "3069de66-cec4-49e8-8f1d-cce05e0800eb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:39.849240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c21906c4-af58-40fa-98b3-40ce4757cab8 req-b9ab018e-c8b7-492a-a3f2-c8066053fe84 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.850023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c21906c4-af58-40fa-98b3-40ce4757cab8 req-b9ab018e-c8b7-492a-a3f2-c8066053fe84 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.940931 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c21906c4-af58-40fa-98b3-40ce4757cab8 req-b9ab018e-c8b7-492a-a3f2-c8066053fe84 service nova] Creating event network-changed:3069de66-cec4-49e8-8f1d-cce05e0800eb for instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b on n-h2-764486-11 Jul 20 04:31:39.966730 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c21906c4-af58-40fa-98b3-40ce4757cab8 req-b9ab018e-c8b7-492a-a3f2-c8066053fe84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140891 Jul 20 04:31:39.969844 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2162/3287] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:39.983708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:39.984449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:39.993547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.993994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:39.994763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:39.995197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.288021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:40.475145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.488039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d1a6f0c-b37a-40a8-bf2b-06d6b0ea8389 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1308 microversion: 2.1 time: 0.516091 Jul 20 04:31:40.490136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2163/3288] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:39 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:40.497120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ac4d51c-6591-48b4-a500-f33119443b4c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2097596533", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ac4d51c-6591-48b4-a500-f33119443b4c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 243 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2097596533", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2097596533', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '429715de-ec28-45fd-a3e3-caa2b81dd5a3'}]}}} Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:40.504912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.511926 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.517128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ac4d51c-6591-48b4-a500-f33119443b4c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:40.522457 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ac4d51c-6591-48b4-a500-f33119443b4c tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027945 Jul 20 04:31:40.523711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2164/3289] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:40 2022] POST /compute/v2.1/servers => generated 175 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:31:40.530271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.531224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.568881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.569888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.570821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.571517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.616430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:40.617333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:40.618053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lazy-loading 'fault' on Instance uuid 35349313-cc85-4329-90f0-4a66910e3ddc {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:31:40.686812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3881c5b1d04353801b73c6ba3d181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7695d44e6643a99987228be8b509e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:40.702512 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-179e1492-3879-4fa0-8652-b32bed509500 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 200 len: 1331 microversion: 2.1 time: 0.177357 Jul 20 04:31:40.713557 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2165/3290] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 1331 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:40.725067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9651d18d-3eea-4510-b7b3-3b901d0c5031 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:40.725347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9651d18d-3eea-4510-b7b3-3b901d0c5031 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: b61173fa-40ec-4900-bab9-a80829991404] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:40.734766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9651d18d-3eea-4510-b7b3-3b901d0c5031 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] HTTP exception thrown: Instance b61173fa-40ec-4900-bab9-a80829991404 could not be found. Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9651d18d-3eea-4510-b7b3-3b901d0c5031 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/b61173fa-40ec-4900-bab9-a80829991404/metadata HTTP/1.1 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance b61173fa-40ec-4900-bab9-a80829991404 could not be found. Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': 'b61173fa-40ec-4900-bab9-a80829991404'} Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61173fa-40ec-4900-bab9-a80829991404 could not be found. Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61173fa-40ec-4900-bab9-a80829991404 could not be found. Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.743643 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61173fa-40ec-4900-bab9-a80829991404 could not be found. Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9651d18d-3eea-4510-b7b3-3b901d0c5031 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 404 to user: Instance b61173fa-40ec-4900-bab9-a80829991404 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9651d18d-3eea-4510-b7b3-3b901d0c5031 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/b61173fa-40ec-4900-bab9-a80829991404/metadata" status: 404 len: 111 microversion: 2.1 time: 0.030783 Jul 20 04:31:40.750022 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2166/3291] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:31:40 2022] GET /compute/v2.1/servers/b61173fa-40ec-4900-bab9-a80829991404/metadata => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:40.865239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0e35a93-d43b-43b0-a2f0-bd7438f98f40 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-404786109", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0e35a93-d43b-43b0-a2f0-bd7438f98f40 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 498 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-404786109", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-404786109', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '429715de-ec28-45fd-a3e3-caa2b81dd5a3'}]}}} Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:31:40.868218 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0e35a93-d43b-43b0-a2f0-bd7438f98f40 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0e35a93-d43b-43b0-a2f0-bd7438f98f40 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010217 Jul 20 04:31:40.871980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2167/3292] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:40 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:31:40.934843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a640d48c-1a5a-4790-8a5e-0553117cdf21 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-465906600", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a640d48c-1a5a-4790-8a5e-0553117cdf21 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 499 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-465906600", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-465906600', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '429715de-ec28-45fd-a3e3-caa2b81dd5a3'}]}}} Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:31:40.940791 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:40.944623 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:40.952845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a640d48c-1a5a-4790-8a5e-0553117cdf21 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:40.954231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a640d48c-1a5a-4790-8a5e-0553117cdf21 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025365 Jul 20 04:31:40.955380 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2168/3293] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:40 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:31:41.029925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cd1ff18-6406-40cd-a182-1059874b374a tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1724323837", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cd1ff18-6406-40cd-a182-1059874b374a tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 754 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1724323837", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1724323837', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '429715de-ec28-45fd-a3e3-caa2b81dd5a3'}]}}} Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:41.042451 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:41.046270 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:41.050283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.050283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.050283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cd1ff18-6406-40cd-a182-1059874b374a tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:41.050283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7cd1ff18-6406-40cd-a182-1059874b374a tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.028877 Jul 20 04:31:41.050283 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2169/3294] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:31:41 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 20 04:31:41.112939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be12d7ad-4397-4602-932f-afeea85f4715 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-225212951", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be12d7ad-4397-4602-932f-afeea85f4715 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 1265 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-225212951", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "429715de-ec28-45fd-a3e3-caa2b81dd5a3"}]}} Jul 20 04:31:41.116035 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-225212951', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '429715de-ec28-45fd-a3e3-caa2b81dd5a3'}]}}} Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.118448 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:31:41.119877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:31:41.127311 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 04:31:41.127311 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.127311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be12d7ad-4397-4602-932f-afeea85f4715 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:41.127311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be12d7ad-4397-4602-932f-afeea85f4715 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.016086 Jul 20 04:31:41.127311 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2170/3295] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Jul 20 04:31:41 2022] POST /compute/v2.1/servers => generated 2221 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 20 04:31:41.130771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96178ae9-b21f-4d4e-b9a2-9122269b045b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:41.144472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96178ae9-b21f-4d4e-b9a2-9122269b045b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.145388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96178ae9-b21f-4d4e-b9a2-9122269b045b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.175227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96178ae9-b21f-4d4e-b9a2-9122269b045b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:31:41.205791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:41.227768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96178ae9-b21f-4d4e-b9a2-9122269b045b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action" status: 202 len: 0 microversion: 2.1 time: 0.107326 Jul 20 04:31:41.229430 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2171/3296] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:41 2022] POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:41.237591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93ab6a3d-2b2f-4572-b5a6-187284c436cc tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.238963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93ab6a3d-2b2f-4572-b5a6-187284c436cc tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: a8435480-a752-4f12-b212-4273af29b346] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.245247 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-93ab6a3d-2b2f-4572-b5a6-187284c436cc tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] HTTP exception thrown: Instance a8435480-a752-4f12-b212-4273af29b346 could not be found. Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93ab6a3d-2b2f-4572-b5a6-187284c436cc tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a8435480-a752-4f12-b212-4273af29b346/metadata/test2 HTTP/1.1 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a8435480-a752-4f12-b212-4273af29b346 could not be found. Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': 'a8435480-a752-4f12-b212-4273af29b346', 'id': 'test2'} Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8435480-a752-4f12-b212-4273af29b346 could not be found. Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8435480-a752-4f12-b212-4273af29b346 could not be found. Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:41.249727 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:41.255089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:41.255089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:41.255089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8435480-a752-4f12-b212-4273af29b346 could not be found. Jul 20 04:31:41.255089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:41.257058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93ab6a3d-2b2f-4572-b5a6-187284c436cc tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 404 to user: Instance a8435480-a752-4f12-b212-4273af29b346 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:41.258204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93ab6a3d-2b2f-4572-b5a6-187284c436cc tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/a8435480-a752-4f12-b212-4273af29b346/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.026339 Jul 20 04:31:41.259286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2172/3297] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/a8435480-a752-4f12-b212-4273af29b346/metadata/test2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:41.274865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.275869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.285894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.286447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.289457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.290163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.643677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:41.711472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:41.727407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15d8eaf8-47a3-4e5f-a929-7d2eb39cbe62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.466603 Jul 20 04:31:41.728000 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2173/3298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:41.742007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.742736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.751140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.752673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.753651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.754259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.785910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:31:41.895781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d3fc3b35-61fe-4054-903c-eedcd24bbf10 tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 204 len: 0 microversion: 2.1 time: 0.166353 Jul 20 04:31:41.899048 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2174/3299] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:31:41 2022] DELETE /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:31:41.907043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:41.908344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:41.916239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.916992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:41.918715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:41.919401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.399514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.408432 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e98b8c6-0eec-46b8-9ecf-89d06a140383 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1308 microversion: 2.1 time: 0.507610 Jul 20 04:31:42.409354 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2175/3300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:41 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1308 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.415564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.416473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] [instance: 35349313-cc85-4329-90f0-4a66910e3ddc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.425476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.426560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.428002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.428988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.445840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] HTTP exception thrown: Instance 35349313-cc85-4329-90f0-4a66910e3ddc could not be found. Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Request method failure captured: Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc HTTP/1.1 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RyJ3L5750NEYSukhs-z3yoe2vs5GMXEGTDpwKb5u3nTa21E28gHyiqtTiuJN015AvDB2-Jw7QqgJDN2TYf3ZpdENV5mCEaO8OiSNASaZfUElLv5z2meeqqy7d0bS4n9LqfJy9pzkDAlufuT05TdyJ33hhlamktc27LKo-_FZgIP_I Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 5d7695d44e6643a99987228be8b509e8 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesAdminNegativeTest-399927879 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5d7695d44e6643a99987228be8b509e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5d7695d44e6643a99987228be8b509e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5d7695d44e6643a99987228be8b509e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5d7695d44e6643a99987228be8b509e8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesAdminNegativeTest-399927879 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 5d7695d44e6643a99987228be8b509e8 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-399927879 Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesAdminNegativeTest-399927879-project Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 0f3881c5b1d04353801b73c6ba3d181e Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesAdminNegativeTest-399927879-project Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 35349313-cc85-4329-90f0-4a66910e3ddc could not be found. Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '35349313-cc85-4329-90f0-4a66910e3ddc'} Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35349313-cc85-4329-90f0-4a66910e3ddc could not be found. Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35349313-cc85-4329-90f0-4a66910e3ddc could not be found. Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:42.448088 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35349313-cc85-4329-90f0-4a66910e3ddc could not be found. Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Returning 404 to user: Instance 35349313-cc85-4329-90f0-4a66910e3ddc could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86893f14-9a79-4685-89b4-780f73058621 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc" status: 404 len: 111 microversion: 2.1 time: 0.039023 Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2176/3301] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/35349313-cc85-4329-90f0-4a66910e3ddc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.458059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.463861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.464311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.465234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.465664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.627447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:42.636650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebeed24b-e7df-4299-a053-b87ca8164ade tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1523 microversion: 2.1 time: 0.185455 Jul 20 04:31:42.637556 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2177/3302] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:42.646264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ffb494f9-3237-4470-a40b-a87762c76ac6 req-6dba1456-674d-4c1a-a358-40690af15836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35349313-cc85-4329-90f0-4a66910e3ddc", "name": "network-vif-deleted", "tag": "ed2ea321-1ec5-48fd-abbe-4686182f3487"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:42.656289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ffb494f9-3237-4470-a40b-a87762c76ac6 req-6dba1456-674d-4c1a-a358-40690af15836 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.657090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ffb494f9-3237-4470-a40b-a87762c76ac6 req-6dba1456-674d-4c1a-a358-40690af15836 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.669236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ffb494f9-3237-4470-a40b-a87762c76ac6 req-6dba1456-674d-4c1a-a358-40690af15836 service nova] Creating event network-vif-deleted:ed2ea321-1ec5-48fd-abbe-4686182f3487 for instance 35349313-cc85-4329-90f0-4a66910e3ddc on n-h2-764486-11 Jul 20 04:31:42.674758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ffb494f9-3237-4470-a40b-a87762c76ac6 req-6dba1456-674d-4c1a-a358-40690af15836 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035799 Jul 20 04:31:42.675891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2178/3303] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:42.681794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a58d757-3270-4e2e-aa24-a60123620ef6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] Calling method '.version_select at 0x7f838af328b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.706800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a58d757-3270-4e2e-aa24-a60123620ef6 tempest-VolumesAdminNegativeTest-399927879 tempest-VolumesAdminNegativeTest-399927879-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603903968" status: 202 len: 0 microversion: 2.1 time: 0.029478 Jul 20 04:31:42.708010 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2179/3304] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:31:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603903968 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:42.751292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:42.752048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:42.766384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.767589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:42.768025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:42.768597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.051530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.060107 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e21f8067-dd2a-4bc2-a214-daf3f1da99cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.319079 Jul 20 04:31:43.061351 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2180/3305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:42 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:43.426320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.427644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.436130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.436794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.437737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.438336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.806225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:43.820081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6eb23168-5cca-4f4b-a04e-8dab1e51d1f7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1308 microversion: 2.1 time: 0.396820 Jul 20 04:31:43.821585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2181/3306] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:43.828036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:43.828943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:43.838537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.839244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:43.841353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:43.842281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.272108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '559b4846a0ac4ec6a24836f47ea282c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ab13306842c4d9bac8dfa88a31073eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.282891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c763f41-0271-4d61-a0e4-0c87dbfd021b tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 200 len: 1523 microversion: 2.1 time: 0.459988 Jul 20 04:31:44.284321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2182/3307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:43 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.295416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.296035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:44.307485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.309454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.311507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.313110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.817658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:44.828444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52133527-2a8a-4954-86e7-f0220926ff44 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.542783 Jul 20 04:31:44.831700 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2183/3308] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:44.837493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e3955e89-d1b5-4a40-90d3-35a473ffae5f req-f746591e-ab80-4d3f-a5cc-9ba0572b3ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c459f8cc-daf3-41d4-b848-cd2adfd63b6b", "name": "network-vif-plugged", "status": "completed", "tag": "3069de66-cec4-49e8-8f1d-cce05e0800eb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:44.865468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e3955e89-d1b5-4a40-90d3-35a473ffae5f req-f746591e-ab80-4d3f-a5cc-9ba0572b3ac2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.866262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e3955e89-d1b5-4a40-90d3-35a473ffae5f req-f746591e-ab80-4d3f-a5cc-9ba0572b3ac2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.891799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e3955e89-d1b5-4a40-90d3-35a473ffae5f req-f746591e-ab80-4d3f-a5cc-9ba0572b3ac2 service nova] Creating event network-vif-plugged:3069de66-cec4-49e8-8f1d-cce05e0800eb for instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b on n-h2-764486-11 Jul 20 04:31:44.902362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e3955e89-d1b5-4a40-90d3-35a473ffae5f req-f746591e-ab80-4d3f-a5cc-9ba0572b3ac2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068202 Jul 20 04:31:44.903159 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2184/3309] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:44.923787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-332cfca3-8aad-4cb8-86f0-83f7b424e830 req-e60a31c9-1a46-47bb-b1d9-a0a96da08d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc23e01-5283-47e1-bb83-c24d83e311eb", "name": "network-vif-deleted", "tag": "46ea50e9-231d-4b08-9cc5-abaf8df464df"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:44.935211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-332cfca3-8aad-4cb8-86f0-83f7b424e830 req-e60a31c9-1a46-47bb-b1d9-a0a96da08d74 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:44.936824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-332cfca3-8aad-4cb8-86f0-83f7b424e830 req-e60a31c9-1a46-47bb-b1d9-a0a96da08d74 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:44.969006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-332cfca3-8aad-4cb8-86f0-83f7b424e830 req-e60a31c9-1a46-47bb-b1d9-a0a96da08d74 service nova] Creating event network-vif-deleted:46ea50e9-231d-4b08-9cc5-abaf8df464df for instance fcc23e01-5283-47e1-bb83-c24d83e311eb on n-h1-764486-11 Jul 20 04:31:44.978523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-332cfca3-8aad-4cb8-86f0-83f7b424e830 req-e60a31c9-1a46-47bb-b1d9-a0a96da08d74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073671 Jul 20 04:31:44.979592 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2185/3310] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:31:44.993991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:44.994727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.008133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.008890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.009855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.010459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.646308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:45.655407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd256a17-36cb-4f1c-ae64-0e8bbba81e04 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1308 microversion: 2.1 time: 0.674503 Jul 20 04:31:45.656161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2186/3311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:44 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:45.670188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.671166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] [instance: fcc23e01-5283-47e1-bb83-c24d83e311eb] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.681180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.681914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.682798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.683302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.698011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] HTTP exception thrown: Instance fcc23e01-5283-47e1-bb83-c24d83e311eb could not be found. Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Request method failure captured: Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb HTTP/1.1 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14USBwFjVNVkAd1hp3NsWV8G17JNfTwxOeqNhArKdboQ-0zLb4hCrTKCeGrDavlhS6RyQbcP7lyRMk_GjBVqPMGTUE1WI62cpSlohTFGkhAd-GHe6-Ep74aNRJT6BGa__W_hQCQYUxQ7j0c0g11Mi5cBod4fvUPs33yn1f5Ze7qd_1k Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7ab13306842c4d9bac8dfa88a31073eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7ab13306842c4d9bac8dfa88a31073eb", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7ab13306842c4d9bac8dfa88a31073eb Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-662591114 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 559b4846a0ac4ec6a24836f47ea282c5 Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-662591114-project Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fcc23e01-5283-47e1-bb83-c24d83e311eb could not be found. Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fcc23e01-5283-47e1-bb83-c24d83e311eb'} Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc23e01-5283-47e1-bb83-c24d83e311eb could not be found. Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc23e01-5283-47e1-bb83-c24d83e311eb could not be found. Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.699840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc23e01-5283-47e1-bb83-c24d83e311eb could not be found. Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] Returning 404 to user: Instance fcc23e01-5283-47e1-bb83-c24d83e311eb could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0cdb440d-e806-4edc-bcce-1c9e00acec8e tempest-ServerMetadataNegativeTestJSON-662591114 tempest-ServerMetadataNegativeTestJSON-662591114-project] 10.222.0.49 "GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb" status: 404 len: 111 microversion: 2.1 time: 0.036900 Jul 20 04:31:45.707055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2187/3312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/fcc23e01-5283-47e1-bb83-c24d83e311eb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:31:45.849093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:45.849737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:45.855929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.856420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:45.857245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:45.857683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.297290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:46.315678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb4ec100-b365-4009-ae0e-6014a5a374b2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.470467 Jul 20 04:31:46.317995 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2188/3313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:45 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:46.673618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:46.674450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:46.682343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.683120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:46.684165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:46.684875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.120221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:47.129201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-078c7bc4-5f34-4619-b13f-d5420518c86e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1488 microversion: 2.1 time: 0.460178 Jul 20 04:31:47.130262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2189/3314] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:46 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:47.147109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b5f96f2-6d8f-4f69-af1d-f30a1527c320 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:47.156251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b5f96f2-6d8f-4f69-af1d-f30a1527c320 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.157060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b5f96f2-6d8f-4f69-af1d-f30a1527c320 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.194071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b5f96f2-6d8f-4f69-af1d-f30a1527c320 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:31:47.227600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:47.267762 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b5f96f2-6d8f-4f69-af1d-f30a1527c320 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b/action" status: 202 len: 0 microversion: 2.1 time: 0.124442 Jul 20 04:31:47.268667 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2190/3315] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:47 2022] POST /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:31:47.287251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:47.288081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:47.332857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.333870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:47.335093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:47.336332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.063220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.074469 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dbeb6e69-f0f8-4889-bec1-177d17650123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.800066 Jul 20 04:31:48.075343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2191/3316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:47 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:48.081485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:48.087308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:48.096948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.098607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.099693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:48.100419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:48.593492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:48.602063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af279252-898d-45b6-8d8f-bf3547de68e0 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.524818 Jul 20 04:31:48.602657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2192/3317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:48 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:49.093711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.094332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.104679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.105135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.109377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.110047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.578802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:49.593030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72a1717e-cc23-44a0-b637-433bf7dc437f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.503808 Jul 20 04:31:49.594814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2193/3318] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:49.621835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:49.623105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:49.632460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.633463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:49.636148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:49.637126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.005404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:50.015998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd9be4d8-e9df-4d3a-a802-8cf84e68df1c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.399731 Jul 20 04:31:50.029098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2194/3319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:49 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:50.611439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:50.613005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:50.619841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.620701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:50.621699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:50.622544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.090384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.103370 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f042394-fa6e-448e-8274-09ae00ecb0fe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.494125 Jul 20 04:31:51.113001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2195/3320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:50 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:51.118308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:51.119322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:51.126514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.127293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.128287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:51.128925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:51.479447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:51.514409 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-071424d0-4ce2-482e-b043-7f98ac17424e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1676 microversion: 2.1 time: 0.399519 Jul 20 04:31:51.521531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2196/3321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:51 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1676 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.120656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.121353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.128913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.130830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.134637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.140129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.508996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:52.541511 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c08e110-8b52-42ee-9874-a5241d636f9c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.419769 Jul 20 04:31:52.556440 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2197/3322] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:52.615342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:52.616614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:52.634209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.634661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:52.635446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:52.635877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.114690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.124692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e450839f-666b-4787-9f2c-a97b4777b51e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1653 microversion: 2.1 time: 0.554145 Jul 20 04:31:53.147734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2198/3323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:52 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1653 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:53.156415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b88421f-da99-4522-82cc-2faa41075105 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:53.172691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b88421f-da99-4522-82cc-2faa41075105 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.173283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b88421f-da99-4522-82cc-2faa41075105 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.230009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b88421f-da99-4522-82cc-2faa41075105 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:31:53.365822 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b88421f-da99-4522-82cc-2faa41075105 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action" status: 202 len: 0 microversion: 2.1 time: 0.213340 Jul 20 04:31:53.379263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2199/3324] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:31:53 2022] POST /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:31:53.401879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.409443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.422382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.423056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.424041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.424678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.873424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:53.891970 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90347003-1f52-4eee-a991-202125623308 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1662 microversion: 2.1 time: 0.510904 Jul 20 04:31:53.893183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2200/3325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1662 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:53.908858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:53.909787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:53.916296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.921828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:53.922889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:53.923498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:54.667110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:54.680001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbb0c1bf-bcb4-4217-aacc-060f1922f3b7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.785571 Jul 20 04:31:54.690295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2201/3326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:53 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:54.989031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-270098127", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": "none"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:55.061297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:55.061722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:55.062441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:55.062853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:55.063352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:55.074152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.074631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.075437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.075874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.094638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Getting quotas for project 02ab74716e4c4aa19b69cc4d7cd15a24. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:55.099687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:55.102040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Getting quotas for user 8a30335ca98a4f41bc7bd9b85a21b941 and project 02ab74716e4c4aa19b69cc4d7cd15a24. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:55.118004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:55.120876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 6fab4e55-6343-4beb-afbd-db9b66386de1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:55.203204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46dad79a-a116-4645-bc8e-a3f967feaf4a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.500248 Jul 20 04:31:55.208493 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2202/3327] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:31:55.213293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.214304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.229591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.231140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.232895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.233551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.472053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.482420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2cba7ccd-f73d-4c99-9e53-8f2f46629076 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1662 microversion: 2.1 time: 0.277176 Jul 20 04:31:55.483811 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2203/3328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:55.490375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2316efb7-42bc-4e95-8c5a-56eaf08b3a98 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.491512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2316efb7-42bc-4e95-8c5a-56eaf08b3a98 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 6fab4e55-6343-4beb-afbd-db9b66386de1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.588983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2316efb7-42bc-4e95-8c5a-56eaf08b3a98 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.603177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2316efb7-42bc-4e95-8c5a-56eaf08b3a98 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.605493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2316efb7-42bc-4e95-8c5a-56eaf08b3a98 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:55.606727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2316efb7-42bc-4e95-8c5a-56eaf08b3a98 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1" status: 200 len: 1277 microversion: 2.47 time: 0.121682 Jul 20 04:31:55.611508 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2204/3329] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:55.679997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1735272476", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": "none"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:55.746893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:31:55.747942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:31:55.748569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:31:55.749221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:31:55.749862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:31:55.764717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.770695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.772319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.774617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.807133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Getting quotas for project 02ab74716e4c4aa19b69cc4d7cd15a24. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:31:55.814028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Getting quotas for user 8a30335ca98a4f41bc7bd9b85a21b941 and project 02ab74716e4c4aa19b69cc4d7cd15a24. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:31:55.836102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:31:55.838523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:31:55.888119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4d6005b-59ae-4553-824b-4dde617f61ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.212001 Jul 20 04:31:55.888952 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2205/3330] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 214 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 04:31:55.900256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:55.901310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:55.909366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.910040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:55.910974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:55.911641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.202429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.214038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90ab2816-0255-4fda-8978-7fa2cea39354 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.318336 Jul 20 04:31:56.218756 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2206/3331] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:55 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:56.224924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91bfab57-4480-402b-920b-4af323dde4b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:31:56.226461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91bfab57-4480-402b-920b-4af323dde4b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.267263 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91bfab57-4480-402b-920b-4af323dde4b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "PUT /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 992 microversion: 2.47 time: 0.047334 Jul 20 04:31:56.277580 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2207/3332] 10.222.0.49 () {62 vars in 1296 bytes} [Wed Jul 20 04:31:56 2022] PUT /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 992 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:31:56.283529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a75b159-a369-4fae-8b25-2e78948dca9f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.284464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a75b159-a369-4fae-8b25-2e78948dca9f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.349354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a75b159-a369-4fae-8b25-2e78948dca9f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.360150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a75b159-a369-4fae-8b25-2e78948dca9f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.362347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a75b159-a369-4fae-8b25-2e78948dca9f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.363705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a75b159-a369-4fae-8b25-2e78948dca9f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1278 microversion: 2.47 time: 0.084752 Jul 20 04:31:56.365145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2208/3333] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:56.500629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:56.501267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:56.518233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.518985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.520007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:56.520647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:56.708317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:56.719405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-352af7d3-be44-461f-90bf-67fcf31ebcd1 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1666 microversion: 2.1 time: 0.222328 Jul 20 04:31:56.720839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2209/3334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:56 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1666 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:57.234902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.235645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.242930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.243472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.244541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.245232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.262196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:31:57.492754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.505509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d7fda85-831b-48da-8cf0-d2dac6cd4d50 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.274520 Jul 20 04:31:57.506685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2210/3335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:31:57.520962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:57.522017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:57.532685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.533424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.534408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:57.535386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:57.681646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.699254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.702445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:57.706245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1eb0ec92-409d-4f6f-bd26-ea6e0be465c5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1338 microversion: 2.47 time: 0.198194 Jul 20 04:31:57.708263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2211/3336] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:57 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1338 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:58.528111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.529706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.540095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.540946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.543361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.544090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.902110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:58.914742 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09b6dd67-8987-4255-a22e-a7d8d7e2f9e8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.394333 Jul 20 04:31:58.915863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2212/3337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:58.922737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:58.923560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:58.930416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.930874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:58.933414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:58.934042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.598618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.608266 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36cf7350-762d-488d-b769-4f55c33dbd13 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.691276 Jul 20 04:31:59.609191 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2213/3338] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:58 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:31:59.614455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.615273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.623858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.624967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.626299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.626983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.741963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.750910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.754559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:31:59.755846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a020935-1f5d-4e6d-b97d-f73a9ee94748 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1336 microversion: 2.47 time: 0.145358 Jul 20 04:31:59.756962 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2214/3339] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:31:59.762250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:31:59.763243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:31:59.772768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.773562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:31:59.774547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:31:59.775232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.190012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.206268 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42286aaa-6b2a-483b-9018-65e462d274af tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.447906 Jul 20 04:32:00.207768 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2215/3340] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:31:59 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.213572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.214504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.222099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.222678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.223581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.224282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.686854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:00.695367 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55d9c50e-136c-47e7-8a95-89ea25f00303 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.486156 Jul 20 04:32:00.712831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2216/3341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:00.725790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:00.726557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:00.748952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.749611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:00.750584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:00.751549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.081120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.094297 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-667ad9ef-4fe2-455d-98b9-17d5d8278ce7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.380223 Jul 20 04:32:01.095396 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2217/3342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:00 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:01.111579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.112708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.119361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.119822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.120860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.121305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.241306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.253808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.255412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:01.256917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c881e79-2814-4b7b-bd35-b14b65676b24 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1357 microversion: 2.47 time: 0.160204 Jul 20 04:32:01.257837 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2218/3343] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:01.262979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1870159877"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:01.264822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.277411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.278077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.279090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.279704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.659047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23ed8427-9661-4ac2-9265-7ba3b35246b0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.398588 Jul 20 04:32:01.664210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2219/3344] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:01 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:32:01.671306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:01.674122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.684565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.685447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.686561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.687236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.812727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:01.813405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:01.814107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:01.814687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:01.815462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:01.923466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:01.946554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.947010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.948596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:01.949263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:01.990665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4547785-92ed-4746-9cf0-6eb7efc76735 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "POST /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d/action" status: 202 len: 1079 microversion: 2.47 time: 0.324123 Jul 20 04:32:01.991946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2220/3345] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:32:01 2022] POST /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d/action => generated 1079 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:32:01.997025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:01.998654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.005943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.006666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.007648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.008255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.253162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.264784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2cae17c-6d00-42c3-a626-e15adb028dd1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.271054 Jul 20 04:32:02.265719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2221/3346] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:01 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:02.281430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:02.282131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:02.288616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.289610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.291342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:02.291972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:02.424606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.435368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.438012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:02.440823 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-662a107c-892c-4a2c-8280-48dd9694e965 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.172143 Jul 20 04:32:02.441408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2222/3347] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:02 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:03.287342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.288007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.310669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.311155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.312012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.312541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.573691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.584409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:03.592818 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e018a22-d1b5-4f74-9cd7-0757adf1385e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.314504 Jul 20 04:32:03.594105 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2223/3348] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:03.600735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:03.602846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:03.611594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.612054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.613154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:03.613422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:03.714009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.740957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.762050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:03.765872 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b89639c-a7d0-4445-848c-b0c3b6c063b4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.170297 Jul 20 04:32:03.766747 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2224/3349] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:03 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:04.612201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:04.615377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:04.645431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.645911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.649598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:04.650170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:04.838309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:04.849188 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3223f4e6-86a6-488f-b84d-8148ef97a1a8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.242430 Jul 20 04:32:04.851031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2225/3350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:05.085044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8018c771-76a8-4350-b77e-2c9c1d677184 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.099044 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8018c771-76a8-4350-b77e-2c9c1d677184 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.246375 Jul 20 04:32:05.099637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2226/3351] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:32:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:05.123794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.124422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:05.133467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.134204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.135460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.136146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.228596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.241180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.245241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:05.252731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6620bbd9-51c2-45c1-b9aa-2da2a9599893 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.127361 Jul 20 04:32:05.254088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2227/3352] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:05 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:05.882112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:05.886817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:05.909786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:05.914817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.919632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:05.920805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:05.923281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:06.355376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=16 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:06.759359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:06.782284 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7e5680b-aa08-4c0e-8756-6b44c4a60a05 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.916609 Jul 20 04:32:06.790830 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2228/3353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:05 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:06.802723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ac506dc-6ae1-472e-935c-e01f759c8874 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1562299570", "imageRef": "757b054c-5f74-4319-bda0-5330e5032d6e", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:06.911814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-0ac506dc-6ae1-472e-935c-e01f759c8874 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:07.584992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0ac506dc-6ae1-472e-935c-e01f759c8874 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ac506dc-6ae1-472e-935c-e01f759c8874 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] Request method failure captured: Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 143 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14VEa2sVlYW9Ies2aVDsfuhXWnAwdL15nFv_y_K2jXCtitjf0pJo3LIbgckSDGo3O1c2l9_jWGFZScPkcBi8D_fzt50sK0Ilg55xUQ9T-wOK_g79PyFr4mgn2CYIhQ3f37aa1TtgIB6ysdfq4Np7KHAuchRcItU7zsCAsWGrpm47tt8 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 12def4d41b9441debce58574ef9a6dd7 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-FlavorsV2NegativeTest-1747778029 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/12def4d41b9441debce58574ef9a6dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/12def4d41b9441debce58574ef9a6dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/12def4d41b9441debce58574ef9a6dd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_12def4d41b9441debce58574ef9a6dd7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-FlavorsV2NegativeTest-1747778029 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 12def4d41b9441debce58574ef9a6dd7 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1747778029 Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-FlavorsV2NegativeTest-1747778029-project Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 576490541b42499980e1ac0fe3bcfcca Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-FlavorsV2NegativeTest-1747778029-project Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1562299570", "imageRef": "757b054c-5f74-4319-bda0-5330e5032d6e", "flavorRef": "452"}} Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: exception: Flavor's memory is too small for requested image. Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1562299570', 'imageRef': '757b054c-5f74-4319-bda0-5330e5032d6e', 'flavorRef': '452'}}} Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:07.588697 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 20 04:32:07.595449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:32:07.598201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ac506dc-6ae1-472e-935c-e01f759c8874 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:32:07.599694 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ac506dc-6ae1-472e-935c-e01f759c8874 tempest-FlavorsV2NegativeTest-1747778029 tempest-FlavorsV2NegativeTest-1747778029-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.806748 Jul 20 04:32:07.600703 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2229/3354] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:06 2022] POST /compute/v2.1/servers => generated 93 bytes in 809 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:32:07.613139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:07.614541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:07.621915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.623102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.624084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.625121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.749912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.759786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.761479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:07.764783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5775f300-b8f0-4238-895d-d4aad5d8b8f6 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.162394 Jul 20 04:32:07.779997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2230/3355] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:07 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:07.816285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:07.817132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:07.825193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.826634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:07.828690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:07.829709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.208779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:08.219760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5cfd024d-9edd-4926-88ea-6b6ee872d7e3 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.416140 Jul 20 04:32:08.222482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2231/3356] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:07 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:08.784305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:08.784991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:08.802981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.803441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.804388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:08.807755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:08.979859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:08.994850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.005653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.007653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-effd20a1-e743-4437-a50c-12c5ceb5b57e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.227446 Jul 20 04:32:09.008600 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2232/3357] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:08 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:09.239128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:09.239754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:09.252014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.252497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.253282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.254236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.633713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:09.641615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-856c4b9e-1a49-42b3-a6ea-62b3d6b238d5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.406355 Jul 20 04:32:09.642803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2233/3358] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:09 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:09.649416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-53ee3fb0-7275-465d-ad91-a97d71a43a39 req-35914aed-0c14-4b71-92ac-29cc1e8cd5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-plugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:09.659366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:09.661821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-53ee3fb0-7275-465d-ad91-a97d71a43a39 req-35914aed-0c14-4b71-92ac-29cc1e8cd5e3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:09.662497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-53ee3fb0-7275-465d-ad91-a97d71a43a39 req-35914aed-0c14-4b71-92ac-29cc1e8cd5e3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:09.684333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-53ee3fb0-7275-465d-ad91-a97d71a43a39 req-35914aed-0c14-4b71-92ac-29cc1e8cd5e3 service nova] Creating event network-vif-plugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:32:09.695522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-53ee3fb0-7275-465d-ad91-a97d71a43a39 req-35914aed-0c14-4b71-92ac-29cc1e8cd5e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049724 Jul 20 04:32:09.698937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2234/3359] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:10.039274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.041172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.067954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.069000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.085419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.086425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.302551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.314918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.320184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.321722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-45c32224-8af3-4cc7-902f-37af2c362297 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.297399 Jul 20 04:32:10.336056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2235/3360] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:10 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:10.659269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:10.660158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:10.682047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.682911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.683923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:10.686838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:10.962060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:10.971240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9d455c0-d6ea-4664-9793-5d547fd4a567 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.316838 Jul 20 04:32:10.976996 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2236/3361] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:10 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:11.511547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-605869660", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:11.574762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:32:11.981950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:32:11.982306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:32:11.982779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:32:11.983181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:32:11.983589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:32:12.001345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.001799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.002603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.003039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.023002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Getting quotas for project ddb004aeb3bc44699fad86608c78534c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:12.030963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Getting quotas for user f3520aa5b08743b491f53108acb27109 and project ddb004aeb3bc44699fad86608c78534c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:12.050828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:32:12.065336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:32:12.205346 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1cf4b914-cf12-41e4-a91a-c9b9f7e95e19 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947121 Jul 20 04:32:12.207420 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2237/3362] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:32:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:32:12.216409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.217649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.226827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.227811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.229339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.230038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.433015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.474663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.486001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.489400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6de7a172-f294-45c6-9ce8-518b855d7327 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.279841 Jul 20 04:32:12.498143 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2238/3363] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:12.507833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.509901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.527899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.529023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.543238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:12.546776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:12.848375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.858277 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e4a861a-654c-4660-8004-ee9c0ae7a555 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.366114 Jul 20 04:32:12.873365 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2239/3364] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:12.873365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-158ac354-1819-4290-a566-5d530b3457ca tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:12.873365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-158ac354-1819-4290-a566-5d530b3457ca tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:12.990045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-158ac354-1819-4290-a566-5d530b3457ca tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:12.997696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-158ac354-1819-4290-a566-5d530b3457ca tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1216 microversion: 2.1 time: 0.131678 Jul 20 04:32:13.005260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2240/3365] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:12 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:13.510702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:13.511331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:13.525055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.525515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.526297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.526730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.697468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.714918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.718282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:13.720633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7a12808-0046-490f-97dc-afd645af0c2f tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.213968 Jul 20 04:32:13.733130 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2241/3366] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:13 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:13.881149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:13.881763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:13.890541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.894859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:13.896079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:13.899162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.151442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.164596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0e7d50a-07de-4976-a25e-0abec9907bd6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.287372 Jul 20 04:32:14.176158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2242/3367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:13 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:32:14.181585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:14.186640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.201030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.201799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.221324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.222064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.337216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.344815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1d3231a-971d-4c36-845b-f88e7b13882c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1286 microversion: 2.1 time: 0.167048 Jul 20 04:32:14.345277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2243/3368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:14 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:14.746684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:14.749015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:14.758766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.759943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.761026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:14.761747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:14.945107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.951776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:14.962306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.964408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:14.968156 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8871f794-c9dc-4b14-800c-348607fbf91a tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.228104 Jul 20 04:32:14.969470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2244/3369] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:14 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:15.184749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:15.186205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:15.198439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.199409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.201470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.202187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.621419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:15.639758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca2cd054-b411-42c8-a6b1-279f4f1406f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.459679 Jul 20 04:32:15.644269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2245/3370] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:15 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:15.651254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:15.651886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:15.672811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.673279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:15.683687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:15.684184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.007971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.041175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58d545f9-7786-4c9f-9982-60337baa017e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1316 microversion: 2.1 time: 0.394886 Jul 20 04:32:16.053171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2246/3371] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:15 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:16.061815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:16.064103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.073343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.074225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.075390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.076691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.185036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.202750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.208229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:16.213504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-470b181e-3353-4bdd-ae07-4d8038222a7c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.157172 Jul 20 04:32:16.214516 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2247/3372] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:16 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:16.657632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:16.659681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:16.670388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.670875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:16.680611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:16.680844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.371154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:17.383614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-adc439b5-ad59-467e-91f8-1b7f739cdd63 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1498 microversion: 2.1 time: 0.730371 Jul 20 04:32:17.384225 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2248/3373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:16 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1498 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:17.409570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:17.412490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:17.425408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.425864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.426886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.431782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.814753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:17.830108 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30f0b343-b072-45f4-8cd3-09541e44e38e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1316 microversion: 2.1 time: 0.436518 Jul 20 04:32:17.831745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2249/3374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:17 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:17.839767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8b04c1a3-19c6-409a-9e70-7b7a5aaf189a req-81a9d082-3769-42f3-a9be-2d25141a17bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:17.862137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8b04c1a3-19c6-409a-9e70-7b7a5aaf189a req-81a9d082-3769-42f3-a9be-2d25141a17bb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.862902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8b04c1a3-19c6-409a-9e70-7b7a5aaf189a req-81a9d082-3769-42f3-a9be-2d25141a17bb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.892949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8b04c1a3-19c6-409a-9e70-7b7a5aaf189a req-81a9d082-3769-42f3-a9be-2d25141a17bb service nova] Creating event network-changed:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:32:17.906211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8b04c1a3-19c6-409a-9e70-7b7a5aaf189a req-81a9d082-3769-42f3-a9be-2d25141a17bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072845 Jul 20 04:32:17.907270 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2250/3375] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:17.925922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:17.928157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:17.937370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.940674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:17.941861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:17.946433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.122846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.141854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.143399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.151693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-778cc497-a534-43f8-b10a-61b3cea440d7 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.234339 Jul 20 04:32:18.167912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2251/3376] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:17 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:18.410151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.411552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.438726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.440632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.444683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.447806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.868051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:18.879879 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed820a71-d21f-4974-9bd8-71e824ca0a43 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 200 len: 1475 microversion: 2.1 time: 0.482623 Jul 20 04:32:18.895439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2252/3377] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 1475 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:18.896713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:18.898181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:18.907126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.907678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:18.909428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:18.910079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.232829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:20.245111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4af44254-4652-4a05-abb4-86b5136ecff5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1316 microversion: 2.1 time: 1.358386 Jul 20 04:32:20.249591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2253/3378] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:18 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1316 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:20.256511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2124875779"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:20.261781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:20.282098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.282553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:20.283358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:20.283799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.042225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28aaabbd-eaa0-4252-b691-e6fc70222cc1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b/action" status: 202 len: 0 microversion: 2.1 time: 0.790337 Jul 20 04:32:21.047814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2254/3379] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:20 2022] POST /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:32:21.059102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.063203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.093763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.094463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.101529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.102101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.268142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.277672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.281067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.282362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee1dbaeb-8622-488f-83a4-f08b4d77a275 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.237955 Jul 20 04:32:21.282944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2255/3380] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:21.299197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-452634dd-dc42-4f46-af81-2649029df7aa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838ae78790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.431026 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-452634dd-dc42-4f46-af81-2649029df7aa tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 0.146832 Jul 20 04:32:21.436721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2256/3381] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:21.442277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:21.444368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:21.468095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.468603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.469786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:21.470550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:21.901640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:21.915037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72ffdef2-8631-4a32-b862-7b8624594208 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1316 microversion: 2.1 time: 0.482050 Jul 20 04:32:21.925814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2257/3382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:21 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:22.304277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:22.305842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:22.324051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:22.353928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.354401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.364957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.366391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.546208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:22.554656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:22.561256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:22.564175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79c46a9a-e582-4c5a-b623-3694e0a97c0e tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.265552 Jul 20 04:32:22.583596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2258/3383] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:22 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:22.589856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab85a51e-1358-4b4e-ae6b-04ba51f77fc7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b296ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:22.682718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab85a51e-1358-4b4e-ae6b-04ba51f77fc7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 0.097688 Jul 20 04:32:22.683322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2259/3384] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:22 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:22.939511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:22.943423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:22.953374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.954559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.956230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:22.956905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:22.997256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:23.358159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:23.368233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99f44322-d36d-42a9-91a4-47bf821b740d tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1316 microversion: 2.1 time: 0.439116 Jul 20 04:32:23.370983 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2260/3385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:22 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:24.013901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.014385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.021895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.022649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.023652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.040530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.105546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:32:24.167726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:24.267134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6754218e-59a7-44eb-9c38-29285700e257 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 204 len: 0 microversion: 2.32 time: 0.823071 Jul 20 04:32:24.268675 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2261/3386] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:32:23 2022] DELETE /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:32:24.284058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:24.287978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:24.307698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.310417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.311112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:24.311570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:24.421296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.435314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.438130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:24.439812 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-506d9931-9c49-4bfa-a342-56f9aaedad50 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.169918 Jul 20 04:32:24.440860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2262/3387] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:24.446502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59c6392e-a460-42c6-b81e-ae2ce6871b2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b878790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.917848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59c6392e-a460-42c6-b81e-ae2ce6871b2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 2.474052 Jul 20 04:32:26.920939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2263/3388] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:24 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 2479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:26.954707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:26.955628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:26.976137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.976648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:26.979453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:26.979901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.352138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.370673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.378152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.382386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-071aac8e-c4e6-473a-be88-ce1bfdd6b62b tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 2958 microversion: 2.32 time: 0.458858 Jul 20 04:32:27.392627 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2264/3389] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:26 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 2958 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:27.405088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.406057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.424067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.424712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.425593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.426245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.814749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.842568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce3268e9-3f09-4d22-901c-0a1cd257520c tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1316 microversion: 2.1 time: 0.447236 Jul 20 04:32:27.853869 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2265/3390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:27.860058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:27.861219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:27.868597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.869275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.870240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:27.870877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:27.979297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.992730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:27.995775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.000582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d735d81c-2313-4145-b61c-fc320c32ff0c tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.144577 Jul 20 04:32:28.001445 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2266/3391] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:27 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:28.020669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-239e06b2-88fc-437b-8157-c9dfcd28820c req-c4d0d3e7-698d-4fe0-9884-50f372457a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "name": "network-vif-plugged", "status": "completed", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:28.032794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-239e06b2-88fc-437b-8157-c9dfcd28820c req-c4d0d3e7-698d-4fe0-9884-50f372457a84 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.035396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-239e06b2-88fc-437b-8157-c9dfcd28820c req-c4d0d3e7-698d-4fe0-9884-50f372457a84 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.053195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-239e06b2-88fc-437b-8157-c9dfcd28820c req-c4d0d3e7-698d-4fe0-9884-50f372457a84 service nova] Creating event network-vif-plugged:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:32:28.060329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-239e06b2-88fc-437b-8157-c9dfcd28820c req-c4d0d3e7-698d-4fe0-9884-50f372457a84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044945 Jul 20 04:32:28.065897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2267/3392] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:28.085368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.091175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.101683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.102844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.104946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.105590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.433952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:28.446603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-748ae117-f755-47f6-af38-fdecfe303be1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.379210 Jul 20 04:32:28.450093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2268/3393] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:28.461947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8a6b672-9f8b-4b04-9f96-16c11816679b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838ae51040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.537844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8a6b672-9f8b-4b04-9f96-16c11816679b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 0.086537 Jul 20 04:32:28.538629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2269/3394] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:28.556446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:28.560980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:28.570749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.570921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:28.577140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:28.578603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.407237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:29.422464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:29.429098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:29.430764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b44c0f4-2943-49c2-a439-c590a20654b2 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 2958 microversion: 2.32 time: 0.881394 Jul 20 04:32:29.440853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2270/3395] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:28 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 2958 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:29.450474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1125047927"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:29.459157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:29.482888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.483831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.486898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:29.487517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:29.967661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9485d6be-cbcd-400f-b531-876fb9a83e43 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.524808 Jul 20 04:32:29.968706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2271/3396] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:29 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:32:29.997798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:29.999953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.015704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.016164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.016987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.017424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.532124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.549029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7294ab3d-3943-4fef-9f96-75e4ab5112df tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1466 microversion: 2.1 time: 0.579067 Jul 20 04:32:30.550352 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2272/3397] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:29 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1466 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:30.555713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.556630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.567142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.567998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.569923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.570584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.690055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.702802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.704382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:30.705633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70563a87-73fe-49b9-be0b-b6f60c45a5b2 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.154010 Jul 20 04:32:30.728760 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2273/3398] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:30 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:30.734246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7babaf0b-5233-4313-b237-a0b24ab07311 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b8789d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.814168 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7babaf0b-5233-4313-b237-a0b24ab07311 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 0.084182 Jul 20 04:32:30.814770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2274/3399] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:30 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:30.831731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7b22e68d-ba88-4f50-96e3-a181a6e3fd55 req-d80c5a3e-207b-4971-bb4c-237238f7a360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c459f8cc-daf3-41d4-b848-cd2adfd63b6b", "name": "network-vif-plugged", "status": "completed", "tag": "3069de66-cec4-49e8-8f1d-cce05e0800eb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:30.842593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7b22e68d-ba88-4f50-96e3-a181a6e3fd55 req-d80c5a3e-207b-4971-bb4c-237238f7a360 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.843042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7b22e68d-ba88-4f50-96e3-a181a6e3fd55 req-d80c5a3e-207b-4971-bb4c-237238f7a360 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.868171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7b22e68d-ba88-4f50-96e3-a181a6e3fd55 req-d80c5a3e-207b-4971-bb4c-237238f7a360 service nova] Creating event network-vif-plugged:3069de66-cec4-49e8-8f1d-cce05e0800eb for instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b on n-h2-764486-11 Jul 20 04:32:30.876209 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7b22e68d-ba88-4f50-96e3-a181a6e3fd55 req-d80c5a3e-207b-4971-bb4c-237238f7a360 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060018 Jul 20 04:32:30.878409 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2275/3400] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:30.884198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:30.885065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:30.892398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.892864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:30.893649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:30.894087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.364093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.378672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.389363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:31.393628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0fff476-ed5d-4ef4-9992-17b7602697e5 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 2937 microversion: 2.32 time: 0.514024 Jul 20 04:32:31.397523 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2276/3401] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:30 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 2937 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:31.434135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-719940783", "metadata": {"image_type": "test"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:31.435508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:31.444110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.444887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.445658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:31.446255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:31.540608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:31.556992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Getting quotas for project ddb004aeb3bc44699fad86608c78534c. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:32:31.565470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Getting quotas for user f3520aa5b08743b491f53108acb27109 and project ddb004aeb3bc44699fad86608c78534c. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:32:32.123221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ae07d24-135e-4550-a328-79e693565746 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "POST /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc/action" status: 202 len: 0 microversion: 2.1 time: 0.700863 Jul 20 04:32:32.132242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2277/3402] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:32:31 2022] POST /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:32:32.143601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.145516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:32.166277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.166967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.170448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.172751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.361472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.365192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:32.375275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.379020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:32.380441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a759a303-cdd9-4f79-9de4-9ed86d9c97cd tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.249634 Jul 20 04:32:32.396656 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2278/3403] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:32.401324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b321ab9-0f34-49c7-8b6a-e65d50729b16 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838ae51790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.474613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b321ab9-0f34-49c7-8b6a-e65d50729b16 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 0.077096 Jul 20 04:32:32.475387 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2279/3404] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:32.485339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80209178-cc20-4cbf-9b0a-0dcfbb9670ff tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aacef70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.554740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80209178-cc20-4cbf-9b0a-0dcfbb9670ff tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1423 microversion: 2.1 time: 0.078063 Jul 20 04:32:32.555612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2280/3405] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:32.561575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:32.562328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:32.573498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.573952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:32.576154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:32.576805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.037512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.057669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.063390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:33.067283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd7357ba-7ea7-480e-9c22-3cc5f1c2d91f tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 2916 microversion: 2.32 time: 0.510291 Jul 20 04:32:33.072190 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2281/3406] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:32 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 2916 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:33.092495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cbf90b98-5e84-4655-a79c-58a7e0ca070c req-333df4c6-e9cf-4e29-bf9e-709a50aabcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-unplugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-unplugged", "status": "completed", "tag": "485f9778-c6c3-483a-8360-17c1418b6beb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:33.120965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cbf90b98-5e84-4655-a79c-58a7e0ca070c req-333df4c6-e9cf-4e29-bf9e-709a50aabcfa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.127235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cbf90b98-5e84-4655-a79c-58a7e0ca070c req-333df4c6-e9cf-4e29-bf9e-709a50aabcfa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.159562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cbf90b98-5e84-4655-a79c-58a7e0ca070c req-333df4c6-e9cf-4e29-bf9e-709a50aabcfa service nova] Creating event network-vif-unplugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:32:33.161227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cbf90b98-5e84-4655-a79c-58a7e0ca070c req-333df4c6-e9cf-4e29-bf9e-709a50aabcfa service nova] Creating event network-vif-unplugged:485f9778-c6c3-483a-8360-17c1418b6beb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:33.182237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cbf90b98-5e84-4655-a79c-58a7e0ca070c req-333df4c6-e9cf-4e29-bf9e-709a50aabcfa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.108473 Jul 20 04:32:33.188433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2282/3407] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:33.399582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:33.400293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:33.421362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.421823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:33.422643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:33.423144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:34.022195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.037473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.038647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:34.039930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4973e795-6f8a-401e-927e-b6c1e49fe298 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1366 microversion: 2.47 time: 0.644556 Jul 20 04:32:34.045483 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2283/3408] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:33 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:32:34.067409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c958bf6-e5b3-4861-b2bf-c75b31d7d232 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aace670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:34.249137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c958bf6-e5b3-4861-b2bf-c75b31d7d232 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1412 microversion: 2.1 time: 0.195407 Jul 20 04:32:34.250092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2284/3409] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:34.255036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-021be24e-85e4-47e6-a4eb-15491ed03636 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838ae51310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:43.421326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:44.026401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=15 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:44.762611 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-021be24e-85e4-47e6-a4eb-15491ed03636 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1423 microversion: 2.1 time: 10.511056 Jul 20 04:32:44.766196 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2285/3410] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:34 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1423 bytes in 10515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:44.778828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:44.782136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:44.808915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.811423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:44.813427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:44.814413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.100559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.133782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.135684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.137427 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c601d9b7-7d4e-4c48-81d5-daaed28b4d21 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1605 microversion: 2.32 time: 0.369547 Jul 20 04:32:45.139883 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2286/3411] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:44 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1605 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:45.147344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-76f4d839-245e-4dce-8bdd-8ddfbbdffb1a req-03b77d19-ce66-4a90-a388-0bec51a5b3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-deleted", "tag": "485f9778-c6c3-483a-8360-17c1418b6beb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:45.160698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76f4d839-245e-4dce-8bdd-8ddfbbdffb1a req-03b77d19-ce66-4a90-a388-0bec51a5b3d9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.161382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76f4d839-245e-4dce-8bdd-8ddfbbdffb1a req-03b77d19-ce66-4a90-a388-0bec51a5b3d9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.189844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-76f4d839-245e-4dce-8bdd-8ddfbbdffb1a req-03b77d19-ce66-4a90-a388-0bec51a5b3d9 service nova] Creating event network-vif-deleted:485f9778-c6c3-483a-8360-17c1418b6beb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:45.198988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-76f4d839-245e-4dce-8bdd-8ddfbbdffb1a req-03b77d19-ce66-4a90-a388-0bec51a5b3d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057566 Jul 20 04:32:45.199641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2287/3412] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:45.212590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:45.215767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:45.229985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.233622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.234726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:45.235343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:45.359429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.369073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.373477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:45.375516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6203d73-d6df-46ba-a081-2d5b10d7e545 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1357 microversion: 2.47 time: 0.174579 Jul 20 04:32:45.376582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2288/3413] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:45 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:45.390389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4d088a6-9886-4775-a885-e2f75b55c2fd tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aafaca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:55.227117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:55.367944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:32:58.301375 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4d088a6-9886-4775-a885-e2f75b55c2fd tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1421 microversion: 2.1 time: 12.923381 Jul 20 04:32:58.301976 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2289/3414] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:45 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1421 bytes in 12925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:58.323070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.330148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:58.341191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.341637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.345174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.345628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.409333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93a1b55c-0c12-4fd2-aee9-24469998bc0c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104560 Jul 20 04:32:58.409957 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2290/3415] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:32:58.418918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-unplugged", "status": "completed", "tag": "3c2ef8d6-0f79-4743-a086-f9636a7204fb"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-unplugged", "status": "completed", "tag": "d3cf2916-8fe8-4548-8f60-ba2b57714d64"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-unplugged", "status": "completed", "tag": "ac4c775a-afe5-4a70-93a2-194e076db607"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-unplugged", "status": "completed", "tag": "198632a3-4238-4993-a9be-014d0029fb9b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:58.440897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.441505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.456754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Creating event network-vif-unplugged:3c2ef8d6-0f79-4743-a086-f9636a7204fb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:58.457484 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Creating event network-vif-unplugged:d3cf2916-8fe8-4548-8f60-ba2b57714d64 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:58.458128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Creating event network-vif-unplugged:ac4c775a-afe5-4a70-93a2-194e076db607 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:58.458998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] Creating event network-vif-unplugged:198632a3-4238-4993-a9be-014d0029fb9b for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:58.469565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b9d51ab4-68ee-4043-9e2c-3ddedab8652f req-384c1739-9f42-410e-be91-8955b89e26e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.058354 Jul 20 04:32:58.475379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2291/3416] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:58.483380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:58.493482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:58.494733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Searching by: {'deleted': False, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:32:58.501455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.502170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.503387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:58.503982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:58.822501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:32:59.087410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.101928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.104039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.129643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.131492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.215744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb4972e6-98c2-4de1-b5c5-e3e93eebb5ac tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.738752 Jul 20 04:32:59.216366 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2292/3417] 10.222.0.49 () {60 vars in 1186 bytes} [Wed Jul 20 04:32:58 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:59.221065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3462fdb-cd07-4487-b008-52da5af57fe8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838ae510d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.282196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3462fdb-cd07-4487-b008-52da5af57fe8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1423 microversion: 2.1 time: 0.064762 Jul 20 04:32:59.283153 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2293/3418] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1423 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.294328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.295789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.307151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.309874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.311964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.312715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.407300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.419182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.420827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.422388 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11f15315-77e6-48b0-8b29-416f0f092362 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1605 microversion: 2.32 time: 0.138073 Jul 20 04:32:59.423168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2294/3419] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1605 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:32:59.429456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-deleted", "tag": "ac4c775a-afe5-4a70-93a2-194e076db607"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-deleted", "tag": "d3cf2916-8fe8-4548-8f60-ba2b57714d64"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-deleted", "tag": "3c2ef8d6-0f79-4743-a086-f9636a7204fb"}, {"server_uuid": "d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812", "name": "network-vif-deleted", "tag": "198632a3-4238-4993-a9be-014d0029fb9b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:32:59.442622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.443110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.470965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Creating event network-vif-deleted:ac4c775a-afe5-4a70-93a2-194e076db607 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:59.471549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Creating event network-vif-deleted:d3cf2916-8fe8-4548-8f60-ba2b57714d64 for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:59.471997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Creating event network-vif-deleted:3c2ef8d6-0f79-4743-a086-f9636a7204fb for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:59.481232 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] Creating event network-vif-deleted:198632a3-4238-4993-a9be-014d0029fb9b for instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 on n-h1-764486-11 Jul 20 04:32:59.489021 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-83710b93-d89d-4979-beff-45055fad6d41 req-641170a1-52c4-46aa-abc3-19a65efdd9d9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.063419 Jul 20 04:32:59.497547 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2295/3420] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:32:59.507737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1de7dd5b-25ef-455d-9e67-efdff7c3c8b6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aef6e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.614518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1de7dd5b-25ef-455d-9e67-efdff7c3c8b6 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 200 len: 1421 microversion: 2.1 time: 0.115475 Jul 20 04:32:59.615113 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2296/3421] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.626453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.627200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.639411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.641220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.646735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.648413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.878483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:32:59.886985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e311cc34-9511-4fef-b47f-735b803c6ef7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.270324 Jul 20 04:32:59.887822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2297/3422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:32:59 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:32:59.904288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:32:59.906028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:32:59.941886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.945878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:32:59.948580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:32:59.951042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.021823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:00.206929 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f53c2e91-5c0e-415d-a729-28e8fa33e87e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 204 len: 0 microversion: 2.1 time: 0.316055 Jul 20 04:33:00.207739 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2298/3423] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:32:59 2022] DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:00.222635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:00.225617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:00.242291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.243138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.244257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:00.244818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:00.310215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:00.491140 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd252429-ad91-41ab-8000-ee21541330c8 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 204 len: 0 microversion: 2.47 time: 0.279940 Jul 20 04:33:00.496994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2299/3424] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:33:00 2022] DELETE /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:33:00.509763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20b5c17c-0b3d-48ac-a42c-116581e909ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aa81b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:01.773430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20b5c17c-0b3d-48ac-a42c-116581e909ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 204 len: 0 microversion: 2.1 time: 1.274566 Jul 20 04:33:01.774397 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2300/3425] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:00 2022] DELETE /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 0 bytes in 1277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:01.782799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-95221593"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:01.785666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:01.804301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.805166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:01.806158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:01.806846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.396112 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f71bdba-c8be-48fe-a50b-da0a1057abcd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.618756 Jul 20 04:33:02.413061 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2301/3426] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:01 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 04:33:02.429119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:02.431325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:02.447488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.448219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:02.453100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:02.454024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.012522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.022010 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5440c5a6-0454-4f8b-8ae3-d7864c8ede7b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1672 microversion: 2.1 time: 0.607399 Jul 20 04:33:03.037807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2302/3427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:02 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1672 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:03.050646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-417c7bec-fd8b-4eb8-9d29-9751c5f9c0f2 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa39b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.160251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-417c7bec-fd8b-4eb8-9d29-9751c5f9c0f2 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1423 microversion: 2.1 time: 0.121136 Jul 20 04:33:03.161166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2303/3428] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1423 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:03.166386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.172878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:03.187267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.187906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.188549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.188993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.709061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.723475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.732977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:03.737273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad472bc2-8eba-43f0-918a-24e73d525132 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1605 microversion: 2.32 time: 0.575241 Jul 20 04:33:03.741435 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2304/3429] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1605 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:03.751685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-plugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}, {"server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "name": "network-vif-plugged", "status": "completed", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}, {"server_uuid": "c459f8cc-daf3-41d4-b848-cd2adfd63b6b", "name": "network-vif-unplugged", "status": "completed", "tag": "3069de66-cec4-49e8-8f1d-cce05e0800eb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:03.777525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.778739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.835055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] Creating event network-vif-plugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:33:03.835569 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] Creating event network-vif-plugged:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:33:03.842572 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] Creating event network-vif-unplugged:3069de66-cec4-49e8-8f1d-cce05e0800eb for instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b on n-h2-764486-11 Jul 20 04:33:03.855299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-48fba1c6-6edc-47e3-8064-b731a45cf3b5 req-0dfedb3a-584d-4010-8051-bf8346476969 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.112032 Jul 20 04:33:03.856294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2305/3430] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:03.863141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:03.863854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:03.872509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.872969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:03.876905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:03.877381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.540175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.566772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.571413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:04.580558 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f96feb99-7dc2-494a-aed1-abe3ddb5fca5 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 200 len: 1363 microversion: 2.47 time: 0.722192 Jul 20 04:33:04.589672 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2306/3431] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:03 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 1363 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:04.606839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:04.609511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:04.629674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.630891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.632076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:04.632792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:04.647885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:04.760833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:05.040299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81eec066-36ba-430d-b189-7a8d8fc832f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 204 len: 0 microversion: 2.1 time: 0.447308 Jul 20 04:33:05.052683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2307/3432] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:33:04 2022] DELETE /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:05.060812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.061522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.099462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.099462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.099462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.099462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.629394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:05.640412 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a68be73f-1a62-4dea-88ba-018d618aea7f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1687 microversion: 2.1 time: 0.594016 Jul 20 04:33:05.651391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2308/3433] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1687 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:05.658660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:05.660138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:05.676621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.677419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.678459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:05.679131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:05.983246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.011671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29e5da35-96d1-491e-a534-b077779cdf69 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 200 len: 1323 microversion: 2.1 time: 0.357831 Jul 20 04:33:06.012281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2309/3434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:05 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:06.040499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37fb0f74-9080-45b1-8f05-c3da20c74e5e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa39dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.170112 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37fb0f74-9080-45b1-8f05-c3da20c74e5e tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1423 microversion: 2.1 time: 0.156639 Jul 20 04:33:06.171803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2310/3435] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1423 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:06.180835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:06.187730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:06.196466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.200850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.202449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:06.204547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:06.585191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.603205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.609058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:06.613613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b31dadba-d81d-4c00-a26b-f4c6a5d8a3b0 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1605 microversion: 2.32 time: 0.439728 Jul 20 04:33:06.615970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2311/3436] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:06 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1605 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:06.632405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1153928391", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "109649da-9a7a-4452-acba-cc48e048c55a"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:06.840179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] validate_networks() for [('109649da-9a7a-4452-acba-cc48e048c55a', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:08.307796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:08.310221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:08.310221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:08.310221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:08.310221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:08.327281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.328848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.331001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.331827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.371292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:08.394753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for user 4fc1acc695b0455cbe8f6ef66145c8aa and project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:08.431969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:08.440048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:08.560185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19b71542-34c6-4c64-94c2-e8b0e42d57e0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941985 Jul 20 04:33:08.569579 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2312/3437] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:08.575387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.591042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 5172359f-b09b-4c65-b2c7-42aad10b243d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.608207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.628925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.632651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.633354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.668924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] HTTP exception thrown: Instance 5172359f-b09b-4c65-b2c7-42aad10b243d could not be found. Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Request method failure captured: Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d HTTP/1.1 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14U5gKI0JrhjNrbMBuMOGi7cDxF9OWK2LHC2UW5-DiV_YurRsNsapVgaDpuxPQjPFAjVOz4b3hdx4_WPHdkrKSX7KWTMrq_R_6Xg6-iYKtGvr05zbo0hjO3-xpGvKfApajB3MBAWlRR8035ydJz2xf9Y0wgkSKh3aUn4dAfueZvPZrM Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 02ab74716e4c4aa19b69cc4d7cd15a24 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerShowV247Test-109055622 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/02ab74716e4c4aa19b69cc4d7cd15a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/02ab74716e4c4aa19b69cc4d7cd15a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/02ab74716e4c4aa19b69cc4d7cd15a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_02ab74716e4c4aa19b69cc4d7cd15a24", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerShowV247Test-109055622 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 02ab74716e4c4aa19b69cc4d7cd15a24 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerShowV247Test-109055622 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerShowV247Test-109055622-project Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8a30335ca98a4f41bc7bd9b85a21b941 Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerShowV247Test-109055622-project Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5172359f-b09b-4c65-b2c7-42aad10b243d could not be found. Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5172359f-b09b-4c65-b2c7-42aad10b243d'} Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5172359f-b09b-4c65-b2c7-42aad10b243d could not be found. Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5172359f-b09b-4c65-b2c7-42aad10b243d could not be found. Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:08.674233 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5172359f-b09b-4c65-b2c7-42aad10b243d could not be found. Jul 20 04:33:08.677605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:08.679760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Returning 404 to user: Instance 5172359f-b09b-4c65-b2c7-42aad10b243d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:08.680862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79ad7c23-bfb8-4ea2-9656-f97be6744475 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d" status: 404 len: 111 microversion: 2.47 time: 0.109996 Jul 20 04:33:08.691044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2313/3438] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/5172359f-b09b-4c65-b2c7-42aad10b243d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:33:08.696447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9e7b0bcc-25a4-4deb-a0d5-d2dfa2177e15 req-31e5f06e-49fc-4c67-8e2b-595cab082084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41bb7e90-bb7b-4f99-8e8e-e9cf980b0410", "name": "network-vif-deleted", "tag": "9c809395-72c8-4622-a76f-06be38cc94f8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:08.715448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9e7b0bcc-25a4-4deb-a0d5-d2dfa2177e15 req-31e5f06e-49fc-4c67-8e2b-595cab082084 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.725023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9e7b0bcc-25a4-4deb-a0d5-d2dfa2177e15 req-31e5f06e-49fc-4c67-8e2b-595cab082084 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.775009 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9e7b0bcc-25a4-4deb-a0d5-d2dfa2177e15 req-31e5f06e-49fc-4c67-8e2b-595cab082084 service nova] Creating event network-vif-deleted:9c809395-72c8-4622-a76f-06be38cc94f8 for instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 on n-h1-764486-11 Jul 20 04:33:08.792025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9e7b0bcc-25a4-4deb-a0d5-d2dfa2177e15 req-31e5f06e-49fc-4c67-8e2b-595cab082084 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099391 Jul 20 04:33:08.800490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2314/3439] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:08.809324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6ac8735e-29bd-4dc2-92a3-e8495bdeadf8 req-b6ad3610-e625-4d13-91b7-3f2ff5a6d99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-unplugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:08.841662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6ac8735e-29bd-4dc2-92a3-e8495bdeadf8 req-b6ad3610-e625-4d13-91b7-3f2ff5a6d99e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.842110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6ac8735e-29bd-4dc2-92a3-e8495bdeadf8 req-b6ad3610-e625-4d13-91b7-3f2ff5a6d99e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.897349 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6ac8735e-29bd-4dc2-92a3-e8495bdeadf8 req-b6ad3610-e625-4d13-91b7-3f2ff5a6d99e service nova] Creating event network-vif-unplugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:33:08.922199 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6ac8735e-29bd-4dc2-92a3-e8495bdeadf8 req-b6ad3610-e625-4d13-91b7-3f2ff5a6d99e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121674 Jul 20 04:33:08.922824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2315/3440] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:08.928150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:08.928901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:08.948319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.955817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:08.959382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:08.959843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.035828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.054856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67bb5e9a-b63d-45ba-a4d0-91bba1274ef5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 1.128549 Jul 20 04:33:10.057427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2316/3441] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:08 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.070861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.072918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.095680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.098398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.102154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.102913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.142047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] HTTP exception thrown: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Request method failure captured: Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 HTTP/1.1 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RwwDs0wflxYpblMVMcDCIbOVF56A9LdazkfjwEbg2CtrQwoErHDkZrKHJ_2Fp9_Y7uSNXuSa-ld_u7WgJjqsr1m-MIMpoiJkYmUfzt420LvZjTnYzF_XmYCKh5h2W4UFYxmHXsHcc6RMnUQ5MM_JwvkBCj8azYLIuLeRJdhY_7ekw Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc0218fbb8d349c1a01636234437d7f8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 79561d22ff3f40739c9515a85b78d561 Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '41bb7e90-bb7b-4f99-8e8e-e9cf980b0410'} Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:10.147860 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:33:10.151237 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:10.154254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Returning 404 to user: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:10.156394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07526f8d-968d-4e95-bdfe-841d65bcd97b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 404 len: 111 microversion: 2.1 time: 0.096763 Jul 20 04:33:10.160707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2317/3442] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:33:10.170945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65d52b0b-63c7-4462-9024-b84828121e74 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa2e820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.271586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65d52b0b-63c7-4462-9024-b84828121e74 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1432 microversion: 2.1 time: 0.106860 Jul 20 04:33:10.272507 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2318/3443] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1432 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.283641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.290043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.307316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.309132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.310147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.310793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.470328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.509333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.514400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.528340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70fc0561-0afc-4348-a3f4-fd14ebb97f32 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1605 microversion: 2.32 time: 0.254440 Jul 20 04:33:10.528983 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2319/3444] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:10.549387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fe4a26e2-8556-43de-be3a-246a7ca3929a req-67c2e6b5-dbae-4e85-9ca7-5c82de4f1f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c459f8cc-daf3-41d4-b848-cd2adfd63b6b", "name": "network-vif-deleted", "tag": "3069de66-cec4-49e8-8f1d-cce05e0800eb"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:10.580103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fe4a26e2-8556-43de-be3a-246a7ca3929a req-67c2e6b5-dbae-4e85-9ca7-5c82de4f1f31 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.580861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fe4a26e2-8556-43de-be3a-246a7ca3929a req-67c2e6b5-dbae-4e85-9ca7-5c82de4f1f31 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.610334 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fe4a26e2-8556-43de-be3a-246a7ca3929a req-67c2e6b5-dbae-4e85-9ca7-5c82de4f1f31 service nova] Creating event network-vif-deleted:3069de66-cec4-49e8-8f1d-cce05e0800eb for instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b on n-h2-764486-11 Jul 20 04:33:10.630788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fe4a26e2-8556-43de-be3a-246a7ca3929a req-67c2e6b5-dbae-4e85-9ca7-5c82de4f1f31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084126 Jul 20 04:33:10.634959 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2320/3445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:10.665370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:10.669336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:10.690895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.692138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.692293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:10.692745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:10.951493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:10.980650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acbaec6f-b2f5-4abf-82f1-2b531bb6e15d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1278 microversion: 2.1 time: 0.337122 Jul 20 04:33:10.983582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2321/3446] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:10 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1278 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:10.996877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.003785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 6fab4e55-6343-4beb-afbd-db9b66386de1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.021791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.023863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.027550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.031550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.104010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 6fab4e55-6343-4beb-afbd-db9b66386de1] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:33:11.321739 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62f9013c-f401-4c51-8235-7c8a3eac69d4 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1" status: 204 len: 0 microversion: 2.47 time: 0.334934 Jul 20 04:33:11.325589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2322/3447] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:33:10 2022] DELETE /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:33:11.358051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d173caa-dc99-4023-addf-a3215508fec6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '.version_select at 0x7f838aa2e940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.414536 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d173caa-dc99-4023-addf-a3215508fec6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081859508" status: 202 len: 0 microversion: 2.1 time: 0.077025 Jul 20 04:33:11.422274 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2323/3448] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081859508 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:11.433470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a67c8ab-a12a-453b-a769-1db6e7cd13a5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838ab80670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.544537 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a67c8ab-a12a-453b-a769-1db6e7cd13a5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 200 len: 1432 microversion: 2.1 time: 0.122471 Jul 20 04:33:11.546724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2324/3449] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 1432 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:11.559665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9ce59528-1ead-4b25-89fc-aeb7116244b7 req-a3676911-4c9f-4657-be92-f60140c862d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-plugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}, {"server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "name": "network-vif-unplugged", "status": "completed", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:11.608177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:11.621038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ce59528-1ead-4b25-89fc-aeb7116244b7 req-a3676911-4c9f-4657-be92-f60140c862d2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.621929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ce59528-1ead-4b25-89fc-aeb7116244b7 req-a3676911-4c9f-4657-be92-f60140c862d2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.695720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9ce59528-1ead-4b25-89fc-aeb7116244b7 req-a3676911-4c9f-4657-be92-f60140c862d2 service nova] Creating event network-vif-plugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:33:11.696320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9ce59528-1ead-4b25-89fc-aeb7116244b7 req-a3676911-4c9f-4657-be92-f60140c862d2 service nova] Creating event network-vif-unplugged:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:33:11.714761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9ce59528-1ead-4b25-89fc-aeb7116244b7 req-a3676911-4c9f-4657-be92-f60140c862d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.164246 Jul 20 04:33:11.720326 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2325/3450] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:11.738006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:11.739980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:11.758222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.759341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:11.760852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:11.760852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.820803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:12.831248 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49e115b4-f76f-4d44-901e-537b7a1f7b3f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 1.108071 Jul 20 04:33:12.836682 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2326/3451] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:11 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:12.843153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:12.843977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 6fab4e55-6343-4beb-afbd-db9b66386de1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:12.853458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.854149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:12.855130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:12.855731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.052799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.063467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.065134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a30335ca98a4f41bc7bd9b85a21b941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ab74716e4c4aa19b69cc4d7cd15a24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.066369 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b68617ef-a4a8-431a-97ba-50335be0e625 tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1" status: 200 len: 1362 microversion: 2.47 time: 0.228406 Jul 20 04:33:13.066953 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2327/3452] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:12 2022] GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:13.083295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.084161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.101013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.101727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.103023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.103624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.311237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.348636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.350815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '641b33d2365747b4a558b462a70501fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af573ffe2b1941e3a69707ccf2e85682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:13.356404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80d1aa78-019f-4d07-9d4d-721912c632e4 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 200 len: 1605 microversion: 2.32 time: 0.275582 Jul 20 04:33:13.358414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2328/3453] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 1605 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:13.370934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:13.374923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:13.394254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.398221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.399927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:13.400608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:13.407756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:14.075771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:14.095674 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-290722bc-4775-4d94-a81d-3ca798448c92 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1466 microversion: 2.1 time: 0.732592 Jul 20 04:33:14.096375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2329/3454] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:13 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1466 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:14.106069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.121606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.130559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.132213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.138378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.139047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.671276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:14.693827 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f4c0787-9e90-4063-9b26-1bacb2225e9b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1308 microversion: 2.1 time: 0.588464 Jul 20 04:33:14.694529 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2330/3455] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1308 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:14.718235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:14.720249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:14.737973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.742728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:14.743692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:14.744218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.385438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:15.398344 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa8591ce-0d6b-4fbb-855e-91675fd53fef tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 0.702488 Jul 20 04:33:15.409125 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2331/3456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:14 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:15.414464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.416381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] [instance: 6fab4e55-6343-4beb-afbd-db9b66386de1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.424003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.425541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.426707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.427475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.450448 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] HTTP exception thrown: Instance 6fab4e55-6343-4beb-afbd-db9b66386de1 could not be found. Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Request method failure captured: Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1 HTTP/1.1 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14U5gKI0JrhjNrbMBuMOGi7cDxF9OWK2LHC2UW5-DiV_YurRsNsapVgaDpuxPQjPFAjVOz4b3hdx4_WPHdkrKSX7KWTMrq_R_6Xg6-iYKtGvr05zbo0hjO3-xpGvKfApajB3MBAWlRR8035ydJz2xf9Y0wgkSKh3aUn4dAfueZvPZrM Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 02ab74716e4c4aa19b69cc4d7cd15a24 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerShowV247Test-109055622 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/02ab74716e4c4aa19b69cc4d7cd15a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/02ab74716e4c4aa19b69cc4d7cd15a24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/02ab74716e4c4aa19b69cc4d7cd15a24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_02ab74716e4c4aa19b69cc4d7cd15a24", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerShowV247Test-109055622 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 02ab74716e4c4aa19b69cc4d7cd15a24 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerShowV247Test-109055622 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerShowV247Test-109055622-project Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8a30335ca98a4f41bc7bd9b85a21b941 Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerShowV247Test-109055622-project Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 6fab4e55-6343-4beb-afbd-db9b66386de1 could not be found. Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '6fab4e55-6343-4beb-afbd-db9b66386de1'} Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fab4e55-6343-4beb-afbd-db9b66386de1 could not be found. Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fab4e55-6343-4beb-afbd-db9b66386de1 could not be found. Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:15.454961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fab4e55-6343-4beb-afbd-db9b66386de1 could not be found. Jul 20 04:33:15.458576 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.468813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] Returning 404 to user: Instance 6fab4e55-6343-4beb-afbd-db9b66386de1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:15.469701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa20974b-2d4c-4807-8bbf-13f42a2a8cec tempest-ServerShowV247Test-109055622 tempest-ServerShowV247Test-109055622-project] 10.222.0.49 "GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1" status: 404 len: 111 microversion: 2.47 time: 0.059237 Jul 20 04:33:15.475020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2332/3457] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/6fab4e55-6343-4beb-afbd-db9b66386de1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:33:15.482469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8187389c-a654-49b4-af00-0f2c93c2b0f2 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a9fe5e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.572090 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8187389c-a654-49b4-af00-0f2c93c2b0f2 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/015a4084-97ff-4146-83ba-116b77f93e6a" status: 200 len: 784 microversion: 2.1 time: 0.095745 Jul 20 04:33:15.573023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2333/3458] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/images/015a4084-97ff-4146-83ba-116b77f93e6a => generated 784 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:15.584067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.584722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:15.622111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.624430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.627921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:15.631275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:15.672453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] HTTP exception thrown: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Request method failure captured: Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 HTTP/1.1 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pfxt2klhdSPusUhVLcr8ZEbZC5Ve5W_C9tpjBTv66b_EangsJKxWT_96gHDruaMatOwXwK8mttXV6PLAnZf9jVJ_7wVr3dOek3fF6beXFl2hQSbC905TTWMikm1UtsPTMRtSgODm--zXLoes1QyFRPgz5-RvbIQT0Gd0RK36pPZO8 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: af573ffe2b1941e3a69707ccf2e85682 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af573ffe2b1941e3a69707ccf2e85682", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: af573ffe2b1941e3a69707ccf2e85682 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TaggedBootDevicesTest-209814389-project Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 641b33d2365747b4a558b462a70501fa Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TaggedBootDevicesTest-209814389-project Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd5d2f1aa-ca71-48f1-8fdf-2c664b2eb812'} Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:15.686009 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:15.689464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:15.691668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Returning 404 to user: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:15.693030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-028bf4a8-c378-4fe6-93a4-dd814967e80c tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 404 len: 111 microversion: 2.32 time: 0.118559 Jul 20 04:33:15.699032 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2334/3459] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:33:15.710858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56c148f3-4eee-4339-96e9-831c2d601b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: .version_select at 0x7f838a9fe940>, body: {"keypair": {"name": "tempest-keypair-774960791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWv8Kp7cGfz4Ufp59MChLV3XDUZe/xW3D98LfEPw24OYenLKQqI4bXA0sIQm4q+sArjsOLmT6cbiPhzBxWnIufFCST9ec9StQ4JzJ067RGmOCWpP8SB6c7+W9BqpJoKRQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:15.761416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-56c148f3-4eee-4339-96e9-831c2d601b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for project fc0218fbb8d349c1a01636234437d7f8. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:15.772230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-56c148f3-4eee-4339-96e9-831c2d601b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for user 79561d22ff3f40739c9515a85b78d561 and project fc0218fbb8d349c1a01636234437d7f8. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:15.860785 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56c148f3-4eee-4339-96e9-831c2d601b47 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158016 Jul 20 04:33:15.868948 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2335/3460] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:33:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:15.885192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cb40347-a48b-4b75-8396-be871c887fde tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.910296 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cb40347-a48b-4b75-8396-be871c887fde tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037703 Jul 20 04:33:15.919282 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2336/3461] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:15.938211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6216c365-b872-451b-b6d6-56fc12a87a7d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '.version_select at 0x7f838aa2ec10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:15.992547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6216c365-b872-451b-b6d6-56fc12a87a7d tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014130127" status: 204 len: 0 microversion: 2.32 time: 0.070633 Jul 20 04:33:15.996428 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2337/3462] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:33:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014130127 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:33:16.006861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:16.007699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:16.017174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.017835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.018874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.019458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.723702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:16.738121 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cfd3069a-ddc0-4724-9a73-44b84a9f4c0b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1308 microversion: 2.1 time: 0.739605 Jul 20 04:33:16.739063 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2338/3463] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:15 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1308 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:16.753210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-be5aea47-7d2d-4908-a7e1-5f2ca03360a9 req-1976b1a7-9597-407f-b446-8b8f8fd2478b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3", "tag": "ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:16.775351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-be5aea47-7d2d-4908-a7e1-5f2ca03360a9 req-1976b1a7-9597-407f-b446-8b8f8fd2478b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:16.784564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-be5aea47-7d2d-4908-a7e1-5f2ca03360a9 req-1976b1a7-9597-407f-b446-8b8f8fd2478b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:16.817394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-be5aea47-7d2d-4908-a7e1-5f2ca03360a9 req-1976b1a7-9597-407f-b446-8b8f8fd2478b service nova] Creating event network-changed:ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a for instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 on n-h1-764486-11 Jul 20 04:33:16.844925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-be5aea47-7d2d-4908-a7e1-5f2ca03360a9 req-1976b1a7-9597-407f-b446-8b8f8fd2478b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100839 Jul 20 04:33:16.850455 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2339/3464] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:16.872647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d0b9afd-6cdb-4c40-b21c-254643dec40f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aafb1f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.339483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:18.638544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d0b9afd-6cdb-4c40-b21c-254643dec40f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "DELETE /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 204 len: 0 microversion: 2.1 time: 1.784486 Jul 20 04:33:18.639136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2340/3465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:16 2022] DELETE /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 0 bytes in 1788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:33:18.647520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:18.648273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:18.655425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.656118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:18.657245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:18.657831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.814014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:19.829584 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ab2e0db-9ce4-40bc-9684-9741939a2eb6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 1.188667 Jul 20 04:33:19.831931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2341/3466] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:18 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:19.839235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:19.840220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:19.856840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.857282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:19.864035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:19.864687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.803554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:20.856053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9eafb0f9-a732-40cf-a3ec-7b5f4f57a7f8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1308 microversion: 2.1 time: 1.014677 Jul 20 04:33:20.872139 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2342/3467] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:19 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1308 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:20.878500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d3a4745-d44d-4429-b28a-dbd2a160a45b tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa11670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.907292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5d3a4745-d44d-4429-b28a-dbd2a160a45b tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] HTTP exception thrown: Image not found. Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d3a4745-d44d-4429-b28a-dbd2a160a45b tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Request method failure captured: Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 HTTP/1.1 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14VL2K9YnwUFNAXEOLuYQerwo14DnKZ-iKvqY6kboQgaj_0x2uB8seCNr3AVOYihNcRBgF2wsEJ5LzGtPTTN_OIrp7Z7Srz8cmTcJ6Q46rtckUUeIPhnO14KnAk8yclu6flf75Lu3OS6wbWeP1TNxSpBDrTGrHKXpfCC_qHkf3I-OlY Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ddb004aeb3bc44699fad86608c78534c Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ddb004aeb3bc44699fad86608c78534c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ddb004aeb3bc44699fad86608c78534c Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerTestJSON-1256670935-project Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3520aa5b08743b491f53108acb27109 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerTestJSON-1256670935-project Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '46226159-5248-46e4-8bab-218cd865b5c7'} Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46226159-5248-46e4-8bab-218cd865b5c7 Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:33:20.910032 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46226159-5248-46e4-8bab-218cd865b5c7 could not be found. Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:33:20.913636 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:20.922053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d3a4745-d44d-4429-b28a-dbd2a160a45b tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:20.923356 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d3a4745-d44d-4429-b28a-dbd2a160a45b tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 404 len: 62 microversion: 2.1 time: 0.049690 Jul 20 04:33:20.924533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2343/3468] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:33:20.938037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:20.939276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:20.949863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.950722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:20.953776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:20.955396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.649166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:21.660486 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eacffd33-55ec-4d02-87be-0199e07392f1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 0.734625 Jul 20 04:33:21.671651 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2344/3469] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:20 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:21.678980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-694404900"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:21.680342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:21.693583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.709113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:21.716762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:21.717309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.480005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c6266af-46d8-414e-8dc6-e7e3a5477616 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "POST /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc/action" status: 202 len: 0 microversion: 2.1 time: 0.806633 Jul 20 04:33:22.480693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2345/3470] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:21 2022] POST /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc/action => generated 0 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:33:22.505662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:22.515659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:22.538983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.541247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.543655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:22.546608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:22.958317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:22.973723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7acb7e3-10c8-4c84-b49a-bce674a78a60 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1308 microversion: 2.1 time: 0.482975 Jul 20 04:33:22.974660 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2346/3471] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:22 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:22.985648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1932651417", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12b10d7a-3706-4719-af72-2f1054872ab5"}], "security_groups": [{"name": "tempest-securitygroup--275508151"}], "key_name": "tempest-keypair-774960791", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:23.170725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] validate_networks() for [('12b10d7a-3706-4719-af72-2f1054872ab5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:24.361418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:24.362207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:24.362711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:24.363118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:24.363542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:24.382412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=13 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:24.384096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.384599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.385429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.396431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.459975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for project fc0218fbb8d349c1a01636234437d7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:24.489274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Getting quotas for user 79561d22ff3f40739c9515a85b78d561 and project fc0218fbb8d349c1a01636234437d7f8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:24.525755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:24.528884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:24.630663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8bf031a-604f-412e-9894-b1c52e344c62 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.654822 Jul 20 04:33:24.636727 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2347/3472] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:33:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:33:24.642591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44389d8d-aa1e-4662-b0b7-fb7e0f1cacc7 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa2e310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.788142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44389d8d-aa1e-4662-b0b7-fb7e0f1cacc7 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1428 microversion: 2.1 time: 0.149678 Jul 20 04:33:24.788842 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2348/3473] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1428 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:24.803961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:24.805104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:24.812020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.816187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:24.824899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:24.825627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.801182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:25.814279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d73ebb9c-581a-4d06-b240-370b54b66cdc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 1.024122 Jul 20 04:33:25.819442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2349/3474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:24 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:25.836686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:25.838130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:25.862278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.864155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:25.865898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:25.867600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.511733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.525225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-968ba02e-cc05-4fa5-a871-78e07eacc554 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1308 microversion: 2.1 time: 0.704266 Jul 20 04:33:26.525749 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2350/3475] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:25 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:26.553318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:26.556691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:26.579789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.587288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.590087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:26.593680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:26.918199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:26.935317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e06653f-b969-4f31-a367-80e6b6f51830 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1289 microversion: 2.1 time: 0.400158 Jul 20 04:33:26.948724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2351/3476] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:26 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1289 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:26.977758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4bf279cd-b747-41a0-8348-f1e488d0b943 req-b2c466a2-3837-4199-9b72-7e18019c8c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3", "name": "network-vif-plugged", "status": "completed", "tag": "ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:27.020729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4bf279cd-b747-41a0-8348-f1e488d0b943 req-b2c466a2-3837-4199-9b72-7e18019c8c16 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:27.021207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4bf279cd-b747-41a0-8348-f1e488d0b943 req-b2c466a2-3837-4199-9b72-7e18019c8c16 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:27.077370 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4bf279cd-b747-41a0-8348-f1e488d0b943 req-b2c466a2-3837-4199-9b72-7e18019c8c16 service nova] Creating event network-vif-plugged:ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a for instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 on n-h1-764486-11 Jul 20 04:33:27.107223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4bf279cd-b747-41a0-8348-f1e488d0b943 req-b2c466a2-3837-4199-9b72-7e18019c8c16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156438 Jul 20 04:33:27.114145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2352/3477] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:27.145647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac22526b-3c60-4662-bc60-51be4373052f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a98d940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.443026 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac22526b-3c60-4662-bc60-51be4373052f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1428 microversion: 2.1 time: 6.322670 Jul 20 04:33:33.453254 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2353/3478] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:27 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1428 bytes in 6337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:33.475197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:33.476655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:33.488329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.489503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:33.491270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:33.491882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.314987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:34.341796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3906f8a-2d58-4e93-a05f-2b0a051e2319 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1682 microversion: 2.1 time: 0.886072 Jul 20 04:33:34.351956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2354/3479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:33 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1682 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:34.375682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:34.399035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:34.451608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:34.464222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.464924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.466659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:34.467279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:34.523246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=5 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:35.634517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:35.642355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:35.673891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c45882d2-1819-49cd-880a-6c23af47798b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1488 microversion: 2.1 time: 1.327050 Jul 20 04:33:35.681097 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2355/3480] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:34 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1488 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.169607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.173196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.196574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.197727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.199336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.199939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.672639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:36.685597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22966bf4-ba06-4a88-af39-9897b9d80945 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1362 microversion: 2.1 time: 1.001936 Jul 20 04:33:36.690065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2356/3481] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:35 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1362 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.697207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.705187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:36.715118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.715836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.716887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.717428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.757829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] HTTP exception thrown: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Request method failure captured: Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 HTTP/1.1 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pfxt2klhdSPusUhVLcr8ZEbZC5Ve5W_C9tpjBTv66b_EangsJKxWT_96gHDruaMatOwXwK8mttXV6PLAnZf9jVJ_7wVr3dOek3fF6beXFl2hQSbC905TTWMikm1UtsPTMRtSgODm--zXLoes1QyFRPgz5-RvbIQT0Gd0RK36pPZO8 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: af573ffe2b1941e3a69707ccf2e85682 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af573ffe2b1941e3a69707ccf2e85682", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: af573ffe2b1941e3a69707ccf2e85682 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TaggedBootDevicesTest-209814389-project Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 641b33d2365747b4a558b462a70501fa Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TaggedBootDevicesTest-209814389-project Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd5d2f1aa-ca71-48f1-8fdf-2c664b2eb812'} Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:36.759940 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:36.764447 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:36.768533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Returning 404 to user: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:36.769718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66a87ee5-16ec-491d-9e9e-d1268c0c3b71 tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 404 len: 111 microversion: 2.32 time: 0.078394 Jul 20 04:33:36.770828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2357/3482] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:33:36 2022] DELETE /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:33:36.778407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2ec61c36-4d99-459f-b1f4-1fcf200bbc4f req-3aa02955-a5f6-4614-8382-17bdf5f8d1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "name": "network-vif-plugged", "status": "completed", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:36.802639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2ec61c36-4d99-459f-b1f4-1fcf200bbc4f req-3aa02955-a5f6-4614-8382-17bdf5f8d1c7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.803446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2ec61c36-4d99-459f-b1f4-1fcf200bbc4f req-3aa02955-a5f6-4614-8382-17bdf5f8d1c7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:36.828421 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2ec61c36-4d99-459f-b1f4-1fcf200bbc4f req-3aa02955-a5f6-4614-8382-17bdf5f8d1c7 service nova] Creating event network-vif-plugged:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:33:36.842263 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2ec61c36-4d99-459f-b1f4-1fcf200bbc4f req-3aa02955-a5f6-4614-8382-17bdf5f8d1c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069906 Jul 20 04:33:36.843207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2358/3483] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:36.848723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4d66637-b76d-4d40-9478-51e0f82ce090 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a9fcee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:36.933462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4d66637-b76d-4d40-9478-51e0f82ce090 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1428 microversion: 2.1 time: 0.088919 Jul 20 04:33:36.934375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2359/3484] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:36 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:36.939091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b78b7493-4634-4fd7-9547-93dfa8d1059f req-d6d54e04-7a43-40ba-9084-2524b534ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49223de1-2911-48d3-bc3a-1e7785c3f47d", "tag": "16828c7b-37af-41fd-a135-4b1af8510a95"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:36.962678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b78b7493-4634-4fd7-9547-93dfa8d1059f req-d6d54e04-7a43-40ba-9084-2524b534ae98 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:36.964443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b78b7493-4634-4fd7-9547-93dfa8d1059f req-d6d54e04-7a43-40ba-9084-2524b534ae98 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.007643 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b78b7493-4634-4fd7-9547-93dfa8d1059f req-d6d54e04-7a43-40ba-9084-2524b534ae98 service nova] Creating event network-changed:16828c7b-37af-41fd-a135-4b1af8510a95 for instance 49223de1-2911-48d3-bc3a-1e7785c3f47d on n-h2-764486-11 Jul 20 04:33:37.055821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b78b7493-4634-4fd7-9547-93dfa8d1059f req-d6d54e04-7a43-40ba-9084-2524b534ae98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097824 Jul 20 04:33:37.065056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2360/3485] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:37.079879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:37.081544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:37.097428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.099353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:37.104976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:37.105926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.041655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:38.057085 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7364d658-3a48-4c3f-a5a6-091231afebbb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.989488 Jul 20 04:33:38.071507 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2361/3486] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:37 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:38.082870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:38.083751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.097372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.098087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.099060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.100013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.138303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lazy-loading 'flavor' on Instance uuid f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:33:38.338921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9133577f-1a38-48b4-a2f9-53a6fa047abe tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3/action" status: 202 len: 0 microversion: 2.1 time: 0.263982 Jul 20 04:33:38.343923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2362/3487] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:38 2022] POST /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:38.356002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.356784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] [instance: d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.370573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.374763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.375735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.376045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.409998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] HTTP exception thrown: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Request method failure captured: Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 HTTP/1.1 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Pfxt2klhdSPusUhVLcr8ZEbZC5Ve5W_C9tpjBTv66b_EangsJKxWT_96gHDruaMatOwXwK8mttXV6PLAnZf9jVJ_7wVr3dOek3fF6beXFl2hQSbC905TTWMikm1UtsPTMRtSgODm--zXLoes1QyFRPgz5-RvbIQT0Gd0RK36pPZO8 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: af573ffe2b1941e3a69707ccf2e85682 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af573ffe2b1941e3a69707ccf2e85682"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af573ffe2b1941e3a69707ccf2e85682", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: af573ffe2b1941e3a69707ccf2e85682 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TaggedBootDevicesTest-209814389 Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TaggedBootDevicesTest-209814389-project Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 641b33d2365747b4a558b462a70501fa Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TaggedBootDevicesTest-209814389-project Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd5d2f1aa-ca71-48f1-8fdf-2c664b2eb812'} Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:33:38.412503 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] Returning 404 to user: Instance d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3092fbae-0864-410d-91eb-b2e68abec9fe tempest-TaggedBootDevicesTest-209814389 tempest-TaggedBootDevicesTest-209814389-project] 10.222.0.49 "GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812" status: 404 len: 111 microversion: 2.32 time: 0.068655 Jul 20 04:33:38.415883 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2363/3488] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/d5d2f1aa-ca71-48f1-8fdf-2c664b2eb812 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:33:38.450716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:38.453252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:38.469883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.470588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:38.472249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:38.472945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:39.856713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:39.872866 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e35d1349-8751-49f0-8855-98dae8b99ea2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1362 microversion: 2.1 time: 1.432357 Jul 20 04:33:39.874068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2364/3489] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:38 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1362 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:39.879647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30db5322-5011-4466-a655-dec7238f7477 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a9fcf70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:39.972602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30db5322-5011-4466-a655-dec7238f7477 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1428 microversion: 2.1 time: 0.097011 Jul 20 04:33:39.980493 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2365/3490] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:39 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:39.985933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:39.991564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:40.006753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.007491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.008755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:40.009346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:40.971327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:40.996286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad278c59-0252-4d0a-b1b9-a6dbb57935b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 200 len: 1479 microversion: 2.1 time: 0.998651 Jul 20 04:33:41.002289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2366/3491] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:39 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 1479 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:41.010752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.026659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.045277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.048938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.049977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.053803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.610830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:41.621414 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c39827f8-72c9-4567-9d7b-328ce8935d1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.617770 Jul 20 04:33:41.623029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2367/3492] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:41.628345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-aea529a2-24ef-4c11-9844-2b9ddaffe9e5 req-86e4d580-91c8-4910-bb66-a63acf6adf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-unplugged", "status": "completed", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:41.640058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:41.642677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-aea529a2-24ef-4c11-9844-2b9ddaffe9e5 req-86e4d580-91c8-4910-bb66-a63acf6adf90 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.643302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-aea529a2-24ef-4c11-9844-2b9ddaffe9e5 req-86e4d580-91c8-4910-bb66-a63acf6adf90 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.660237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-aea529a2-24ef-4c11-9844-2b9ddaffe9e5 req-86e4d580-91c8-4910-bb66-a63acf6adf90 service nova] Creating event network-vif-unplugged:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:33:41.667322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-aea529a2-24ef-4c11-9844-2b9ddaffe9e5 req-86e4d580-91c8-4910-bb66-a63acf6adf90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042852 Jul 20 04:33:41.668415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2368/3493] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:41.734328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06294248-402c-4c57-abe3-96d36ace5d39 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'create', calling method: .version_select at 0x7f838a9d2820>, body: {"keypair": {"name": "tempest-keypair-404177568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkBBKNB+Z2EheVPbVivT46lmbfvu96UZ1minITX4NXr0rH3q2d4PMzUWHyCEd6nGw46OobFFGp1nGhLxicUvpMl33SpsOS7joo2Oj4HKW14u/5TAibtRA5X+VNiFBZo7w=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:41.752749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-06294248-402c-4c57-abe3-96d36ace5d39 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:41.762531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-06294248-402c-4c57-abe3-96d36ace5d39 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for user b270c9997f31458ca90746e7dd495e78 and project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:41.820834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06294248-402c-4c57-abe3-96d36ace5d39 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.151012 Jul 20 04:33:41.821803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2369/3494] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:33:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:33:41.837260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:41.841204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:41.875102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.875575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:41.876431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:41.876878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:42.197586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:42.222287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6eb762c5-4061-4da2-8941-35637acec537 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1362 microversion: 2.1 time: 0.391319 Jul 20 04:33:42.225698 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2370/3495] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:41 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:42.242513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86d87e2c-557c-4cad-a684-a4cd3d9cac02 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa11dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:44.090464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86d87e2c-557c-4cad-a684-a4cd3d9cac02 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1428 microversion: 2.1 time: 1.860756 Jul 20 04:33:44.091861 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2371/3496] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:42 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1428 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:44.112453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-456273380"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:44.120560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:44.150489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.152392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:44.158175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:44.158869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.071398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d2b95d6-69b5-45b9-a588-065047c81a68 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3/action" status: 202 len: 0 microversion: 2.1 time: 0.972307 Jul 20 04:33:45.082333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2372/3497] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:44 2022] POST /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3/action => generated 0 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:33:45.096247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:45.111658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:45.130425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.132158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:45.134511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:45.140446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.634436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:46.647015 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a6b674b-b9ab-4476-a1ec-e10bde32915c tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1362 microversion: 2.1 time: 1.555061 Jul 20 04:33:46.648121 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2373/3498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:45 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1362 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:46.653227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ed7af78f-909d-4d12-8054-21c3974feacc req-8f5f7823-8d2d-4937-ba87-d7bcde6ecbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49223de1-2911-48d3-bc3a-1e7785c3f47d", "name": "network-vif-plugged", "status": "completed", "tag": "16828c7b-37af-41fd-a135-4b1af8510a95"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:46.709916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed7af78f-909d-4d12-8054-21c3974feacc req-8f5f7823-8d2d-4937-ba87-d7bcde6ecbd7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.715034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed7af78f-909d-4d12-8054-21c3974feacc req-8f5f7823-8d2d-4937-ba87-d7bcde6ecbd7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.729374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ed7af78f-909d-4d12-8054-21c3974feacc req-8f5f7823-8d2d-4937-ba87-d7bcde6ecbd7 service nova] Creating event network-vif-plugged:16828c7b-37af-41fd-a135-4b1af8510a95 for instance 49223de1-2911-48d3-bc3a-1e7785c3f47d on n-h2-764486-11 Jul 20 04:33:46.758304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ed7af78f-909d-4d12-8054-21c3974feacc req-8f5f7823-8d2d-4937-ba87-d7bcde6ecbd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108755 Jul 20 04:33:46.765093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2374/3499] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:46.784580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:46.797456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:46.823590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.824279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:46.826841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:46.827440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.465011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:47.478606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-501095cb-2572-4f56-b778-2a08153ef4eb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.702930 Jul 20 04:33:47.481329 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2375/3500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:46 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:47.494634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2895906b-492b-42f1-8694-0b7f40369abd tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a9d2310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.629593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2895906b-492b-42f1-8694-0b7f40369abd tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.144824 Jul 20 04:33:47.630879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2376/3501] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:47.646201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db9f6d92-b283-4915-9915-ac786f877a00 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a9fcc10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.832585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db9f6d92-b283-4915-9915-ac786f877a00 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1428 microversion: 2.1 time: 0.198708 Jul 20 04:33:47.833884 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2377/3502] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1428 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:47.850332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:47.855287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:47.878950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.879667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:47.888067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:47.888873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:48.257931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:48.282730 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-728f9db0-e9f0-4408-9f54-f2be61752ed5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.445759 Jul 20 04:33:48.285467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2378/3503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:47 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:48.305437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1791939927", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42d377c-cf53-473d-9e23-9ada58f0afec"}], "security_groups": [{"name": "tempest-securitygroup--1820633905"}], "key_name": "tempest-keypair-404177568", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:51.775127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:54.706748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] validate_networks() for [('a42d377c-cf53-473d-9e23-9ada58f0afec', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:33:55.702566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:33:55.702944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:33:55.703425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:33:55.707243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:33:55.707826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:33:55.730610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.732170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.733163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:55.733765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:55.779771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:33:55.789707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for user b270c9997f31458ca90746e7dd495e78 and project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:33:55.827629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:33:55.831831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:33:55.953961 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1497f69-7665-418f-a964-cd5148f2899f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 7.667176 Jul 20 04:33:55.957131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2379/3504] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:33:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 7671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:33:55.974222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:55.975134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:55.994021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.001237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.006314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.007164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.027032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:33:56.706260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:56.719884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d684b41-bd70-4f34-8090-40c389af7a05 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1547 microversion: 2.1 time: 0.760653 Jul 20 04:33:56.724774 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2380/3505] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:55 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1547 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:56.739887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:56.746139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:56.772965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.773433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:56.774198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:56.774630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.465840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:57.479397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00ccd763-f8d3-4021-944b-56821d4d9c04 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.748774 Jul 20 04:33:57.480296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2381/3506] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:56 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:57.489801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1c4d396-3946-495f-9e6a-9abd39993ff0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a98d160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.595572 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1c4d396-3946-495f-9e6a-9abd39993ff0 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.112849 Jul 20 04:33:57.596500 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2382/3507] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:57.606026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e51fe6c-7930-4326-8e9c-b701b28c74bb tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a9fcf70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.725992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e51fe6c-7930-4326-8e9c-b701b28c74bb tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1437 microversion: 2.1 time: 0.124613 Jul 20 04:33:57.733655 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2383/3508] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:57.734934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-45ad2280-262b-440d-910a-be6365412158 req-86ea5070-be76-4e85-8b28-a05e97c1bc5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3", "name": "network-vif-plugged", "status": "completed", "tag": "ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:57.760802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45ad2280-262b-440d-910a-be6365412158 req-86ea5070-be76-4e85-8b28-a05e97c1bc5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.761439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45ad2280-262b-440d-910a-be6365412158 req-86ea5070-be76-4e85-8b28-a05e97c1bc5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.813452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-45ad2280-262b-440d-910a-be6365412158 req-86ea5070-be76-4e85-8b28-a05e97c1bc5f service nova] Creating event network-vif-plugged:ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a for instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 on n-h1-764486-11 Jul 20 04:33:57.834908 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-45ad2280-262b-440d-910a-be6365412158 req-86ea5070-be76-4e85-8b28-a05e97c1bc5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106101 Jul 20 04:33:57.841002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2384/3509] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:57.856902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:57.862656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:57.889089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.890649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:57.892617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:57.895063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.424450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.461509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.465535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:33:58.468657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c0292a8-28e0-4f3b-9a83-649e20452408 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1333 microversion: 2.20 time: 0.626057 Jul 20 04:33:58.482154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2385/3510] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:33:57 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1333 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:33:58.493460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:58.505151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.518972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.520326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.522726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.523390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.696037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a4c492b-74cc-46b4-abbb-ecd68621b5a3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.212122 Jul 20 04:33:58.697018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2386/3511] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:33:58.702847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:33:58.703970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:58.719421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.723117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.725490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:58.726762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:58.909099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e99defe7-dfe0-4604-9c11-1444c2cd2365 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.210345 Jul 20 04:33:58.910153 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2387/3512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:33:58 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:33:58.921390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c434ce4b-02da-45c1-a38e-b83a2d186591 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838a9d2ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.044069 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c434ce4b-02da-45c1-a38e-b83a2d186591 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 200 len: 1437 microversion: 2.1 time: 0.132473 Jul 20 04:33:59.045268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2388/3513] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:58 2022] GET /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 1437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:59.057803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc977ded-d291-4dac-8b67-c649120fc690 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a98ddc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.148578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc977ded-d291-4dac-8b67-c649120fc690 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.100161 Jul 20 04:33:59.149351 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2389/3514] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:33:59.169489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:33:59.171972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:33:59.190183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.190988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.193105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:33:59.193929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:33:59.992729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:00.006635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1cddf5ac-4363-4709-a122-cbd3ee4a56bf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1671 microversion: 2.1 time: 0.852263 Jul 20 04:34:00.007793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2390/3515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:33:59 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1671 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:00.025649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:00.026492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:00.048109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.060110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:00.061236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:00.066870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.470813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.485252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19a7da62-c80d-4d29-901d-d17f5ce61489 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1466 microversion: 2.1 time: 2.469934 Jul 20 04:34:02.489532 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2391/3516] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:00 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1466 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:02.498951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:02.499566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:02.548839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.549657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.550730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:02.551382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:02.833787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.866107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.873941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:02.876221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19e27933-6ed3-43b8-b27c-20f84352d43b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1339 microversion: 2.20 time: 0.385610 Jul 20 04:34:02.879392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2392/3517] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1339 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:02.903472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82bb5bad-4bf3-4260-a3dc-29b682201de7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a99eee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.031043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82bb5bad-4bf3-4260-a3dc-29b682201de7 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.148364 Jul 20 04:34:03.031632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2393/3518] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:02 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:03.057685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cba9749c-c36a-4e3d-ab1f-be9d8ca90b20 req-7a8c5210-e211-473e-a494-c5b0e6e15854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "name": "network-vif-unplugged", "status": "completed", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:03.124343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cba9749c-c36a-4e3d-ab1f-be9d8ca90b20 req-7a8c5210-e211-473e-a494-c5b0e6e15854 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.124829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cba9749c-c36a-4e3d-ab1f-be9d8ca90b20 req-7a8c5210-e211-473e-a494-c5b0e6e15854 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.162410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cba9749c-c36a-4e3d-ab1f-be9d8ca90b20 req-7a8c5210-e211-473e-a494-c5b0e6e15854 service nova] Creating event network-vif-unplugged:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:34:03.204895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cba9749c-c36a-4e3d-ab1f-be9d8ca90b20 req-7a8c5210-e211-473e-a494-c5b0e6e15854 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154959 Jul 20 04:34:03.209889 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2394/3519] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:03.244690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:03.245514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:03.282377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.282839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:03.283643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:03.284091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:04.244614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:04.264522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d24fe45-3581-4fc8-99b2-8e2c2ef48dd4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1671 microversion: 2.1 time: 1.045789 Jul 20 04:34:04.265052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2395/3520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:03 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1671 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:04.298050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5cc3963-9562-4d7b-9db6-064f27d6277a tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa119d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:05.756397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:05.810643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:06.005327 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5cc3963-9562-4d7b-9db6-064f27d6277a tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "DELETE /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d" status: 204 len: 0 microversion: 2.1 time: 1.731719 Jul 20 04:34:06.006034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2396/3521] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:04 2022] DELETE /compute/v2.1/images/02643194-5293-42b3-aa48-a31e5ca4a95d => generated 0 bytes in 1733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:06.034736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.039696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.058947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.059644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.060624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.064615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.590525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.610420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.616826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:06.621972 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bc0eff1-8101-4885-bf2b-0eff6d6d1461 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 0.612411 Jul 20 04:34:06.626012 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2397/3522] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:06.654632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f348acde-7089-4924-908f-94b7372b4b8a tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a99e940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.794393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f348acde-7089-4924-908f-94b7372b4b8a tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.160876 Jul 20 04:34:06.798914 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2398/3523] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:06.813702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:06.819754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:06.840582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.841912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:06.843297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:06.843835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.198244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:07.215116 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbfc93ee-2627-45ef-8ee1-b0fa3c561d45 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.409667 Jul 20 04:34:07.215909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2399/3524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:06 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:07.252439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2dc3a3b5-2ffd-488f-ac90-b75471b0fdac req-8c838b5d-e526-4bb2-8dd3-529cc0f9275a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49223de1-2911-48d3-bc3a-1e7785c3f47d", "tag": "16828c7b-37af-41fd-a135-4b1af8510a95"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:07.280467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2dc3a3b5-2ffd-488f-ac90-b75471b0fdac req-8c838b5d-e526-4bb2-8dd3-529cc0f9275a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.280915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2dc3a3b5-2ffd-488f-ac90-b75471b0fdac req-8c838b5d-e526-4bb2-8dd3-529cc0f9275a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.319271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2dc3a3b5-2ffd-488f-ac90-b75471b0fdac req-8c838b5d-e526-4bb2-8dd3-529cc0f9275a service nova] Creating event network-changed:16828c7b-37af-41fd-a135-4b1af8510a95 for instance 49223de1-2911-48d3-bc3a-1e7785c3f47d on n-h2-764486-11 Jul 20 04:34:07.334904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2dc3a3b5-2ffd-488f-ac90-b75471b0fdac req-8c838b5d-e526-4bb2-8dd3-529cc0f9275a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099811 Jul 20 04:34:07.343199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2400/3525] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:07.361963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-988b1bf2-3542-4a18-b063-9a0f3c65dfc5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '.version_select at 0x7f838aa2e550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:07.410378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-988b1bf2-3542-4a18-b063-9a0f3c65dfc5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] HTTP exception thrown: Image not found. Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-988b1bf2-3542-4a18-b063-9a0f3c65dfc5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Request method failure captured: Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 HTTP/1.1 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14VL2K9YnwUFNAXEOLuYQerwo14DnKZ-iKvqY6kboQgaj_0x2uB8seCNr3AVOYihNcRBgF2wsEJ5LzGtPTTN_OIrp7Z7Srz8cmTcJ6Q46rtckUUeIPhnO14KnAk8yclu6flf75Lu3OS6wbWeP1TNxSpBDrTGrHKXpfCC_qHkf3I-OlY Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ddb004aeb3bc44699fad86608c78534c Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ddb004aeb3bc44699fad86608c78534c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ddb004aeb3bc44699fad86608c78534c Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerTestJSON-1256670935-project Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3520aa5b08743b491f53108acb27109 Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerTestJSON-1256670935-project Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '46226159-5248-46e4-8bab-218cd865b5c7'} Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 46226159-5248-46e4-8bab-218cd865b5c7 to delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46226159-5248-46e4-8bab-218cd865b5c7 could not be found. Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.412619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:34:07.416873 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:07.419170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-988b1bf2-3542-4a18-b063-9a0f3c65dfc5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:07.420215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-988b1bf2-3542-4a18-b063-9a0f3c65dfc5 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "DELETE /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7" status: 404 len: 62 microversion: 2.1 time: 0.075930 Jul 20 04:34:07.421288 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2401/3526] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:07 2022] DELETE /compute/v2.1/images/46226159-5248-46e4-8bab-218cd865b5c7 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:34:07.426467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:07.434171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:07.459695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.466647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.467776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.468453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.587659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b88bfd9-4c84-4d7c-b88c-df9835429757 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 200 len: 322 microversion: 2.1 time: 0.164240 Jul 20 04:34:07.588873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2402/3527] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:07 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:07.600287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:07.602699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:07.618319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.620527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.623616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:07.626800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:07.694503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:07.969265 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ba5c68e-9af3-4a9d-bf93-7730daa0d04f tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 204 len: 0 microversion: 2.1 time: 0.373503 Jul 20 04:34:07.971300 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2403/3528] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:07 2022] DELETE /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:07.984989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:07.986933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.019886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.020341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.024622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.025076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.778258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:08.784078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:08.803385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bfff19ba-7822-4b98-972e-3664f00f346b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.825107 Jul 20 04:34:08.805207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2404/3529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:07 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:08.828988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:08.829612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:08.858344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.859257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:08.860463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:08.861106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.396916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:09.413484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:09.419141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:09.420639 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93cd0675-29b4-407a-85be-13c0cf554af0 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 0.614422 Jul 20 04:34:09.421419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2405/3530] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:08 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:09.432589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3921b45-eecb-4d16-98e9-bb8fddb4aeff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a98d1f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:09.516747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3921b45-eecb-4d16-98e9-bb8fddb4aeff tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.094294 Jul 20 04:34:09.517345 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2406/3531] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:09 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:09.526405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:09.527017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:09.572907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.573369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:09.574190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:09.574695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.580434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3520aa5b08743b491f53108acb27109', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb004aeb3bc44699fad86608c78534c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:10.596044 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51a00836-7b1f-49f1-b3ce-1b88833b3ab6 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 200 len: 1472 microversion: 2.1 time: 1.075469 Jul 20 04:34:10.596810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2407/3532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:09 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 1472 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:10.605092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:10.609049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:10.628711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.629542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:10.633220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:10.634014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.237220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:11.249781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33f4f1ef-24ab-40d1-914c-1ed580e24122 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.651381 Jul 20 04:34:11.253433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2408/3533] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:10 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:11.264683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3cf7a3d0-afad-4b0f-a44b-577a5745a5f4 req-5c312867-03b4-4ad3-a2e4-71f3fc399fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:11.285072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3cf7a3d0-afad-4b0f-a44b-577a5745a5f4 req-5c312867-03b4-4ad3-a2e4-71f3fc399fb5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.285517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3cf7a3d0-afad-4b0f-a44b-577a5745a5f4 req-5c312867-03b4-4ad3-a2e4-71f3fc399fb5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.312887 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3cf7a3d0-afad-4b0f-a44b-577a5745a5f4 req-5c312867-03b4-4ad3-a2e4-71f3fc399fb5 service nova] Creating event network-changed:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h1-764486-11 Jul 20 04:34:11.321322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3cf7a3d0-afad-4b0f-a44b-577a5745a5f4 req-5c312867-03b4-4ad3-a2e4-71f3fc399fb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066010 Jul 20 04:34:11.330193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2409/3534] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:11.335941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:11.341439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:11.351126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.352189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:11.355992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:11.356726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.353942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.364484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.387142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:12.388792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02b45e81-7dda-4361-8766-7ef87991276a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 1.057262 Jul 20 04:34:12.400653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2410/3535] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:11 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:12.419203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edba0f11-e359-43eb-aef2-564f476b6553 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aa6bb80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.553482 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edba0f11-e359-43eb-aef2-564f476b6553 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.143248 Jul 20 04:34:12.554683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2411/3536] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:12.577715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:12.582867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:12.585870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:12.607789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.608453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:12.609482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:12.610101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.491952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:13.501979 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a1cf787-b61e-4f21-a38c-9d55bbedfd30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.945965 Jul 20 04:34:13.512745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2412/3537] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:12 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:13.522596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.523204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] [instance: 10ce9d03-b23f-4b04-b6c7-7e613671a7fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.578434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.588992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.599089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.599764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.660646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] HTTP exception thrown: Instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc could not be found. Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Request method failure captured: Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc HTTP/1.1 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14VL2K9YnwUFNAXEOLuYQerwo14DnKZ-iKvqY6kboQgaj_0x2uB8seCNr3AVOYihNcRBgF2wsEJ5LzGtPTTN_OIrp7Z7Srz8cmTcJ6Q46rtckUUeIPhnO14KnAk8yclu6flf75Lu3OS6wbWeP1TNxSpBDrTGrHKXpfCC_qHkf3I-OlY Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ddb004aeb3bc44699fad86608c78534c Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddb004aeb3bc44699fad86608c78534c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ddb004aeb3bc44699fad86608c78534c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ddb004aeb3bc44699fad86608c78534c Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1256670935 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesOneServerTestJSON-1256670935-project Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3520aa5b08743b491f53108acb27109 Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesOneServerTestJSON-1256670935-project Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc could not be found. Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '10ce9d03-b23f-4b04-b6c7-7e613671a7fc'} Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc could not be found. Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc could not be found. Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:34:13.663713 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc could not be found. Jul 20 04:34:13.667891 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:34:13.673574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] Returning 404 to user: Instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:34:13.674692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f055083e-0bfd-47ea-9e0f-8df2f0726ab8 tempest-ImagesOneServerTestJSON-1256670935 tempest-ImagesOneServerTestJSON-1256670935-project] 10.222.0.49 "GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc" status: 404 len: 111 microversion: 2.1 time: 0.160593 Jul 20 04:34:13.681449 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2413/3538] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/10ce9d03-b23f-4b04-b6c7-7e613671a7fc => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:34:13.709997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c439783e-7a30-479e-a2ec-5270186318cd req-e82e9c87-a3c6-4813-8e40-e742af23c6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ce9d03-b23f-4b04-b6c7-7e613671a7fc", "name": "network-vif-deleted", "tag": "f43f162e-a946-4fa5-bcc7-65258db8500c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:13.735126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c439783e-7a30-479e-a2ec-5270186318cd req-e82e9c87-a3c6-4813-8e40-e742af23c6fb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.735904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c439783e-7a30-479e-a2ec-5270186318cd req-e82e9c87-a3c6-4813-8e40-e742af23c6fb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.771162 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c439783e-7a30-479e-a2ec-5270186318cd req-e82e9c87-a3c6-4813-8e40-e742af23c6fb service nova] Creating event network-vif-deleted:f43f162e-a946-4fa5-bcc7-65258db8500c for instance 10ce9d03-b23f-4b04-b6c7-7e613671a7fc on n-h2-764486-11 Jul 20 04:34:13.791808 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c439783e-7a30-479e-a2ec-5270186318cd req-e82e9c87-a3c6-4813-8e40-e742af23c6fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098237 Jul 20 04:34:13.795041 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2414/3539] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:13.821613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:13.823088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:13.847081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.849483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:13.862580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:13.865446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.846634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.859245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.876305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:14.877741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c73c5b4a-a849-4807-8b47-674fd1314f05 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 1.081304 Jul 20 04:34:14.888626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2415/3540] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:13 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:14.888626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:14.888626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:14.916143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.925413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:14.928989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:14.941862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.652142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:15.665000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c7d7b06d-9cf2-41be-8ec1-4b5983d48c14 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.784555 Jul 20 04:34:15.668752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2416/3541] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:14 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:15.685923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18f1832a-9d1a-4578-8506-2d24c26dadbc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aa2e160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:15.828655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18f1832a-9d1a-4578-8506-2d24c26dadbc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1437 microversion: 2.1 time: 0.157961 Jul 20 04:34:15.829255 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2417/3542] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:15 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:15.902800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:15.904430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:15.951066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.951826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:15.959139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:15.959928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:16.867524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:16.892406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:16.897576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:16.898772 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94865686-a080-4ea3-84bf-a2e64f48b63a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 1.004580 Jul 20 04:34:16.910867 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2418/3543] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:15 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:34:16.911412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-146119079", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "99a89468-e93b-45f5-b6e7-131721ce1601"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:17.090131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] validate_networks() for [('99a89468-e93b-45f5-b6e7-131721ce1601', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:18.047453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:18.047453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:18.048639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:18.049405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:18.050043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:18.065794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.068726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.070901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.076191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.111488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:18.118861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for user 4d4ae756d3714b598164985ed7d7876c and project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:18.134455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:18.137260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:18.248887 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1ab1351-0584-4216-b597-a8b088a113b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342606 Jul 20 04:34:18.250475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2419/3544] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:18.264484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d694bd5c-18b5-4cb6-bc89-964f981ab13c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a94f700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.367501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d694bd5c-18b5-4cb6-bc89-964f981ab13c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1446 microversion: 2.1 time: 0.110671 Jul 20 04:34:18.368231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2420/3545] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:18.395147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:18.395808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:18.427287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.427748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:18.439123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:18.441168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.463618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.476644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.479363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.486724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96ab0335-a93b-4e00-a780-8ad8e8f2cf63 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 1.108143 Jul 20 04:34:19.487371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2421/3546] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:18 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:19.495344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:19.505500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:19.530772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.536234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.537096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:19.537537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:19.675759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:19.684177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-caa0cf4f-5a31-4470-9e00-d6406ac9c543 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1266 microversion: 2.1 time: 0.192830 Jul 20 04:34:19.687050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2422/3547] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:19 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:19.700230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1aa787b2-c6e8-423a-8be4-bceac305e7a5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a9d23a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:19.781492 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1aa787b2-c6e8-423a-8be4-bceac305e7a5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 200 len: 1446 microversion: 2.1 time: 0.091326 Jul 20 04:34:19.782256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2423/3548] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:19 2022] GET /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:19.794654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f483d38-d9d9-4f41-b5ba-42ba472d6f6b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838a9fc550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:20.849262 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f483d38-d9d9-4f41-b5ba-42ba472d6f6b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 204 len: 0 microversion: 2.1 time: 1.058695 Jul 20 04:34:20.854027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2424/3549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:19 2022] DELETE /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:20.859093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:20.859708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:20.875068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.876966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:20.878334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:20.880226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.292153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:21.307492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:21.309340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:21.310674 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00b30d39-0b7f-4ca5-a229-01786dedc9e5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 0.455625 Jul 20 04:34:21.313377 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2425/3550] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:20 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:21.325953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:21.328024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:21.342196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.342906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.345238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.345962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.476858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:21.489761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-413ebf29-6e0e-4de8-b5ae-1fbcc55c19e8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1272 microversion: 2.1 time: 0.174433 Jul 20 04:34:21.490567 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2426/3551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:21 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:21.496289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:21.497145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:21.504105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.504911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.506105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.506897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.540220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:34:21.684043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-970e613f-1349-4055-8dec-1681c00261d2 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 204 len: 0 microversion: 2.1 time: 0.191712 Jul 20 04:34:21.700092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2427/3552] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:34:21 2022] DELETE /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:34:21.708514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a06c55de-da85-4f6a-af61-a83829f1fece req-7b86ec55-425b-44b2-a9b2-50e6657399c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "name": "network-vif-plugged", "status": "completed", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:21.742202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a06c55de-da85-4f6a-af61-a83829f1fece req-7b86ec55-425b-44b2-a9b2-50e6657399c2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:21.753273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a06c55de-da85-4f6a-af61-a83829f1fece req-7b86ec55-425b-44b2-a9b2-50e6657399c2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:21.784919 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a06c55de-da85-4f6a-af61-a83829f1fece req-7b86ec55-425b-44b2-a9b2-50e6657399c2 service nova] Creating event network-vif-plugged:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h1-764486-11 Jul 20 04:34:21.807058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a06c55de-da85-4f6a-af61-a83829f1fece req-7b86ec55-425b-44b2-a9b2-50e6657399c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102657 Jul 20 04:34:21.807840 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2428/3553] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:21.902890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1211581818", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "109649da-9a7a-4452-acba-cc48e048c55a"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:22.002969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] validate_networks() for [('109649da-9a7a-4452-acba-cc48e048c55a', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:23.972867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:23.974680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:23.975549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:23.976906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:23.978805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:23.996853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.997719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:23.998731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:23.999409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.011486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:24.036069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:24.043550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Getting quotas for user 4fc1acc695b0455cbe8f6ef66145c8aa and project 1b72cee10fd34b7995d955a1647d5ac6. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:24.075387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:24.078806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:24.151477 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50af5917-c446-4621-a352-ab41d1abd1dc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.254565 Jul 20 04:34:24.161615 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2429/3554] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:24.171463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:24.172926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:24.180488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.181286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:24.182567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:24.183217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.478772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.494664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.496214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:25.497429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5dd611d3-5ff3-4aaa-be11-efa01c2d3a71 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1407 microversion: 2.20 time: 1.334379 Jul 20 04:34:25.506002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2430/3555] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:24 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1407 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:25.521314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:25.522073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:25.536114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.538771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:25.539679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:25.540125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.755200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:26.765939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a8d719e-e0f6-4fba-9f39-0422ada36929 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 1.258704 Jul 20 04:34:26.785758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2431/3556] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:25 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:26.800021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-109cfe01-2f48-4120-b83d-e4515e7d546b req-6729c98c-d58b-4bbd-9031-f23e9d81bf3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3", "name": "network-vif-unplugged", "status": "completed", "tag": "ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:26.840438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-109cfe01-2f48-4120-b83d-e4515e7d546b req-6729c98c-d58b-4bbd-9031-f23e9d81bf3f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.850433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-109cfe01-2f48-4120-b83d-e4515e7d546b req-6729c98c-d58b-4bbd-9031-f23e9d81bf3f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.894538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-109cfe01-2f48-4120-b83d-e4515e7d546b req-6729c98c-d58b-4bbd-9031-f23e9d81bf3f service nova] Creating event network-vif-unplugged:ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a for instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 on n-h1-764486-11 Jul 20 04:34:26.926302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-109cfe01-2f48-4120-b83d-e4515e7d546b req-6729c98c-d58b-4bbd-9031-f23e9d81bf3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134051 Jul 20 04:34:26.927118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2432/3557] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:26.940841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:26.956078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:26.976825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.984950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:26.985952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:26.986661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.203617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:27.218645 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71c5d2b0-45f9-4a80-bcb8-3d2a9de167e9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1266 microversion: 2.1 time: 0.281862 Jul 20 04:34:27.226458 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2433/3558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:26 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:27.241398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e59e7205-ab14-4b1b-b208-8ab526d6cccd req-d74c29b0-b2ea-4a3f-9426-6e9bfca503ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3", "name": "network-vif-deleted", "tag": "ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:27.286646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e59e7205-ab14-4b1b-b208-8ab526d6cccd req-d74c29b0-b2ea-4a3f-9426-6e9bfca503ff service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.288921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e59e7205-ab14-4b1b-b208-8ab526d6cccd req-d74c29b0-b2ea-4a3f-9426-6e9bfca503ff service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.320124 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e59e7205-ab14-4b1b-b208-8ab526d6cccd req-d74c29b0-b2ea-4a3f-9426-6e9bfca503ff service nova] Creating event network-vif-deleted:ab5e5d25-50ff-47cb-89e4-0c0ae3f21f2a for instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 on n-h1-764486-11 Jul 20 04:34:27.325481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e59e7205-ab14-4b1b-b208-8ab526d6cccd req-d74c29b0-b2ea-4a3f-9426-6e9bfca503ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091712 Jul 20 04:34:27.327189 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2434/3559] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:27.334754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:27.339941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:27.378066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.378510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:27.384726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:27.385179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.298844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.310851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.316309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:28.325452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c041cc21-4468-4a76-9af6-9352ff99ea07 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1599 microversion: 2.20 time: 0.996801 Jul 20 04:34:28.328410 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2435/3560] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:34:27 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1599 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:34:28.338399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:28.340977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:28.387247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.389910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:28.395556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:28.396058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.036540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:29.050861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e20f8f8c-864b-4568-92c7-9ae8d0055384 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.722292 Jul 20 04:34:29.051466 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2436/3561] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:28 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:29.070234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:29.077046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.097335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.099472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.100662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.101119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.348957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:29.358251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8ddc84c-0152-44ed-9aff-7bd5bce42315 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1266 microversion: 2.1 time: 0.305094 Jul 20 04:34:29.358856 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2437/3562] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:29 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:29.383789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:29.384931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.401437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.402997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.406047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.407413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.478151 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81455b38-9e9d-49f6-b6a2-6cf922a82649 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/ips" status: 200 len: 144 microversion: 2.1 time: 0.105017 Jul 20 04:34:29.486838 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2438/3563] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:34:29 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/ips => generated 144 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:29.497265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:29.501924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:29.516420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.517052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.518248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.521356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.838062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97e8b2cc-a03e-4e0c-8a08-02d372f1f43c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.349571 Jul 20 04:34:29.839760 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2439/3564] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:34:29 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-interface => generated 285 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:34:29.854378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ce930f17-f4ad-4668-ae49-42b1bc4d9acc req-24b467b0-9fef-48ca-8ca5-9ffd7fc33c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18302633-ec26-4ab7-a37c-2078988a1f96", "tag": "0f0803ef-2cdc-46da-82b6-9e1d797e76ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:29.883304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ce930f17-f4ad-4668-ae49-42b1bc4d9acc req-24b467b0-9fef-48ca-8ca5-9ffd7fc33c8a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:29.883960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ce930f17-f4ad-4668-ae49-42b1bc4d9acc req-24b467b0-9fef-48ca-8ca5-9ffd7fc33c8a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:29.936066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ce930f17-f4ad-4668-ae49-42b1bc4d9acc req-24b467b0-9fef-48ca-8ca5-9ffd7fc33c8a service nova] Creating event network-changed:0f0803ef-2cdc-46da-82b6-9e1d797e76ef for instance 18302633-ec26-4ab7-a37c-2078988a1f96 on n-h1-764486-11 Jul 20 04:34:29.947363 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ce930f17-f4ad-4668-ae49-42b1bc4d9acc req-24b467b0-9fef-48ca-8ca5-9ffd7fc33c8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104948 Jul 20 04:34:29.956778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2440/3565] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:30.072527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:30.073888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.095057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.095521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.096455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.099743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.581916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:30.598240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a32b8716-c76d-4c97-b539-71088aa95147 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.531585 Jul 20 04:34:30.609178 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2441/3566] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:30 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:30.618233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:30.618845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:30.651352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.651895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:30.652801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:30.661782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.855720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:31.910833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a3c68ef-bf15-4dc1-afed-6487657215b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 1.310478 Jul 20 04:34:31.927788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2442/3567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:30 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:31.938562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:31.939481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:31.953145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.953898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:31.954897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:31.955501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.782071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:32.810033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5628be5b-ea67-4831-bd0b-33d012e3bac4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.876905 Jul 20 04:34:32.811222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2443/3568] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:31 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:32.825806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c37658bb-4459-4f0e-aa5d-1392a7fd23e3"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:32.829486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:32.847021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.847862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:32.850209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:32.851251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.384617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37dd8f16-f0b0-4166-9be4-91239e61a708 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566376 Jul 20 04:34:33.391456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2444/3569] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:34:32 2022] POST /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:33.404535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:33.405228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:33.421281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.423354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:33.424368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:33.424788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.012041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:34.074446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:34.356949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.385115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85a79881-fd0e-451b-9b88-baaa95087645 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 0.989572 Jul 20 04:34:34.390206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2445/3570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:33 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:34.402892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:34.403775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:34.418982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.419762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.420847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:34.421849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:34.958605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:34.973590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eaa8ebd8-82a6-49c9-b8a3-db63b9cddfdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.581128 Jul 20 04:34:34.974479 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2446/3571] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:34 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:35.414638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:35.415575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:35.437096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.443722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:35.445047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:35.448762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.231773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.238628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:36.260067 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-914e0ae0-0a76-432a-8bba-74ea6a2d1f78 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 0.841148 Jul 20 04:34:36.262385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2447/3572] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:35 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:36.278880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:36.285037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:36.301179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.305609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.319462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.326469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:36.965945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:36.978618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bdb99d5e-0256-4c60-9be5-f8de0074055e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.714573 Jul 20 04:34:36.980311 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2448/3573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:36 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:36.985479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c4b9a6d3-1177-4e22-871d-910eda53e682 req-beafee70-ecfb-4234-935c-1e94d4611ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8", "tag": "ffd2df0b-e9e5-4faf-abcb-907066179895"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:36.993530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:36.996956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c4b9a6d3-1177-4e22-871d-910eda53e682 req-beafee70-ecfb-4234-935c-1e94d4611ac2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:36.997647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c4b9a6d3-1177-4e22-871d-910eda53e682 req-beafee70-ecfb-4234-935c-1e94d4611ac2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.028211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c4b9a6d3-1177-4e22-871d-910eda53e682 req-beafee70-ecfb-4234-935c-1e94d4611ac2 service nova] Creating event network-changed:ffd2df0b-e9e5-4faf-abcb-907066179895 for instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 on n-h2-764486-11 Jul 20 04:34:37.040048 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c4b9a6d3-1177-4e22-871d-910eda53e682 req-beafee70-ecfb-4234-935c-1e94d4611ac2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057173 Jul 20 04:34:37.041175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2449/3574] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:37.047137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c2e544bc-5668-4092-b170-49e98c8c9b6f req-c4b99d23-84d7-4a69-8e39-845be00bff0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:37.086858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c2e544bc-5668-4092-b170-49e98c8c9b6f req-c4b99d23-84d7-4a69-8e39-845be00bff0f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.087692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c2e544bc-5668-4092-b170-49e98c8c9b6f req-c4b99d23-84d7-4a69-8e39-845be00bff0f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.108542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c2e544bc-5668-4092-b170-49e98c8c9b6f req-c4b99d23-84d7-4a69-8e39-845be00bff0f service nova] Creating event network-changed:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h1-764486-11 Jul 20 04:34:37.121940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c2e544bc-5668-4092-b170-49e98c8c9b6f req-c4b99d23-84d7-4a69-8e39-845be00bff0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079154 Jul 20 04:34:37.122770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2450/3575] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:37.284400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:37.285258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:37.295216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.298026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:37.311311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:37.318619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.730460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:39.748032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d145ee5-eeb0-4ddc-991b-69573ba7598d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 2.467912 Jul 20 04:34:39.751248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2451/3576] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:37 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 2472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:34:39.760457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:39.768791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:39.801291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.809737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:39.812466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:39.813180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:40.685231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:40.705342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c3e4f30-755f-42c4-b1ae-e41c8b196c7b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.951691 Jul 20 04:34:40.715034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2452/3577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:39 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:41.026514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1437275603", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "8467d03c-b3db-4919-8e2b-81c11dbbed50"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:41.147452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] validate_networks() for [('8467d03c-b3db-4919-8e2b-81c11dbbed50', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:43.519928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:43.520737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:43.521559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:43.522444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:43.523220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:43.555746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.556218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.557076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.557522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:43.644518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Getting quotas for project 49089c187edc4dd185e85d90fa7a1193. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:43.664000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Getting quotas for user 4dc192fe53b349f2ac2cb53628b764a3 and project 49089c187edc4dd185e85d90fa7a1193. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:43.701628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:43.709091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:43.917425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88ee5787-b364-4901-bf33-9a7a129d9f26 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.200573 Jul 20 04:34:43.918571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2453/3578] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:43.949055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6f887e7c-0de1-4185-96f9-5c2ea6faaccb req-15ac0ae1-d565-419e-8487-f7f072c36492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18302633-ec26-4ab7-a37c-2078988a1f96", "name": "network-vif-plugged", "status": "completed", "tag": "0f0803ef-2cdc-46da-82b6-9e1d797e76ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:43.995653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6f887e7c-0de1-4185-96f9-5c2ea6faaccb req-15ac0ae1-d565-419e-8487-f7f072c36492 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:43.996232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6f887e7c-0de1-4185-96f9-5c2ea6faaccb req-15ac0ae1-d565-419e-8487-f7f072c36492 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.022384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6f887e7c-0de1-4185-96f9-5c2ea6faaccb req-15ac0ae1-d565-419e-8487-f7f072c36492 service nova] Creating event network-vif-plugged:0f0803ef-2cdc-46da-82b6-9e1d797e76ef for instance 18302633-ec26-4ab7-a37c-2078988a1f96 on n-h1-764486-11 Jul 20 04:34:44.028378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6f887e7c-0de1-4185-96f9-5c2ea6faaccb req-15ac0ae1-d565-419e-8487-f7f072c36492 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094166 Jul 20 04:34:44.029852 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2454/3579] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:44.036275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:44.037314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:44.082828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.088643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:44.098866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:44.102260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.502400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.517073 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7998574c-6432-46ae-aad3-8e26e94fc85c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 1.483883 Jul 20 04:34:45.520875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2455/3580] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:44 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.533467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.534385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.550472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.551254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.552254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.552926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.942736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:45.954099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78d2d79d-21d0-404f-8a12-237e547b1bce tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1314 microversion: 2.1 time: 0.431721 Jul 20 04:34:45.957330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2456/3581] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:45.969145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:45.969772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:45.984449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.984903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:45.987907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:45.988398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:46.295296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:46.309454 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8db93eef-0225-4283-9603-73ea0132a27b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1287 microversion: 2.1 time: 0.349856 Jul 20 04:34:46.320388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2457/3582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:45 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1287 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:46.333332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-17355499", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:46.433990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:47.068980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:47.071996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:47.073164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:47.073876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:47.074623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:47.110919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.112241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.113576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.114400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.155494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Getting quotas for project f5d28aa7778a4d1a96c5385a6e2e87b3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:47.170282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Getting quotas for user 9f85fdd270414383948a8e7c0f49437b and project f5d28aa7778a4d1a96c5385a6e2e87b3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:47.199898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:47.205224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:47.365447 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbfac435-1516-4a4e-a982-93e39e6153cc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047452 Jul 20 04:34:47.372132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2458/3583] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:47.381775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:47.383247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:47.405077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.406380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:47.429197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:47.430809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.242536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:48.268834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80587f32-1fee-4cfb-a848-115588e0b853 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 0.893937 Jul 20 04:34:48.271216 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2459/3584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:47 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:48.287420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:48.289766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:48.318730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.320940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:48.323479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:48.326434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.207729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.252756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e966b79f-f63e-4ae1-b86a-84090a0347b4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1501 microversion: 2.1 time: 0.967803 Jul 20 04:34:49.276257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2460/3585] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:48 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1501 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:49.293017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.294451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.308581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.309290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.310303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.322605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.807191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:49.819490 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-536209c5-8549-4ff1-8d53-0ae8649ebe65 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1317 microversion: 2.1 time: 0.541345 Jul 20 04:34:49.839144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2461/3586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:49.846142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:49.847060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:49.863469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.873551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:49.876919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:49.880136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.402489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:50.435157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e63999b-87a7-4563-8fcb-0e5fffacabdc tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1273 microversion: 2.1 time: 0.594043 Jul 20 04:34:50.436391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2462/3587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:49 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1273 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:50.467819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9914c406-e78e-48b3-91a4-1f8129be0f9a req-5ea5e77a-db06-423e-90c6-9a3190867f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8", "name": "network-vif-plugged", "status": "completed", "tag": "ffd2df0b-e9e5-4faf-abcb-907066179895"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:50.497611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9914c406-e78e-48b3-91a4-1f8129be0f9a req-5ea5e77a-db06-423e-90c6-9a3190867f53 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.498195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9914c406-e78e-48b3-91a4-1f8129be0f9a req-5ea5e77a-db06-423e-90c6-9a3190867f53 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.551284 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9914c406-e78e-48b3-91a4-1f8129be0f9a req-5ea5e77a-db06-423e-90c6-9a3190867f53 service nova] Creating event network-vif-plugged:ffd2df0b-e9e5-4faf-abcb-907066179895 for instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 on n-h2-764486-11 Jul 20 04:34:50.561417 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9914c406-e78e-48b3-91a4-1f8129be0f9a req-5ea5e77a-db06-423e-90c6-9a3190867f53 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101280 Jul 20 04:34:50.562042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2463/3588] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:50.570987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd6f541a-1c72-41f7-9b8a-78d62cf19d71 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:50.600062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd6f541a-1c72-41f7-9b8a-78d62cf19d71 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.601820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd6f541a-1c72-41f7-9b8a-78d62cf19d71 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.662816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd6f541a-1c72-41f7-9b8a-78d62cf19d71 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:34:50.849314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd6f541a-1c72-41f7-9b8a-78d62cf19d71 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96/action" status: 202 len: 0 microversion: 2.1 time: 0.282146 Jul 20 04:34:50.860646 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2464/3589] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:50 2022] POST /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:34:50.880991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:50.882955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:50.894273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.895200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:50.896999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:50.898612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.765138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:51.784243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2fa8db3-aea1-4b01-8ee4-60a0467f3eb5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1308 microversion: 2.1 time: 0.921078 Jul 20 04:34:51.792927 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2465/3590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:50 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1308 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:51.802599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:51.818682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:51.879147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.879801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:51.882380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:51.883297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.184433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:52.197994 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d94283c2-660b-4dbd-b636-311afb0aec42 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1317 microversion: 2.1 time: 0.402817 Jul 20 04:34:52.201611 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2466/3591] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:51 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:52.214519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:52.238102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:52.262266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.263211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.265006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:52.265683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:52.302655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:53.202162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.233917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33d3ac3e-96e6-4306-88df-e7a5b2689734 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 1.026967 Jul 20 04:34:53.234528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2467/3592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:52 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:53.268839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.269625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.299673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.300239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.301207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.302482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.457116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:53.475223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9f6a12f-0629-4314-9eb5-fee78c532877 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1271 microversion: 2.1 time: 0.221364 Jul 20 04:34:53.487313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2468/3593] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:53.493299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.516504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.526758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.529245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.541279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.542260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.637798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6abf90a0-fcab-4b7b-b285-211f6ccf5087 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146795 Jul 20 04:34:53.647711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2469/3594] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:53.659326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-082d17b7-8cc0-40fe-9834-1e427477f50c req-5b67a6fd-7101-4bb7-bd91-5901a11cc4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f75e754-ad0f-4b95-90f5-b595cc85ed06", "tag": "d91a6aa3-72c2-4849-a92a-a03a7cd4a828"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:53.681487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-082d17b7-8cc0-40fe-9834-1e427477f50c req-5b67a6fd-7101-4bb7-bd91-5901a11cc4de service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.687060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-082d17b7-8cc0-40fe-9834-1e427477f50c req-5b67a6fd-7101-4bb7-bd91-5901a11cc4de service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.714185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-082d17b7-8cc0-40fe-9834-1e427477f50c req-5b67a6fd-7101-4bb7-bd91-5901a11cc4de service nova] Creating event network-changed:d91a6aa3-72c2-4849-a92a-a03a7cd4a828 for instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 on n-h2-764486-11 Jul 20 04:34:53.720082 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-082d17b7-8cc0-40fe-9834-1e427477f50c req-5b67a6fd-7101-4bb7-bd91-5901a11cc4de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070108 Jul 20 04:34:53.721615 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2470/3595] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:53.729085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:53.736580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:53.761377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.761377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:53.761377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:53.762912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.145050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.154436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07270c1c-eb11-431f-9a16-7e7e0ae429d8 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1488 microversion: 2.1 time: 0.431234 Jul 20 04:34:54.161251 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2471/3596] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:53 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1488 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:54.170065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.174037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.192071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.194692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.198254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.200540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.566610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:54.600463 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1ae087e-b553-4c3f-bdbc-053f48d8c31b tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1317 microversion: 2.1 time: 0.437071 Jul 20 04:34:54.602293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2472/3597] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:54.633313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:54.639837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.693927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.697085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.698572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.699258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.822038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4d87e32-d013-482f-811e-8be12b0d5da3 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/c37658bb-4459-4f0e-aa5d-1392a7fd23e3" status: 200 len: 194 microversion: 2.1 time: 0.216426 Jul 20 04:34:54.823234 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2473/3598] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Jul 20 04:34:54 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/c37658bb-4459-4f0e-aa5d-1392a7fd23e3 => generated 194 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:54.866418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-331280316"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:54.887355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:54.934789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.935278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:54.936134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:54.936623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.951471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b70ddc2-40c5-45e1-9297-ca5edf4435f4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "POST /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8/action" status: 202 len: 0 microversion: 2.1 time: 1.098416 Jul 20 04:34:55.953963 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2474/3599] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:34:54 2022] POST /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 04:34:55.971708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:55.976768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:55.990954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.992688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:55.994755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:55.996588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.604692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:56.636628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74757d39-9bb0-44f9-8f25-241f5270c110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 0.680091 Jul 20 04:34:56.638044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2475/3600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:55 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:56.647621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:56.676631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:56.713755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.714715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:56.715623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:56.716166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.064873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.099383 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90833dee-b812-461f-86d0-dbcc5b8ffcb8 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1313 microversion: 2.1 time: 0.457390 Jul 20 04:34:57.103517 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2476/3601] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:56 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:57.128586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.130276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:57.145888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:57.153635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.154193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.155101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:57.155640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:57.186639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:57.544907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:34:57.560478 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bb4690a-31a4-4b3f-bade-8a1c610f673c tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1317 microversion: 2.1 time: 0.449859 Jul 20 04:34:57.573187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2477/3602] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:57.597421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f8ec6b2-63d5-49d5-875f-9cee105018d1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aef6c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:57.699991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f8ec6b2-63d5-49d5-875f-9cee105018d1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045" status: 200 len: 1411 microversion: 2.1 time: 0.125397 Jul 20 04:34:57.700637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2478/3603] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:34:57 2022] GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:34:57.925056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1205038499", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0582102c-44cf-4d49-81ab-c3a20d9bb2b5"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:58.073133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] validate_networks() for [('0582102c-44cf-4d49-81ab-c3a20d9bb2b5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:34:59.262538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:34:59.263474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:34:59.264326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:34:59.265075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:34:59.265797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:34:59.297241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.298315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.300251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.302964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.327137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Getting quotas for project 0461f118909f4f02a0e6c8c7d188d598. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:34:59.333727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Getting quotas for user e06a575272ea4a2b910febb713d2f369 and project 0461f118909f4f02a0e6c8c7d188d598. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:34:59.349752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:34:59.352706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:34:59.388064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:34:59.475497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea10f268-344f-48cb-86b1-fbb6c23a0f25 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768067 Jul 20 04:34:59.476485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2479/3604] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:34:59.524165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-107e4dc3-0b26-4106-82a6-27d4f4c33511 req-0e266653-9479-43f3-9cb1-7beaf5a50822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9d7109-14ad-4702-9d8f-e24ec596a89a", "tag": "fa9bacdf-684d-4cdc-bf29-ed944b0a924d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:34:59.547397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-107e4dc3-0b26-4106-82a6-27d4f4c33511 req-0e266653-9479-43f3-9cb1-7beaf5a50822 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.547841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-107e4dc3-0b26-4106-82a6-27d4f4c33511 req-0e266653-9479-43f3-9cb1-7beaf5a50822 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.568445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-107e4dc3-0b26-4106-82a6-27d4f4c33511 req-0e266653-9479-43f3-9cb1-7beaf5a50822 service nova] Creating event network-changed:fa9bacdf-684d-4cdc-bf29-ed944b0a924d for instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a on n-h1-764486-11 Jul 20 04:34:59.586407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-107e4dc3-0b26-4106-82a6-27d4f4c33511 req-0e266653-9479-43f3-9cb1-7beaf5a50822 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106230 Jul 20 04:34:59.587328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2480/3605] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:34:59.595449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:34:59.600440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:34:59.619737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.620500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:34:59.621137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:34:59.621503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.041763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:00.053728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-455f4075-629f-467c-9dbe-418fb7c013a6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 0.464103 Jul 20 04:35:00.072486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2481/3606] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:34:59 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.072486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ff01676-be34-46a5-9a60-0072675491b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f839ce60550>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.152672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ff01676-be34-46a5-9a60-0072675491b5 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045" status: 200 len: 1411 microversion: 2.1 time: 0.090318 Jul 20 04:35:00.153662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2482/3607] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:00.169138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f968286-89ab-462f-a985-c1751061febc"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:00.170960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.184618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.185713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.189370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.190260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.779341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d54be5c3-bf3d-46ea-b2b4-278ad43301a6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "POST /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624245 Jul 20 04:35:00.780808 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2483/3608] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:35:00 2022] POST /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments => generated 194 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:00.798705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:00.800722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:00.814814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.816393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:00.820039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:00.821479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.375986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:01.389198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4409537-2011-41b4-85df-524b5709f7b4 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1313 microversion: 2.1 time: 0.605340 Jul 20 04:35:01.411090 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2484/3609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:00 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:01.433343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:01.434488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:01.446067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.446802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.449032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:01.449812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:01.501661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:02.545721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:02.554780 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6de57770-d745-4ace-bff5-0646b0151632 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1317 microversion: 2.1 time: 1.142370 Jul 20 04:35:02.555377 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2485/3610] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:01 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1317 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:02.573353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:02.573961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:02.594785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.595209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:02.595993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:02.596445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.340449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:03.355313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4abae998-0fb6-4093-a1b3-c6ac2da38122 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1283 microversion: 2.1 time: 0.785770 Jul 20 04:35:03.361733 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2486/3611] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:02 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1283 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:03.373950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.377046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.392205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.395871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.396965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.399635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.501494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa016fae-b3af-4418-bb38-63d8845546cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/ips" status: 200 len: 152 microversion: 2.20 time: 0.134693 Jul 20 04:35:03.517402 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2487/3612] 10.222.0.49 () {60 vars in 1288 bytes} [Wed Jul 20 04:35:03 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/ips => generated 152 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:35:03.528409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0108dd68-2c4a-448c-aa31-8c86ea4e5bf9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838affe700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.832597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0108dd68-2c4a-448c-aa31-8c86ea4e5bf9 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045" status: 204 len: 0 microversion: 2.1 time: 0.312423 Jul 20 04:35:03.833654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2488/3613] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:03 2022] DELETE /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:03.839587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:03.840516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:03.858500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.859354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:03.861825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:03.862473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.451496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:04.465470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-98454d44-f9b7-4b68-84db-18583dd6cfa0 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 0.630459 Jul 20 04:35:04.469316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2489/3614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:03 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:04.486208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:04.487447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:04.507297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.508485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:04.511322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:04.512374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.260846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:05.280751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7489cadf-da04-4bba-93aa-4632dcc85a48 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1313 microversion: 2.1 time: 0.809973 Jul 20 04:35:05.288807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2490/3615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:04 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:05.298362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-62799929-5291-43dc-b658-ec36d113275b req-4c4deb40-2329-4081-ad09-c8f9c3f80c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f75e754-ad0f-4b95-90f5-b595cc85ed06", "name": "network-vif-plugged", "status": "completed", "tag": "d91a6aa3-72c2-4849-a92a-a03a7cd4a828"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:05.338695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-62799929-5291-43dc-b658-ec36d113275b req-4c4deb40-2329-4081-ad09-c8f9c3f80c49 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.339560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-62799929-5291-43dc-b658-ec36d113275b req-4c4deb40-2329-4081-ad09-c8f9c3f80c49 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.379798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-62799929-5291-43dc-b658-ec36d113275b req-4c4deb40-2329-4081-ad09-c8f9c3f80c49 service nova] Creating event network-vif-plugged:d91a6aa3-72c2-4849-a92a-a03a7cd4a828 for instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 on n-h2-764486-11 Jul 20 04:35:05.397042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-62799929-5291-43dc-b658-ec36d113275b req-4c4deb40-2329-4081-ad09-c8f9c3f80c49 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103563 Jul 20 04:35:05.400416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2491/3616] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:05.456958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:05.459456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:05.503433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.506666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:05.512275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:05.513040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.353278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:06.365632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ecd63801-cda6-41bf-850d-bb2a9002a8d4 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1317 microversion: 2.1 time: 0.946887 Jul 20 04:35:06.371285 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2492/3617] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:05 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1317 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:06.376973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7bf8caf8-b8bc-4de1-8028-04500edce46b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f839cda43a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.437334 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7bf8caf8-b8bc-4de1-8028-04500edce46b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Image not found. Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7bf8caf8-b8bc-4de1-8028-04500edce46b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 HTTP/1.1 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '29685a1a-711f-455b-9286-00e14336a045'} Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 29685a1a-711f-455b-9286-00e14336a045 Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 04:35:06.440019 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 29685a1a-711f-455b-9286-00e14336a045 could not be found. Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7bf8caf8-b8bc-4de1-8028-04500edce46b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7bf8caf8-b8bc-4de1-8028-04500edce46b tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045" status: 404 len: 62 microversion: 2.1 time: 0.068561 Jul 20 04:35:06.449949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2493/3618] 10.222.0.49 () {58 vars in 1232 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:35:06.462711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:06.462711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:06.495632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.496155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:06.507544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:06.516938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:07.186021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:07.259924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc182a81-a007-4823-bd42-213c254da5de tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1325 microversion: 2.1 time: 0.810251 Jul 20 04:35:07.269005 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2494/3619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:06 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1325 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:07.341264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:07.345200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:07.369150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:07.370182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:07.371859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:07.372753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.276415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.295071 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3cea9186-cdd2-4c1e-8ea1-67cc268a0cc9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 1.019016 Jul 20 04:35:08.297732 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2495/3620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:07 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:08.317487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:08.326756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:08.381944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.387339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.392577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:08.397360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:08.938136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:08.959557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fe0978d-1883-4240-bbb4-dc1e0b4140d1 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1313 microversion: 2.1 time: 0.651241 Jul 20 04:35:08.964537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2496/3621] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:08 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:08.970016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:08.980716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.015968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.015968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.016934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.017814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.318144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:09.343362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:09.593238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:09.611425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87e979ba-6634-4ea4-8eeb-f8a79d9b4972 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1501 microversion: 2.1 time: 0.644987 Jul 20 04:35:09.612033 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2497/3622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:08 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1501 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:09.617005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:09.622655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:09.642983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.644004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:09.645155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:09.650586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.109889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.133820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4932c70c-c868-45d5-b6d5-f65cd0514897 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1506 microversion: 2.1 time: 0.520478 Jul 20 04:35:10.141777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2498/3623] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:09 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:10.157869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b7805e89-5347-4a6e-8804-de1492e53d91 req-0ae061f4-304a-4395-aad9-ad2e779f13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8", "name": "network-vif-plugged", "status": "completed", "tag": "ffd2df0b-e9e5-4faf-abcb-907066179895"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:10.171130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b7805e89-5347-4a6e-8804-de1492e53d91 req-0ae061f4-304a-4395-aad9-ad2e779f13a8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.172178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b7805e89-5347-4a6e-8804-de1492e53d91 req-0ae061f4-304a-4395-aad9-ad2e779f13a8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.211917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b7805e89-5347-4a6e-8804-de1492e53d91 req-0ae061f4-304a-4395-aad9-ad2e779f13a8 service nova] Creating event network-vif-plugged:ffd2df0b-e9e5-4faf-abcb-907066179895 for instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 on n-h2-764486-11 Jul 20 04:35:10.226899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b7805e89-5347-4a6e-8804-de1492e53d91 req-0ae061f4-304a-4395-aad9-ad2e779f13a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079526 Jul 20 04:35:10.240008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2499/3624] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:10.262233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:10.265754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:10.280474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.281595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.283228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.284236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.680971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:10.695127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21aeb1db-0d28-4b4b-baf5-729785e9cdfc tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1325 microversion: 2.1 time: 0.451380 Jul 20 04:35:10.697173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2500/3625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:10 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1325 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:10.707667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:10.709091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:10.726958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.728087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.729367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:10.730735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:10.820415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lazy-loading 'flavor' on Instance uuid 784190f6-370f-4649-9bee-c669f705e6fc {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:11.237501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e09a3b5d-84ce-41db-97b6-30392d401ec2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/action" status: 202 len: 0 microversion: 2.20 time: 0.537670 Jul 20 04:35:11.241558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2501/3626] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:35:10 2022] POST /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:11.245384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:11.246148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:11.255258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.255789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.257198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.257645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.549328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:11.561170 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5bb8164-eb80-43d4-bbbb-fdda0260d591 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 0.320675 Jul 20 04:35:11.562118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2502/3627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:11 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:11.585003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-537c02d3-54aa-4e60-bbfc-04ab77c1d393 req-de46924d-c4d8-4a5e-9978-f6c3a274de34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c8acaa-9525-4c25-b769-3503fe6095e4", "tag": "76c81c38-23de-4787-804d-ab2dea982dcc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:11.608212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-537c02d3-54aa-4e60-bbfc-04ab77c1d393 req-de46924d-c4d8-4a5e-9978-f6c3a274de34 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.608212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-537c02d3-54aa-4e60-bbfc-04ab77c1d393 req-de46924d-c4d8-4a5e-9978-f6c3a274de34 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.635636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-537c02d3-54aa-4e60-bbfc-04ab77c1d393 req-de46924d-c4d8-4a5e-9978-f6c3a274de34 service nova] Creating event network-changed:76c81c38-23de-4787-804d-ab2dea982dcc for instance f3c8acaa-9525-4c25-b769-3503fe6095e4 on n-h1-764486-11 Jul 20 04:35:11.652984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-537c02d3-54aa-4e60-bbfc-04ab77c1d393 req-de46924d-c4d8-4a5e-9978-f6c3a274de34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071216 Jul 20 04:35:11.655900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2503/3628] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:11.671225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:11.672283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:11.688555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.700689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.701771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:11.702228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:11.768114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:12.218942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.234390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b722d612-db4d-4518-a52b-503f6869e983 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1313 microversion: 2.1 time: 0.576879 Jul 20 04:35:12.239727 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2504/3629] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:11 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:12.245322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:12.252265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:12.267994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.268783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.271258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.271909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.337404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.338438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a907f0f3-f81e-415a-9328-eb0a5e798c0a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06/os-instance-actions/req-88ee5787-b364-4901-bf33-9a7a129d9f26" status: 200 len: 313 microversion: 2.1 time: 0.097369 Jul 20 04:35:12.348146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2505/3630] 10.222.0.49 () {58 vars in 1418 bytes} [Wed Jul 20 04:35:12 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06/os-instance-actions/req-88ee5787-b364-4901-bf33-9a7a129d9f26 => generated 313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:12.348146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:12.348146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:12.370094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.370548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.371374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:12.371823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:12.964392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:12.981710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b054c5de-a8a5-4c9c-ba1c-b2e743e3e305 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1501 microversion: 2.1 time: 0.640927 Jul 20 04:35:12.983252 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2506/3631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:12 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1501 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:12.990307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:12.991904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.000861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.001566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.002704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.003427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.402354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.414469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.415998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.417246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c6b0d72-0b70-4fdb-8d92-2e4e5ff8919c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.432483 Jul 20 04:35:13.417815 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2507/3632] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:12 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:13.441003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:13.442101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:13.456612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.473170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.474561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.474809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.855350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:13.870091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f2370b2-c8d3-454f-a50b-3e16bececcb6 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1325 microversion: 2.1 time: 0.441621 Jul 20 04:35:13.870938 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2508/3633] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:13 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:13.875660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5f1482e5-91d1-4067-a1fb-f292fff2454c req-ad421279-d2ef-4b18-90cf-6358dda63d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9d7109-14ad-4702-9d8f-e24ec596a89a", "name": "network-vif-plugged", "status": "completed", "tag": "fa9bacdf-684d-4cdc-bf29-ed944b0a924d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:13.904462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f1482e5-91d1-4067-a1fb-f292fff2454c req-ad421279-d2ef-4b18-90cf-6358dda63d5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:13.904921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f1482e5-91d1-4067-a1fb-f292fff2454c req-ad421279-d2ef-4b18-90cf-6358dda63d5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:13.938102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5f1482e5-91d1-4067-a1fb-f292fff2454c req-ad421279-d2ef-4b18-90cf-6358dda63d5f service nova] Creating event network-vif-plugged:fa9bacdf-684d-4cdc-bf29-ed944b0a924d for instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a on n-h1-764486-11 Jul 20 04:35:13.957817 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5f1482e5-91d1-4067-a1fb-f292fff2454c req-ad421279-d2ef-4b18-90cf-6358dda63d5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084342 Jul 20 04:35:13.963455 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2509/3634] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:14.011239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:14.014028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:14.043985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.046115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.048029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.049072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.317420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f19d4184-b5c2-403f-8bbb-971a26211392 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "POST /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06/action" status: 202 len: 0 microversion: 2.1 time: 0.351069 Jul 20 04:35:14.318526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2510/3635] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:13 2022] POST /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:14.349391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:14.358083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:14.373371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.374106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.375061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.375654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.830753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:14.849742 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db938604-e95b-4483-8a6e-2cd0f26ad5e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1511 microversion: 2.1 time: 0.526005 Jul 20 04:35:14.851064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2511/3636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:14 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:14.866533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:14.873339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:14.883299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.884973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:14.887087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:14.887778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.203843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:15.222775 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61b2999e-80a0-4399-9539-8515dbf07e4f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1313 microversion: 2.1 time: 0.365794 Jul 20 04:35:15.224028 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2512/3637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:14 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:15.231563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:15.232452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:15.241755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.242460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.243446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.244077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.593733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:15.644578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fccd4f2f-541a-40d1-b0c1-76cf8e0c2aab tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1501 microversion: 2.1 time: 0.418841 Jul 20 04:35:15.655318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2513/3638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:15 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1501 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:15.673483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:15.675017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:15.697967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.698653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:15.702585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:15.703626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.326137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.347267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76058cb8-05ea-4483-9ad3-f35d2a94fd4a tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1508 microversion: 2.1 time: 0.689462 Jul 20 04:35:16.349678 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2514/3639] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:15 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:16.358550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:16.360270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:16.375431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.376209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.378966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.381060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.670558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.688239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.691911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:16.693509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d131898-f710-411a-9afe-b0ab28029bff tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.340234 Jul 20 04:35:16.695109 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2515/3640] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:16 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:16.704042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:16.704994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:16.728426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.729054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.730395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:16.730950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:16.980566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:17.000381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2159bfd5-2ef6-4af6-8dac-6ab518c7a3a8 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1325 microversion: 2.1 time: 0.303075 Jul 20 04:35:17.001459 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2516/3641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:16 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:17.011747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.012888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.020725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.021513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.022669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.023112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.223002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:17.235001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4cf6a53-8b39-4ed6-8997-fa20846c1de8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1488 microversion: 2.1 time: 0.231374 Jul 20 04:35:17.248390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2517/3642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:17.248390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-48a4ba1c-1244-4477-884f-b8860f185340 req-5090e6ec-40cb-4429-a004-92d37626f044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c8acaa-9525-4c25-b769-3503fe6095e4", "name": "network-vif-plugged", "status": "completed", "tag": "76c81c38-23de-4787-804d-ab2dea982dcc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:17.254130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48a4ba1c-1244-4477-884f-b8860f185340 req-5090e6ec-40cb-4429-a004-92d37626f044 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.254962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48a4ba1c-1244-4477-884f-b8860f185340 req-5090e6ec-40cb-4429-a004-92d37626f044 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.267732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-48a4ba1c-1244-4477-884f-b8860f185340 req-5090e6ec-40cb-4429-a004-92d37626f044 service nova] Creating event network-vif-plugged:76c81c38-23de-4787-804d-ab2dea982dcc for instance f3c8acaa-9525-4c25-b769-3503fe6095e4 on n-h1-764486-11 Jul 20 04:35:17.276879 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-48a4ba1c-1244-4477-884f-b8860f185340 req-5090e6ec-40cb-4429-a004-92d37626f044 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038438 Jul 20 04:35:17.278163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2518/3643] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:17.305649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.308119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.319423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.321002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.322693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.323959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.626898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:17.638779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38396d2b-71d8-4e6f-a618-2ae5797b3773 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1462 microversion: 2.1 time: 0.357600 Jul 20 04:35:17.639835 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2519/3644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1462 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:17.656346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:17.657379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.668682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.669407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.670695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.671292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.875010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:17.897871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-43f48ff0-e97e-484e-9f67-5c8a3419f653 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1501 microversion: 2.1 time: 0.250010 Jul 20 04:35:17.898752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2520/3645] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:17 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:17.903372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:17.904442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:17.926277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.926892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.930025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:17.930755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:17.970070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:18.017657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f00db937-f1a1-4ec2-a138-03efc81a5f64 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 200 len: 133 microversion: 2.1 time: 0.116320 Jul 20 04:35:18.019293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2521/3646] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:35:17 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 133 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:18.029203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:18.030160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:18.038674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.039394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.040393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.041011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.245840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.258176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0bb4b883-59cb-4b83-966f-d500b25ed7f5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1506 microversion: 2.1 time: 0.235884 Jul 20 04:35:18.259081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2522/3647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:18 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:18.264134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:18.264889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:18.271935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.276163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.277539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.277990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.316084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:18.466301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c57a0daf-6c37-434a-9080-6e692206f74f tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 204 len: 0 microversion: 2.1 time: 0.203232 Jul 20 04:35:18.468326 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2523/3648] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:18 2022] DELETE /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:18.481891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:18.483414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:18.501870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.502584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.503986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.504722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.812520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.829040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.832711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:18.835571 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef72e427-c3b2-4e34-975f-eef2bd0f8436 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.360559 Jul 20 04:35:18.836602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2524/3649] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:18 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:18.848736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:18.850751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:18.863672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.865508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:18.867890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:18.869123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.128560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.155432 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-053dffdf-1949-4a9c-b6e4-04916cdb0673 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1325 microversion: 2.1 time: 0.315380 Jul 20 04:35:19.159066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2525/3650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:18 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1325 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:19.173909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.174977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.191269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.191929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.193219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.194457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.459321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.467840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4972cfd9-969f-4bd5-883d-d451b8ec2138 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.308656 Jul 20 04:35:19.468453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2526/3651] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:19.480519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '.version_select at 0x7f838aede5e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.481455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.488659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.489469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.491416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.492167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.554029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c76653e5-0b84-4832-be45-f99f35f8c1d8 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.083334 Jul 20 04:35:19.554986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2527/3652] 10.222.0.49 () {58 vars in 1295 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06/os-instance-actions => generated 611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:19.567724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.568599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.576573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.577163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.578069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.578578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.806388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f85fdd270414383948a8e7c0f49437b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d28aa7778a4d1a96c5385a6e2e87b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:19.820765 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d898bd2-0a10-447e-97f3-f0d7a6d9c7ea tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 200 len: 1468 microversion: 2.1 time: 0.258095 Jul 20 04:35:19.821940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2528/3653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:19.827851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:19.828575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:19.830859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:19.839114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.839795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:19.840615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:19.841049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.278649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.306066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8b48b03-0f81-492e-a853-04fa0fc85c3f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1501 microversion: 2.1 time: 0.482819 Jul 20 04:35:20.328934 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2529/3654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:19 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1501 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:20.347960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.349026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.357241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.358001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.359143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.359926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.700408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:20.711894 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6514a3fa-2964-438d-86ae-aabea1374059 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.374587 Jul 20 04:35:20.712764 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2530/3655] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:20 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:20.718226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.718776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.735414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.736456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.742233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.749427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.798644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:20.933759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11e4ac28-34b7-4147-9ddd-957ef78783a1 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 204 len: 0 microversion: 2.1 time: 0.218847 Jul 20 04:35:20.936554 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2531/3656] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:20 2022] DELETE /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:20.954719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:20.956596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:20.984759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:20.987151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:20.990210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.001281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.398279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.414188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.416455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.417691 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42aa2ca9-559c-4842-8f3f-6396779f06f6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.478983 Jul 20 04:35:21.418471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2532/3657] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:20 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:21.445120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.446946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.458953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.461161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.462759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.463651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.703654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:21.729261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6241a602-72b6-4424-9db2-df127fb2a420 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1522 microversion: 2.1 time: 0.298013 Jul 20 04:35:21.732023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2533/3658] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:21.748097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.750272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.769857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.770754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.773165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.773870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.845148 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-459216d9-66ea-446e-8f49-d34788d495da tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.111665 Jul 20 04:35:21.851293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2534/3659] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:21.862805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:21.863461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:21.870377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.871004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.871987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:21.872754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:21.877693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:22.072404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.079628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ca9e828-7b02-4aaa-9145-7e84abc20517 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.226138 Jul 20 04:35:22.080461 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2535/3660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:21 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:22.109918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.109918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] [instance: 3e9d7109-14ad-4702-9d8f-e24ec596a89a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.119554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.120018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.120858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.121306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] HTTP exception thrown: Instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a could not be found. Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Request method failure captured: Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a HTTP/1.1 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14XhuB7sre66szc-CTNhTG8DefO0KpX0VR4FRDYgW1N_axrybxwf_Onb53zQAyKqzfPZ4IRpd5ji9_skOjM_eRw2mO3pLwZTV9rS-euLA1LVjjnxbWdUsZhfKhdzlzaatsWu6u2g_3disNVlRmwfE4mb2oPt_APQEe01OWzogeNsw4U Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: f5d28aa7778a4d1a96c5385a6e2e87b3 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-1192199430 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f5d28aa7778a4d1a96c5385a6e2e87b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f5d28aa7778a4d1a96c5385a6e2e87b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f5d28aa7778a4d1a96c5385a6e2e87b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f5d28aa7778a4d1a96c5385a6e2e87b3", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-1192199430 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: f5d28aa7778a4d1a96c5385a6e2e87b3 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-1192199430 Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-1192199430-project Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9f85fdd270414383948a8e7c0f49437b Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-1192199430-project Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a could not be found. Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3e9d7109-14ad-4702-9d8f-e24ec596a89a'} Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a could not be found. Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:22.172481 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a could not be found. Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a could not be found. Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] Returning 404 to user: Instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c69d8323-3b09-4e56-8409-cb4784a35b73 tempest-VolumesNegativeTest-1192199430 tempest-VolumesNegativeTest-1192199430-project] 10.222.0.49 "GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a" status: 404 len: 111 microversion: 2.1 time: 0.086488 Jul 20 04:35:22.187625 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2536/3661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/3e9d7109-14ad-4702-9d8f-e24ec596a89a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:22.195932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.196910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.207902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.211043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.212305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.214750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.538563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.559984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cc140d0-6782-4523-9b7b-1f7eb7c34783 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1512 microversion: 2.1 time: 0.379638 Jul 20 04:35:22.561640 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2537/3662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:22.570912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1a4d29bc-2701-4aa1-a3d2-b875c6817e2a req-0d4609be-4cae-4f86-832c-e1dd669d894d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9d7109-14ad-4702-9d8f-e24ec596a89a", "name": "network-vif-deleted", "tag": "fa9bacdf-684d-4cdc-bf29-ed944b0a924d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:22.617065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1a4d29bc-2701-4aa1-a3d2-b875c6817e2a req-0d4609be-4cae-4f86-832c-e1dd669d894d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.618930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1a4d29bc-2701-4aa1-a3d2-b875c6817e2a req-0d4609be-4cae-4f86-832c-e1dd669d894d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.638206 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1a4d29bc-2701-4aa1-a3d2-b875c6817e2a req-0d4609be-4cae-4f86-832c-e1dd669d894d service nova] Creating event network-vif-deleted:fa9bacdf-684d-4cdc-bf29-ed944b0a924d for instance 3e9d7109-14ad-4702-9d8f-e24ec596a89a on n-h1-764486-11 Jul 20 04:35:22.655717 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1a4d29bc-2701-4aa1-a3d2-b875c6817e2a req-0d4609be-4cae-4f86-832c-e1dd669d894d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091676 Jul 20 04:35:22.660494 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2538/3663] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:22.679442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.681655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.693078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.693713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.696038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.696842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.948707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:22.961857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f1921ee-9c7e-4bbf-be86-a8cd7bf082ee tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1501 microversion: 2.1 time: 0.299574 Jul 20 04:35:22.963688 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2539/3664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:22.970858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:22.971789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:22.979701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.980603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:22.982119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:22.982402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.018416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] HTTP exception thrown: Action 999 not found Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Request method failure captured: Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4/os-instance-actions/999 HTTP/1.1 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14XwAgdh3fv6X8l1RSaOMtjEmAyLbDr2-9-EuHaAObZrnmRp6FWJe1j1ARuYnhZ-yJe3CPrNuiQOTfQXFE8q3WmqLRVFbwOiKB7Z2oZnORG5BRGevPFPiv62hlWcGMW0_qI_G3BJT-CbrfsWKsneRvwtqd2KD1jdl6yfT2ucWzdbOgg Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0461f118909f4f02a0e6c8c7d188d598 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0461f118909f4f02a0e6c8c7d188d598", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0461f118909f4f02a0e6c8c7d188d598 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsNegativeTestJSON-1421514350-project Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e06a575272ea4a2b910febb713d2f369 Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1421514350-project Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: exception: Action 999 not found Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': 'f3c8acaa-9525-4c25-b769-3503fe6095e4', 'id': '999'} Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 20 04:35:23.029815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:23.036221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Returning 404 to user: Action 999 not found {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:23.038147 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8222753a-f4bd-4244-a8a0-3c7c6a912366 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.072705 Jul 20 04:35:23.039495 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2540/3665] 10.222.0.49 () {58 vars in 1307 bytes} [Wed Jul 20 04:35:22 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4/os-instance-actions/999 => generated 66 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:35:23.044876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.046097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.055777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.057168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.059131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.060924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.137958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f353ae4-d20f-4bc8-b185-f814a95a7e89 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/c37658bb-4459-4f0e-aa5d-1392a7fd23e3" status: 200 len: 194 microversion: 2.1 time: 0.096969 Jul 20 04:35:23.139052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2541/3666] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/c37658bb-4459-4f0e-aa5d-1392a7fd23e3 => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:23.144245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.144889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.152589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.153175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.153915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.154352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.623333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:23.630943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41a7f4e2-4213-4622-855b-8a06590e0ff5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.490874 Jul 20 04:35:23.631578 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2542/3667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:23.650374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:23.651006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:23.674475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.676026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:23.679344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:23.679987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.024958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.045963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.050038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.054523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6fb79b1d-702e-497a-bd6c-479eac9a9cea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1745 microversion: 2.20 time: 0.421891 Jul 20 04:35:24.055415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2543/3668] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:23 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1745 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:24.061892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7dbceba9-94dc-4a44-b1ec-8184bc807842 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '.version_select at 0x7f838aede160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.072948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7dbceba9-94dc-4a44-b1ec-8184bc807842 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.091617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7dbceba9-94dc-4a44-b1ec-8184bc807842 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] HTTP exception thrown: Instance 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4 could not be found. Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7dbceba9-94dc-4a44-b1ec-8184bc807842 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Request method failure captured: Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/277c2dfa-7def-4b37-b2aa-c9c7a9d726c4/os-instance-actions HTTP/1.1 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14XwAgdh3fv6X8l1RSaOMtjEmAyLbDr2-9-EuHaAObZrnmRp6FWJe1j1ARuYnhZ-yJe3CPrNuiQOTfQXFE8q3WmqLRVFbwOiKB7Z2oZnORG5BRGevPFPiv62hlWcGMW0_qI_G3BJT-CbrfsWKsneRvwtqd2KD1jdl6yfT2ucWzdbOgg Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0461f118909f4f02a0e6c8c7d188d598 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0461f118909f4f02a0e6c8c7d188d598", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0461f118909f4f02a0e6c8c7d188d598 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsNegativeTestJSON-1421514350-project Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e06a575272ea4a2b910febb713d2f369 Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1421514350-project Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4 could not be found. Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '277c2dfa-7def-4b37-b2aa-c9c7a9d726c4'} Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4 could not be found. Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:24.099283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4 could not be found. Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4 could not be found. Jul 20 04:35:24.107933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:24.111216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7dbceba9-94dc-4a44-b1ec-8184bc807842 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Returning 404 to user: Instance 277c2dfa-7def-4b37-b2aa-c9c7a9d726c4 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:24.113640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7dbceba9-94dc-4a44-b1ec-8184bc807842 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/277c2dfa-7def-4b37-b2aa-c9c7a9d726c4/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.054890 Jul 20 04:35:24.115875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2544/3669] 10.222.0.49 () {58 vars in 1295 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/277c2dfa-7def-4b37-b2aa-c9c7a9d726c4/os-instance-actions => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:24.127372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.129133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.145555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.146724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.149249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.149963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.362285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lazy-loading 'services' on Instance uuid 49223de1-2911-48d3-bc3a-1e7785c3f47d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:24.540295 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93136e2a-777e-4491-b362-83326c593ee2 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/c37658bb-4459-4f0e-aa5d-1392a7fd23e3" status: 202 len: 0 microversion: 2.1 time: 0.417802 Jul 20 04:35:24.541357 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2545/3670] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:35:24 2022] DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/c37658bb-4459-4f0e-aa5d-1392a7fd23e3 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:24.549748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:24.550712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:24.563834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.564818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.567204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.568204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.658645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:24.661225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:24.662648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lazy-loading 'fault' on Instance uuid 8f75e754-ad0f-4b95-90f5-b595cc85ed06 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:24.746300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc192fe53b349f2ac2cb53628b764a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49089c187edc4dd185e85d90fa7a1193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:24.768478 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05d1d6b2-0c65-4fde-8cc5-7d82789de529 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 200 len: 1307 microversion: 2.1 time: 0.224489 Jul 20 04:35:24.776509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2546/3671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:24 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:25.038304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4dbbe349-f277-4dc9-ab48-bb5cd166eb4a req-b492df35-7727-4827-ba55-3f541257f43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f75e754-ad0f-4b95-90f5-b595cc85ed06", "name": "network-vif-deleted", "tag": "d91a6aa3-72c2-4849-a92a-a03a7cd4a828"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:25.064238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4dbbe349-f277-4dc9-ab48-bb5cd166eb4a req-b492df35-7727-4827-ba55-3f541257f43a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:25.065208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4dbbe349-f277-4dc9-ab48-bb5cd166eb4a req-b492df35-7727-4827-ba55-3f541257f43a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:25.093224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4dbbe349-f277-4dc9-ab48-bb5cd166eb4a req-b492df35-7727-4827-ba55-3f541257f43a service nova] Creating event network-vif-deleted:d91a6aa3-72c2-4849-a92a-a03a7cd4a828 for instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 on n-h2-764486-11 Jul 20 04:35:25.103065 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4dbbe349-f277-4dc9-ab48-bb5cd166eb4a req-b492df35-7727-4827-ba55-3f541257f43a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324163 Jul 20 04:35:25.103992 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2547/3672] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:25.116385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1372361257", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "99a89468-e93b-45f5-b6e7-131721ce1601"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:25.902928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] validate_networks() for [('99a89468-e93b-45f5-b6e7-131721ce1601', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:27.132846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:27.133538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:27.134276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:27.134934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:27.135746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:27.164727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.167269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.170038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.170739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.221175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:27.231324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for user 4d4ae756d3714b598164985ed7d7876c and project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:27.246459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:27.251087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:35:27.337724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25923374-89eb-49ef-9279-c45f0cebfbeb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.226266 Jul 20 04:35:27.348266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2548/3673] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:35:27.366595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:27.370455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:27.394429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.395076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.396236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.409657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.713446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:27.727446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2e49a70-33dd-47f8-a5cb-01c3cf6992b4 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1488 microversion: 2.1 time: 0.372307 Jul 20 04:35:27.729235 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2549/3674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:27 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:27.748843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:27.755136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:27.770036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.770682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.771871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:27.775743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:27.818168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:27.980833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d4bf05d-b8c5-490d-ac6d-53886214a99e tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 204 len: 0 microversion: 2.1 time: 0.249423 Jul 20 04:35:27.981504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2550/3675] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:27 2022] DELETE /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:27.988835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:27.991878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.011473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.012120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.013248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.014196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.389630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.406747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.411034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.412664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1460a280-5ff1-41ba-a279-edae85225e04 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.429304 Jul 20 04:35:28.413393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2551/3676] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:27 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:28.423556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.425077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] [instance: 8f75e754-ad0f-4b95-90f5-b595cc85ed06] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.436025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.436603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.437392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.437922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.477395 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] HTTP exception thrown: Instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 could not be found. Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Request method failure captured: Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 HTTP/1.1 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Xf0vTR3_wITtDwjF4Ta1RewAVEdTMClmNW9Mb-uMZDjZ7tUEmPmOYn7trOLtpLo88NxX7FM7H8FwvpWbf_K5RNSrPL9tqEIXaHSbEhvbzpZq2ajL4aHL_emyHCF8TOmrqaQX974KcJF8ThKmUESKlaalgF_50VQqLA6qiFsX0enJ0 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 49089c187edc4dd185e85d90fa7a1193 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsTestJSON-111661602 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49089c187edc4dd185e85d90fa7a1193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49089c187edc4dd185e85d90fa7a1193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49089c187edc4dd185e85d90fa7a1193"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49089c187edc4dd185e85d90fa7a1193", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsTestJSON-111661602 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 49089c187edc4dd185e85d90fa7a1193 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsTestJSON-111661602 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsTestJSON-111661602-project Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4dc192fe53b349f2ac2cb53628b764a3 Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsTestJSON-111661602-project Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 could not be found. Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8f75e754-ad0f-4b95-90f5-b595cc85ed06'} Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 could not be found. Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 could not be found. Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:28.482176 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 could not be found. Jul 20 04:35:28.490507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:28.493463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] Returning 404 to user: Instance 8f75e754-ad0f-4b95-90f5-b595cc85ed06 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:28.495374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0892c46c-988f-46ea-ab1e-3b56d90519c5 tempest-InstanceActionsTestJSON-111661602 tempest-InstanceActionsTestJSON-111661602-project] 10.222.0.49 "GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06" status: 404 len: 111 microversion: 2.1 time: 0.079988 Jul 20 04:35:28.497064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2552/3677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:28 2022] GET /compute/v2.1/servers/8f75e754-ad0f-4b95-90f5-b595cc85ed06 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:28.528804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-adcf3c1b-c586-422c-b3f5-a6619f32f5a5 req-66f6a985-8311-407b-a451-08b2bc93246d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "name": "network-vif-plugged", "status": "completed", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:28.548027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-adcf3c1b-c586-422c-b3f5-a6619f32f5a5 req-66f6a985-8311-407b-a451-08b2bc93246d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.548569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-adcf3c1b-c586-422c-b3f5-a6619f32f5a5 req-66f6a985-8311-407b-a451-08b2bc93246d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.588949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-adcf3c1b-c586-422c-b3f5-a6619f32f5a5 req-66f6a985-8311-407b-a451-08b2bc93246d service nova] Creating event network-vif-plugged:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h1-764486-11 Jul 20 04:35:28.602620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-adcf3c1b-c586-422c-b3f5-a6619f32f5a5 req-66f6a985-8311-407b-a451-08b2bc93246d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103510 Jul 20 04:35:28.607427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2553/3678] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:28.613076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.613802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.647429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.647899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.661945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.662604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.689187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:28.821082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:28.836685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7420a16-100c-476f-aefc-c424dec1f153 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1211 microversion: 2.1 time: 0.222492 Jul 20 04:35:28.837655 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2554/3679] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:28 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1211 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:28.850934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:28.854950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:28.869814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.870795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.873613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:28.874556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:28.924620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:29.084426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3871f34b-6a9e-4252-8cb6-b3c251e6409d tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 204 len: 0 microversion: 2.1 time: 0.243761 Jul 20 04:35:29.084864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2555/3680] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:28 2022] DELETE /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:29.109434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.111730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.128803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.129784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.131279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.132201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.498121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:29.545635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e79e41f-578c-4a94-b376-f16d650288a2 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1528 microversion: 2.1 time: 0.458712 Jul 20 04:35:29.552079 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2556/3681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1528 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:29.577416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab31cedf-fcf3-4904-b258-4fd1bdd8dd2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b0f4700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.664751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ab31cedf-fcf3-4904-b258-4fd1bdd8dd2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Image not found. Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab31cedf-fcf3-4904-b258-4fd1bdd8dd2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 HTTP/1.1 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '29685a1a-711f-455b-9286-00e14336a045'} Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 29685a1a-711f-455b-9286-00e14336a045 to delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 29685a1a-711f-455b-9286-00e14336a045 could not be found. Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.669507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:35:29.680523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:29.690100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab31cedf-fcf3-4904-b258-4fd1bdd8dd2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:29.692671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab31cedf-fcf3-4904-b258-4fd1bdd8dd2e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045" status: 404 len: 62 microversion: 2.1 time: 0.135309 Jul 20 04:35:29.694891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2557/3682] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:29 2022] DELETE /compute/v2.1/images/29685a1a-711f-455b-9286-00e14336a045 => generated 62 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:35:29.706074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:29.707598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:29.727237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.729122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:29.731267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:29.732666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:30.773590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.783526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.789434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:30.804629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20aba496-d5ed-40e6-8d00-2378b88003ad tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 1.107367 Jul 20 04:35:30.809083 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2558/3683] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:29 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:30.825295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:30.830060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:30.843897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:30.845345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:30.850345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:30.852595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:30.946955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:35:31.096991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Instance is already in deleting state, ignoring this request Jul 20 04:35:31.097839 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3118c6f-d9b4-4678-b128-7c0f9e17c63f tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 204 len: 0 microversion: 2.1 time: 0.286106 Jul 20 04:35:31.098753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2559/3684] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:30 2022] DELETE /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:35:31.104604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:31.105287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.127179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.127179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.127951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.128418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.348869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:31.398191 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3173334-16c0-400c-9e74-84afa148487d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1273 microversion: 2.1 time: 0.292282 Jul 20 04:35:31.399260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2560/3685] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:31 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:31.449361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:31.450451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:31.486719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.487282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:31.488427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:31.489212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.350947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a575272ea4a2b910febb713d2f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461f118909f4f02a0e6c8c7d188d598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:32.350947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e117926-a730-4c02-b305-0de0ccc1c413 tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 200 len: 1528 microversion: 2.1 time: 0.930136 Jul 20 04:35:32.357085 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2561/3686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:31 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 1528 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:32.374615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-53854b85-7d93-4dc9-9bcf-d18df2d9f7d5 req-5add112e-3e0e-494b-b8f7-fac2ea0b0184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8", "name": "network-vif-unplugged", "status": "completed", "tag": "ffd2df0b-e9e5-4faf-abcb-907066179895"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:32.410680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-53854b85-7d93-4dc9-9bcf-d18df2d9f7d5 req-5add112e-3e0e-494b-b8f7-fac2ea0b0184 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.411201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-53854b85-7d93-4dc9-9bcf-d18df2d9f7d5 req-5add112e-3e0e-494b-b8f7-fac2ea0b0184 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.452325 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-53854b85-7d93-4dc9-9bcf-d18df2d9f7d5 req-5add112e-3e0e-494b-b8f7-fac2ea0b0184 service nova] Creating event network-vif-unplugged:ffd2df0b-e9e5-4faf-abcb-907066179895 for instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 on n-h2-764486-11 Jul 20 04:35:32.462649 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-53854b85-7d93-4dc9-9bcf-d18df2d9f7d5 req-5add112e-3e0e-494b-b8f7-fac2ea0b0184 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103702 Jul 20 04:35:32.467793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2562/3687] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:32.475320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:32.475320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:32.480601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:32.482888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.483457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:32.484298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:32.484853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.283112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc1acc695b0455cbe8f6ef66145c8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b72cee10fd34b7995d955a1647d5ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.300798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9156c2fc-c34d-4f96-8cfd-13e8add973ec tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 200 len: 1494 microversion: 2.1 time: 0.831511 Jul 20 04:35:33.302002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2563/3688] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:32 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 1494 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:33.351334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.356099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.376955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.381210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.382784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.391429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.903777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.923562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.931140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:33.934667 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8573efa-d154-4f43-a4f0-d64b57166519 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.620589 Jul 20 04:35:33.937612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2564/3689] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:33 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:33.963051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:33.967571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:33.990266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.991245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:33.992563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:33.993537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.260096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:34.283014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f25901e-c971-48a7-b8c2-f3b0a4057ab9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1273 microversion: 2.1 time: 0.339675 Jul 20 04:35:34.306514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2565/3690] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:33 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:34.342883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-13fa56bf-4218-469b-b18d-b04ac98aca43 req-b46c0263-af7f-4bab-afd0-7f3893ff891d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c8acaa-9525-4c25-b769-3503fe6095e4", "name": "network-vif-deleted", "tag": "76c81c38-23de-4787-804d-ab2dea982dcc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:34.398757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-13fa56bf-4218-469b-b18d-b04ac98aca43 req-b46c0263-af7f-4bab-afd0-7f3893ff891d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.399444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-13fa56bf-4218-469b-b18d-b04ac98aca43 req-b46c0263-af7f-4bab-afd0-7f3893ff891d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.471610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-13fa56bf-4218-469b-b18d-b04ac98aca43 req-b46c0263-af7f-4bab-afd0-7f3893ff891d service nova] Creating event network-vif-deleted:76c81c38-23de-4787-804d-ab2dea982dcc for instance f3c8acaa-9525-4c25-b769-3503fe6095e4 on n-h1-764486-11 Jul 20 04:35:34.498821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-13fa56bf-4218-469b-b18d-b04ac98aca43 req-b46c0263-af7f-4bab-afd0-7f3893ff891d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189639 Jul 20 04:35:34.509197 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2566/3691] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:34.545560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.551109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] [instance: f3c8acaa-9525-4c25-b769-3503fe6095e4] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.583481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.584844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.586012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.589210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.665215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] HTTP exception thrown: Instance f3c8acaa-9525-4c25-b769-3503fe6095e4 could not be found. Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Request method failure captured: Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 HTTP/1.1 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14XwAgdh3fv6X8l1RSaOMtjEmAyLbDr2-9-EuHaAObZrnmRp6FWJe1j1ARuYnhZ-yJe3CPrNuiQOTfQXFE8q3WmqLRVFbwOiKB7Z2oZnORG5BRGevPFPiv62hlWcGMW0_qI_G3BJT-CbrfsWKsneRvwtqd2KD1jdl6yfT2ucWzdbOgg Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0461f118909f4f02a0e6c8c7d188d598 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0461f118909f4f02a0e6c8c7d188d598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0461f118909f4f02a0e6c8c7d188d598", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0461f118909f4f02a0e6c8c7d188d598 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1421514350 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-InstanceActionsNegativeTestJSON-1421514350-project Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e06a575272ea4a2b910febb713d2f369 Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1421514350-project Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f3c8acaa-9525-4c25-b769-3503fe6095e4 could not be found. Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f3c8acaa-9525-4c25-b769-3503fe6095e4'} Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c8acaa-9525-4c25-b769-3503fe6095e4 could not be found. Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c8acaa-9525-4c25-b769-3503fe6095e4 could not be found. Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.668425 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c8acaa-9525-4c25-b769-3503fe6095e4 could not be found. Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] Returning 404 to user: Instance f3c8acaa-9525-4c25-b769-3503fe6095e4 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:34.673609 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e85930a-76c3-486b-8984-08dc9bb7674a tempest-InstanceActionsNegativeTestJSON-1421514350 tempest-InstanceActionsNegativeTestJSON-1421514350-project] 10.222.0.49 "GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4" status: 404 len: 111 microversion: 2.1 time: 0.158028 Jul 20 04:35:34.685912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2567/3692] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/f3c8acaa-9525-4c25-b769-3503fe6095e4 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:34.695635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.708200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.740508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.747701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.750383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.751185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.783014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 could not be found. Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 HTTP/1.1 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 could not be found. Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8'} Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 could not be found. Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 could not be found. Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.785416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.792798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:34.792798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:34.792798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:34.792798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:34.792798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 could not be found. Jul 20 04:35:34.792798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.794802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:34.795905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd3bd684-4de3-4657-8576-2ad712d72a0c tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8" status: 404 len: 111 microversion: 2.1 time: 0.108536 Jul 20 04:35:34.797171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2568/3693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] GET /compute/v2.1/servers/80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:34.822101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3afd6a34-fef2-41a8-be43-0b7602f4a015 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838aec3af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.892457 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3afd6a34-fef2-41a8-be43-0b7602f4a015 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Image not found. Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3afd6a34-fef2-41a8-be43-0b7602f4a015 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 HTTP/1.1 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1edd3bae-bf4e-4286-ae3d-521d1dbedcf3'} Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 to delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 could not be found. Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.896228 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3afd6a34-fef2-41a8-be43-0b7602f4a015 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:34.900702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3afd6a34-fef2-41a8-be43-0b7602f4a015 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3" status: 404 len: 62 microversion: 2.1 time: 0.097094 Jul 20 04:35:34.902153 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2569/3694] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:34 2022] DELETE /compute/v2.1/images/1edd3bae-bf4e-4286-ae3d-521d1dbedcf3 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:35:34.919516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:34.933195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:34.956461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.972292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:34.973669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:34.975083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.033259 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 HTTP/1.1 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3'} Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:35.034875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:35.039562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ec01625-cbf1-46d8-9335-7eb1a4cb106e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 404 len: 111 microversion: 2.1 time: 0.127266 Jul 20 04:35:35.044564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2570/3695] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:34 2022] DELETE /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:35.053914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:35.054585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:35.073635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.074100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.074907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.075354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.357779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.376683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.384679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:35.387815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5df9c86a-b16c-49f3-8be2-01026f9427eb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.341764 Jul 20 04:35:35.394244 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2571/3696] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:35 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:35.416550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:35.418721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:35.442473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.445709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.450240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.458261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.563103 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 HTTP/1.1 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3'} Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.574877 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:35.579028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:35.579028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:35.579028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:35.579028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:35.579028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. Jul 20 04:35:35.579028 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:35.580339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:35.583378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f24ed2a-c4a9-40c6-a8d7-7cf89f595d49 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3" status: 404 len: 111 microversion: 2.1 time: 0.187095 Jul 20 04:35:35.607187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2572/3697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:35 2022] GET /compute/v2.1/servers/f08e64d9-7f4a-46b2-8fc8-6a6e2232cdc3 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:35.661888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:35.676663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:35.697170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.697745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:35.698536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:35.698976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.076250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:36.083168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:36.105361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2b1dc29-a432-4384-ba2e-000c0756e357 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1273 microversion: 2.1 time: 0.486840 Jul 20 04:35:36.119808 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2573/3698] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:35 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1273 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:36.125638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57ff852b-e42c-417f-ac03-49450804390e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838b00a310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.177298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-57ff852b-e42c-417f-ac03-49450804390e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Image not found. Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57ff852b-e42c-417f-ac03-49450804390e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a HTTP/1.1 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'b338d642-49bd-45b6-9395-e6474a1bc47a'} Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b338d642-49bd-45b6-9395-e6474a1bc47a to delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b338d642-49bd-45b6-9395-e6474a1bc47a could not be found. Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.179371 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.183987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57ff852b-e42c-417f-ac03-49450804390e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:36.185586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-57ff852b-e42c-417f-ac03-49450804390e tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a" status: 404 len: 62 microversion: 2.1 time: 0.063477 Jul 20 04:35:36.186539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2574/3699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:36 2022] DELETE /compute/v2.1/images/b338d642-49bd-45b6-9395-e6474a1bc47a => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:35:36.196335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.200398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:36.218250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.223116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.224856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.228584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.266453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b HTTP/1.1 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c459f8cc-daf3-41d4-b848-cd2adfd63b6b'} Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:36.268167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9dd13634-34b9-41d6-9786-3a7eb2aa9cdc tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 404 len: 111 microversion: 2.1 time: 0.078434 Jul 20 04:35:36.273974 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2575/3700] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:36 2022] DELETE /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:35:36.282756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.295206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: c459f8cc-daf3-41d4-b848-cd2adfd63b6b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:36.305301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.305762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.306543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.307012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.354430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b HTTP/1.1 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c459f8cc-daf3-41d4-b848-cd2adfd63b6b'} Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.356721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.365751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance c459f8cc-daf3-41d4-b848-cd2adfd63b6b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:36.367203 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c081472f-8cbe-4833-9e06-b9a8faff9123 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b" status: 404 len: 111 microversion: 2.1 time: 0.079987 Jul 20 04:35:36.368318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2576/3701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:36 2022] GET /compute/v2.1/servers/c459f8cc-daf3-41d4-b848-cd2adfd63b6b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:36.376133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00f5ea6b-82ce-4cc4-9b64-8b5861259823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '.version_select at 0x7f838af190d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.449892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-00f5ea6b-82ce-4cc4-9b64-8b5861259823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Image not found. Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00f5ea6b-82ce-4cc4-9b64-8b5861259823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 HTTP/1.1 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: exception: Image not found. Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4b1639ce-edcb-459a-9927-4655cc1b2535'} Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b1639ce-edcb-459a-9927-4655cc1b2535 to delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b1639ce-edcb-459a-9927-4655cc1b2535 could not be found. Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.451714 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00f5ea6b-82ce-4cc4-9b64-8b5861259823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Image not found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00f5ea6b-82ce-4cc4-9b64-8b5861259823 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535" status: 404 len: 62 microversion: 2.1 time: 0.081689 Jul 20 04:35:36.458575 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2577/3702] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:36 2022] DELETE /compute/v2.1/images/4b1639ce-edcb-459a-9927-4655cc1b2535 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:35:36.461092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:36.461586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:36.485767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.486510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:36.487561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:36.488164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.097339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.124021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.136115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:37.148871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db493e1d-b4d5-41ff-a775-ec50e15ec4b1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.693566 Jul 20 04:35:37.149497 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2578/3703] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:36 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:37.178796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:37.179309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:37.210149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:37.211990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.212480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.218381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.218850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.241136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:35:37.283503 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d HTTP/1.1 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fe68d5b7-3c53-4581-be34-866b5c03ab5d'} Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:37.285520 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:37.290620 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:37.294391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:37.298526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63fa58dc-a999-4dda-8f7a-a2d7bdeb55ac tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 404 len: 111 microversion: 2.1 time: 0.147932 Jul 20 04:35:37.302029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2579/3704] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:35:37 2022] DELETE /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:37.325197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f71c3ead-f1e3-4ed4-ba1d-3aed55853b0c req-655f334f-2b1a-4989-bb32-9b6fcb2b6c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8", "name": "network-vif-deleted", "tag": "ffd2df0b-e9e5-4faf-abcb-907066179895"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:37.350822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f71c3ead-f1e3-4ed4-ba1d-3aed55853b0c req-655f334f-2b1a-4989-bb32-9b6fcb2b6c44 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.354091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f71c3ead-f1e3-4ed4-ba1d-3aed55853b0c req-655f334f-2b1a-4989-bb32-9b6fcb2b6c44 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.385610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f71c3ead-f1e3-4ed4-ba1d-3aed55853b0c req-655f334f-2b1a-4989-bb32-9b6fcb2b6c44 service nova] Creating event network-vif-deleted:ffd2df0b-e9e5-4faf-abcb-907066179895 for instance 80b0d73c-3bae-49ba-b4b8-a8dc6a3002e8 on n-h2-764486-11 Jul 20 04:35:37.401969 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f71c3ead-f1e3-4ed4-ba1d-3aed55853b0c req-655f334f-2b1a-4989-bb32-9b6fcb2b6c44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096066 Jul 20 04:35:37.405680 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2580/3705] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:37.415654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:37.420944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:37.439810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.442302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.446989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.447733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.540006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7d6f405-718b-4a1c-90ea-6aedc8856700 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/9f968286-89ab-462f-a985-c1751061febc" status: 200 len: 194 microversion: 2.1 time: 0.128916 Jul 20 04:35:37.544862 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2581/3706] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Jul 20 04:35:37 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/9f968286-89ab-462f-a985-c1751061febc => generated 194 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:37.567995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:37.572021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:37.597037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.601126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:37.602525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:37.603150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.277273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:38.299237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29e4e278-2a44-42d6-b222-20a56bd36a38 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1315 microversion: 2.1 time: 0.751517 Jul 20 04:35:38.301881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2582/3707] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:37 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:38.331510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.332919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] [instance: fe68d5b7-3c53-4581-be34-866b5c03ab5d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:38.375560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.378408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.379552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.381460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.438942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] HTTP exception thrown: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Request method failure captured: Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d HTTP/1.1 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14TfTebV7NubqYaVPvBWebnOS3EFDSzfLlt5fKLfxAMUHpmunq6i1mLrByFXZiOaQ32IHSxugdGsgon_2G3ziIBhV3tTUSkZ9VMl7xynr5aEDAWjswpRpP_jd_mj0CUjmLC5MuM3VirdLE4t-8ClC3dxV4xiOwXaTKSdGbW-Ra9OJRU Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1b72cee10fd34b7995d955a1647d5ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1b72cee10fd34b7995d955a1647d5ac6", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ImagesTestJSON-456111739 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1b72cee10fd34b7995d955a1647d5ac6 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ImagesTestJSON-456111739 Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4fc1acc695b0455cbe8f6ef66145c8aa Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ImagesTestJSON-456111739-project Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fe68d5b7-3c53-4581-be34-866b5c03ab5d'} Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:38.446201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:35:38.450752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:35:38.450752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:35:38.450752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:35:38.450752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:35:38.450752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. Jul 20 04:35:38.450752 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:35:38.452266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] Returning 404 to user: Instance fe68d5b7-3c53-4581-be34-866b5c03ab5d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:35:38.477187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-496e859c-bf7a-45a9-82be-137e993c96b1 tempest-ImagesTestJSON-456111739 tempest-ImagesTestJSON-456111739-project] 10.222.0.49 "GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d" status: 404 len: 111 microversion: 2.1 time: 0.168960 Jul 20 04:35:38.481314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2583/3708] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:38 2022] GET /compute/v2.1/servers/fe68d5b7-3c53-4581-be34-866b5c03ab5d => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:35:38.508691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:38.509747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:38.540342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.540342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.544548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:38.544933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:38.944746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lazy-loading 'services' on Instance uuid 49223de1-2911-48d3-bc3a-1e7785c3f47d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:35:39.156966 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9944bbe0-ee4b-41d9-942a-989f7217674e tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/9f968286-89ab-462f-a985-c1751061febc" status: 202 len: 0 microversion: 2.1 time: 0.666825 Jul 20 04:35:39.158184 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2584/3709] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:35:38 2022] DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments/9f968286-89ab-462f-a985-c1751061febc => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:35:39.186480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:39.187471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:39.202373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.204015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.207187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.208382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.809049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.829378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.831728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:39.844195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0371172-0f4b-4b4d-9607-188950176189 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.684946 Jul 20 04:35:39.849969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2585/3710] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:39 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:39.875761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:39.885877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:39.920667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.934500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:39.936266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:39.937373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.635710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:41.654594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdfa91d3-d153-4ea7-9535-27731d2a6a76 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1315 microversion: 2.1 time: 1.792694 Jul 20 04:35:41.658220 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2586/3711] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:39 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1315 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:41.675960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-83bc8739-6215-482f-92bd-728d96f481f0 req-b7913120-3bdc-419b-bc96-a3fab089f268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd", "tag": "d7eeae4f-9129-45fa-854a-0be7c3325b13"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:41.712696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-83bc8739-6215-482f-92bd-728d96f481f0 req-b7913120-3bdc-419b-bc96-a3fab089f268 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.721901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-83bc8739-6215-482f-92bd-728d96f481f0 req-b7913120-3bdc-419b-bc96-a3fab089f268 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.788823 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-83bc8739-6215-482f-92bd-728d96f481f0 req-b7913120-3bdc-419b-bc96-a3fab089f268 service nova] Creating event network-changed:d7eeae4f-9129-45fa-854a-0be7c3325b13 for instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd on n-h2-764486-11 Jul 20 04:35:41.809983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-83bc8739-6215-482f-92bd-728d96f481f0 req-b7913120-3bdc-419b-bc96-a3fab089f268 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145095 Jul 20 04:35:41.812864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2587/3712] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:41.846460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:41.857727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:41.892225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.893036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:41.894386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:41.895114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.238795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.250107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.276316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:45.288885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc58f913-06ad-4757-89a4-84082757b5c2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 3.464423 Jul 20 04:35:45.293123 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2588/3713] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:41 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 3480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:45.316309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:45.332386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:45.371548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.382438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:45.390762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:45.392296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.893631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:47.909515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d54c5510-8b92-4f13-9204-87b1e45ad5b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1315 microversion: 2.1 time: 2.595719 Jul 20 04:35:47.914958 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2589/3714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:45 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1315 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:47.933550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:47.936136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:47.963162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.963975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:47.965050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:47.965708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:48.841626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.858210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.860286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:48.865544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d425f7a8-a047-4524-9f83-971c5bb42dbc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.948678 Jul 20 04:35:48.869347 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2590/3715] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:47 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:49.669745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:49.673002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:49.695487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.703398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:49.705151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:49.706100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.224062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:52.274111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afa4d23e-a3a6-4008-a85a-0623a3e6947b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1315 microversion: 2.1 time: 3.329166 Jul 20 04:35:52.282618 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2591/3716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:48 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1315 bytes in 3339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:35:52.345667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:52.347150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:52.376151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.376877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:52.377813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:52.393238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:54.260885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.288638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.290521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:54.305845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2468c9d7-26e5-4281-8a65-2ad2fb5ee1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 1.969490 Jul 20 04:35:54.311298 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2592/3717] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:35:52 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:35:54.823781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cf822eb0-86e3-47db-ad2d-de1d0ddeb481 req-3b3f8325-2b45-4b51-8f2e-f731ffaa3480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd", "name": "network-vif-plugged", "status": "completed", "tag": "d7eeae4f-9129-45fa-854a-0be7c3325b13"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:54.943765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cf822eb0-86e3-47db-ad2d-de1d0ddeb481 req-3b3f8325-2b45-4b51-8f2e-f731ffaa3480 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:54.944229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cf822eb0-86e3-47db-ad2d-de1d0ddeb481 req-3b3f8325-2b45-4b51-8f2e-f731ffaa3480 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.062236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cf822eb0-86e3-47db-ad2d-de1d0ddeb481 req-3b3f8325-2b45-4b51-8f2e-f731ffaa3480 service nova] Creating event network-vif-plugged:d7eeae4f-9129-45fa-854a-0be7c3325b13 for instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd on n-h2-764486-11 Jul 20 04:35:55.087647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cf822eb0-86e3-47db-ad2d-de1d0ddeb481 req-3b3f8325-2b45-4b51-8f2e-f731ffaa3480 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.771881 Jul 20 04:35:55.092232 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2593/3718] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:35:55.128808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:35:55.133165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:35:55.177549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.182052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:55.185308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:55.186128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:56.388430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:35:56.421724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59225c16-9adf-49bd-8715-221ea8272a96 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1315 microversion: 2.1 time: 1.320737 Jul 20 04:35:56.446206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2594/3719] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:35:55 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1315 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:35:56.692373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-950339688", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "19f4f427-dc68-4f80-aad7-5b1e1cfb14f0"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:35:56.869407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] validate_networks() for [('19f4f427-dc68-4f80-aad7-5b1e1cfb14f0', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:35:59.422539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:35:59.423157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:35:59.423427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:35:59.423838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:35:59.424247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:35:59.483000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.495841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.508510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:35:59.510183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:35:59.584537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Getting quotas for project cb424a86017a4c418751e2d7ee007847. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:35:59.610860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Getting quotas for user d7afaf4026ba4f35b9c6d8b20bf91bb1 and project cb424a86017a4c418751e2d7ee007847. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:35:59.795475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:35:59.814387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:00.122696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-407710f9-ae3b-4bdd-b8d1-e7e9e682751b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.671002 Jul 20 04:36:00.152243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2595/3720] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:35:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:00.170423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.176100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.227720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.228515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.230635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.234922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.355137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3583793a-d482-45bd-b458-d34fc33866d6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.193089 Jul 20 04:36:00.369063 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2596/3721] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments => generated 25 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:00.389747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:00.391545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:00.419269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.420077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.448459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:00.453337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:00.560496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:01.059778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.072255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.081060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.087735 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb1cd144-3141-48bd-a59f-0f3b97300626 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1740 microversion: 2.20 time: 0.713047 Jul 20 04:36:01.089314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2597/3722] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:00 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1740 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:01.103811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:01.104849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:01.148189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.152555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.159809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:01.164224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:01.678061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:01.700011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-072445fd-7d73-4cf4-8669-f769be93e80d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1502 microversion: 2.1 time: 0.607645 Jul 20 04:36:01.717685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2598/3723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:01 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1502 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:01.739652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-727371273", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "19f4f427-dc68-4f80-aad7-5b1e1cfb14f0"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:01.960794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] validate_networks() for [('19f4f427-dc68-4f80-aad7-5b1e1cfb14f0', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:04.194843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:04.195526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:04.195729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:04.196135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:04.196828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:04.199078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:04.221680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.222323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.223348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.223790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.286299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Getting quotas for project cb424a86017a4c418751e2d7ee007847. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:04.310170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Getting quotas for user d7afaf4026ba4f35b9c6d8b20bf91bb1 and project cb424a86017a4c418751e2d7ee007847. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:04.334866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:04.337255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:04.446810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6007a924-d473-47e7-a552-e0379fa0274f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.723693 Jul 20 04:36:04.456287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2599/3724] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:04.462218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.463232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.514057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.514521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.516159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.516656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.605243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81c823b1-2119-425f-8989-95041211a1fa tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147644 Jul 20 04:36:04.606472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2600/3725] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:04.612066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:04.615737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.633686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.634523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.635531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.636173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.715141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d047cf02-f8a1-43bd-ae40-7c2cfa219a33 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action" status: 200 len: 14 microversion: 2.1 time: 0.107178 Jul 20 04:36:04.716428 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2601/3726] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:04 2022] POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:04.723442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:04.730045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:04.746357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.749309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:04.757865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:04.758895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.926128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.942627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.944264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:05.945679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29099048-9071-479e-8fa4-281c7df8e70f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1722 microversion: 2.20 time: 1.227765 Jul 20 04:36:05.946454 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2602/3727] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:04 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1722 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:05.963902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:05.964771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:05.971847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.972585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:05.973632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:05.974237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:06.046296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:36:06.244056 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed73660d-2512-47e7-965d-806df150a085 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 204 len: 0 microversion: 2.1 time: 0.284199 Jul 20 04:36:06.245408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2603/3728] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:05 2022] DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:06.256105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1199995855", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "451", "networks": [{"uuid": "19f4f427-dc68-4f80-aad7-5b1e1cfb14f0"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:06.344607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] validate_networks() for [('19f4f427-dc68-4f80-aad7-5b1e1cfb14f0', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:07.287793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:07.289144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:07.289806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:07.290383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:07.291108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:07.301899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.302707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.303813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.304647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.325336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Getting quotas for project cb424a86017a4c418751e2d7ee007847. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:07.331438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Getting quotas for user d7afaf4026ba4f35b9c6d8b20bf91bb1 and project cb424a86017a4c418751e2d7ee007847. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:07.352454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:07.355532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:07.419790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00155436-6567-40d9-8e6a-0386cb307570 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172119 Jul 20 04:36:07.427679 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2604/3729] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:07.611897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19a25ff2-7fd6-479a-aa63-8bbb87708d46 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838b231160>, body: {"keypair": {"name": "tempest-keypair-451323920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhegaGtk5KcWpfTmgUI7BmwircTwntMvG7wz0GGJc8OS+iEzeel0vducSzvX7lolfhtBTRff/1/u3MQtYcQesx0IZG3OEqS0NDtJURX8B3tTamRR8slGyHFFXhtShRWeg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:07.635352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-19a25ff2-7fd6-479a-aa63-8bbb87708d46 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:07.655411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-19a25ff2-7fd6-479a-aa63-8bbb87708d46 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:07.718408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19a25ff2-7fd6-479a-aa63-8bbb87708d46 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.289258 Jul 20 04:36:07.719193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2605/3730] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 291 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:07.724132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:07.725176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:07.734387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.734885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.735976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:07.739174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:07.948085 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b43d8e0-b61d-40bd-a82b-0cd33081dbfc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action" status: 200 len: 14 microversion: 2.1 time: 0.227221 Jul 20 04:36:07.949489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2606/3731] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:07 2022] POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:07.969271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:07.970190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:08.031409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.033975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:08.043104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:08.043998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.011019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.043362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7358e4c8-4726-4176-9eee-be1fb5ff6812 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1671 microversion: 2.1 time: 1.091416 Jul 20 04:36:09.044271 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2607/3732] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:07 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1671 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:09.072239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.082032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.109859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.111082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.112827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.116142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.686044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.736989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.744958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:09.757047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92c18816-4401-4b82-9170-8f742586ea03 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1665 microversion: 2.20 time: 0.706801 Jul 20 04:36:09.759239 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2608/3733] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1665 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:09.782132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:09.783662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:09.811726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.813682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:09.816125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:09.817784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.016393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:10.036774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67f44b64-9384-496d-a15b-5b6f136bb327 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1281 microversion: 2.1 time: 0.274723 Jul 20 04:36:10.049224 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2609/3734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:09 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:10.065017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ece9ac5c-2900-4763-bcb7-9d63399ebc76 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838b1113a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:10.086635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ece9ac5c-2900-4763-bcb7-9d63399ebc76 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-451323920" status: 200 len: 512 microversion: 2.2 time: 0.025373 Jul 20 04:36:10.088008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2610/3735] 10.222.0.49 () {60 vars in 1254 bytes} [Wed Jul 20 04:36:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-451323920 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:10.104555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-871fca11-bf49-4537-bc8e-b13242714826 req-ababfb5d-cdf0-40d7-9db0-7d4cb69111e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "name": "network-vif-unplugged", "status": "completed", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:10.139043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-871fca11-bf49-4537-bc8e-b13242714826 req-ababfb5d-cdf0-40d7-9db0-7d4cb69111e2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.142575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-871fca11-bf49-4537-bc8e-b13242714826 req-ababfb5d-cdf0-40d7-9db0-7d4cb69111e2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.176689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_external_events [req-871fca11-bf49-4537-bc8e-b13242714826 req-ababfb5d-cdf0-40d7-9db0-7d4cb69111e2 service nova] Unable to find a host for instance 784190f6-370f-4649-9bee-c669f705e6fc. Dropping event network-vif-unplugged {{(pid=123724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:36:10.178400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-871fca11-bf49-4537-bc8e-b13242714826 req-ababfb5d-cdf0-40d7-9db0-7d4cb69111e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084302 Jul 20 04:36:10.186599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2611/3736] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:36:10.197630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:10.200471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.214903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.216016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.218076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.219181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.313798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8376651c-6fa1-4762-8774-992fe9486950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action" status: 200 len: 14 microversion: 2.1 time: 0.124935 Jul 20 04:36:10.314781 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2612/3737] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:10 2022] POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:10.330137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "671535ba-1671-436e-b5fb-2af9fc322dbe"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:10.331447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:10.339344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.339805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:10.340642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:10.341095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.498513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05d4da53-5294-458e-9473-ed1e8d6d8291 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.181937 Jul 20 04:36:11.514277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2613/3738] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Jul 20 04:36:10 2022] POST /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 188 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:36:11.545686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:11.547964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:11.608177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.617661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.621146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:11.626859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:11.822086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:13.085271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79561d22ff3f40739c9515a85b78d561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0218fbb8d349c1a01636234437d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:13.127239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd701623-33ab-448b-9f22-e6d35a3ea11d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 200 len: 1604 microversion: 2.1 time: 1.601605 Jul 20 04:36:13.132147 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2614/3739] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:11 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 1604 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:13.154439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b4fccde-6970-4540-9137-67faa5f58f8e tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838ae7f3a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.250991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b4fccde-6970-4540-9137-67faa5f58f8e tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451323920" status: 204 len: 0 microversion: 2.2 time: 0.115328 Jul 20 04:36:13.254458 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2615/3740] 10.222.0.49 () {60 vars in 1257 bytes} [Wed Jul 20 04:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451323920 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:13.283189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2aec5072-d7f0-4e91-805f-08954241e59b req-da68207b-7c3a-4bb5-9ab9-9384c65069b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c7f8e2-b6a6-4839-b0b7-11503c93cfac", "tag": "c004f5b4-d7a8-470c-97d7-2cd982176015"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:13.343490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2aec5072-d7f0-4e91-805f-08954241e59b req-da68207b-7c3a-4bb5-9ab9-9384c65069b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.346190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2aec5072-d7f0-4e91-805f-08954241e59b req-da68207b-7c3a-4bb5-9ab9-9384c65069b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.407943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2aec5072-d7f0-4e91-805f-08954241e59b req-da68207b-7c3a-4bb5-9ab9-9384c65069b1 service nova] Creating event network-changed:c004f5b4-d7a8-470c-97d7-2cd982176015 for instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac on n-h1-764486-11 Jul 20 04:36:13.425622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2aec5072-d7f0-4e91-805f-08954241e59b req-da68207b-7c3a-4bb5-9ab9-9384c65069b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168493 Jul 20 04:36:13.435219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2616/3741] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:13.460644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:13.462469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.493849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.495002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.496924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.500983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.810679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:13.842681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5fa9150-269e-4ce3-9d6d-0745cb369482 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1279 microversion: 2.1 time: 0.387763 Jul 20 04:36:13.843738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2617/3742] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:13 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1279 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:13.850817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:13.852430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:13.860648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.861792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:13.862948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:13.863608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.029099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d32c78e-a041-453c-bce3-17616051b786 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action" status: 200 len: 16401 microversion: 2.1 time: 0.183152 Jul 20 04:36:14.030081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2618/3743] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:13 2022] POST /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd/action => generated 16401 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:36:14.036037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:14.045565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:14.078166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.079740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.084582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.085932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.419751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c5931c6-02e0-47b8-9343-38d9e2f1e65b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/action" status: 202 len: 0 microversion: 2.20 time: 0.388168 Jul 20 04:36:14.420623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2619/3744] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:36:14 2022] POST /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:14.463476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26523a3c-9718-49c9-90de-c0b8ff4f27a2 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838ba56550>, body: {"keypair": {"name": "tempest-keypair-708668230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlhDIZTwEyxlxqENQiIJP/bZ4iUo0+hhjykcwUov4UL/7NlUq45XBJpMas7eGmTU58gNNUP72YVHIHkE2FdBq+phmbXTcyXlzRQacIAhx8nwEURQ4J+xbp+1kqEW78/MA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:14.584820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-26523a3c-9718-49c9-90de-c0b8ff4f27a2 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:14.623415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-26523a3c-9718-49c9-90de-c0b8ff4f27a2 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:14.768095 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26523a3c-9718-49c9-90de-c0b8ff4f27a2 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.332544 Jul 20 04:36:14.769400 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2620/3745] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 348 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:14.806971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:14.808305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:14.826745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:14.846647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.849550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:14.851384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:14.856028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.687633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:15.709723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95e9651b-bfcf-4ebd-a9fc-7e8e60f14723 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.938937 Jul 20 04:36:15.725414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2621/3746] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:14 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:15.742045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:15.743966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:15.765027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.769039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.770296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.770924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.841471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] HTTP exception thrown: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Request method failure captured: Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d HTTP/1.1 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RwwDs0wflxYpblMVMcDCIbOVF56A9LdazkfjwEbg2CtrQwoErHDkZrKHJ_2Fp9_Y7uSNXuSa-ld_u7WgJjqsr1m-MIMpoiJkYmUfzt420LvZjTnYzF_XmYCKh5h2W4UFYxmHXsHcc6RMnUQ5MM_JwvkBCj8azYLIuLeRJdhY_7ekw Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc0218fbb8d349c1a01636234437d7f8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 79561d22ff3f40739c9515a85b78d561 Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '49223de1-2911-48d3-bc3a-1e7785c3f47d'} Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:15.843947 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Returning 404 to user: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:15.851038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35f98523-8879-4d90-beae-97c0d78d48ce tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 404 len: 111 microversion: 2.1 time: 0.118931 Jul 20 04:36:15.853437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2622/3747] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:15 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:15.864058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:15.864739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:15.892525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.893599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:15.895766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:15.895766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.549003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:16.561723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:16.563504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:16.565204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4851feab-c828-4831-92f3-55807bf045cb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1751 microversion: 2.20 time: 0.708756 Jul 20 04:36:16.565976 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2623/3748] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:15 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1751 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:16.571339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f7ec7a1-a8a6-4b5a-844e-4c7d9b781dcf tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838b9fc8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:16.640663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f7ec7a1-a8a6-4b5a-844e-4c7d9b781dcf tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708668230" status: 204 len: 0 microversion: 2.2 time: 0.072827 Jul 20 04:36:16.657237 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2624/3749] 10.222.0.49 () {60 vars in 1257 bytes} [Wed Jul 20 04:36:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708668230 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:16.679661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:16.680862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:16.709957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.726573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:16.727660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:16.728402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.318831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:17.414948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:17.459791 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-171f4556-bd89-4c65-8918-14ba766acba9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1321 microversion: 2.1 time: 0.796846 Jul 20 04:36:17.462692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2625/3750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:16 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:17.474888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-eb007094-8025-4f79-9cb9-c52ecc350fff req-0dbfd4f3-9258-42b8-9761-1d3f4bb67d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49223de1-2911-48d3-bc3a-1e7785c3f47d", "name": "network-vif-deleted", "tag": "16828c7b-37af-41fd-a135-4b1af8510a95"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:17.515052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb007094-8025-4f79-9cb9-c52ecc350fff req-0dbfd4f3-9258-42b8-9761-1d3f4bb67d6a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.541038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb007094-8025-4f79-9cb9-c52ecc350fff req-0dbfd4f3-9258-42b8-9761-1d3f4bb67d6a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.623030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eb007094-8025-4f79-9cb9-c52ecc350fff req-0dbfd4f3-9258-42b8-9761-1d3f4bb67d6a service nova] Creating event network-vif-deleted:16828c7b-37af-41fd-a135-4b1af8510a95 for instance 49223de1-2911-48d3-bc3a-1e7785c3f47d on n-h2-764486-11 Jul 20 04:36:17.661128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-eb007094-8025-4f79-9cb9-c52ecc350fff req-0dbfd4f3-9258-42b8-9761-1d3f4bb67d6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189971 Jul 20 04:36:17.669576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2626/3751] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:17.709734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:17.715700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:17.805576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.806531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:17.807617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:17.808702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.256368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:18.341429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b56f667-f6ad-4172-b68a-c5d2444b29a4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.669683 Jul 20 04:36:18.343561 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2627/3752] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:17 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:18.361763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39657a81-567e-40c1-aea3-11f0c33fc28d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '.version_select at 0x7f838b9565e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.415276 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39657a81-567e-40c1-aea3-11f0c33fc28d tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774960791" status: 202 len: 0 microversion: 2.1 time: 0.067510 Jul 20 04:36:18.425624 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2628/3753] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774960791 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:18.441152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e11a1186-7718-489a-9d80-d1dad4046847 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838b111940>, body: {"keypair": {"name": "tempest-keypair-283546833", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:18.557552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e11a1186-7718-489a-9d80-d1dad4046847 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:18.574395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e11a1186-7718-489a-9d80-d1dad4046847 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:18.660883 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e11a1186-7718-489a-9d80-d1dad4046847 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.232264 Jul 20 04:36:18.664140 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2629/3754] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:18 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:18.676807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:18.679169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:18.695727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.696469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:18.697450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:18.698053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.374096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:19.401484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:19.408906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:19.412191 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3569ced1-f268-4ead-885d-41d18cf3d975 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1753 microversion: 2.20 time: 0.740439 Jul 20 04:36:19.435555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2630/3755] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:18 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1753 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:19.435555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-77fc521d-2d29-4fbd-98de-8c432139490a req-9c8f4367-6c1a-496e-9df8-e020d4368a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09a3e91-173a-4ff1-b657-569689c2c838", "tag": "097e0288-9940-4bb2-ae64-a229d380da85"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:19.462089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-77fc521d-2d29-4fbd-98de-8c432139490a req-9c8f4367-6c1a-496e-9df8-e020d4368a66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.462089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-77fc521d-2d29-4fbd-98de-8c432139490a req-9c8f4367-6c1a-496e-9df8-e020d4368a66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.524388 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-77fc521d-2d29-4fbd-98de-8c432139490a req-9c8f4367-6c1a-496e-9df8-e020d4368a66 service nova] Creating event network-changed:097e0288-9940-4bb2-ae64-a229d380da85 for instance f09a3e91-173a-4ff1-b657-569689c2c838 on n-h1-764486-11 Jul 20 04:36:19.533581 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-77fc521d-2d29-4fbd-98de-8c432139490a req-9c8f4367-6c1a-496e-9df8-e020d4368a66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113820 Jul 20 04:36:19.534879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2631/3756] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:19.542189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0b85d71f-0255-4ed4-b7a9-04fca82a3913 req-224c973c-a2da-48b1-b161-70bda323948c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c7f8e2-b6a6-4839-b0b7-11503c93cfac", "name": "network-vif-plugged", "status": "completed", "tag": "c004f5b4-d7a8-470c-97d7-2cd982176015"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:19.552486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0b85d71f-0255-4ed4-b7a9-04fca82a3913 req-224c973c-a2da-48b1-b161-70bda323948c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.553227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0b85d71f-0255-4ed4-b7a9-04fca82a3913 req-224c973c-a2da-48b1-b161-70bda323948c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.577142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0b85d71f-0255-4ed4-b7a9-04fca82a3913 req-224c973c-a2da-48b1-b161-70bda323948c service nova] Creating event network-vif-plugged:c004f5b4-d7a8-470c-97d7-2cd982176015 for instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac on n-h1-764486-11 Jul 20 04:36:19.585961 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0b85d71f-0255-4ed4-b7a9-04fca82a3913 req-224c973c-a2da-48b1-b161-70bda323948c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048863 Jul 20 04:36:19.589961 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2632/3757] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:19.602779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:19.603543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:19.625501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.625989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:19.626822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:19.627260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.370728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:21.399641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3833f2d8-4e62-48f0-b086-58c550e8b1cd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 1.807239 Jul 20 04:36:21.420908 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2633/3758] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:19 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:21.438748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:21.440015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:21.480650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.481287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:21.482344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:21.482906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.200584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:22.243300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d6d24ce-3047-4ed0-a5e3-ccdfb7116e87 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1321 microversion: 2.1 time: 0.820448 Jul 20 04:36:22.248869 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2634/3759] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:21 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1321 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:22.271413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-070307bd-64cb-4d57-9053-1b52929c2e59 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838bace280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:22.367062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-070307bd-64cb-4d57-9053-1b52929c2e59 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283546833" status: 204 len: 0 microversion: 2.2 time: 0.113656 Jul 20 04:36:22.368184 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2635/3760] 10.222.0.49 () {60 vars in 1257 bytes} [Wed Jul 20 04:36:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283546833 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:22.374001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:22.375503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:22.385799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.386569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:22.387552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:22.388203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.405161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:23.434296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:23.438860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:23.443496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab4a6631-b4a1-4398-907e-5e66818b7323 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1753 microversion: 2.20 time: 1.073805 Jul 20 04:36:23.473616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2636/3761] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:22 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1753 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:23.491742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:23.492407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:23.518521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.518984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:23.520031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:23.520705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.276786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:24.327089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-560a2cac-3f76-4f51-a9b4-5a3b140d355f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.842969 Jul 20 04:36:24.330091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2637/3762] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:23 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:24.372919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-71e8fc5e-6d8d-46fa-84b1-7c9dd6cc019b req-ac15aad7-2b63-4b44-858c-6b1bae84cba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a74219-6dda-4acf-a2cf-9ebbc6881334", "tag": "8f152d43-30d8-46ea-a48f-8bba81599fba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:24.412617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-71e8fc5e-6d8d-46fa-84b1-7c9dd6cc019b req-ac15aad7-2b63-4b44-858c-6b1bae84cba8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.413677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-71e8fc5e-6d8d-46fa-84b1-7c9dd6cc019b req-ac15aad7-2b63-4b44-858c-6b1bae84cba8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.427686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-71e8fc5e-6d8d-46fa-84b1-7c9dd6cc019b req-ac15aad7-2b63-4b44-858c-6b1bae84cba8 service nova] Creating event network-changed:8f152d43-30d8-46ea-a48f-8bba81599fba for instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 on n-h2-764486-11 Jul 20 04:36:24.433810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-71e8fc5e-6d8d-46fa-84b1-7c9dd6cc019b req-ac15aad7-2b63-4b44-858c-6b1bae84cba8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101413 Jul 20 04:36:24.435674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2638/3763] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:24.441819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c61ba8e-b259-4189-9821-02f49f11d66f tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838b0cc550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1416384334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3PQaIkTW5cp2DVPqMkTHMXKD9CPhvnLs8YjpcGfBsxGE4UjTx8Sx6b2lx8ZpzfwA7SXwCb8lDgQ78RO6dsGB0d8TXazB2s3yHXRmMayzZvm7zmIbCwTLnWPcprgbu2vA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:24.469716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0c61ba8e-b259-4189-9821-02f49f11d66f tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:24.485749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0c61ba8e-b259-4189-9821-02f49f11d66f tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:24.551190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c61ba8e-b259-4189-9821-02f49f11d66f tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.113420 Jul 20 04:36:24.563469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2639/3764] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:24.566966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:24.567625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:24.605574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.607984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:24.609598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:24.617545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.168646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:25.200102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ac801bb-9220-4e6e-aa0c-bcb6ec74e19f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1321 microversion: 2.1 time: 0.645054 Jul 20 04:36:25.207205 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2640/3765] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:24 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1321 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:25.227420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:25.230493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:25.257917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.261112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.266116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.267594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.362275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:25.509145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Locking {{(pid=123724) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 20 04:36:25.670893 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31a26f08-4a03-41ba-a172-6c28d3f292dd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.461167 Jul 20 04:36:25.672442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2641/3766] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:25 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:25.682447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:25.684045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:25.693342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.694182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:25.695135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:25.696730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.016506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.034667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.038278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.040873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea98e9d2-ce43-4cee-b057-877ffb54696d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1753 microversion: 2.20 time: 0.366583 Jul 20 04:36:26.041914 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2642/3767] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:25 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1753 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:26.052635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8430c635-a6e8-431c-a742-bfd643e70a7c tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838ba96af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1530794995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8tcvoiQB39BHQg/fUmm8jKTnH2whZjB62gvMcAZ/0/WcuVKADeJLUCp4rYZe7JYDMns0fNZ6wL+lL2cZvOlHk2VLYrXYKLlN6KTl5wlyhjE/xZYhfR5KAjsNwr9arrMA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:26.076937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8430c635-a6e8-431c-a742-bfd643e70a7c tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:26.089193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8430c635-a6e8-431c-a742-bfd643e70a7c tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:26.138880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8430c635-a6e8-431c-a742-bfd643e70a7c tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094483 Jul 20 04:36:26.140419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2643/3768] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:26 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:26.150929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.152311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.165267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.166128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.167920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.168716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.573480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:26.610289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d36bc6a-c0b3-4347-a7be-56e452b2c826 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.468024 Jul 20 04:36:26.615732 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2644/3769] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:26.638096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82e12532-8f6e-4a12-bf35-2ceb148c0689 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838afffc10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-699263306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5wySI18vYYOI9mV7WCT+/M99KgdniuMbn7spZ7ZOv3+T9em7BDwJj0AkGIBgHq7EQW4asbiwG8lqibtuaG3AlYN+fUzsJr0F6PSS+O5F9EePSE4dtarNYBAk7ylhP6rg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:26.703944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-82e12532-8f6e-4a12-bf35-2ceb148c0689 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:26.715955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-82e12532-8f6e-4a12-bf35-2ceb148c0689 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:26.824113 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82e12532-8f6e-4a12-bf35-2ceb148c0689 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.206597 Jul 20 04:36:26.828993 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2645/3770] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:26 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 212 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:26.849074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:26.850609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:26.869484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.870886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:26.873806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:26.876014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.193771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:27.211942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33ccd5dc-9cc8-4e29-91ac-4d3483f83ef7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1321 microversion: 2.1 time: 0.379638 Jul 20 04:36:27.231379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2646/3771] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:26 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:27.243471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:27.255467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.256342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.342356 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] HTTP exception thrown: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a is locked Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Request method failure captured: Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action HTTP/1.1 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14T22iRK6Sa_9H5Jpqs_BLJz2nevKLy_ccLoCksC65mmIChHCut8qFaUQpr22YOnwPQOWxZfsfvnbBLW-Lz9RbeapZjTIKfEK7AYU0z0km67942gu8s_OfQ33rnSvU6W4eFzLDwPi3RuXRdkWHpGtuGxD2FNaOjWD5G8_aL5DFJg1pk Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ee53c54f478471c951962c22855b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ee53c54f478471c951962c22855b465", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-160176566 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4d4ae756d3714b598164985ed7d7876c Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: {"os-stop": {}} Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a is locked Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0574120e-c5ec-4131-9fd9-def29f85a93a', 'body': {'os-stop': {}}} Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a is locked Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a is locked Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a is locked Jul 20 04:36:27.346087 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:27.357985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Returning 409 to user: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a is locked {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:27.359988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96c70846-bbc6-434c-a1d4-b422bf207b61 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 409 len: 107 microversion: 2.1 time: 0.126740 Jul 20 04:36:27.361819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2647/3772] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:27 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 107 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:36:27.381093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c2b4911b-3536-40e0-9259-69229ff4c420 req-39074d40-4d81-4b31-ad8f-0504fcde4c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09a3e91-173a-4ff1-b657-569689c2c838", "name": "network-vif-plugged", "status": "completed", "tag": "097e0288-9940-4bb2-ae64-a229d380da85"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:27.389209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:27.402050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c2b4911b-3536-40e0-9259-69229ff4c420 req-39074d40-4d81-4b31-ad8f-0504fcde4c51 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:27.402994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c2b4911b-3536-40e0-9259-69229ff4c420 req-39074d40-4d81-4b31-ad8f-0504fcde4c51 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:27.437017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c2b4911b-3536-40e0-9259-69229ff4c420 req-39074d40-4d81-4b31-ad8f-0504fcde4c51 service nova] Creating event network-vif-plugged:097e0288-9940-4bb2-ae64-a229d380da85 for instance f09a3e91-173a-4ff1-b657-569689c2c838 on n-h1-764486-11 Jul 20 04:36:27.446991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c2b4911b-3536-40e0-9259-69229ff4c420 req-39074d40-4d81-4b31-ad8f-0504fcde4c51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082197 Jul 20 04:36:27.448831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2648/3773] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:27.467556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53026436-4ed9-40f7-a2b2-37c8d212e622 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838bebe4c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:27.472897 n-d-764486-11 devstack@n-api.service[123724]: WARNING oslo_db.sqlalchemy.utils [None req-53026436-4ed9-40f7-a2b2-37c8d212e622 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:36:27.503047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53026436-4ed9-40f7-a2b2-37c8d212e622 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.052161 Jul 20 04:36:27.518805 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2649/3774] 10.222.0.49 () {60 vars in 1176 bytes} [Wed Jul 20 04:36:27 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:27.955015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1414178816", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:28.037687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] validate_networks() for [('738bc9b3-63f1-49e2-9a17-dfc66ca765a1', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:29.174231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:29.175590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:29.176499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:29.177347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:29.178156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:29.202010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=43 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:29.205423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.206240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.208685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.209487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.239600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Getting quotas for project 607843d657d5443d8f30ea9f1679d4ce. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:29.249601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Getting quotas for user bb17b40494cc4ad4a7a5f131c7b54ea3 and project 607843d657d5443d8f30ea9f1679d4ce. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:29.267926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:29.272608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:29.380272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9182d66f-8d4a-4ef0-863d-e260f4c45762 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.859426 Jul 20 04:36:29.381650 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2650/3775] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:29.390532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:29.391617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.404447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.405218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.406822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.407909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.735780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.756013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.757925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:29.760032 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a0df92b-5ebd-4b0c-aa41-62520c99c682 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1753 microversion: 2.20 time: 0.377002 Jul 20 04:36:29.761270 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2651/3776] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:29 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1753 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:29.766392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:29.767296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:29.789689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.790859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.792032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:29.792731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:29.905444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Unlocking {{(pid=123724) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:36:30.023987 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4eabea79-fcbb-4050-8034-0c50f50f1950 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.261223 Jul 20 04:36:30.030330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2652/3777] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:29 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:30.044189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d95042bd-ab34-4ac4-b203-14ca272ae590 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f83983311f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.090327 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d95042bd-ab34-4ac4-b203-14ca272ae590 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-699263306" status: 204 len: 0 microversion: 2.2 time: 0.057806 Jul 20 04:36:30.091375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2653/3778] 10.222.0.49 () {60 vars in 1317 bytes} [Wed Jul 20 04:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-699263306 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:30.098411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.099335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.108067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.109465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.111027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.113323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.465423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.474348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f73d8eb-f478-4f65-b4c8-33711048e49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1321 microversion: 2.1 time: 0.381204 Jul 20 04:36:30.474997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2654/3779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:30.491215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.491849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.500766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.501475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.502443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.503153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.645454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:30.656519 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-404cef3c-1cdf-42c2-af84-17a983bd1a4f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1227 microversion: 2.1 time: 0.170747 Jul 20 04:36:30.658161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2655/3780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1227 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:30.667439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-126d390f-18ed-4b19-838f-cac101524ae8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:30.680553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-126d390f-18ed-4b19-838f-cac101524ae8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.687215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-126d390f-18ed-4b19-838f-cac101524ae8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.757667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-126d390f-18ed-4b19-838f-cac101524ae8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:36:30.839903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-126d390f-18ed-4b19-838f-cac101524ae8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.180303 Jul 20 04:36:30.840836 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2656/3781] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:30 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:30.852119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3ba1970-d483-49ce-8d16-7d767fee2dfd tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838bbd6dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.880768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3ba1970-d483-49ce-8d16-7d767fee2dfd tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1530794995" status: 204 len: 0 microversion: 2.2 time: 0.032743 Jul 20 04:36:30.883819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2657/3782] 10.222.0.49 () {60 vars in 1320 bytes} [Wed Jul 20 04:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1530794995 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:30.897625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-502215f1-7b0e-4eab-b486-67f73e117a56 req-1de327b9-55de-436a-a4d1-385c424fda47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a74219-6dda-4acf-a2cf-9ebbc6881334", "name": "network-vif-plugged", "status": "completed", "tag": "8f152d43-30d8-46ea-a48f-8bba81599fba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:30.921226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-502215f1-7b0e-4eab-b486-67f73e117a56 req-1de327b9-55de-436a-a4d1-385c424fda47 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.930862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-502215f1-7b0e-4eab-b486-67f73e117a56 req-1de327b9-55de-436a-a4d1-385c424fda47 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.954424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-502215f1-7b0e-4eab-b486-67f73e117a56 req-1de327b9-55de-436a-a4d1-385c424fda47 service nova] Creating event network-vif-plugged:8f152d43-30d8-46ea-a48f-8bba81599fba for instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 on n-h2-764486-11 Jul 20 04:36:30.964856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-502215f1-7b0e-4eab-b486-67f73e117a56 req-1de327b9-55de-436a-a4d1-385c424fda47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078663 Jul 20 04:36:30.965759 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2658/3783] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:30.972560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:30.973665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:30.981389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.982198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:30.983189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:30.983989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.008103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:31.334008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.353922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.358454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.360750 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cfbde660-15cb-4395-8a64-84e06bd28423 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1753 microversion: 2.20 time: 0.393206 Jul 20 04:36:31.372103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2659/3784] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:30 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1753 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:31.372103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.373042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:31.387153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.388570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.390773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.391998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.841241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:31.854361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41cad5dd-5b39-4292-bbf2-70dab1b7586b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.491125 Jul 20 04:36:31.855245 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2660/3785] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:31 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:31.871773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7efb195-4862-452a-afb1-f835ae36fcd7 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838ba875e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.900413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7efb195-4862-452a-afb1-f835ae36fcd7 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1416384334" status: 204 len: 0 microversion: 2.2 time: 0.043803 Jul 20 04:36:31.901226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2661/3786] 10.222.0.49 () {60 vars in 1320 bytes} [Wed Jul 20 04:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1416384334 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:31.916729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:31.917360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:31.931220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.931738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:31.932721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:31.933292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.368789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:32.381935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7855600a-efcb-4b85-8614-c086cde6309b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1321 microversion: 2.1 time: 0.472091 Jul 20 04:36:32.382537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2662/3787] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:31 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:32.417617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:32.417617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.442427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.443007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.447592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.453464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.734416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:32.747177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4696a427-16d7-4b5c-85be-06787eca22f6 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1281 microversion: 2.1 time: 0.363549 Jul 20 04:36:32.752017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2663/3788] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:32 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1281 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:32.760154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cab02387-1ec3-4a44-af95-c944a3485964 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838ba87160>, body: {"keypair": {"name": "tempest-keypair-1286700406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnEyccU5tuqNVDyGgEKCVSJzbn4pNmKxK9Z5ypykeKtzNaZm0mx9jrwrMqajltnJNpXwmZkEWMxOl8Rm3etdU1uQGVUHlcXEMuqtMTBv4lhOlNObazlDxtDTUYcdEzcFw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:32.843558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cab02387-1ec3-4a44-af95-c944a3485964 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:32.863666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cab02387-1ec3-4a44-af95-c944a3485964 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:32.927316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cab02387-1ec3-4a44-af95-c944a3485964 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.169744 Jul 20 04:36:32.929282 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2664/3789] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Jul 20 04:36:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 04:36:32.951272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:32.955689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:32.971037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.973588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:32.977473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:32.978046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.477703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.493412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.495407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:33.496702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f08ba13-d518-4ee6-837a-bc1f4ea4c0ea tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1753 microversion: 2.20 time: 0.565512 Jul 20 04:36:33.497469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2665/3790] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:32 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1753 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:33.522396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:33.529490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:33.544903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.553897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:33.555340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:33.556610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.006430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.023104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6a1428e-5fdc-4540-9317-d812bc170e6c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.524343 Jul 20 04:36:34.044399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2666/3791] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:33 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:34.044399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-702507e8-06b0-470a-809a-132f5469300f tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838ba74040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.066625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-702507e8-06b0-470a-809a-132f5469300f tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1286700406" status: 200 len: 513 microversion: 2.2 time: 0.032558 Jul 20 04:36:34.075013 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2667/3792] 10.222.0.49 () {60 vars in 1257 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1286700406 => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:34.082510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.083128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.097287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.097532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.098261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.098684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.714285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:34.726942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23b66139-ebf5-4718-86ed-3c1eab50694d tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1512 microversion: 2.1 time: 0.650702 Jul 20 04:36:34.728308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2668/3793] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:34.738365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:34.739517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:34.759348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.760336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:34.761404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:34.762010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.132749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.157446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-769dad7a-2f75-427d-9cbb-915d7777abb2 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1323 microversion: 2.1 time: 0.426999 Jul 20 04:36:35.158657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2669/3794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:34 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:35.183535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9315bcd0-651a-4a04-995c-585516ac5962 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838bb29b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.186790 n-d-764486-11 devstack@n-api.service[123724]: WARNING oslo_db.sqlalchemy.utils [None req-9315bcd0-651a-4a04-995c-585516ac5962 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:36:35.201078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9315bcd0-651a-4a04-995c-585516ac5962 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.023540 Jul 20 04:36:35.204436 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2670/3795] 10.222.0.49 () {60 vars in 1176 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:35.226871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.233137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.252429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.255798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.262048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.263061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.759432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.773283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.775215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:35.776858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99bb4d38-3b86-439c-a270-70f3bed772cf tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.573251 Jul 20 04:36:35.777606 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2671/3796] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:35.784868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:35.785640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:35.793635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.794798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:35.795922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:35.796545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.325982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.343298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7ce9e7a-a427-497a-9b3b-c41b055d0dbf tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1511 microversion: 2.1 time: 0.563354 Jul 20 04:36:36.350031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2672/3797] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:35 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1511 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:36.364167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.373853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:36.395130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.396317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.398011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.399059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.836029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:36.851483 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd6a18cf-a34e-42bf-a142-50580a8d6fd1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.499742 Jul 20 04:36:36.852098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2673/3798] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:36 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:36.871280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d791ebb1-2803-4d62-ab9c-f8f3810460f0 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838ba96940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:36.902016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d791ebb1-2803-4d62-ab9c-f8f3810460f0 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286700406" status: 204 len: 0 microversion: 2.2 time: 0.034656 Jul 20 04:36:36.903650 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2674/3799] 10.222.0.49 () {60 vars in 1260 bytes} [Wed Jul 20 04:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286700406 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:36.912309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e79437d5-894f-4ca7-a437-86758db25969 req-aa36e7cf-81ae-476c-9ada-bb2ab2dc4e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:36.934816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e79437d5-894f-4ca7-a437-86758db25969 req-aa36e7cf-81ae-476c-9ada-bb2ab2dc4e00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:36.935515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e79437d5-894f-4ca7-a437-86758db25969 req-aa36e7cf-81ae-476c-9ada-bb2ab2dc4e00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:36.983255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e79437d5-894f-4ca7-a437-86758db25969 req-aa36e7cf-81ae-476c-9ada-bb2ab2dc4e00 service nova] Creating event network-changed:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h2-764486-11 Jul 20 04:36:36.995494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e79437d5-894f-4ca7-a437-86758db25969 req-aa36e7cf-81ae-476c-9ada-bb2ab2dc4e00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090046 Jul 20 04:36:37.000807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2675/3800] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:37.282758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-595c9889-8cc4-4fb5-a7fc-cedc64bb5441 req-1f03f035-9b22-4dab-83e9-3fee3f5a1f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:37.293612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-595c9889-8cc4-4fb5-a7fc-cedc64bb5441 req-1f03f035-9b22-4dab-83e9-3fee3f5a1f6b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.293982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-595c9889-8cc4-4fb5-a7fc-cedc64bb5441 req-1f03f035-9b22-4dab-83e9-3fee3f5a1f6b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.310179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-595c9889-8cc4-4fb5-a7fc-cedc64bb5441 req-1f03f035-9b22-4dab-83e9-3fee3f5a1f6b service nova] Creating event network-changed:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:36:37.318510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-595c9889-8cc4-4fb5-a7fc-cedc64bb5441 req-1f03f035-9b22-4dab-83e9-3fee3f5a1f6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314996 Jul 20 04:36:37.320301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2676/3801] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:37.328609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.332119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.340381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.341136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.342071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.342869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.544082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.555506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79905fba-8551-43a4-8734-cb638e34f1fa tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1323 microversion: 2.1 time: 0.233221 Jul 20 04:36:37.565678 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2677/3802] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:37.570872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.571771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.579439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.579790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.580630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.581066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.808210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:37.826936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea4f13e7-92f9-4b38-8bf1-5feb798b8522 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838" status: 200 len: 1511 microversion: 2.1 time: 0.258276 Jul 20 04:36:37.827645 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2678/3803] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:37.846975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:37.848376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:37.856708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.857560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:37.858504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:37.859114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:38.134280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.163134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.166709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:38.169031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c5b3bc3-e0c5-4da5-ba85-5105126b614e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.325632 Jul 20 04:36:38.184460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2679/3804] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:37 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:38.184460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Action: 'create', calling method: .version_select at 0x7f838b111940>, body: {"keypair": {"name": "tempest-keypair-472203949", "type": "x509"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:38.224307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:38.235199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:38.237633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:38.279737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.processutils [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpegzkqty0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpegzkqty0/temp.key -subj /CN=2c2f09efd0214dc7b3225083f7b99763 -extensions v3_req_client {{(pid=123724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:36:38.902070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.processutils [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpegzkqty0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpegzkqty0/temp.key -subj /CN=2c2f09efd0214dc7b3225083f7b99763 -extensions v3_req_client" returned: 0 in 0.622s {{(pid=123724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:36:38.903847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.processutils [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpegzkqty0/temp.key -password pass: {{(pid=123724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 04:36:38.977996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.processutils [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpegzkqty0/temp.key -password pass:" returned: 0 in 0.073s {{(pid=123724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 04:36:39.093799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:39.139853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Getting quotas for user 2c2f09efd0214dc7b3225083f7b99763 and project 5b9e12b41f0f4ce087f9212aa97ed6bf. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:39.234479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:39.298233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebe138fd-0ce2-40f2-9183-19d8488a2b8b tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.125455 Jul 20 04:36:39.315571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2680/3805] 10.222.0.49 () {62 vars in 1197 bytes} [Wed Jul 20 04:36:38 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1139 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:39.336245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:39.365120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:39.391067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:39.474676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.475245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.476271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:39.476850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:39.896740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:40.154521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:40.177696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.178203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.624450 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03be6b4d-295e-4d87-8a31-e4b490604bba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.310338 Jul 20 04:36:40.625342 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2681/3806] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jul 20 04:36:39 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:40.645563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:40.653233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:40.681808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.682283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:40.683227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:40.697311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.480667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:41.484641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:41.499235 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae337fab-2e20-464a-9bf4-5466fb7712b7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.858794 Jul 20 04:36:41.526415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2682/3807] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:40 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:41.547909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:41.550630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:41.593796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.594271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:41.595275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:41.595738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.369259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.405737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb5db71b-ace0-4f29-a602-e453b06adb19 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1323 microversion: 2.1 time: 1.877453 Jul 20 04:36:43.415810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2683/3808] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:41 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1323 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:43.415810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.415810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:43.421712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.422326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.423309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.424128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.830792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.867681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.874930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.885866 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0ae6358-0184-4086-8a15-dc05e7212721 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.476894 Jul 20 04:36:43.887412 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2684/3809] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:43.906531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0bd29718-41d8-42ba-8e1a-9386fdad0e25 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838be8e280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.924385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0bd29718-41d8-42ba-8e1a-9386fdad0e25 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-472203949" status: 200 len: 1533 microversion: 2.2 time: 0.035719 Jul 20 04:36:43.925793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2685/3810] 10.222.0.49 () {60 vars in 1254 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-472203949 => generated 1533 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:43.934499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:43.942447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:43.943595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-950339688', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:43.953436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.954128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:43.956472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:43.957610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.107961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:44.237453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:44.261810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.264242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.807011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfb39197-04af-4b0b-ae94-dfc53e051d78 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-950339688" status: 200 len: 1514 microversion: 2.1 time: 0.879293 Jul 20 04:36:44.808171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2686/3811] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Jul 20 04:36:43 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-950339688 => generated 1514 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:44.813860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:44.814011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:44.860085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.860754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:44.861888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:44.864383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.448191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.459272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae8bc4c9-0c95-4f04-a7a8-e88c3d5d458f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1656 microversion: 2.1 time: 0.650048 Jul 20 04:36:45.488970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2687/3812] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:44 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1656 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.502141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3b58fab-1997-4605-ba80-12cd0559545e tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838b0f4ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.509734 n-d-764486-11 devstack@n-api.service[123724]: WARNING oslo_db.sqlalchemy.utils [None req-f3b58fab-1997-4605-ba80-12cd0559545e tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:36:45.523637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3b58fab-1997-4605-ba80-12cd0559545e tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.032719 Jul 20 04:36:45.526762 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2688/3813] 10.222.0.49 () {60 vars in 1176 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.535767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.544071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:45.557210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.559445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.560566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.561743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.859457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.871148 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7959d1ec-70d0-4de8-969f-1c720086d4a1 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1323 microversion: 2.1 time: 0.343058 Jul 20 04:36:45.871954 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2689/3814] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:45.878145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:45.882050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:45.883210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:45.897031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.898067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:45.911954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:45.913255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.160922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:46.499052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:46.564142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:46.564679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:46.992390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79c0c045-0eee-4476-b289-04dd22426cbc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.119133 Jul 20 04:36:46.994063 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2690/3815] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Jul 20 04:36:45 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:46.999248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7c7cc041-9b92-4cd6-bfa9-d05b649e9c49 req-f9cacca5-36cb-4abc-8e70-f596cecc2b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "name": "network-vif-plugged", "status": "completed", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:47.017770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c7cc041-9b92-4cd6-bfa9-d05b649e9c49 req-f9cacca5-36cb-4abc-8e70-f596cecc2b82 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.029175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c7cc041-9b92-4cd6-bfa9-d05b649e9c49 req-f9cacca5-36cb-4abc-8e70-f596cecc2b82 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.059496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7c7cc041-9b92-4cd6-bfa9-d05b649e9c49 req-f9cacca5-36cb-4abc-8e70-f596cecc2b82 service nova] Creating event network-vif-plugged:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:36:47.077707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7c7cc041-9b92-4cd6-bfa9-d05b649e9c49 req-f9cacca5-36cb-4abc-8e70-f596cecc2b82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081896 Jul 20 04:36:47.083551 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2691/3816] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:47.099245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.100322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.116562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.117374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.121598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.122202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.877412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.904577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.906567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:47.908121 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d444daa-c118-4971-bff6-b05d36247e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.822757 Jul 20 04:36:47.933419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2692/3817] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:47 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:47.939839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:47.941207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:47.948906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.949585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.950526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:47.951116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:47.979359 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] HTTP exception thrown: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Request method failure captured: Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d HTTP/1.1 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RwwDs0wflxYpblMVMcDCIbOVF56A9LdazkfjwEbg2CtrQwoErHDkZrKHJ_2Fp9_Y7uSNXuSa-ld_u7WgJjqsr1m-MIMpoiJkYmUfzt420LvZjTnYzF_XmYCKh5h2W4UFYxmHXsHcc6RMnUQ5MM_JwvkBCj8azYLIuLeRJdhY_7ekw Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc0218fbb8d349c1a01636234437d7f8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 79561d22ff3f40739c9515a85b78d561 Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '49223de1-2911-48d3-bc3a-1e7785c3f47d'} Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:48.011504 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:48.016489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:48.018264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Returning 404 to user: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:48.024632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0673676-d5da-4bf2-85f4-a036cc5693cd tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 404 len: 111 microversion: 2.1 time: 0.084243 Jul 20 04:36:48.025504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2693/3818] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:47 2022] DELETE /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:48.045693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72bc6ad0-be99-4de8-9026-824185d8e936 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:48.077885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72bc6ad0-be99-4de8-9026-824185d8e936 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.079662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72bc6ad0-be99-4de8-9026-824185d8e936 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.122939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72bc6ad0-be99-4de8-9026-824185d8e936 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:36:48.198448 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72bc6ad0-be99-4de8-9026-824185d8e936 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.171299 Jul 20 04:36:48.199091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2694/3819] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:48 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:48.209380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-271f29d5-0b13-485c-aa2a-ee7d3a58bad1 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] Calling method '.version_select at 0x7f838bcdd4c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.261252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-271f29d5-0b13-485c-aa2a-ee7d3a58bad1 tempest-KeyPairsV22TestJSON-1240285181 tempest-KeyPairsV22TestJSON-1240285181-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472203949" status: 204 len: 0 microversion: 2.2 time: 0.051870 Jul 20 04:36:48.262447 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2695/3820] 10.222.0.49 () {60 vars in 1257 bytes} [Wed Jul 20 04:36:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472203949 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:36:48.280896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.282229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:48.302855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.303764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.308063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.308879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.693317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.721559 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56b4d2d4-2760-4efc-9577-a62a507d5e84 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1323 microversion: 2.1 time: 0.456545 Jul 20 04:36:48.722666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2696/3821] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:48.727957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:48.735735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.771647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.servers [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Removing options 'limit' from query {{(pid=123724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:36:48.772807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:48.793477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.812430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.812430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.812430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:48.858738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:48.865673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:48.866264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.107552 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23d08fbc-49fc-4c1e-9c54-8d6d1e8cb4df tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.383693 Jul 20 04:36:49.108408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2697/3822] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 04:36:48 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:49.117235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.117956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 49223de1-2911-48d3-bc3a-1e7785c3f47d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.129916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.130354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.131695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.131805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.150853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] HTTP exception thrown: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Request method failure captured: Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d HTTP/1.1 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RwwDs0wflxYpblMVMcDCIbOVF56A9LdazkfjwEbg2CtrQwoErHDkZrKHJ_2Fp9_Y7uSNXuSa-ld_u7WgJjqsr1m-MIMpoiJkYmUfzt420LvZjTnYzF_XmYCKh5h2W4UFYxmHXsHcc6RMnUQ5MM_JwvkBCj8azYLIuLeRJdhY_7ekw Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc0218fbb8d349c1a01636234437d7f8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 79561d22ff3f40739c9515a85b78d561 Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '49223de1-2911-48d3-bc3a-1e7785c3f47d'} Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:49.153085 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. Jul 20 04:36:49.158470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:49.159921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Returning 404 to user: Instance 49223de1-2911-48d3-bc3a-1e7785c3f47d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:49.161024 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0eb77dff-ec6c-42f1-b32e-2f2db6bbb38b tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d" status: 404 len: 111 microversion: 2.1 time: 0.051332 Jul 20 04:36:49.162241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2698/3823] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/49223de1-2911-48d3-bc3a-1e7785c3f47d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:49.168478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.169279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.200651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.201107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.201897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.202446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.673517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:49.693946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6cfb9a5c-c8e3-46e7-b3a2-df8bb1947346 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1665 microversion: 2.1 time: 0.529842 Jul 20 04:36:49.701296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2699/3824] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1665 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:49.715083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:49.726457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:49.764387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.765045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:49.766024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:49.766616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.757488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.772638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.783882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.787880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdaacb40-43fb-43bc-a478-6784a271de3e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 1.083301 Jul 20 04:36:50.805145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2700/3825] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:49 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:50.811428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.816232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:50.817362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:50.826690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.827782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.829256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.830146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.864738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:50.906418 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8988a146-084c-477b-8eb2-e588d0c98bf2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.099498 Jul 20 04:36:50.909155 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2701/3826] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:50.914746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:50.915999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:50.934834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.935679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.936803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:50.937665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:50.945488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:51.485022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.494595 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-697af83c-a942-4a9b-afa9-d01536d95306 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1518 microversion: 2.1 time: 0.583868 Jul 20 04:36:51.496328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2702/3827] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:50 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1518 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:51.503483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.504535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:51.511873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.512322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.513403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.513633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.877883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.886540 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-757bc9b7-d17f-4b4a-b654-6591738a0872 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1665 microversion: 2.1 time: 0.388416 Jul 20 04:36:51.896387 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2703/3828] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1665 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:51.896387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:51.900828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:51.900828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.servers [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Removing options 'limit' from query {{(pid=123724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:36:51.900828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:51.906640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.907045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.908517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:51.909013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:51.977798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:52.051342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65e6bee8-8d4f-4e1c-89eb-59950e4bc8db tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.159094 Jul 20 04:36:52.053554 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2704/3829] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Jul 20 04:36:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:52.074148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:52.075422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:52.083242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.085137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.086184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.086849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.134666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lazy-loading 'flavor' on Instance uuid bdc5d91c-0674-4383-b623-4623346c02ef {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:36:52.307806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-193de005-682d-4120-837a-48fc11d90a66 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action" status: 200 len: 32 microversion: 2.1 time: 0.251947 Jul 20 04:36:52.308614 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2705/3830] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:52 2022] POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:36:52.326643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.328438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:52.340199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.340672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.341456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.341895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.615251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.629456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.632531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.635866 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e363ee41-faec-4583-a006-28c490417090 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.321817 Jul 20 04:36:52.637887 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2706/3831] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:52.656440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.671524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:52.671524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:52.679003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.679453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.680250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.680707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.745331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:52.808521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3bc5c2c3-425b-44dc-8fc8-45e731450cf9 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.166915 Jul 20 04:36:52.809136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2707/3832] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers => generated 1010 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:52.816182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:52.817332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:52.824013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.824497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:52.825292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:52.825811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.074705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:53.084753 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90c3832c-add4-4f1e-a974-c8f77e6b232a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.274511 Jul 20 04:36:53.085618 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2708/3833] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:52 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:53.282066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80c8b39f-ea59-4894-aa3f-5e458521907c tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Calling method '.version_select at 0x7f839cd91160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:53.296524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c8b39f-ea59-4894-aa3f-5e458521907c tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.296974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c8b39f-ea59-4894-aa3f-5e458521907c tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.297817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c8b39f-ea59-4894-aa3f-5e458521907c tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:53.298250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c8b39f-ea59-4894-aa3f-5e458521907c tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:53.325772 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80c8b39f-ea59-4894-aa3f-5e458521907c tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.238813 Jul 20 04:36:53.326555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2709/3834] 10.222.0.49 () {58 vars in 1121 bytes} [Wed Jul 20 04:36:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:53.422411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1315104928", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "34f0f4d6-d654-4e1d-816b-835f3ac199bd"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:53.476298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] validate_networks() for [('34f0f4d6-d654-4e1d-816b-835f3ac199bd', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:54.057075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:36:54.057634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:36:54.058125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:36:54.058787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:36:54.059542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:36:54.070628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.071073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.071864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.072333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.090531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Getting quotas for project e8c206190e874398b163786396840b01. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:54.096002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Getting quotas for user f60665dc488a413cbe1480418011d3db and project e8c206190e874398b163786396840b01. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:54.097837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:54.115358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:36:54.117985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:36:54.205335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0c29cf1-c824-4983-bde9-899390db9fab tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876997 Jul 20 04:36:54.206657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2710/3835] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:36:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:36:54.218032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.222916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.224165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:54.242434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.243043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.244136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.244698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.401349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:54.489695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f719d42f-c98f-4dd7-87a5-a57b5e2b6313 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.281884 Jul 20 04:36:54.492646 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2711/3836] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:54.504232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:54.505988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:54.523317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.523829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.524862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:54.525363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:54.735226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:54.754936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e75c8cb-0d4a-4a68-81e5-e4460d94884d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.260670 Jul 20 04:36:54.755419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2712/3837] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:54 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:54.762368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1514150510", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:54.856405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:36:55.134183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Getting quotas for project b69608b5a0eb458fba77a4e0f82f3a93. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:36:55.143439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Getting quotas for user cb65b1320c9e4d599cc57c73bfb56b4b and project b69608b5a0eb458fba77a4e0f82f3a93. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:36:55.167527 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Request method failure captured: Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 1752 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZkoQWNhO32Z-X18zS2ztKxiRTM9xzS0ZNxZDiFX57FCYtgtzRy5JwrPclc6yIzZkwZkv_JI3vP_LW17pHdGWwUY74EDC8v1TNbRJj2RYN6HazNcX50QklKhuouPHqxMSXOIlQpRWEEhOhb0B23Le12Izx7ihJ5ncuUruDBrQJojRg Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b69608b5a0eb458fba77a4e0f82f3a93 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-599337324 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b69608b5a0eb458fba77a4e0f82f3a93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b69608b5a0eb458fba77a4e0f82f3a93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b69608b5a0eb458fba77a4e0f82f3a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b69608b5a0eb458fba77a4e0f82f3a93", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-599337324 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b69608b5a0eb458fba77a4e0f82f3a93 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-599337324 Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-599337324-project Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: cb65b1320c9e4d599cc57c73bfb56b4b Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-599337324-project Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1514150510", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:55.173071 n-d-764486-11 devstack@n-api.service[123724]: exception: Maximum number of metadata items exceeds 128 Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1514150510', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:36:55.175605 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:55.179290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61614b34-7b7c-442a-af2e-4f5a8da34545 tempest-AbsoluteLimitsNegativeTestJSON-599337324 tempest-AbsoluteLimitsNegativeTestJSON-599337324-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.418528 Jul 20 04:36:55.187055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2713/3838] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Jul 20 04:36:54 2022] POST /compute/v2.1/servers => generated 87 bytes in 431 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:36:55.195474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.198506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.212071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.212987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.215223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.215856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.416143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.429122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.432080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.435173 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da972f12-56de-4215-9727-c69183dd707a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.246064 Jul 20 04:36:55.437247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2714/3839] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:55.445280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.446046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.457184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.457673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.458980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.458980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.480881 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] HTTP exception thrown: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Request method failure captured: Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 HTTP/1.1 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RwwDs0wflxYpblMVMcDCIbOVF56A9LdazkfjwEbg2CtrQwoErHDkZrKHJ_2Fp9_Y7uSNXuSa-ld_u7WgJjqsr1m-MIMpoiJkYmUfzt420LvZjTnYzF_XmYCKh5h2W4UFYxmHXsHcc6RMnUQ5MM_JwvkBCj8azYLIuLeRJdhY_7ekw Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc0218fbb8d349c1a01636234437d7f8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 79561d22ff3f40739c9515a85b78d561 Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '41bb7e90-bb7b-4f99-8e8e-e9cf980b0410'} Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:55.482523 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Returning 404 to user: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3636e31f-6a18-4aaf-ad42-4f75282fa6cf tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 404 len: 111 microversion: 2.1 time: 0.045462 Jul 20 04:36:55.488280 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2715/3840] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:36:55 2022] DELETE /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:55.492041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.493045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.501821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.502817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.503657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.504499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.787316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.800323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b56a2d18-41c1-4c57-aabc-b1667e32e25a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.310541 Jul 20 04:36:55.801729 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2716/3841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:55.820688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.821601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:55.831339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.831526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.832468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.832737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.952781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.966234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6aaba3f3-0bdf-4a38-b802-ad6244bf285e tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1284 microversion: 2.1 time: 0.161891 Jul 20 04:36:55.968132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2717/3842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:55.975399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:55.981362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:55.982026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.servers [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Removing options 'limit' from query {{(pid=123724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:36:55.982881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:55.994206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.995035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:55.996714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:55.998013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.030267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e5550a8-546a-4eeb-93f5-92a9e78e7049 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.060731 Jul 20 04:36:56.031295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2718/3843] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jul 20 04:36:55 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:56.036839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.040256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.050379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.051083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.052120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.052806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.058412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:36:56.353304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.370903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8237cc2d-b62c-420b-877d-3779ab6bb922 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.335382 Jul 20 04:36:56.372698 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2719/3844] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:56.387524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.391232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] [instance: 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.408108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.409059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.409942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.410492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.438152 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] HTTP exception thrown: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Request method failure captured: Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 HTTP/1.1 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14RwwDs0wflxYpblMVMcDCIbOVF56A9LdazkfjwEbg2CtrQwoErHDkZrKHJ_2Fp9_Y7uSNXuSa-ld_u7WgJjqsr1m-MIMpoiJkYmUfzt420LvZjTnYzF_XmYCKh5h2W4UFYxmHXsHcc6RMnUQ5MM_JwvkBCj8azYLIuLeRJdhY_7ekw Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc0218fbb8d349c1a01636234437d7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc0218fbb8d349c1a01636234437d7f8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: fc0218fbb8d349c1a01636234437d7f8 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1673763304 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 79561d22ff3f40739c9515a85b78d561 Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeTestJSON-1673763304-project Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '41bb7e90-bb7b-4f99-8e8e-e9cf980b0410'} Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:36:56.440061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] Returning 404 to user: Instance 41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51c1c46e-db40-47d3-97bf-9daf404971f6 tempest-AttachVolumeTestJSON-1673763304 tempest-AttachVolumeTestJSON-1673763304-project] 10.222.0.49 "GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410" status: 404 len: 111 microversion: 2.1 time: 0.065394 Jul 20 04:36:56.443912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2720/3845] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/41bb7e90-bb7b-4f99-8e8e-e9cf980b0410 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:36:56.450949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.456615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:56.458267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-950339688', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:36:56.467084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.469915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.471119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.472245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.603785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:36:56.694565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f4754a0-5cf5-4779-bee0-cac51481d49a tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-950339688" status: 200 len: 345 microversion: 2.1 time: 0.250286 Jul 20 04:36:56.695957 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2721/3846] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-950339688 => generated 345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:36:56.705251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:56.705850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.712274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.712765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.719763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.719763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.791870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Unlocking {{(pid=123724) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 04:36:56.855264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c246f162-bdfc-4b13-83ce-ae9f87d4dca2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.156322 Jul 20 04:36:56.862900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2722/3847] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:56 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:56.869069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:56.869979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:56.879273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.880092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:56.883176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:56.883674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.382935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.391712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.393762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.394934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34e8dc01-acbf-4d77-afb1-4498e4dca2d6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.530505 Jul 20 04:36:57.405289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2723/3848] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:36:56 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:36:57.405289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb4ca4bd-4154-4f69-8f12-e11a011d136c tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:36:57.406471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb4ca4bd-4154-4f69-8f12-e11a011d136c tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.406920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb4ca4bd-4154-4f69-8f12-e11a011d136c tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.431487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fb4ca4bd-4154-4f69-8f12-e11a011d136c tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:36:57.482737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb4ca4bd-4154-4f69-8f12-e11a011d136c tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "POST /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac/action" status: 202 len: 0 microversion: 2.1 time: 0.085191 Jul 20 04:36:57.486657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2724/3849] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:36:57 2022] POST /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:36:57.492824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.493698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.500895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.501754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.502937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.503527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.850651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:57.866315 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a870768-2a76-479f-acbc-57656f36d69d tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.378224 Jul 20 04:36:57.869484 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2725/3850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:57.874858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:57.875684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:57.882634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.883094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:57.883880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:57.884316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.329745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:58.350258 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68e8ee10-86c8-4c81-9914-cb5c7443e602 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.476571 Jul 20 04:36:58.366558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2726/3851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:57 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:58.372831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:58.373844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:58.384711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.386555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:58.388286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:58.388997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.014678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.028057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7af60cd5-f0a4-4227-91ce-edbf55beaf59 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1314 microversion: 2.1 time: 0.658915 Jul 20 04:36:59.032588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2727/3852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:58 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:59.042314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.042936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.061651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.062385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.063676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.064254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.631506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:36:59.640110 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6eeb13f4-6b11-4559-a31a-5e6d6856adac tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1521 microversion: 2.1 time: 0.606207 Jul 20 04:36:59.646176 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2728/3853] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:36:59.651757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:36:59.655970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:36:59.663950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.664711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:36:59.673306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:36:59.674246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.083640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:00.105202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-64486fda-4732-468c-adf1-29b36d05b713 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.457014 Jul 20 04:37:00.105980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2729/3854] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:36:59 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:00.123656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:00.124699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:00.151581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.161786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:00.163144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:00.163818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.135762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.153640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.155993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.157980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-987dd290-adba-41c5-acd2-76015f56de87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 1.038600 Jul 20 04:37:01.164632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2730/3855] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:00 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:01.171326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.172291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.190853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.191754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.195370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.196170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.646813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:01.659137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82d5c0ca-dc1b-432b-ab1c-95cc15fca75a tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.492352 Jul 20 04:37:01.660368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2731/3856] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:01.665788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dbd2a5fb-9702-4713-8aeb-18e1bea07070 req-0e9a9cb3-0bb4-40d4-be00-974cce25d721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41098e3e-9107-48f3-aa56-32f586b5edde", "tag": "f0bd9752-19de-4d7b-b0fe-a75806b48b90"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:01.677515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dbd2a5fb-9702-4713-8aeb-18e1bea07070 req-0e9a9cb3-0bb4-40d4-be00-974cce25d721 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.678138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dbd2a5fb-9702-4713-8aeb-18e1bea07070 req-0e9a9cb3-0bb4-40d4-be00-974cce25d721 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.712775 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dbd2a5fb-9702-4713-8aeb-18e1bea07070 req-0e9a9cb3-0bb4-40d4-be00-974cce25d721 service nova] Creating event network-changed:f0bd9752-19de-4d7b-b0fe-a75806b48b90 for instance 41098e3e-9107-48f3-aa56-32f586b5edde on n-h1-764486-11 Jul 20 04:37:01.732227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dbd2a5fb-9702-4713-8aeb-18e1bea07070 req-0e9a9cb3-0bb4-40d4-be00-974cce25d721 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070401 Jul 20 04:37:01.733154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2732/3857] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:01.744512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:01.752207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:01.771802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.774544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.780536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:01.780991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:01.834442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:02.163513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.181049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d07b4781-bfde-45c0-bc2c-0ce291f5f689 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1314 microversion: 2.1 time: 0.446360 Jul 20 04:37:02.181751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2733/3858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:01 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:02.191916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.194881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.209591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.210395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.211391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.213125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.525054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:02.545509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c59c70af-e6be-4411-b8e5-03ba608504f4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.360698 Jul 20 04:37:02.558144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2734/3859] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:02.564395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:02.566502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:02.574082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.574785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:02.575776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:02.576465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.048373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.067145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-792a4ca8-a2bb-49f5-9370-63c4f90d8bfe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1521 microversion: 2.1 time: 0.507051 Jul 20 04:37:03.069317 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2735/3860] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:02 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:03.086589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.088712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.108684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.110054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.111340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.112782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.498285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.516544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.518966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:03.520341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e807b459-7250-4fab-b1f3-587482de343b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.449664 Jul 20 04:37:03.525121 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2736/3861] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:03.536690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:03.543248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.554755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.556368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.558668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.559974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.767250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33e497d1-34a9-45f1-9b95-b092562dc40f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.240487 Jul 20 04:37:03.768809 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2737/3862] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:03 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:03.793998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:03.801381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:03.865724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.866421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:03.882424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:03.883021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.249477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.260467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b32994a-ccef-44f2-adef-eebdbb22ad69 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.471041 Jul 20 04:37:04.260987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2738/3863] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:03 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:04.266441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:04.267263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:04.274975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.275697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.276672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.277263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.781382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:04.795256 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a55698f-ebf5-407d-aad3-eed77a578ef1 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1314 microversion: 2.1 time: 0.531952 Jul 20 04:37:04.796881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2739/3864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:04 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:04.814840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-91aff1dd-e730-42c6-bc34-7be4ba1345a1 req-fd48ed29-9ebc-4630-91ee-9fb2262d6a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "name": "network-vif-plugged", "status": "completed", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:04.837919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-91aff1dd-e730-42c6-bc34-7be4ba1345a1 req-fd48ed29-9ebc-4630-91ee-9fb2262d6a71 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.839358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-91aff1dd-e730-42c6-bc34-7be4ba1345a1 req-fd48ed29-9ebc-4630-91ee-9fb2262d6a71 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.872965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-91aff1dd-e730-42c6-bc34-7be4ba1345a1 req-fd48ed29-9ebc-4630-91ee-9fb2262d6a71 service nova] Creating event network-vif-plugged:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h2-764486-11 Jul 20 04:37:04.888005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-91aff1dd-e730-42c6-bc34-7be4ba1345a1 req-fd48ed29-9ebc-4630-91ee-9fb2262d6a71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087332 Jul 20 04:37:04.895122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2740/3865] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:04.920071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:04.942043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:04.958119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.964477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:04.975799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:04.976491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.161658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=37 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:05.518775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.538438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bab6d9c1-8563-46d2-911d-049febce7002 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1654 microversion: 2.1 time: 0.641642 Jul 20 04:37:05.553009 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2741/3866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:04 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1654 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:05.556952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.557827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:05.567201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.568370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.571284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:05.571912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:05.952273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:05.973726 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6473e2a-b38b-451a-a777-d96a110ade3e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1521 microversion: 2.1 time: 0.427397 Jul 20 04:37:05.974732 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2742/3867] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:05.994665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:05.995574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.018607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.019429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.020304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.020834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.255436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.273851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.276565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.278163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d17eb57-fa7d-4598-81aa-ea15173cd2ba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1809 microversion: 2.20 time: 0.302255 Jul 20 04:37:06.292098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2743/3868] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:05 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:06.297475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:06.298181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.315343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.316498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.317400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.317920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.509842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=24 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:06.547811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:06.557305 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20f3ed35-0dda-4ca2-87d5-51e3bec036dd tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.263782 Jul 20 04:37:06.560849 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2744/3869] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:06 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:06.576919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:06.577832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.587934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.588581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.589728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.590185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.730775 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd2f2341-d1ee-47ad-8849-5b7dcad13b27 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.167805 Jul 20 04:37:06.732311 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2745/3870] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:06 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:06.768124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:06.769162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:06.781820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.782338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:06.783271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:06.783843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.143705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:07.157834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ec72b64-5229-43a6-be91-2e827256da33 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1314 microversion: 2.1 time: 0.423870 Jul 20 04:37:07.158490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2746/3871] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:06 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:07.573402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ab7c61a-a8e1-4a5b-99af-be5a3b2ff69f tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f839802d790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-823650301", "description": "tempest-description-497788786"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:07.800178 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ab7c61a-a8e1-4a5b-99af-be5a3b2ff69f tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.640003 Jul 20 04:37:07.801003 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2747/3872] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:37:07 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:07.806466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:07.807067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:07.821755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.824868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:07.826216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:07.826817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.118678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.134109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-613712c3-a0a4-43b1-9641-f5e8a9da996e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.331118 Jul 20 04:37:08.135486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2748/3873] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:07 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:08.145211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:08.147357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:08.163237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.164384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.166110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.167110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.437107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.441919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:08.456880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3919b283-244d-4c93-b5f5-a81be5d38dbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1521 microversion: 2.1 time: 0.315968 Jul 20 04:37:08.466091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2749/3874] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:08.485016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-72e3565e-f85a-44f1-bbd8-472bbea30434 req-667c2b81-b68c-4d19-ad0c-da6314b74a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41098e3e-9107-48f3-aa56-32f586b5edde", "name": "network-vif-plugged", "status": "completed", "tag": "f0bd9752-19de-4d7b-b0fe-a75806b48b90"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:08.504640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72e3565e-f85a-44f1-bbd8-472bbea30434 req-667c2b81-b68c-4d19-ad0c-da6314b74a60 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.505382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72e3565e-f85a-44f1-bbd8-472bbea30434 req-667c2b81-b68c-4d19-ad0c-da6314b74a60 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.543333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-72e3565e-f85a-44f1-bbd8-472bbea30434 req-667c2b81-b68c-4d19-ad0c-da6314b74a60 service nova] Creating event network-vif-plugged:f0bd9752-19de-4d7b-b0fe-a75806b48b90 for instance 41098e3e-9107-48f3-aa56-32f586b5edde on n-h1-764486-11 Jul 20 04:37:08.551525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-72e3565e-f85a-44f1-bbd8-472bbea30434 req-667c2b81-b68c-4d19-ad0c-da6314b74a60 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081172 Jul 20 04:37:08.553312 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2750/3875] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:08.583423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:08.594879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:08.618735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.619196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.621678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:08.624062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:08.951479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.978912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.980610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:08.981946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d626717-a629-4e2f-9c04-f37bf837500d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1796 microversion: 2.20 time: 0.425957 Jul 20 04:37:08.982940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2751/3876] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1796 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:37:08.999417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.000066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.010809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.013195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.014116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.016245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.294961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.305783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67c790df-b5c1-4337-b633-c2328d24b887 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.321774 Jul 20 04:37:09.317559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2752/3877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:08 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:09.329485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c0e7bc3-c927-40ff-b69d-8d0395d7063c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838ae77160>, body: {"security_group_rule": {"parent_group_id": "8d68f5c1-edc6-49c6-90e9-ddd877f96593", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:09.628879 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c0e7bc3-c927-40ff-b69d-8d0395d7063c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.309899 Jul 20 04:37:09.630634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2753/3878] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:09.635683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.636308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.638479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:09.650287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.650956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.651779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.652220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.825069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:09.837305 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba927d36-401e-4021-ba76-3cccbec58bc4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.205463 Jul 20 04:37:09.840597 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2754/3879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:09 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:09.845296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:09.846688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:09.857574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.858034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:09.858835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:09.859396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.084965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.094224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad81eb92-a372-42be-8caa-4da02f41e810 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1314 microversion: 2.1 time: 0.254984 Jul 20 04:37:10.104340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2755/3880] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:09 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:10.104340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.104340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.122114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.122724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.123634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.124173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.364147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.374442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f9cda9e-57b0-4897-9cf6-e1ae5df4b0d7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1521 microversion: 2.1 time: 0.277384 Jul 20 04:37:10.384401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2756/3881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:10.384401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5efbe5a-1eef-46a2-b564-7a9b26969381 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838a98d4c0>, body: {"security_group_rule": {"parent_group_id": "8d68f5c1-edc6-49c6-90e9-ddd877f96593", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:10.433100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d5efbe5a-1eef-46a2-b564-7a9b26969381 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: This rule already exists in group 8d68f5c1-edc6-49c6-90e9-ddd877f96593 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5efbe5a-1eef-46a2-b564-7a9b26969381 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 138 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "8d68f5c1-edc6-49c6-90e9-ddd877f96593", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: exception: This rule already exists in group 8d68f5c1-edc6-49c6-90e9-ddd877f96593 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8d68f5c1-edc6-49c6-90e9-ddd877f96593', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 8d68f5c1-edc6-49c6-90e9-ddd877f96593 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 8d68f5c1-edc6-49c6-90e9-ddd877f96593 Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:10.435149 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:10.440622 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:10.440622 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:10.440622 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 8d68f5c1-edc6-49c6-90e9-ddd877f96593 Jul 20 04:37:10.440622 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:10.441853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5efbe5a-1eef-46a2-b564-7a9b26969381 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 400 to user: This rule already exists in group 8d68f5c1-edc6-49c6-90e9-ddd877f96593 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:10.442874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5efbe5a-1eef-46a2-b564-7a9b26969381 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.066433 Jul 20 04:37:10.444047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2757/3882] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:10 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:37:10.453709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.454545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.465835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.466467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.467783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.468430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.655699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.666260 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87f56064-1ede-4577-bae8-46723e3258b2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.220429 Jul 20 04:37:10.667204 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2758/3883] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:10.673551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:10.674449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:10.682616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.683063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.683865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:10.684580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:10.845368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:10.854451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da86e263-c051-422e-9d70-e0e31d72f5ee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.186163 Jul 20 04:37:10.855045 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2759/3884] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:10 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:10.859706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e2ce1c9-5bfb-4877-b93a-0427115bbebe tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838af55040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.036646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e2ce1c9-5bfb-4877-b93a-0427115bbebe tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/785a9642-8cdb-4e45-938f-0df36bf0172f" status: 202 len: 0 microversion: 2.1 time: 0.180454 Jul 20 04:37:11.037644 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2760/3885] 10.222.0.49 () {58 vars in 1286 bytes} [Wed Jul 20 04:37:10 2022] DELETE /compute/v2.1/os-security-group-rules/785a9642-8cdb-4e45-938f-0df36bf0172f => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:11.044292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.045649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.058063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.058608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.060221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.060775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.255634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.266843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f01cd82a-0497-4e5e-80ae-7bc303fade4b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.227662 Jul 20 04:37:11.280440 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2761/3886] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:11.285533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c06d6ea6-5c4e-4674-8493-20d9e24466a8 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f839ced1ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1467279535", "description": "tempest-description-582484788"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:11.549267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c06d6ea6-5c4e-4674-8493-20d9e24466a8 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.266930 Jul 20 04:37:11.556881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2762/3887] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:37:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:11.564042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.567153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.574786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.575261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.576037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.577884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.814429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:11.823334 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-111f2f00-ac47-4df8-8bca-90a27e265c0c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1497 microversion: 2.1 time: 0.264648 Jul 20 04:37:11.824576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2763/3888] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:11.831436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:11.832330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:11.840999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.841847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:11.843723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:11.844506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.078161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.088312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a599dca2-8c5e-414b-814c-64b72f234441 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.261800 Jul 20 04:37:12.103501 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2764/3889] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:11 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:12.114192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.116067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.122848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.123684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.124793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.125408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.335562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.347630 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eace755c-a297-4c36-973c-5abddd26ae50 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1521 microversion: 2.1 time: 0.240611 Jul 20 04:37:12.359376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2765/3890] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:12.365274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be075759-9ba7-42dc-803d-9aa173a9ae9b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838aafb1f0>, body: {"security_group_rule": {"parent_group_id": "058af8c5-9d42-49df-bf04-37684b4e5f54", "ip_protocol": "tcp", "from_port": 24698591, "to_port": 22}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:12.420077 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-be075759-9ba7-42dc-803d-9aa173a9ae9b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Invalid port range 24698591:22. Former value cannot be greater than the later Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be075759-9ba7-42dc-803d-9aa173a9ae9b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 144 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "058af8c5-9d42-49df-bf04-37684b4e5f54", "ip_protocol": "tcp", "from_port": 24698591, "to_port": 22}} Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid port range 24698591:22. Former value cannot be greater than the later Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '058af8c5-9d42-49df-bf04-37684b4e5f54', 'ip_protocol': 'tcp', 'from_port': 24698591, 'to_port': 22}}} Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 24698591:22. Former value cannot be greater than the later Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 24698591:22. Former value cannot be greater than the later Jul 20 04:37:12.422353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 24698591:22. Former value cannot be greater than the later Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be075759-9ba7-42dc-803d-9aa173a9ae9b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 400 to user: Invalid port range 24698591:22. Former value cannot be greater than the later {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:12.426093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be075759-9ba7-42dc-803d-9aa173a9ae9b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.063328 Jul 20 04:37:12.428684 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2766/3891] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:12 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:37:12.434138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.434755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.447640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.448103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.449517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.450119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.750760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:12.760158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5cf5de9-ff39-4adb-b6ce-6d7a7684f9db tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.329913 Jul 20 04:37:12.761025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2767/3892] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:12.766060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:12.766834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:12.775672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.776579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.777612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:12.778237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:12.993838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.003798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f332ee10-e0cd-4ae7-a699-e2376e75161e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.241536 Jul 20 04:37:13.025439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2768/3893] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:12 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:13.040330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e32b554b-f00d-4ba3-937d-a0387cfa4860 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838ae519d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-433505214", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:13.044779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e32b554b-f00d-4ba3-937d-a0387cfa4860 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Security group id should be uuid Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e32b554b-f00d-4ba3-937d-a0387cfa4860 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 130 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-433505214", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group id should be uuid Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-433505214', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:13.046954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:13.051365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 20 04:37:13.051365 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.055089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e32b554b-f00d-4ba3-937d-a0387cfa4860 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 400 to user: Security group id should be uuid {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:13.056312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e32b554b-f00d-4ba3-937d-a0387cfa4860 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028811 Jul 20 04:37:13.057620 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2769/3894] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:13 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:37:13.067500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fed05d7-b65a-4b1a-9dd4-e9af2e933be7 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838aecfd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-665372369", "description": "tempest-description-1718271768"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:13.389859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fed05d7-b65a-4b1a-9dd4-e9af2e933be7 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.320343 Jul 20 04:37:13.392087 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2770/3895] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:37:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:13.407083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.407982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:13.416514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.416977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.417851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.418532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.709624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.727509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-606d5235-8f15-442d-a5af-66c1decf0bbd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1498 microversion: 2.1 time: 0.324337 Jul 20 04:37:13.728872 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2771/3896] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1498 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:13.734198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0b45156-86ce-403d-83a7-894e507fd375 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f839cced940>, body: {"security_group_rule": {"parent_group_id": "08ad58f3-772d-41c2-ab56-834df71dca15", "ip_protocol": "tempest-999-606096783", "from_port": 22, "to_port": 22}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:13.804862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a0b45156-86ce-403d-83a7-894e507fd375 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Invalid IP protocol tempest-999-606096783. Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0b45156-86ce-403d-83a7-894e507fd375 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 156 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "08ad58f3-772d-41c2-ab56-834df71dca15", "ip_protocol": "tempest-999-606096783", "from_port": 22, "to_port": 22}} Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid IP protocol tempest-999-606096783. Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '08ad58f3-772d-41c2-ab56-834df71dca15', 'ip_protocol': 'tempest-999-606096783', 'from_port': 22, 'to_port': 22}}} Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-606096783. Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-606096783. Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.808595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-606096783. Jul 20 04:37:13.817614 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:13.818846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0b45156-86ce-403d-83a7-894e507fd375 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 400 to user: Invalid IP protocol tempest-999-606096783. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:13.819962 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0b45156-86ce-403d-83a7-894e507fd375 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.089366 Jul 20 04:37:13.820665 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2772/3897] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:13 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:37:13.825308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.829658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:13.829658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:13.837118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.837733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.838687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.839491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.879215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:13.951799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35ef2d8b-f735-4e07-8d9e-88d5727f9c10 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.129977 Jul 20 04:37:13.952918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2773/3898] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:13.972071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:13.972907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:13.981864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.982985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:13.983794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:13.984335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.148524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:14.151913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:14.159397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1781f7ba-1cb0-4a60-acfc-9e7d91620f7c tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.200130 Jul 20 04:37:14.160783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2774/3899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:13 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:14.166344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca12e89d-57e3-48b0-87f4-ab5858b94528 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838ae518b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1241529250", "description": "tempest-description-587716099"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:14.374339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca12e89d-57e3-48b0-87f4-ab5858b94528 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.211514 Jul 20 04:37:14.376960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2775/3900] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:37:14 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:14.388845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acf7261a-530b-4d32-a4e1-84f007c0a7e7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:14.401764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acf7261a-530b-4d32-a4e1-84f007c0a7e7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.402522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acf7261a-530b-4d32-a4e1-84f007c0a7e7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.438847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-acf7261a-530b-4d32-a4e1-84f007c0a7e7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:37:14.506942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acf7261a-530b-4d32-a4e1-84f007c0a7e7 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "POST /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac/action" status: 202 len: 0 microversion: 2.1 time: 0.127367 Jul 20 04:37:14.510936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2776/3901] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:14 2022] POST /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:14.515296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02441635-5336-4b98-8e20-2cc4cdd54628 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838a98db80>, body: {"security_group_rule": {"parent_group_id": "544b467f-9ae4-4d54-a2b9-0a66b2e1c8ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:14.611687 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-02441635-5336-4b98-8e20-2cc4cdd54628 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02441635-5336-4b98-8e20-2cc4cdd54628 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 138 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "544b467f-9ae4-4d54-a2b9-0a66b2e1c8ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '544b467f-9ae4-4d54-a2b9-0a66b2e1c8ff', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:37:14.613381 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02441635-5336-4b98-8e20-2cc4cdd54628 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02441635-5336-4b98-8e20-2cc4cdd54628 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.106118 Jul 20 04:37:14.621255 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2777/3902] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:14 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:37:14.624007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:14.624779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:14.634957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.635444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.636230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:14.636720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:14.950753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:14.963129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50756666-e5b5-4c98-9591-ac09dcf70be2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1507 microversion: 2.1 time: 0.342864 Jul 20 04:37:14.964639 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2778/3903] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:14 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:14.971310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88b949fa-ae22-49b9-86fe-5c0024917f28 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838ae51040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1244750266", "description": "tempest-description-1861234499"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:15.402033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88b949fa-ae22-49b9-86fe-5c0024917f28 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.431066 Jul 20 04:37:15.402897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2779/3904] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:37:14 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:15.420591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:15.421354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:15.438402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:15.438995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.448636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:15.449196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:15.712212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:15.727084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db6bc7d2-12f5-42bb-b6cb-da9f6de1d460 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.322364 Jul 20 04:37:15.728832 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2780/3905] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:15 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:15.745618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42bcc450-bec8-4344-afcf-8c74712f5ecd tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838ae511f0>, body: {"security_group_rule": {"parent_group_id": "96ffb964-29d6-4fd3-af1e-b8a91ceb0a2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1102520904}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:15.812315 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-42bcc450-bec8-4344-afcf-8c74712f5ecd tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Invalid port range 22:1102520904. Valid TCP ports should be between 1-65535 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42bcc450-bec8-4344-afcf-8c74712f5ecd tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 146 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "96ffb964-29d6-4fd3-af1e-b8a91ceb0a2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1102520904}} Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid port range 22:1102520904. Valid TCP ports should be between 1-65535 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '96ffb964-29d6-4fd3-af1e-b8a91ceb0a2c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1102520904}}} Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1102520904. Valid TCP ports should be between 1-65535 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1102520904. Valid TCP ports should be between 1-65535 Jul 20 04:37:15.813846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1102520904. Valid TCP ports should be between 1-65535 Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42bcc450-bec8-4344-afcf-8c74712f5ecd tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 400 to user: Invalid port range 22:1102520904. Valid TCP ports should be between 1-65535 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42bcc450-bec8-4344-afcf-8c74712f5ecd tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.085274 Jul 20 04:37:15.821056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2781/3906] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:15 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:37:15.828531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Action: 'create', calling method: .version_select at 0x7f838aafaf70>, body: {"security_group_rule": {"parent_group_id": "e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:15.864900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:37:15.865579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Neutron security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c not found {{(pid=123724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 04:37:15.866431 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.866431 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 138 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: {"security_group_rule": {"parent_group_id": "e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:37:15.870094 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] Jul 20 04:37:15.874001 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.879908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 404 to user: Security group e1c08645-f5f5-4ef4-aab2-0e7ee5946a2c does not exist Jul 20 04:37:15.879908 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-551a0ad6-e2db-4e98-8b99-a68bf9c12398'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:15.881434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f536719-ea45-4ad6-8d14-1ca72d7dc20b tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.057854 Jul 20 04:37:15.882677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2782/3907] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Jul 20 04:37:15 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:15.895614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838a98d940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:15.922872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG neutronclient.v2_0.client [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist", "detail": ""}} {{(pid=123724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 04:37:15.923531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Neutron security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb not found {{(pid=123724) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 20 04:37:15.924310 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] HTTP exception thrown: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.924310 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Request method failure captured: Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-security-group-rules/c4733b85-42af-40af-a7d5-8abc8b1268eb HTTP/1.1 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZykNvZo7YkUxrsjCFuyrf0sZ9Bv_JXRRlJCT9rx4njY2625ZosqanOyjQTOnEvfLgpizVONA337vdllhCoH169PEh8wcmAm-oENEJRnnda-0JTrmIoufx2wJInOLeKvWGRKTOH35JPWNd7jKPMLCNRYo5oQOEGZAkby6XnhlO6ChE Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8001eb44e334c3792caae41ea494812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8001eb44e334c3792caae41ea494812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8001eb44e334c3792caae41ea494812", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a8001eb44e334c3792caae41ea494812 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9461dc6358bd4165a55a65f49a2911f6 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-254906215-project Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: exception: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c4733b85-42af-40af-a7d5-8abc8b1268eb'} Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 04:37:15.930020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] Jul 20 04:37:15.935573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:15.942459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Returning 404 to user: Security group rule c4733b85-42af-40af-a7d5-8abc8b1268eb does not exist Jul 20 04:37:15.942459 n-d-764486-11 devstack@n-api.service[123724]: Neutron server returns request_ids: ['req-a31a2e09-0746-43a1-9a43-414fa13bfcb9'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:15.943607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d662abcc-739a-4ebe-a40e-454cbbaf639c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/c4733b85-42af-40af-a7d5-8abc8b1268eb" status: 404 len: 199 microversion: 2.1 time: 0.053347 Jul 20 04:37:15.951205 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2783/3908] 10.222.0.49 () {58 vars in 1286 bytes} [Wed Jul 20 04:37:15 2022] DELETE /compute/v2.1/os-security-group-rules/c4733b85-42af-40af-a7d5-8abc8b1268eb => generated 199 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:37:15.961431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c202f206-01e4-4663-8107-706bcee5457c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838aecf280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.233555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c202f206-01e4-4663-8107-706bcee5457c tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/96ffb964-29d6-4fd3-af1e-b8a91ceb0a2c" status: 202 len: 0 microversion: 2.1 time: 0.280063 Jul 20 04:37:16.234656 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2784/3909] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:37:15 2022] DELETE /compute/v2.1/os-security-groups/96ffb964-29d6-4fd3-af1e-b8a91ceb0a2c => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:16.242392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.245090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.261319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.261319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.261319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.261319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.465105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:16.474638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e596f6f-212d-4ca3-b22c-175428843035 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1507 microversion: 2.1 time: 0.238857 Jul 20 04:37:16.475218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2785/3910] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:16 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:16.480187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.480706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.487696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.488150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.488948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.489560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.518792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:16.654566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ae8b339-ee96-48e7-a8c6-43904187ae28 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "DELETE /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 204 len: 0 microversion: 2.1 time: 0.176942 Jul 20 04:37:16.656039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2786/3911] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:16 2022] DELETE /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:16.673136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1203f5c2-f4d1-4a01-9fd3-2318defd49bc tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838ab91040>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.919544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1203f5c2-f4d1-4a01-9fd3-2318defd49bc tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/544b467f-9ae4-4d54-a2b9-0a66b2e1c8ff" status: 202 len: 0 microversion: 2.1 time: 0.261500 Jul 20 04:37:16.920150 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2787/3912] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:37:16 2022] DELETE /compute/v2.1/os-security-groups/544b467f-9ae4-4d54-a2b9-0a66b2e1c8ff => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:16.925466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:16.927454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:16.943883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.944343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:16.945655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:16.946114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.119982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.128928 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2119ac40-3fca-4fe6-93d8-e076e8de757c tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1503 microversion: 2.1 time: 0.207697 Jul 20 04:37:17.129518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2788/3913] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:16 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:17.134515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.135126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.141182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.141634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.143114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.143560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.305071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:17.315653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c743e2f2-f88b-4d77-817b-3de6e098098e tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.184710 Jul 20 04:37:17.316655 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2789/3914] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:17.321859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb314d99-479b-4388-9d80-5b676fbe1a76 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838aafbdc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.924234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb314d99-479b-4388-9d80-5b676fbe1a76 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/08ad58f3-772d-41c2-ab56-834df71dca15" status: 202 len: 0 microversion: 2.1 time: 0.605586 Jul 20 04:37:17.924873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2790/3915] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:37:17 2022] DELETE /compute/v2.1/os-security-groups/08ad58f3-772d-41c2-ab56-834df71dca15 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:17.929708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:17.930325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:17.944693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.945140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:17.948106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:17.948593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.160176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:18.169247 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec3ffa0f-814c-4fc6-8bc5-354f014cf6dc tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1511 microversion: 2.1 time: 0.243398 Jul 20 04:37:18.170072 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2791/3916] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:17 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:18.175220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff0965c8-b8ae-4e3b-b818-9b543653cc0e tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838aafbd30>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.774072 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff0965c8-b8ae-4e3b-b818-9b543653cc0e tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/058af8c5-9d42-49df-bf04-37684b4e5f54" status: 202 len: 0 microversion: 2.1 time: 0.602606 Jul 20 04:37:18.774864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2792/3917] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:37:18 2022] DELETE /compute/v2.1/os-security-groups/058af8c5-9d42-49df-bf04-37684b4e5f54 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:18.780877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:18.781354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:18.794524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.794987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:18.795857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:18.796207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.154594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60665dc488a413cbe1480418011d3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8c206190e874398b163786396840b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.168495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-933eed1a-402e-47a6-b75a-35c74c23d617 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 200 len: 1503 microversion: 2.1 time: 0.392621 Jul 20 04:37:19.170591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2793/3918] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:18 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:19.182482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:19.188398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.189685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.servers [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Removing options 'limit' from query {{(pid=123724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 04:37:19.190470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:19.192255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.192891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.193944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.194679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.197282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c8b6e0b-a899-4c1c-b57a-93477f3aff22 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.024832 Jul 20 04:37:19.198839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2794/3919] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jul 20 04:37:19 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:37:19.206317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:19.208395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:19.214574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.215276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.217176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.218216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.454325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:19.471054 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd5af226-9516-4722-98ee-eaa2b792abc7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.269773 Jul 20 04:37:19.471784 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2795/3920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:19 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:19.476565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25c43bf6-3a5e-4e6e-9b87-f0d0cd03bf03 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] Calling method '.version_select at 0x7f838a614a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:19.761245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25c43bf6-3a5e-4e6e-9b87-f0d0cd03bf03 tempest-SecurityGroupRulesNegativeTestJSON-254906215 tempest-SecurityGroupRulesNegativeTestJSON-254906215-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8d68f5c1-edc6-49c6-90e9-ddd877f96593" status: 202 len: 0 microversion: 2.1 time: 0.287968 Jul 20 04:37:19.788022 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2796/3921] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:37:19 2022] DELETE /compute/v2.1/os-security-groups/8d68f5c1-edc6-49c6-90e9-ddd877f96593 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:19.809614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-746bd9fd-33a4-4a5e-85a1-0972e27e32fc req-e2cf196d-4c21-4efa-b7ae-9c9b4324b430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41098e3e-9107-48f3-aa56-32f586b5edde", "name": "network-vif-deleted", "tag": "f0bd9752-19de-4d7b-b0fe-a75806b48b90"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:19.832568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-746bd9fd-33a4-4a5e-85a1-0972e27e32fc req-e2cf196d-4c21-4efa-b7ae-9c9b4324b430 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.843033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-746bd9fd-33a4-4a5e-85a1-0972e27e32fc req-e2cf196d-4c21-4efa-b7ae-9c9b4324b430 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.889815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-746bd9fd-33a4-4a5e-85a1-0972e27e32fc req-e2cf196d-4c21-4efa-b7ae-9c9b4324b430 service nova] Creating event network-vif-deleted:f0bd9752-19de-4d7b-b0fe-a75806b48b90 for instance 41098e3e-9107-48f3-aa56-32f586b5edde on n-h1-764486-11 Jul 20 04:37:19.914119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-746bd9fd-33a4-4a5e-85a1-0972e27e32fc req-e2cf196d-4c21-4efa-b7ae-9c9b4324b430 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132205 Jul 20 04:37:19.915241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2797/3922] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:19.924301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:19.925276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:19.935144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.935603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:19.937972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:19.938434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.167046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.181367 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc2e0f13-2583-4c20-85d4-65e905accb40 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1511 microversion: 2.1 time: 0.262759 Jul 20 04:37:20.182951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2798/3923] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:19 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:20.207682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.208570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] [instance: 41098e3e-9107-48f3-aa56-32f586b5edde] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.218162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.218777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.219694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.220238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.247515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] HTTP exception thrown: Instance 41098e3e-9107-48f3-aa56-32f586b5edde could not be found. Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Request method failure captured: Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde HTTP/1.1 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Zg9UeW-mp2IdImmle43yz-RQLpttn32-QQNdV4N54-bS4wR2t5tg93wTXzHiKVnqFUSt6NmSK5nyAQt3mbQfObd2WGPpg6vUrFgPYxoThcZ83n1FWqplQZuIUvSpV5W-Nb5pNfNTCUcihzSvf22We0uNzXTjQVJV12ow0tUXdGgwo Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: e8c206190e874398b163786396840b01 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesActionsTest-1478069580 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e8c206190e874398b163786396840b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e8c206190e874398b163786396840b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e8c206190e874398b163786396840b01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e8c206190e874398b163786396840b01", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesActionsTest-1478069580 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: e8c206190e874398b163786396840b01 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesActionsTest-1478069580 Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesActionsTest-1478069580-project Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f60665dc488a413cbe1480418011d3db Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesActionsTest-1478069580-project Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 41098e3e-9107-48f3-aa56-32f586b5edde could not be found. Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '41098e3e-9107-48f3-aa56-32f586b5edde'} Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41098e3e-9107-48f3-aa56-32f586b5edde could not be found. Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41098e3e-9107-48f3-aa56-32f586b5edde could not be found. Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:20.252571 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41098e3e-9107-48f3-aa56-32f586b5edde could not be found. Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] Returning 404 to user: Instance 41098e3e-9107-48f3-aa56-32f586b5edde could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-427780a3-be3d-4b60-a5a6-f46d360d4138 tempest-VolumesActionsTest-1478069580 tempest-VolumesActionsTest-1478069580-project] 10.222.0.49 "GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde" status: 404 len: 111 microversion: 2.1 time: 0.057104 Jul 20 04:37:20.258072 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2799/3924] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/41098e3e-9107-48f3-aa56-32f586b5edde => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:37:20.264915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.264915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.275944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.276737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.277557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.277998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.528345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.550080 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d02b9c1-248f-404d-8973-afdad01fc085 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838" status: 200 len: 1511 microversion: 2.1 time: 0.288432 Jul 20 04:37:20.554551 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2800/3925] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:20.581199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.582406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.607528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.612994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.615334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.617478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.864722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:20.874625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01d5ca63-297b-4366-8680-38c7b0e767f3 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.311835 Jul 20 04:37:20.876319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2801/3926] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:20.903953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:20.904888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:20.929954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.930801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.933950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:20.934467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:20.946733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:21.447274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.464557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af1b1267-b9f3-403b-a00a-d6859c363066 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1512 microversion: 2.1 time: 0.586473 Jul 20 04:37:21.465361 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2802/3927] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:20 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1512 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:21.493262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:21.501846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:21.503123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:21.702621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.703324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.709710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:21.710573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:21.882184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:22.082555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d18ee45c-1d6f-4457-acd3-d5c1bde3a6b2 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 345 microversion: 2.1 time: 0.593559 Jul 20 04:37:22.083204 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2803/3928] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:37:21 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 345 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:22.091796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.092653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.127676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.127676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.127676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.139656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.473765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.486746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05b3cff8-4ff3-4b99-b1d4-42a4c213ef9f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.401792 Jul 20 04:37:22.488078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2804/3929] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:22.505398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.506262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.529200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.529663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.532192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.532624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.932639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:22.943905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a57c8ce3-5f21-4853-b23b-6828e5f3b5af tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1511 microversion: 2.1 time: 0.443182 Jul 20 04:37:22.949845 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2805/3930] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:22.967934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:22.968819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:22.990499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.993129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:22.996842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:22.997626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.711870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:23.747810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6edb5b1-849e-4924-bed3-34677f263306 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838" status: 200 len: 1511 microversion: 2.1 time: 0.785371 Jul 20 04:37:23.764502 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2806/3931] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:22 2022] GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:23.776674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:23.777525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:23.788817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.789575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:23.791630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:23.799835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.566075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:24.597660 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47973fdb-a720-44df-aaf8-24428777cdb7 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.831599 Jul 20 04:37:24.604480 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2807/3932] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:23 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:24.641503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:24.645699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:24.661303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.663326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:24.670503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:24.678950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.084109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.096487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c52079b1-aacd-4c43-872e-87a76e0ae1e8 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1512 microversion: 2.1 time: 0.490368 Jul 20 04:37:25.102397 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2808/3933] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:24 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1512 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:25.132152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.146798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.150689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:25.171422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.176447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.180252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.181457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.296799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:25.369208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:25.383559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.384332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.670798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a64168c8-e9c1-4748-997f-4b7b3f694747 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.550786 Jul 20 04:37:25.672253 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2809/3934] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:25.688822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:25.688822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:25.698146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.708035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:25.708035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:25.708815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.271964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.282067 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0cf2baef-ebef-463c-acb5-683782eaccb5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1524 microversion: 2.1 time: 0.607762 Jul 20 04:37:26.286589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2810/3935] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:25 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1524 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:26.298817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:26.303265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.305450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:26.478959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.479728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.481125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.482062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.551887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:26.619436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4592e75a-c14b-46ef-a345-85a2310b45ba tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.323960 Jul 20 04:37:26.622780 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2811/3936] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Jul 20 04:37:26 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:26.640932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:26.647611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:26.651797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:26.667201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.670050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.672474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:26.673153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:26.834540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:26.994504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d506854-b5c2-4ab2-8b5d-e860de8fe511 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.349480 Jul 20 04:37:26.996513 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2812/3937] 10.222.0.49 () {58 vars in 1211 bytes} [Wed Jul 20 04:37:26 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:27.010541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.018596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.019441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:27.029043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.029872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.031302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.032288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.171755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:27.292672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-984b6dd6-c306-4ad3-b307-4b7285c1755e tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.288709 Jul 20 04:37:27.303376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2813/3938] 10.222.0.49 () {58 vars in 1195 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:37:27.309271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.310084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:27.318477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.319329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.320280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.321353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.632911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.655888 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7642c2a-ff7f-4f98-99bc-7cddf42fc949 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1504 microversion: 2.1 time: 0.350716 Jul 20 04:37:27.657378 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2814/3939] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:27.668275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:27.677760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:27.680548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': '-950339688', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:27.694107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.695317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.696900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:27.698290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:27.837425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:27.939728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9fab2105-81b4-43e0-b01c-4ee6033b6468 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-950339688" status: 200 len: 345 microversion: 2.1 time: 0.279326 Jul 20 04:37:27.948467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2815/3940] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Jul 20 04:37:27 2022] GET /compute/v2.1/servers?name=-950339688 => generated 345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:27.950560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3589c2df-7d93-492f-81d2-6774de800790 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'create', calling method: .version_select at 0x7f838a614040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-700342910", "description": "tempest-description-429081163"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:28.234750 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3589c2df-7d93-492f-81d2-6774de800790 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.290341 Jul 20 04:37:28.249137 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2816/3941] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Jul 20 04:37:27 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:28.264677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:28.270607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:28.271189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:28.278290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.279689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.280570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.281207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.480856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:28.499912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:28.714328 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42cb9e79-3d3a-46ff-9758-77a1baa8f32b tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.456682 Jul 20 04:37:28.725463 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2817/3942] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Jul 20 04:37:28 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:28.734505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-700342910"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:28.736287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:28.747683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.753570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:28.753570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:28.753570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:29.049373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Adding security group 4310fdd0-bb45-4dd0-ae23-cb6440d98c70 to port bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 Jul 20 04:37:30.038544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c6f01aa-aa51-4f81-ab31-4003a9c6d825 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action" status: 202 len: 0 microversion: 2.1 time: 1.311245 Jul 20 04:37:30.040318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2818/3943] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:28 2022] POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:30.052511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:30.081551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:30.085453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-95033968', 'deleted': False, 'project_id': 'cb424a86017a4c418751e2d7ee007847'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 04:37:30.113279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.114684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.117322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.119505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.310439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 04:37:30.404120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0b66321-2a53-4e34-989e-eaf0aecd26bd tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-95033968" status: 200 len: 345 microversion: 2.1 time: 0.363456 Jul 20 04:37:30.408828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2819/3944] 10.222.0.49 () {58 vars in 1225 bytes} [Wed Jul 20 04:37:30 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-95033968 => generated 345 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:30.432427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-700342910"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:30.432427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:30.446687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.447324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.460322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:30.460851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:30.702675 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Removing security group 4310fdd0-bb45-4dd0-ae23-cb6440d98c70 from port bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 Jul 20 04:37:31.676866 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3fee88d-0df0-4474-9e31-516f5f3a4293 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action" status: 202 len: 0 microversion: 2.1 time: 1.265631 Jul 20 04:37:31.678892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2820/3945] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:30 2022] POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action => generated 0 bytes in 1270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:31.690335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-70d97659-8ece-424e-89e7-697a7565a616 req-55071b37-84c0-4d89-882d-a43b1b4e850b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:31.752335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-70d97659-8ece-424e-89e7-697a7565a616 req-55071b37-84c0-4d89-882d-a43b1b4e850b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.756140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-70d97659-8ece-424e-89e7-697a7565a616 req-55071b37-84c0-4d89-882d-a43b1b4e850b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.850786 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-70d97659-8ece-424e-89e7-697a7565a616 req-55071b37-84c0-4d89-882d-a43b1b4e850b service nova] Creating event network-changed:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:37:31.870567 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-70d97659-8ece-424e-89e7-697a7565a616 req-55071b37-84c0-4d89-882d-a43b1b4e850b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181092 Jul 20 04:37:31.871570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2821/3946] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:31.878354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:31.879128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:31.909546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:31.915037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.917170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:31.919960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:31.926350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:32.072500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:32.410256 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de0645fc-d323-41a5-8293-7d01ccfd2d19 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "DELETE /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 204 len: 0 microversion: 2.1 time: 0.534987 Jul 20 04:37:32.412017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2822/3947] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:31 2022] DELETE /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:32.425327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2a23c45-3e20-4110-ac22-573cba6bfcee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'create', calling method: .version_select at 0x7f838aea7a60>, body: {"pool": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:35.367943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:37.408221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2a23c45-3e20-4110-ac22-573cba6bfcee tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.993872 Jul 20 04:37:37.409383 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2823/3948] 10.222.0.49 () {60 vars in 1169 bytes} [Wed Jul 20 04:37:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:37.418699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:37.420624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:37.438814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.439262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.440774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:37.441209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:37.874689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:37.921172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea6bb92d-cbba-400f-b571-9bcc3036e9f4 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 200 len: 1476 microversion: 2.1 time: 0.498652 Jul 20 04:37:37.924022 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2824/3949] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:37 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:37.939279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:37.940325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.010770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.014695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.023340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.024673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.402519 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ac32437-9805-403c-a6a1-9da5b75c18d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.473608 Jul 20 04:37:38.423520 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2825/3950] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:37 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:38.445859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-23ddb6a5-9627-4458-8bb2-efa498a16d5d req-675f34e2-f013-45f4-8e37-bc33e4907747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:38.505722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-23ddb6a5-9627-4458-8bb2-efa498a16d5d req-675f34e2-f013-45f4-8e37-bc33e4907747 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.506873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-23ddb6a5-9627-4458-8bb2-efa498a16d5d req-675f34e2-f013-45f4-8e37-bc33e4907747 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.554728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-23ddb6a5-9627-4458-8bb2-efa498a16d5d req-675f34e2-f013-45f4-8e37-bc33e4907747 service nova] Creating event network-changed:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:37:38.562794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-23ddb6a5-9627-4458-8bb2-efa498a16d5d req-675f34e2-f013-45f4-8e37-bc33e4907747 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133579 Jul 20 04:37:38.566774 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2826/3951] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:38.574749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.248"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:38.576398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:38.591961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.595720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.598936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:38.599627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:38.695733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Acquired lock "refresh_cache-bdc5d91c-0674-4383-b623-4623346c02ef" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:37:40.199408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=18 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:42.486299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:37:44.264603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Updating instance_info_cache with network_info: [{"id": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6", "address": "fa:16:3e:14:72:41", "network": {"id": "738bc9b3-63f1-49e2-9a17-dfc66ca765a1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1319414139-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "607843d657d5443d8f30ea9f1679d4ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbcf1a774-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:37:44.284305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Releasing lock "refresh_cache-bdc5d91c-0674-4383-b623-4623346c02ef" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:37:44.286109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79399e45-de83-444e-a692-8292cb40d0c5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action" status: 202 len: 0 microversion: 2.1 time: 5.717682 Jul 20 04:37:44.287312 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2827/3952] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:38 2022] POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action => generated 0 bytes in 5720 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:37:44.309497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:44.311113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:44.336050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.337511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:44.339176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:44.340229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.732392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:45.807612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66af1067-e196-4754-9cb8-038d3ba35145 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 1.517541 Jul 20 04:37:45.808822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2828/3953] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:44 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:45.836436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:45.840730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 91a74219-6dda-4acf-a2cf-9ebbc6881334] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:45.867615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.870559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.878057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:45.889347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:45.948953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] HTTP exception thrown: Instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 could not be found. Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Request method failure captured: Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 HTTP/1.1 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Yom94KvrkiEBEaeBnoPpFKdH6v6eGxsNHkp1oudhfwBNWd2c6N5pjyW4RY-mkmC_xvlRbR3yPw63kaxeuq8O91s8GnlcA-52cXB0_yVEnisZV4AwB9oWmXxhcvAvlldOBdqef6_uNHthPiGPIlBSBLUd_Q2tppgHaWEShcrClVBoU Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cb424a86017a4c418751e2d7ee007847 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb424a86017a4c418751e2d7ee007847", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cb424a86017a4c418751e2d7ee007847 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServerFiltersTestJSON-1921956207-project Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d7afaf4026ba4f35b9c6d8b20bf91bb1 Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServerFiltersTestJSON-1921956207-project Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 could not be found. Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '91a74219-6dda-4acf-a2cf-9ebbc6881334'} Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 could not be found. Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 could not be found. Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:37:45.974405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 could not be found. Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:37:45.983011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Returning 404 to user: Instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:37:45.989144 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b797364e-f8d0-4ec2-aafd-a72f6bb67c88 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334" status: 404 len: 111 microversion: 2.1 time: 0.155962 Jul 20 04:37:45.989144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2829/3954] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:45 2022] GET /compute/v2.1/servers/91a74219-6dda-4acf-a2cf-9ebbc6881334 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:37:46.017478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ebaf8631-023d-4789-b49b-8128eb3a84ae req-3c5f2cac-fb45-467b-8fd8-4e31c7c5d6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a74219-6dda-4acf-a2cf-9ebbc6881334", "name": "network-vif-deleted", "tag": "8f152d43-30d8-46ea-a48f-8bba81599fba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:46.071769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ebaf8631-023d-4789-b49b-8128eb3a84ae req-3c5f2cac-fb45-467b-8fd8-4e31c7c5d6cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.073658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ebaf8631-023d-4789-b49b-8128eb3a84ae req-3c5f2cac-fb45-467b-8fd8-4e31c7c5d6cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.173813 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ebaf8631-023d-4789-b49b-8128eb3a84ae req-3c5f2cac-fb45-467b-8fd8-4e31c7c5d6cf service nova] Creating event network-vif-deleted:8f152d43-30d8-46ea-a48f-8bba81599fba for instance 91a74219-6dda-4acf-a2cf-9ebbc6881334 on n-h2-764486-11 Jul 20 04:37:46.200184 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ebaf8631-023d-4789-b49b-8128eb3a84ae req-3c5f2cac-fb45-467b-8fd8-4e31c7c5d6cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210270 Jul 20 04:37:46.208873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2830/3955] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:46.241317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.248"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:46.820313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:46.828019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.829282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:46.830275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:46.832535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:47.425847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Acquired lock "refresh_cache-bdc5d91c-0674-4383-b623-4623346c02ef" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 04:37:50.245852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Building network info cache for instance {{(pid=123724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 04:37:52.459125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Updating instance_info_cache with network_info: [{"id": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6", "address": "fa:16:3e:14:72:41", "network": {"id": "738bc9b3-63f1-49e2-9a17-dfc66ca765a1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1319414139-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "607843d657d5443d8f30ea9f1679d4ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbcf1a774-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:37:52.505707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Releasing lock "refresh_cache-bdc5d91c-0674-4383-b623-4623346c02ef" {{(pid=123724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 04:37:52.506710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf86be02-9f78-4ab0-878e-782c84896388 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action" status: 202 len: 0 microversion: 2.1 time: 6.288439 Jul 20 04:37:52.508178 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2831/3956] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:37:46 2022] POST /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef/action => generated 0 bytes in 6298 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 04:37:52.522814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:52.526866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:52.564009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.564490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.569770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:52.580986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:52.714169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:37:52.909897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:37:53.120317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8c193c1-b257-4044-a544-a082f6bf070f tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838" status: 204 len: 0 microversion: 2.1 time: 0.605886 Jul 20 04:37:53.131807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2832/3957] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:37:52 2022] DELETE /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:53.158757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:53.159430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:53.178251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.178713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.179647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.185328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.323766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a9c3e61-9bd1-461a-997b-e3fcd4e5779f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments/671535ba-1671-436e-b5fb-2af9fc322dbe" status: 200 len: 194 microversion: 2.20 time: 0.190042 Jul 20 04:37:53.324445 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2833/3958] 10.222.0.49 () {60 vars in 1453 bytes} [Wed Jul 20 04:37:53 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments/671535ba-1671-436e-b5fb-2af9fc322dbe => generated 194 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:37:53.349935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e05154bd-820a-4cbf-a51d-f9739e4f1934 req-2a5b0d76-9999-4eb3-9585-d10af903ca29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:53.410054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e05154bd-820a-4cbf-a51d-f9739e4f1934 req-2a5b0d76-9999-4eb3-9585-d10af903ca29 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:53.410810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e05154bd-820a-4cbf-a51d-f9739e4f1934 req-2a5b0d76-9999-4eb3-9585-d10af903ca29 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:53.462404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e05154bd-820a-4cbf-a51d-f9739e4f1934 req-2a5b0d76-9999-4eb3-9585-d10af903ca29 service nova] Creating event network-changed:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:37:53.493008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e05154bd-820a-4cbf-a51d-f9739e4f1934 req-2a5b0d76-9999-4eb3-9585-d10af903ca29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166953 Jul 20 04:37:53.493671 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2834/3959] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:53.511810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-715ed83e-5ee3-47fd-ae65-896ece377428 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '.version_select at 0x7f838ba87ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.161701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-715ed83e-5ee3-47fd-ae65-896ece377428 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/e44dba2f-94d0-4a56-afb1-b3b38f6ce733" status: 202 len: 0 microversion: 2.1 time: 3.665074 Jul 20 04:37:57.162655 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2835/3960] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 04:37:53 2022] DELETE /compute/v2.1/os-floating-ips/e44dba2f-94d0-4a56-afb1-b3b38f6ce733 => generated 0 bytes in 3667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:57.195784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.197457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:57.238984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.239958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.241394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.245208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.620213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:37:57.632627 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aff40496-25b8-4659-8458-091614c39abb tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838" status: 200 len: 1517 microversion: 2.1 time: 0.460852 Jul 20 04:37:57.635141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2836/3961] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:37:57 2022] GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 => generated 1517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:37:57.654319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:57.656536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:37:57.679388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.680298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.681378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:57.682055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:57.972170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lazy-loading 'services' on Instance uuid 784190f6-370f-4649-9bee-c669f705e6fc {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:37:58.329006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad6a0a9b-297b-417e-9971-5ce8e1bb7f37 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments/671535ba-1671-436e-b5fb-2af9fc322dbe" status: 202 len: 0 microversion: 2.20 time: 0.690095 Jul 20 04:37:58.348081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2837/3962] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Jul 20 04:37:57 2022] DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments/671535ba-1671-436e-b5fb-2af9fc322dbe => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:37:58.387600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f0595255-c4fb-444c-a3e1-f3655728bb40 req-9e87f8e3-3e5a-483b-b3af-4da85121f83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:58.458735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0595255-c4fb-444c-a3e1-f3655728bb40 req-9e87f8e3-3e5a-483b-b3af-4da85121f83a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:37:58.460807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0595255-c4fb-444c-a3e1-f3655728bb40 req-9e87f8e3-3e5a-483b-b3af-4da85121f83a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:37:58.538370 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f0595255-c4fb-444c-a3e1-f3655728bb40 req-9e87f8e3-3e5a-483b-b3af-4da85121f83a service nova] Creating event network-changed:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:37:58.563217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f0595255-c4fb-444c-a3e1-f3655728bb40 req-9e87f8e3-3e5a-483b-b3af-4da85121f83a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204118 Jul 20 04:37:58.565491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2838/3963] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:37:58.597243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-014653d8-364d-4451-b9c1-cb68e0215b43 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '.version_select at 0x7f839ce06b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:37:59.057186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-014653d8-364d-4451-b9c1-cb68e0215b43 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/4310fdd0-bb45-4dd0-ae23-cb6440d98c70" status: 202 len: 0 microversion: 2.1 time: 0.488324 Jul 20 04:37:59.063100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2839/3964] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 04:37:58 2022] DELETE /compute/v2.1/os-security-groups/4310fdd0-bb45-4dd0-ae23-cb6440d98c70 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:37:59.070923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-962890386", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "f1b7c130-08ff-4ac9-aa1e-8f8cc2b73300"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:37:59.284391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] validate_networks() for [('f1b7c130-08ff-4ac9-aa1e-8f8cc2b73300', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:00.362106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:00.364585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:00.365460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:00.366134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:00.367472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:00.399733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.404538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.418739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.419625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.451057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Getting quotas for project d6a0c385f4394e8fa2398bd01c3d635f. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:00.458438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Getting quotas for user 9e90538f47054eacb99903b93b6b1d15 and project d6a0c385f4394e8fa2398bd01c3d635f. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:00.475212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:00.479903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:00.595468 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5de08ef4-ae43-4e8f-ac47-a356b8e8b034 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519430 Jul 20 04:38:00.596122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2840/3965] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:37:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:00.603817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.606806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:00.618874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.619324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.620112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.621114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.669026 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f53f43c-ac0d-4c2c-8dca-afd3764391a8 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068561 Jul 20 04:38:00.670478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2841/3966] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:00.681699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.685579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: f09a3e91-173a-4ff1-b657-569689c2c838] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:00.706805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.713556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.715360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.716450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.779172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] HTTP exception thrown: Instance f09a3e91-173a-4ff1-b657-569689c2c838 could not be found. Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Request method failure captured: Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 HTTP/1.1 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Yom94KvrkiEBEaeBnoPpFKdH6v6eGxsNHkp1oudhfwBNWd2c6N5pjyW4RY-mkmC_xvlRbR3yPw63kaxeuq8O91s8GnlcA-52cXB0_yVEnisZV4AwB9oWmXxhcvAvlldOBdqef6_uNHthPiGPIlBSBLUd_Q2tppgHaWEShcrClVBoU Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cb424a86017a4c418751e2d7ee007847 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb424a86017a4c418751e2d7ee007847", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cb424a86017a4c418751e2d7ee007847 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServerFiltersTestJSON-1921956207-project Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d7afaf4026ba4f35b9c6d8b20bf91bb1 Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServerFiltersTestJSON-1921956207-project Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f09a3e91-173a-4ff1-b657-569689c2c838 could not be found. Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f09a3e91-173a-4ff1-b657-569689c2c838'} Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09a3e91-173a-4ff1-b657-569689c2c838 could not be found. Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09a3e91-173a-4ff1-b657-569689c2c838 could not be found. Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:00.790495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09a3e91-173a-4ff1-b657-569689c2c838 could not be found. Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:00.798537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Returning 404 to user: Instance f09a3e91-173a-4ff1-b657-569689c2c838 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:00.808430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa42e4cf-4225-4aa8-b914-2ab6963113fe tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838" status: 404 len: 111 microversion: 2.1 time: 0.121253 Jul 20 04:38:00.809317 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2842/3967] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:00 2022] GET /compute/v2.1/servers/f09a3e91-173a-4ff1-b657-569689c2c838 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:00.822407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:00.822912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:00.846785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.864730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.869590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:00.870630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:00.992600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:01.195474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0e607fc-74f2-451a-a9a2-c8752368a473 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 204 len: 0 microversion: 2.1 time: 0.384079 Jul 20 04:38:01.201841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2843/3968] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:00 2022] DELETE /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:01.212318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-973bba89-ac94-436d-9c18-90fcd518e3f9 req-2420345f-cf7b-46aa-adf8-9f9915a1a4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09a3e91-173a-4ff1-b657-569689c2c838", "name": "network-vif-deleted", "tag": "097e0288-9940-4bb2-ae64-a229d380da85"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:01.246485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-973bba89-ac94-436d-9c18-90fcd518e3f9 req-2420345f-cf7b-46aa-adf8-9f9915a1a4ed service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.247122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-973bba89-ac94-436d-9c18-90fcd518e3f9 req-2420345f-cf7b-46aa-adf8-9f9915a1a4ed service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.337064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-973bba89-ac94-436d-9c18-90fcd518e3f9 req-2420345f-cf7b-46aa-adf8-9f9915a1a4ed service nova] Creating event network-vif-deleted:097e0288-9940-4bb2-ae64-a229d380da85 for instance f09a3e91-173a-4ff1-b657-569689c2c838 on n-h1-764486-11 Jul 20 04:38:01.367171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-973bba89-ac94-436d-9c18-90fcd518e3f9 req-2420345f-cf7b-46aa-adf8-9f9915a1a4ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165845 Jul 20 04:38:01.370958 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2844/3969] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:01.377853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f259d25-e9b9-4a96-9290-a10e31a6968c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:01.386593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f259d25-e9b9-4a96-9290-a10e31a6968c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.533421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5f259d25-e9b9-4a96-9290-a10e31a6968c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:01.547358 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f259d25-e9b9-4a96-9290-a10e31a6968c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1218 microversion: 2.1 time: 0.174259 Jul 20 04:38:01.549427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2845/3970] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:01 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:01.590567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:01.591279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:01.627232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.627889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.630530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:01.631757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:01.794877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:02.045715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:02.085030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad02df16-bca9-424d-ad88-2e607ff963ca tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "DELETE /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 204 len: 0 microversion: 2.1 time: 0.529809 Jul 20 04:38:02.091510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2846/3971] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:38:01 2022] DELETE /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:38:02.104284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.105940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.118680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.119575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.121400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.122094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.426951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.438098 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d76fe0f-42fb-4f49-9ec5-dd2acb14f99f tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1510 microversion: 2.1 time: 0.343394 Jul 20 04:38:02.444805 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2847/3972] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:02.451093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.452375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.464176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.466384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.469396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.471946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.565121 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0a97a60-a6e1-4961-bef1-7d4c9cc7f354 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124714 Jul 20 04:38:02.566419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2848/3973] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:02.571689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.572550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.580074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.580850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.581892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.582529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.888571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:02.913490 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-471f95ab-37fc-495f-b9d3-7bd0f4d32a07 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1517 microversion: 2.1 time: 0.330797 Jul 20 04:38:02.914184 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2849/3974] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:02.918934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:02.921536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:02.928771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.929543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:02.930493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:02.931084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.052657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:03.063330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:03.072578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffad0446-2692-4d10-9763-bf168ff3fa37 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1214 microversion: 2.1 time: 0.156925 Jul 20 04:38:03.073440 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2850/3975] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:02 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:03.458374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:03.460193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:03.482027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.485508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:03.487013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:03.489739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:04.973508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:04.986416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e64d996b-ef4c-4360-8971-df9267422d76 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1510 microversion: 2.1 time: 1.534312 Jul 20 04:38:04.988774 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2851/3976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:03 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1510 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:05.005029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.012629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.067537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.068501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.069712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.070453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.188996 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14e80865-6a4b-41d5-8d53-ec1e2c1c660c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.194927 Jul 20 04:38:05.194239 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2852/3977] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:04 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:05.204572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.216636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.237309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.238352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.240429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.240977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.785322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:05.807709 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f5b8a22-ca52-41c0-9f09-48590d9250c1 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1517 microversion: 2.1 time: 0.609898 Jul 20 04:38:05.812596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2853/3978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1517 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:05.821359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:05.827217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:05.844400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.848419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:05.849923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:05.852783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.177660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.210197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e9a56ac-215c-41a9-897e-762e1a66ae91 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1276 microversion: 2.1 time: 0.393664 Jul 20 04:38:06.213812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2854/3979] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:05 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1276 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.231761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-56a28098-79da-41ed-af95-471ded6fc06a req-6653173e-7b4e-4e41-a165-62f6527ccbda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc5d91c-0674-4383-b623-4623346c02ef", "name": "network-vif-deleted", "tag": "bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:06.281762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-56a28098-79da-41ed-af95-471ded6fc06a req-6653173e-7b4e-4e41-a165-62f6527ccbda service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.285172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-56a28098-79da-41ed-af95-471ded6fc06a req-6653173e-7b4e-4e41-a165-62f6527ccbda service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.325875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-56a28098-79da-41ed-af95-471ded6fc06a req-6653173e-7b4e-4e41-a165-62f6527ccbda service nova] Creating event network-vif-deleted:bcf1a774-6b09-4edc-a7eb-16cb5a99e7e6 for instance bdc5d91c-0674-4383-b623-4623346c02ef on n-h2-764486-11 Jul 20 04:38:06.347625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-56a28098-79da-41ed-af95-471ded6fc06a req-6653173e-7b4e-4e41-a165-62f6527ccbda service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132244 Jul 20 04:38:06.348748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2855/3980] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:06.370287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.373752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.396480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.397181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.403113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.403611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.537718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.538021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.542954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lazy-loading 'fault' on Instance uuid bdc5d91c-0674-4383-b623-4623346c02ef {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:06.768480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb17b40494cc4ad4a7a5f131c7b54ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607843d657d5443d8f30ea9f1679d4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:06.785097 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63a7e531-f5ae-4b40-90ec-5769dbc1b0be tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 200 len: 1313 microversion: 2.1 time: 0.431798 Jul 20 04:38:06.787131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2856/3981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:06.820865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d0e2f0ed-a155-4fc4-a01a-d69801e69f37 req-4fa0013c-e7c7-4376-8f1a-d36f736cce4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c7f8e2-b6a6-4839-b0b7-11503c93cfac", "name": "network-vif-deleted", "tag": "c004f5b4-d7a8-470c-97d7-2cd982176015"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:06.839672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d0e2f0ed-a155-4fc4-a01a-d69801e69f37 req-4fa0013c-e7c7-4376-8f1a-d36f736cce4c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.842558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d0e2f0ed-a155-4fc4-a01a-d69801e69f37 req-4fa0013c-e7c7-4376-8f1a-d36f736cce4c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.882904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d0e2f0ed-a155-4fc4-a01a-d69801e69f37 req-4fa0013c-e7c7-4376-8f1a-d36f736cce4c service nova] Creating event network-vif-deleted:c004f5b4-d7a8-470c-97d7-2cd982176015 for instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac on n-h1-764486-11 Jul 20 04:38:06.896687 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d0e2f0ed-a155-4fc4-a01a-d69801e69f37 req-4fa0013c-e7c7-4376-8f1a-d36f736cce4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106580 Jul 20 04:38:06.898091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2857/3982] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:06.913202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:06.916681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:06.938226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.939152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:06.941011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:06.941659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.012126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9e6d88b-0efd-409c-b701-57e41454cab7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109762 Jul 20 04:38:07.020525 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2858/3983] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:06 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:07.036665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.038181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.050501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.051415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.053155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.054436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.167623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.168162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.169822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lazy-loading 'fault' on Instance uuid 60c7f8e2-b6a6-4839-b0b7-11503c93cfac {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:07.258998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7afaf4026ba4f35b9c6d8b20bf91bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb424a86017a4c418751e2d7ee007847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:07.271380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08600a9d-5cf5-48ce-9687-444390267361 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 200 len: 1310 microversion: 2.1 time: 0.248026 Jul 20 04:38:07.271916 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2859/3984] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 1310 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:07.271916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:07.283055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:07.300873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.301403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:07.302225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:07.302669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.216965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:08.227212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e21f805-e1e7-4349-bf85-0768bb57dcc8 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1318 microversion: 2.1 time: 0.953273 Jul 20 04:38:08.228649 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2860/3985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:07 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1318 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:08.237498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.247700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] [instance: bdc5d91c-0674-4383-b623-4623346c02ef] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.272675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.275169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.278609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.281926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.328670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] HTTP exception thrown: Instance bdc5d91c-0674-4383-b623-4623346c02ef could not be found. Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Request method failure captured: Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef HTTP/1.1 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ZKPXrJL9QVa0eSmIL-k4YjJSGaFnZCOAcdC64_3CXHfztR64RA6C9rJsazkbR0MRjyNvMEcvU8kQqBxiwL-a4LOJNXgqqIk_Jl_gPzEA0IhnqhyLI_WhKu0wYC2MAQqUcG2o_JhjLOa8UgMYTa1RFgbiEJD2TOn-QUqCGJ_7owtQY Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 607843d657d5443d8f30ea9f1679d4ce Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1001522736 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/607843d657d5443d8f30ea9f1679d4ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/607843d657d5443d8f30ea9f1679d4ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/607843d657d5443d8f30ea9f1679d4ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_607843d657d5443d8f30ea9f1679d4ce", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1001522736 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 607843d657d5443d8f30ea9f1679d4ce Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1001522736 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueTestJSONUnderV235-1001522736-project Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bb17b40494cc4ad4a7a5f131c7b54ea3 Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1001522736-project Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance bdc5d91c-0674-4383-b623-4623346c02ef could not be found. Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'bdc5d91c-0674-4383-b623-4623346c02ef'} Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc5d91c-0674-4383-b623-4623346c02ef could not be found. Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc5d91c-0674-4383-b623-4623346c02ef could not be found. Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.331318 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc5d91c-0674-4383-b623-4623346c02ef could not be found. Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] Returning 404 to user: Instance bdc5d91c-0674-4383-b623-4623346c02ef could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:08.337442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a41e043-77d8-4186-ae0a-fcf721516fa5 tempest-ServerRescueTestJSONUnderV235-1001522736 tempest-ServerRescueTestJSONUnderV235-1001522736-project] 10.222.0.49 "GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef" status: 404 len: 111 microversion: 2.1 time: 0.103794 Jul 20 04:38:08.350813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2861/3986] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/bdc5d91c-0674-4383-b623-4623346c02ef => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:08.371509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.377716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.401324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.401789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.404933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.413062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.498948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6977461-de17-4a3d-bd92-a86f009df8fc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146464 Jul 20 04:38:08.505267 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2862/3987] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:08.513363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:08.514141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] [instance: 60c7f8e2-b6a6-4839-b0b7-11503c93cfac] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:08.528340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.528826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.529629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:08.530076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:08.569042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] HTTP exception thrown: Instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac could not be found. Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Request method failure captured: Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac HTTP/1.1 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Yom94KvrkiEBEaeBnoPpFKdH6v6eGxsNHkp1oudhfwBNWd2c6N5pjyW4RY-mkmC_xvlRbR3yPw63kaxeuq8O91s8GnlcA-52cXB0_yVEnisZV4AwB9oWmXxhcvAvlldOBdqef6_uNHthPiGPIlBSBLUd_Q2tppgHaWEShcrClVBoU Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cb424a86017a4c418751e2d7ee007847 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cb424a86017a4c418751e2d7ee007847"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cb424a86017a4c418751e2d7ee007847", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cb424a86017a4c418751e2d7ee007847 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1921956207 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ListServerFiltersTestJSON-1921956207-project Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d7afaf4026ba4f35b9c6d8b20bf91bb1 Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ListServerFiltersTestJSON-1921956207-project Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac could not be found. Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '60c7f8e2-b6a6-4839-b0b7-11503c93cfac'} Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac could not be found. Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac could not be found. Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:08.583122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac could not be found. Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] Returning 404 to user: Instance 60c7f8e2-b6a6-4839-b0b7-11503c93cfac could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:08.588267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f19278d8-8e3e-425f-bc7d-df3839b735d0 tempest-ListServerFiltersTestJSON-1921956207 tempest-ListServerFiltersTestJSON-1921956207-project] 10.222.0.49 "GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac" status: 404 len: 111 microversion: 2.1 time: 0.078514 Jul 20 04:38:08.591443 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2863/3988] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:08 2022] GET /compute/v2.1/servers/60c7f8e2-b6a6-4839-b0b7-11503c93cfac => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:38:09.248762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:09.250803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:09.295343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.297892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:09.302101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:09.303239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.020490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:10.042846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d89f6fd-b193-493f-90c5-1bdc60a5e00c tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1318 microversion: 2.1 time: 0.800518 Jul 20 04:38:10.060707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2864/3989] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:09 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:10.070551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:10.071523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:10.091629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.092100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.092984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:10.093436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:10.213578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-813219f9-52d8-4877-8c1f-8df5b7e2da98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151348 Jul 20 04:38:10.226490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2865/3990] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:10 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:38:11.062636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:11.067678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:11.068576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:11.084507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.085176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.086154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:11.087075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:11.539574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:12.084057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:12.102914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c04d1bf-d512-47a7-b723-97ad96d358d9 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1318 microversion: 2.1 time: 1.038664 Jul 20 04:38:12.115633 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2866/3991] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:11 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:12.132567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.134432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.149946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.150661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.152299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.152970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.250773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f6b4036-7c7a-4786-9b3e-23e0b8003469 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.132952 Jul 20 04:38:12.252223 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2867/3992] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:38:12 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:12.283838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5cb136a1-3cea-420e-88d4-1af558c7523c req-5a67f527-d810-43d5-865c-db663b3a0ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1abeb4b9-6957-48ea-87f9-ef46fc67c93d", "tag": "9bbd9324-ebac-4358-be55-41a1e3b88e9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:12.314874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5cb136a1-3cea-420e-88d4-1af558c7523c req-5a67f527-d810-43d5-865c-db663b3a0ce3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.319581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5cb136a1-3cea-420e-88d4-1af558c7523c req-5a67f527-d810-43d5-865c-db663b3a0ce3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.367049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5cb136a1-3cea-420e-88d4-1af558c7523c req-5a67f527-d810-43d5-865c-db663b3a0ce3 service nova] Creating event network-changed:9bbd9324-ebac-4358-be55-41a1e3b88e9c for instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d on n-h1-764486-11 Jul 20 04:38:12.379934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5cb136a1-3cea-420e-88d4-1af558c7523c req-5a67f527-d810-43d5-865c-db663b3a0ce3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110221 Jul 20 04:38:12.383528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2868/3993] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:12.394304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.399047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.410780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.411615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.415085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.415991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.502115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:38:12.619400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:12.761665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2bb59810-d4a8-47e6-8825-b06bb8f88395 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 204 len: 0 microversion: 2.20 time: 0.374990 Jul 20 04:38:12.771718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2869/3994] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:38:12 2022] DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:38:12.802636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:12.803356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:12.827400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.834466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:12.835337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:12.835904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.557961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.567953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.569644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:13.570707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80216dae-7075-4a75-8470-97a146bfed9b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.794918 Jul 20 04:38:13.592778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2870/3995] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:12 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:13.604183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:13.605052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:13.628421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.629426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:13.630446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:13.631063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.598629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:14.613176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e15c99a1-e03d-41da-9b96-f9612a05bdfb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1318 microversion: 2.1 time: 1.019007 Jul 20 04:38:14.617914 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2871/3996] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:13 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:14.641041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:14.642533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:14.668685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.669078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:14.669872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:14.677546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.471071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.482294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.513090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:15.517983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9eebf589-b14c-47b2-adba-3b2ed5424bd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.898477 Jul 20 04:38:15.521923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2872/3997] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:14 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:15.637389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:15.638760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:15.660030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.660609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:15.661467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:15.670531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.613760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:16.630696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-735c0a9e-b846-468d-a0ce-af9cbfb68b2d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1318 microversion: 2.1 time: 0.997615 Jul 20 04:38:16.635773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2873/3998] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:15 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1318 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:16.650117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:16.653685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:16.690078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.696110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:16.704998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:16.710072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.231157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.246541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.252208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:17.255389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f4a1789-a367-401f-80ba-66f17ab67ef1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1724 microversion: 2.20 time: 0.617947 Jul 20 04:38:17.257602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2874/3999] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:16 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1724 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:17.268413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bf797091-a506-4066-8c93-c65d47f754bf req-f6d7eaee-79e9-4926-8b6f-9858798d07fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abeb4b9-6957-48ea-87f9-ef46fc67c93d", "name": "network-vif-plugged", "status": "completed", "tag": "9bbd9324-ebac-4358-be55-41a1e3b88e9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:17.295192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf797091-a506-4066-8c93-c65d47f754bf req-f6d7eaee-79e9-4926-8b6f-9858798d07fa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.296194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf797091-a506-4066-8c93-c65d47f754bf req-f6d7eaee-79e9-4926-8b6f-9858798d07fa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.321759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bf797091-a506-4066-8c93-c65d47f754bf req-f6d7eaee-79e9-4926-8b6f-9858798d07fa service nova] Creating event network-vif-plugged:9bbd9324-ebac-4358-be55-41a1e3b88e9c for instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d on n-h1-764486-11 Jul 20 04:38:17.334864 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bf797091-a506-4066-8c93-c65d47f754bf req-f6d7eaee-79e9-4926-8b6f-9858798d07fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074424 Jul 20 04:38:17.336676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2875/4000] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:17.663962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:17.664762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:17.689076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.691497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:17.694393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:17.696905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.193708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.206818 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32094826-498f-4172-bfca-b24777c5af41 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1318 microversion: 2.1 time: 0.547909 Jul 20 04:38:18.216343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2876/4001] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:17 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:18.293040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.294224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.326309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.339341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.340280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.340759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.533453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.557591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.560887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:18.580502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-296c4663-40dc-48e8-a973-24708ac778f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1656 microversion: 2.20 time: 0.294265 Jul 20 04:38:18.580987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2877/4002] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1656 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:18.832122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:18.832795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:18.859559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.860306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:18.861935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:18.862654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.551875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:19.569986 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd2d15f5-f3cb-4c78-a443-68f294e807f2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.742865 Jul 20 04:38:19.573201 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2878/4003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:18 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:19.609273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:19.611584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:19.635478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.638926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:19.644790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:19.646897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.119377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.128936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50ba49d9-2d41-4f87-bfbd-fdf6e28cbd70 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1507 microversion: 2.1 time: 0.553564 Jul 20 04:38:20.160319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2879/4004] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:19 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1507 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:20.168650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.171131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.190317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.191220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.192438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.193419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.523083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.539226 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5502803c-1fa4-471e-a717-a4246a1bbefb tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.377536 Jul 20 04:38:20.540409 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2880/4005] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:20.557829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:20.558976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:20.591025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.592027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.593081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.595477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.679833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.680593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:20.681213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lazy-loading 'fault' on Instance uuid 784190f6-370f-4649-9bee-c669f705e6fc {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:38:20.883879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.924619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.937947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:20.940239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee00c4f9-d663-4038-a944-b5a8b7e3629c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 200 len: 1371 microversion: 2.20 time: 0.398414 Jul 20 04:38:20.941352 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2881/4006] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:20 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 1371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:20.973226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7abb51e9-3873-44a1-ba45-fb58c4e65129 req-e3c61976-3569-4f28-96d8-29a98787e826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784190f6-370f-4649-9bee-c669f705e6fc", "name": "network-vif-deleted", "tag": "3c334ded-4fc9-4945-8eb1-ce31da02b823"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:20.985407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7abb51e9-3873-44a1-ba45-fb58c4e65129 req-e3c61976-3569-4f28-96d8-29a98787e826 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:20.986385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7abb51e9-3873-44a1-ba45-fb58c4e65129 req-e3c61976-3569-4f28-96d8-29a98787e826 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.002785 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7abb51e9-3873-44a1-ba45-fb58c4e65129 req-e3c61976-3569-4f28-96d8-29a98787e826 service nova] Creating event network-vif-deleted:3c334ded-4fc9-4945-8eb1-ce31da02b823 for instance 784190f6-370f-4649-9bee-c669f705e6fc on n-h2-764486-11 Jul 20 04:38:21.011224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7abb51e9-3873-44a1-ba45-fb58c4e65129 req-e3c61976-3569-4f28-96d8-29a98787e826 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048230 Jul 20 04:38:21.012322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2882/4007] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:21.021017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:21.021735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:21.036123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.037084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:21.048692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:21.049472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.421423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:22.452462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6df9312f-79ca-4533-b287-8f38e54eeb30 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 1.436273 Jul 20 04:38:22.467211 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2883/4008] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:21 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:22.497261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.498885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.528750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.531214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.532084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.532574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.574530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] HTTP exception thrown: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Request method failure captured: Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc HTTP/1.1 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Wj7i-SInEGEtuvkhxCNJQ0RaM0VZS97rGCf7SkYPSo0wTYVi0Mp0w-z99OP57ciGn9ANOYvqTDNGDRm4s0pFSXnBQ0Va4C9FkuRek2C05pIQiFx_qChsOWjUxlYfjrfVITIWtt2jjujFHG94CJ63Ssd1UHYJim03KDb6VRghLeKjw Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c40fb3817b94adb97d02e5a2bd1f206", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b270c9997f31458ca90746e7dd495e78 Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '784190f6-370f-4649-9bee-c669f705e6fc'} Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.576239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Returning 404 to user: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:38:22.589157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-060f216c-d1e6-4a8a-831e-e4f33509eb3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 404 len: 111 microversion: 2.20 time: 0.115529 Jul 20 04:38:22.594918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2884/4009] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:38:22.609273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:22.609882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:22.624227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.625040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:22.626417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:22.632187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:23.689362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:23.736463 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d373637-4a99-4f69-8b74-82d79197d436 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 1.140906 Jul 20 04:38:23.741795 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2885/4010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:22 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:23.767893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a48c8ea-f3fc-472e-abb3-51c183c80c93 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '.version_select at 0x7f838bab6a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:23.840799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a48c8ea-f3fc-472e-abb3-51c183c80c93 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404177568" status: 204 len: 0 microversion: 2.20 time: 0.096712 Jul 20 04:38:23.844154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2886/4011] 10.222.0.49 () {60 vars in 1258 bytes} [Wed Jul 20 04:38:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404177568 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:38:24.083645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1056664922", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "99a89468-e93b-45f5-b6e7-131721ce1601"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:24.118446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:33.380287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] validate_networks() for [('99a89468-e93b-45f5-b6e7-131721ce1601', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:33.708092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:34.159453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:34.243668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:34.244280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:34.245372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:34.246845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:34.249587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:34.270783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.271948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.273666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:34.274660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:34.313481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:34.328923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for user 4d4ae756d3714b598164985ed7d7876c and project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:34.358403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:34.364009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:34.499168 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3ab8487-9ad8-495f-89a6-1b7d0c23cbdd tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.422835 Jul 20 04:38:34.500170 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2887/4012] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 10424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:35.558954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1112589159", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": "none"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:35.776731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:35.778033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:35.779103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:35.780034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:35.781425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:35.815726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.821199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.830159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:35.835607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:35.913049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Getting quotas for project 754e35f7ade945a5b62da644311b4324. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:35.934618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Getting quotas for user 24ecd15d61504c1a8a54b0bb46dc40d2 and project 754e35f7ade945a5b62da644311b4324. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:36.026930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:36.034934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:36.233593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebf24453-6256-4233-805a-fe155a808608 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.732441 Jul 20 04:38:36.240520 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2888/4013] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:38:36.250642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16a78e34-0f7f-408f-a088-04f489bfafc6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'create', calling method: .version_select at 0x7f838b0de3a0>, body: {"keypair": {"name": "tempest-keypair-1967071582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9r/VxLRz3MAR03ADaKMLfX/SVk4EGM/gt1NW5xNnxGgVBOk40Y3AQu+IVRzTb57aohs81lF24WMDWqmOtM7kFDm/uNiQRI2mjUU/+eHpPplNdK5PVH2cTVoWSv9zzhIQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:36.327109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-16a78e34-0f7f-408f-a088-04f489bfafc6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:36.354512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-16a78e34-0f7f-408f-a088-04f489bfafc6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for user b270c9997f31458ca90746e7dd495e78 and project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:36.507553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16a78e34-0f7f-408f-a088-04f489bfafc6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.263255 Jul 20 04:38:36.522237 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2889/4014] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:38:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:38:37.277826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-702146230", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:37.442929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:39.159889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:39.161047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:39.162475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:39.163076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:39.164250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:39.175463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.176331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.177275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.178235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.214229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:39.222895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:39.247144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:39.253337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:39.335759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e31ec6c5-e09e-43cb-ad7d-269ed35dce5e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.809928 Jul 20 04:38:39.336725 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2890/4015] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:38:39.342173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:39.345134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:39.358332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.359499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.360598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.361269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.702315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:39.715172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afb37e52-0706-495e-bcb6-d5c29af7509b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1273 microversion: 2.1 time: 0.376074 Jul 20 04:38:39.717777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2891/4016] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:39 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:39.756870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:39.767309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:39.794206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.797175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:39.802567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:39.807851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.066044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.085878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.089361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.090989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af34d4e5-6458-4947-8dc1-2554008a6121 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1336 microversion: 2.54 time: 0.371062 Jul 20 04:38:40.093982 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2892/4017] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:39 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1336 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:40.117027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53015777-03f0-4663-8e3a-eb3790765e3c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:40.118271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53015777-03f0-4663-8e3a-eb3790765e3c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:40.412277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53015777-03f0-4663-8e3a-eb3790765e3c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:40.452606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53015777-03f0-4663-8e3a-eb3790765e3c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1192 microversion: 2.1 time: 0.348073 Jul 20 04:38:40.454256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2893/4018] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:40 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1192 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:40.754055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:40.754522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:40.793946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.799687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:40.809382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:40.811302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.915147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:41.928078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba65dca0-f34b-46c9-8830-2b494f5a9f8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1315 microversion: 2.1 time: 1.182933 Jul 20 04:38:41.941156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2894/4019] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:40 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1315 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:41.948195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:41.949216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:41.968393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.969677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:41.977319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:41.980463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.382566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.399441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.404943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.407705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d56346ea-8635-4f4f-a98d-7725e644ddef tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1357 microversion: 2.54 time: 0.464463 Jul 20 04:38:42.410108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2895/4020] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:41 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1357 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:42.459757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:42.462001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:42.485142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.487679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.489070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:42.511100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:42.699485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:42.737641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-24257795-a0f7-4787-8031-93b96e626f34 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1250 microversion: 2.1 time: 0.325606 Jul 20 04:38:42.739599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2896/4021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:42 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1250 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:42.880067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1863795134", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a42d377c-cf53-473d-9e23-9ada58f0afec"}], "security_groups": [{"name": "tempest-securitygroup--1945077928"}], "key_name": "tempest-keypair-1967071582", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:43.248166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] validate_networks() for [('a42d377c-cf53-473d-9e23-9ada58f0afec', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:38:44.500774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:44.512549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:44.514568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:44.515459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:44.516104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:44.548030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.548998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.550956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:44.554077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:44.650130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:44.717124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Getting quotas for user b270c9997f31458ca90746e7dd495e78 and project 7c40fb3817b94adb97d02e5a2bd1f206. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:44.806640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:38:44.823968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:38:45.021557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3d2e582-6fc9-4cbd-a37c-e3382fefc0d1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.280175 Jul 20 04:38:45.023356 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2897/4022] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jul 20 04:38:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:38:45.041706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86b522bd-d001-4fc3-9382-b7f8f4d68cb9 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Action: 'create', calling method: .version_select at 0x7f838a98d670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1380192571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuLDpb/Tgl8BeA4w4ik/GLIV3D6ixmBzNXKYgxWnNUNlsMGe6S/2O+QytCGQphKwJHMd9frAsIvZ8QYlQEyo1kpMRz+yfQEZlPMf5iT//A2F6dgpDxGSPiKlTe8YitVlA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:45.101753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-86b522bd-d001-4fc3-9382-b7f8f4d68cb9 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Getting quotas for project 754e35f7ade945a5b62da644311b4324. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:38:45.113559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-86b522bd-d001-4fc3-9382-b7f8f4d68cb9 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Getting quotas for user 24ecd15d61504c1a8a54b0bb46dc40d2 and project 754e35f7ade945a5b62da644311b4324. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:38:45.136572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:45.167578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86b522bd-d001-4fc3-9382-b7f8f4d68cb9 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.142789 Jul 20 04:38:45.170297 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2898/4023] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:38:45 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:38:45.182602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:45.184400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:45.200005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.201643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.204130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.205116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.813093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:45.829918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40f79313-dff9-48c4-a60f-c9b0e30b025c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1315 microversion: 2.1 time: 0.657880 Jul 20 04:38:45.830526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2899/4024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:45 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:45.848672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:45.849235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:45.859892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.860742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:45.862373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:45.863647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.161636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.172279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0c121d0-fa01-43a4-9404-c43c08794546 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.328964 Jul 20 04:38:46.176129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2900/4025] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:45 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:46.208748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fb298770-9ff2-4b81-a6b8-6bcaac18ba46 req-2d7c6599-fb9c-4949-900f-1aa5fb6a0528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29727f32-3dfd-4243-a196-c09cfa2bb9b8", "tag": "5fc18a82-55dc-44bb-9bf5-96bad73b68a7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:46.226461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fb298770-9ff2-4b81-a6b8-6bcaac18ba46 req-2d7c6599-fb9c-4949-900f-1aa5fb6a0528 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.228925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fb298770-9ff2-4b81-a6b8-6bcaac18ba46 req-2d7c6599-fb9c-4949-900f-1aa5fb6a0528 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.262495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fb298770-9ff2-4b81-a6b8-6bcaac18ba46 req-2d7c6599-fb9c-4949-900f-1aa5fb6a0528 service nova] Creating event network-changed:5fc18a82-55dc-44bb-9bf5-96bad73b68a7 for instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 on n-h2-764486-11 Jul 20 04:38:46.282107 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fb298770-9ff2-4b81-a6b8-6bcaac18ba46 req-2d7c6599-fb9c-4949-900f-1aa5fb6a0528 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100902 Jul 20 04:38:46.284570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2901/4026] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:46.296180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:46.307556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:46.337460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.337917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.338750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.339190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.513598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.565312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.577907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:46.586758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-402bf140-d85c-4e1f-b9cc-0d6c1da197c7 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1286 microversion: 2.20 time: 0.298778 Jul 20 04:38:46.598925 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2902/4027] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:46 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1286 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:46.605754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1380192571", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:46.610309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:46.620678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.621938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.624334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:46.625103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:46.790082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:38:46.790523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:38:46.793996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:38:46.796164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:38:46.798418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:38:47.054273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:47.069750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.070669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.071760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.071760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.129668 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be727d3b-aa30-4671-993d-12060f5a1d26 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "POST /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208/action" status: 202 len: 1140 microversion: 2.54 time: 0.529190 Jul 20 04:38:47.142115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2903/4028] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Jul 20 04:38:46 2022] POST /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208/action => generated 1140 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 04:38:47.148262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-413e1507-0697-4799-8eee-e5a6324ae245 req-b2cc6ad5-eaa2-413e-83e5-6a72a6d84f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74ed104c-b7f1-4a15-83e7-2ed46958128b", "tag": "ec813c24-40cd-4f4d-b4cb-ca2bd40f4b85"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:47.158265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-413e1507-0697-4799-8eee-e5a6324ae245 req-b2cc6ad5-eaa2-413e-83e5-6a72a6d84f69 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.158612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-413e1507-0697-4799-8eee-e5a6324ae245 req-b2cc6ad5-eaa2-413e-83e5-6a72a6d84f69 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.172433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-413e1507-0697-4799-8eee-e5a6324ae245 req-b2cc6ad5-eaa2-413e-83e5-6a72a6d84f69 service nova] Creating event network-changed:ec813c24-40cd-4f4d-b4cb-ca2bd40f4b85 for instance 74ed104c-b7f1-4a15-83e7-2ed46958128b on n-h2-764486-11 Jul 20 04:38:47.180247 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-413e1507-0697-4799-8eee-e5a6324ae245 req-b2cc6ad5-eaa2-413e-83e5-6a72a6d84f69 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Jul 20 04:38:47.182408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2904/4029] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:47.189030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:47.189949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:47.212157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.212983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:47.213911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:47.214275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.011135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.023911 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9bf82966-a74d-4f2f-ad9b-ca3287c3de2d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1315 microversion: 2.1 time: 0.839076 Jul 20 04:38:48.024779 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2905/4030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:47 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:48.041971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:48.042879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:48.061702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.063869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.066880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.068381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.175328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.206400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.211653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.213686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5aa7acd6-dde0-43b1-a330-18c165bb2536 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.179775 Jul 20 04:38:48.215148 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2906/4031] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:48 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:48.236921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:48.238772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:48.254332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.255046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.256615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.257351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.686805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.699573 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d335f57-f187-40e0-a416-c460566b5f61 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.482738 Jul 20 04:38:48.700386 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2907/4032] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:48 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:48.725782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:48.727779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:48.741948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.743581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.745975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:48.747667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:48.758350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:48.884488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.900119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.903799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:48.905669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b89a0858-f5af-41f9-b5fd-4265c27eae3a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1340 microversion: 2.20 time: 0.193094 Jul 20 04:38:48.907150 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2908/4033] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:48 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:49.041863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.042476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.050215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.050753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.051909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.052437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.388888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.398899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1331745f-5040-4f16-a574-89aa7700c3c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1315 microversion: 2.1 time: 0.361137 Jul 20 04:38:49.399685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2909/4034] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:49.405967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.406911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.415783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.416607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.417607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.418229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.573134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.589312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.596708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.609806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4504bd1-37b2-4fcd-8f74-e395b29ca890 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.208523 Jul 20 04:38:49.613328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2910/4035] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:49.723440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.726419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:49.743128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.745453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.746716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:49.747470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:49.965434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:49.978815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eeb45a24-23c7-4ee7-a5f2-1a29b12a74f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.259501 Jul 20 04:38:49.990217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2911/4036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:49.997748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:49.998494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:50.006198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.006778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.007817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.008410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.104455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.114805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.116535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.117755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c203435-884f-4ed5-b239-9559e75f074a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1340 microversion: 2.20 time: 0.126079 Jul 20 04:38:50.128388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2912/4037] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:49 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1340 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:50.432041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:50.435751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:50.455649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.457376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.459665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.461815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.706787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.716492 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4f605e3-9286-4648-b2c5-c195db1ea447 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1315 microversion: 2.1 time: 0.300530 Jul 20 04:38:50.717406 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2913/4038] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:50 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:50.722610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:50.723350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:50.731246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.732702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.733798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:50.734313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:50.846720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.873503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.879697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:50.882943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4f5e060-623b-4991-bbae-15764f745f64 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.162415 Jul 20 04:38:50.884550 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2914/4039] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:50 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:51.003861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:51.004525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:51.011575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.012031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.013338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.013872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.311391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:51.328944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26bd258d-10d3-45f6-bf26-4c680e923ab9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.335056 Jul 20 04:38:51.330171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2915/4040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:50 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:51.339662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:51.341726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:51.352737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.353435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.354577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.355186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.604338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:51.618263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:51.621909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:51.626122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac944c27-ee45-4639-ada0-954ebace822e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1408 microversion: 2.20 time: 0.294605 Jul 20 04:38:51.639261 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2916/4041] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:51 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:51.652024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c87ce919-af81-439f-a63d-ba704b42e611 req-511db213-2205-403c-b541-47b2f468d59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29727f32-3dfd-4243-a196-c09cfa2bb9b8", "name": "network-vif-plugged", "status": "completed", "tag": "5fc18a82-55dc-44bb-9bf5-96bad73b68a7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:51.677027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c87ce919-af81-439f-a63d-ba704b42e611 req-511db213-2205-403c-b541-47b2f468d59f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.677744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c87ce919-af81-439f-a63d-ba704b42e611 req-511db213-2205-403c-b541-47b2f468d59f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.706328 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c87ce919-af81-439f-a63d-ba704b42e611 req-511db213-2205-403c-b541-47b2f468d59f service nova] Creating event network-vif-plugged:5fc18a82-55dc-44bb-9bf5-96bad73b68a7 for instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 on n-h2-764486-11 Jul 20 04:38:51.722335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c87ce919-af81-439f-a63d-ba704b42e611 req-511db213-2205-403c-b541-47b2f468d59f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081300 Jul 20 04:38:51.724292 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2917/4042] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:51.747376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:51.748921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:51.767032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.767665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:51.768713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:51.769311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.399208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:52.417110 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe1f7eaa-0769-4c95-bee7-46de8c4c69c4 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1315 microversion: 2.1 time: 0.670797 Jul 20 04:38:52.419016 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2918/4043] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:51 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:38:52.438429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:52.439561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:52.461766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.462266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:52.463530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:52.464069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.004269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.029798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.046304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.056649 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8fb839c0-701b-420f-b254-6199dd3fc85f tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.635419 Jul 20 04:38:53.064849 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2919/4044] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:52 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:53.085012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:53.087570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:53.120712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.121513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.123446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.124224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.763865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:53.787776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54f0357e-3408-4135-aacb-81ec70be0b8c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.721281 Jul 20 04:38:53.789491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2920/4045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:53 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:53.803580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:53.813603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:53.828739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.832492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:53.833531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:53.837252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.229709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.264388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.271387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.273566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61e7df5a-98fc-485a-9d22-3777fb133144 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1408 microversion: 2.20 time: 0.482104 Jul 20 04:38:54.274848 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2921/4046] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:53 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:54.282713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9fea0dc3-5286-4555-a3af-a2ae53c8edae req-3e6f170f-203a-4786-b11a-23c7d9f41d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:54.297692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9fea0dc3-5286-4555-a3af-a2ae53c8edae req-3e6f170f-203a-4786-b11a-23c7d9f41d84 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.299512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9fea0dc3-5286-4555-a3af-a2ae53c8edae req-3e6f170f-203a-4786-b11a-23c7d9f41d84 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.329788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9fea0dc3-5286-4555-a3af-a2ae53c8edae req-3e6f170f-203a-4786-b11a-23c7d9f41d84 service nova] Creating event network-changed:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h1-764486-11 Jul 20 04:38:54.336309 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9fea0dc3-5286-4555-a3af-a2ae53c8edae req-3e6f170f-203a-4786-b11a-23c7d9f41d84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059731 Jul 20 04:38:54.337413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2922/4047] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:54.345696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:54.346712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:54.357356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.357808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.358594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.359105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.570305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.579895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-45d58fab-96ee-45c1-b98c-ed21d0f9b257 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1502 microversion: 2.1 time: 0.241125 Jul 20 04:38:54.580793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2923/4048] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:54 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:54.593290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:54.594488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:54.601508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:54.605254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.606042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.607448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.608239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.711876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.721234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.723562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:54.725426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0cba1a08-4458-4fc4-85c1-1af79a3b983a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.139934 Jul 20 04:38:54.738872 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2924/4049] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:54 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:54.745072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:54.745950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:54.760202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.761470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:54.762830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:54.763807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:55.004972 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Removing security group 49d33e7c-1f74-49ff-a1ee-c88c41204ec7 from port 5fc18a82-55dc-44bb-9bf5-96bad73b68a7 Jul 20 04:38:55.126539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=34 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:55.956145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e910957-420d-40cc-9e80-265a36b45d81 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8/action" status: 202 len: 0 microversion: 2.1 time: 1.214480 Jul 20 04:38:55.963276 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2925/4050] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:38:54 2022] POST /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8/action => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:38:55.979743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:55.984331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:56.021366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:56.022146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:56.025945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:56.030240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:56.144305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:38:56.421905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:56.430905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82878bcf-a4f2-4c9d-9b8b-d4d3be8777ad tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.465899 Jul 20 04:38:56.431813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2926/4051] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:55 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:56.452845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:56.453549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:56.472342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:56.472342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:56.473079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:56.473514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.186178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.215849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.219728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.235971 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ee8970f-24f7-4897-a1cb-9b488c79f72d tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1408 microversion: 2.20 time: 0.794215 Jul 20 04:38:57.237693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2927/4052] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:56 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1408 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:57.246821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f9b3ea68-ac91-4de4-b826-76a1c4812168 req-7ba390b6-a5f6-478c-b8f0-769b3e0300ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ed104c-b7f1-4a15-83e7-2ed46958128b", "name": "network-vif-plugged", "status": "completed", "tag": "ec813c24-40cd-4f4d-b4cb-ca2bd40f4b85"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:57.265455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f9b3ea68-ac91-4de4-b826-76a1c4812168 req-7ba390b6-a5f6-478c-b8f0-769b3e0300ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.265904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f9b3ea68-ac91-4de4-b826-76a1c4812168 req-7ba390b6-a5f6-478c-b8f0-769b3e0300ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.283677 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f9b3ea68-ac91-4de4-b826-76a1c4812168 req-7ba390b6-a5f6-478c-b8f0-769b3e0300ce service nova] Creating event network-vif-plugged:ec813c24-40cd-4f4d-b4cb-ca2bd40f4b85 for instance 74ed104c-b7f1-4a15-83e7-2ed46958128b on n-h2-764486-11 Jul 20 04:38:57.289578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f9b3ea68-ac91-4de4-b826-76a1c4812168 req-7ba390b6-a5f6-478c-b8f0-769b3e0300ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049538 Jul 20 04:38:57.290745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2928/4053] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:57.297352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.298368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.323447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.324689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.326416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.327429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.494908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.514870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.520899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.528243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5834865c-773b-450c-b87e-31305db31a24 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.234363 Jul 20 04:38:57.533012 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2929/4054] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:38:57.553126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.553850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.572999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.573460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.574417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.574906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.799206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:57.814918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87ebbcbc-1206-44a8-b267-01170d2e4fb3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1460 microversion: 2.1 time: 0.278134 Jul 20 04:38:57.816731 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2930/4055] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1460 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:57.824188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9784269a-e2ec-420c-baf3-a0438821a494 req-344e06a1-425a-4ade-b6a8-64669a872eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29727f32-3dfd-4243-a196-c09cfa2bb9b8", "tag": "5fc18a82-55dc-44bb-9bf5-96bad73b68a7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:38:57.837926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9784269a-e2ec-420c-baf3-a0438821a494 req-344e06a1-425a-4ade-b6a8-64669a872eac service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.839000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9784269a-e2ec-420c-baf3-a0438821a494 req-344e06a1-425a-4ade-b6a8-64669a872eac service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.864635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9784269a-e2ec-420c-baf3-a0438821a494 req-344e06a1-425a-4ade-b6a8-64669a872eac service nova] Creating event network-changed:5fc18a82-55dc-44bb-9bf5-96bad73b68a7 for instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 on n-h2-764486-11 Jul 20 04:38:57.875373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9784269a-e2ec-420c-baf3-a0438821a494 req-344e06a1-425a-4ade-b6a8-64669a872eac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056192 Jul 20 04:38:57.876746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2931/4056] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:38:57.888469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:57.889983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:57.906431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.906888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:57.907780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:57.908139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.345468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:58.357271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-117adaeb-fd02-4fff-a9fc-ba2cbe7dcf4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1292 microversion: 2.1 time: 0.477465 Jul 20 04:38:58.358200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2932/4057] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:57 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1292 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:58.365767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:58.366446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:58.373939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.374395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:58.375761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:58.375761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.282257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:38:59.303460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65f12939-e8c0-47bf-9916-31d8ee7f665a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.942449 Jul 20 04:38:59.304457 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2933/4058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:38:58 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:38:59.337330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:38:59.339129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:38:59.352589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.353630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:38:59.355103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:38:59.355103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.079837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.097387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.100502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.103145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14f3087c-78ff-4cfe-85f7-247bbc139c1a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1408 microversion: 2.20 time: 0.783765 Jul 20 04:39:00.104196 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2934/4059] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:38:59 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1408 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:00.114020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.115467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.126600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.127407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.128810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.130488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.273782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.289527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.291729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:00.294332 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee136ef6-11ed-4583-b03e-919ac36edc21 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.187732 Jul 20 04:39:00.295130 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2935/4060] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:00.301310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:00.302242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:00.313672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.314497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:00.315915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:00.317305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.059265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:01.083712 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35b0915c-43ea-44c9-8b58-9cc820d33c8e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.786760 Jul 20 04:39:01.098210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2936/4061] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:00 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:01.118126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-76b78f7f-8779-4198-97e8-8b77f16c272c req-97cfb968-4e84-473e-b2c0-e2b846f34b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "name": "network-vif-plugged", "status": "completed", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:01.142968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76b78f7f-8779-4198-97e8-8b77f16c272c req-97cfb968-4e84-473e-b2c0-e2b846f34b0f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.143760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76b78f7f-8779-4198-97e8-8b77f16c272c req-97cfb968-4e84-473e-b2c0-e2b846f34b0f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.193453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-76b78f7f-8779-4198-97e8-8b77f16c272c req-97cfb968-4e84-473e-b2c0-e2b846f34b0f service nova] Creating event network-vif-plugged:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h1-764486-11 Jul 20 04:39:01.211619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-76b78f7f-8779-4198-97e8-8b77f16c272c req-97cfb968-4e84-473e-b2c0-e2b846f34b0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109467 Jul 20 04:39:01.212698 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2937/4062] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:01.241165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:01.243306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.262755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.263823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.266197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.267740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.630184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:01.644039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6511cf97-0d4c-4a80-8a9a-46a43b50c8d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1473 microversion: 2.1 time: 0.429502 Jul 20 04:39:01.645009 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2938/4063] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:01 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:01.650165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:01.650948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:01.659466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.660143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:01.661119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:01.661850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.148209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.164397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e1bea94-33cb-4aac-a242-aeb2717c705d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.515414 Jul 20 04:39:02.166048 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2939/4064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:01 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:02.173792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:02.175446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.182337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.183816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.185994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.186972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.577543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.603351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.623971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.631713 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f98fb13-1c56-4b8b-bfe1-8f7e72f19610 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1408 microversion: 2.20 time: 0.460654 Jul 20 04:39:02.634596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2940/4065] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:02 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:02.650834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:02.652162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:02.662147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.662939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.664033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:02.664804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:02.861772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.882784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.884752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:02.886081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1a7a12b-4d14-4a32-b127-8455ef5cb3d8 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1409 microversion: 2.54 time: 0.250091 Jul 20 04:39:02.886840 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2941/4066] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:02 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1409 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:02.892597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-844251447", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:03.030032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:03.847631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:03.849297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:03.850312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:03.851213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:03.852189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:03.877481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.885115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.888334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:03.889261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:03.938577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:03.955161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:03.983222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:04.024844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:04.031094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:04.170852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9b2d4e8-e425-4aa4-81a1-61916d11edf5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273180 Jul 20 04:39:04.179925 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2942/4067] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:04.192723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:04.193737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.205815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.206536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.207679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.208312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.568884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:04.608664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-333621e1-7d8a-4006-a664-b52184a30812 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.425880 Jul 20 04:39:04.610486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2943/4068] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:04 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:04.626574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5584f01a-2e10-4fa4-89b7-93698e63bfec", "device": "/dev/sdb"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:04.630288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:04.651301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.653207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:04.654817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:04.655894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.477110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:05.502063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56afa1cb-dedd-4069-97e2-4761c6c8ff4e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "POST /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889126 Jul 20 04:39:05.509810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2944/4069] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:39:04 2022] POST /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:05.509810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffe566af-259d-4066-90e4-dcfd756c6d22 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Action: 'create', calling method: .version_select at 0x7f83983311f0>, body: {"keypair": {"name": "tempest-keypair-1444967246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG11uuB3uJ1ZQPvv3Q2PZAemCwJno5Q0z4Wwn+CTflrm3WYi2RZdGDPHHxuIIdKJzVrRNO3t1VLSzrMadbncCknaY4AsS0Fmu5GqwozHra5b/yy3aDxH8ScEWYMBZoLQQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:05.524523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ffe566af-259d-4066-90e4-dcfd756c6d22 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Getting quotas for project cbf31942fc7040c29667c26fa198521a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:05.532403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ffe566af-259d-4066-90e4-dcfd756c6d22 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Getting quotas for user b3248cf992334800aa9a235250b800d1 and project cbf31942fc7040c29667c26fa198521a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:05.565491 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffe566af-259d-4066-90e4-dcfd756c6d22 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.061395 Jul 20 04:39:05.566507 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2945/4070] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jul 20 04:39:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 04:39:05.574059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:05.576261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:05.593083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.594051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.596698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.605686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.909295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:05.932941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:05.936242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:05.937909 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af92fe6f-975d-499a-8e36-3af4080ee8da tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1599 microversion: 2.20 time: 0.369966 Jul 20 04:39:05.945657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2946/4071] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:05 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1599 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:05.960312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:05.961271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:05.968815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.969609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:05.970566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:05.971195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.061527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:06.076098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:06.080683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:06.080980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6add0b9e-78a3-47e2-8113-a13d9f6acb8b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1415 microversion: 2.54 time: 0.131751 Jul 20 04:39:06.081698 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2947/4072] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:05 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1415 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:06.087550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:06.088311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:06.095198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.095912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.097057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:06.097503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:06.132189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:06.387856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f73dfb22-29bc-45b7-ba65-09b1e28bc124 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca" status: 204 len: 0 microversion: 2.1 time: 0.303994 Jul 20 04:39:06.389256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2948/4073] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:06 2022] DELETE /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:06.410083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1005050209", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "99a89468-e93b-45f5-b6e7-131721ce1601"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:06.548597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] validate_networks() for [('99a89468-e93b-45f5-b6e7-131721ce1601', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:07.998199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:07.998842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:07.999149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:07.999568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:07.999990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:08.032559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.033200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.034314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.035057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.086852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:08.097051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Getting quotas for user 4d4ae756d3714b598164985ed7d7876c and project 9ee53c54f478471c951962c22855b465. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:08.129335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:08.138024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:08.255910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65a4e475-bcbc-435a-bb1a-7aed5f57d8e2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.860169 Jul 20 04:39:08.257820 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2949/4074] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:08.273137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:08.274032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:08.316165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.316654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.317651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.325836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.513610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6be51324-32ac-44a1-9d52-f4ec70739d87 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.253964 Jul 20 04:39:08.520483 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2950/4075] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:39:08 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:08.520483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:08.521372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:08.539731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.540392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.541183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.541617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.688586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.702629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c91bc16-e74a-4abb-afc2-8731b78a374a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca" status: 200 len: 1212 microversion: 2.1 time: 0.186680 Jul 20 04:39:08.703571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2951/4076] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:08 2022] GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:08.709860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:08.712782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:08.726537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.741532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.755171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:08.755648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:08.917206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.934791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.942352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24ecd15d61504c1a8a54b0bb46dc40d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e35f7ade945a5b62da644311b4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:08.943602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75fadb99-73ad-43a0-b312-c53e39702707 tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 200 len: 1400 microversion: 2.54 time: 0.238530 Jul 20 04:39:08.944195 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2952/4077] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:08 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 1400 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:08.962341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b129b138-6263-41c2-8233-3afbb71a69b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:08.967170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b129b138-6263-41c2-8233-3afbb71a69b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:09.182483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b129b138-6263-41c2-8233-3afbb71a69b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:09.191724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b129b138-6263-41c2-8233-3afbb71a69b9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1215 microversion: 2.1 time: 0.246415 Jul 20 04:39:09.205426 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2953/4078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:08 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1215 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:09.210553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2b44be0-d062-4c64-897d-342b7d39882c tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '.version_select at 0x7f838af78a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:09.266568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2b44be0-d062-4c64-897d-342b7d39882c tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1380192571" status: 204 len: 0 microversion: 2.54 time: 0.059675 Jul 20 04:39:09.284946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2954/4079] 10.222.0.49 () {60 vars in 1318 bytes} [Wed Jul 20 04:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1380192571 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:39:09.297956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:09.298631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:09.316546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.320000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.321490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:09.328536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:09.433314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:09.671627 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a18b4da-095d-4642-a886-edb77512c01b tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "DELETE /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 204 len: 0 microversion: 2.54 time: 0.384966 Jul 20 04:39:09.672794 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2955/4080] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:39:09 2022] DELETE /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:39:09.686215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-87453197", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6ecb03cf-79b0-4c41-b6bd-d9973fb0c8a0"}, {"port": "20c95765-ee3c-4e38-9205-ccc73ae4a263", "tag": "port-1"}, {"port": "77fc1372-a850-48e8-9faa-d9368e1c1727", "tag": "port-2"}, {"uuid": "719ccbb2-2c18-4b6d-a949-8ca158ef5a44", "tag": "net-1"}, {"uuid": "719ccbb2-2c18-4b6d-a949-8ca158ef5a44"}, {"uuid": "b616b663-d349-4e32-ab3f-55c568d7c861", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b616b663-d349-4e32-ab3f-55c568d7c861", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8cdd5af4-a043-4809-8ff0-92ed472b06bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9cd1b80d-ccfb-4fb3-90c8-10161b492efe", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9ab6b4a3-75ad-4994-ba0c-04395b2dbf89", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--937752856"}], "key_name": "tempest-keypair-1444967246", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:09.930143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] validate_networks() for [('6ecb03cf-79b0-4c41-b6bd-d9973fb0c8a0', None, None, None, None, None), (None, None, '20c95765-ee3c-4e38-9205-ccc73ae4a263', None, None, None), (None, None, '77fc1372-a850-48e8-9faa-d9368e1c1727', None, None, None), ('719ccbb2-2c18-4b6d-a949-8ca158ef5a44', None, None, None, None, None), ('719ccbb2-2c18-4b6d-a949-8ca158ef5a44', None, None, None, None, None), ('b616b663-d349-4e32-ab3f-55c568d7c861', '10.2.2.100', None, None, None, None), ('b616b663-d349-4e32-ab3f-55c568d7c861', '10.2.2.200', None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:15.922380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:15.923007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:15.923256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:15.923821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:15.924281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:15.937101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.937544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.939077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:15.939814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:15.963704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Getting quotas for project cbf31942fc7040c29667c26fa198521a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:15.971878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Getting quotas for user b3248cf992334800aa9a235250b800d1 and project cbf31942fc7040c29667c26fa198521a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:16.181843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:16.186398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8cdd5af4-a043-4809-8ff0-92ed472b06bc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9cd1b80d-ccfb-4fb3-90c8-10161b492efe',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ab6b4a3-75ad-4994-ba0c-04395b2dbf89',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:16.732900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff602d30-f5cc-49c9-8587-2010909a566d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.057199 Jul 20 04:39:16.734254 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2956/4081] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Jul 20 04:39:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 7060 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 04:39:16.740795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.742663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] [instance: 11ef814d-e1a6-4c66-aadc-0fc16346b208] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:16.786912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.787410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.788217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.793306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.822497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] HTTP exception thrown: Instance 11ef814d-e1a6-4c66-aadc-0fc16346b208 could not be found. Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Request method failure captured: Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 HTTP/1.1 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14a_Wm5tjujZDN3ulKqrHLEvD-jHax7cRVQbi85GkfKTL6BetokvwdrjSkAaxBe8hHFcXrz4dsOj-TMB59NPjF3vMUBylPsm6saNyWiVAuvRddaC17VZEMpnIXkCCBLipvzT5B3V_wbL8yTj-qYuBwbtRPymtt7DithE6Gq6C8EhLMA Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.54 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 754e35f7ade945a5b62da644311b4324 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerShowV254Test-470916507 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/754e35f7ade945a5b62da644311b4324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/754e35f7ade945a5b62da644311b4324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/754e35f7ade945a5b62da644311b4324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_754e35f7ade945a5b62da644311b4324", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerShowV254Test-470916507 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 754e35f7ade945a5b62da644311b4324 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerShowV254Test-470916507 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerShowV254Test-470916507-project Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 24ecd15d61504c1a8a54b0bb46dc40d2 Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerShowV254Test-470916507-project Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 11ef814d-e1a6-4c66-aadc-0fc16346b208 could not be found. Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '11ef814d-e1a6-4c66-aadc-0fc16346b208'} Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ef814d-e1a6-4c66-aadc-0fc16346b208 could not be found. Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ef814d-e1a6-4c66-aadc-0fc16346b208 could not be found. Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:16.824261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ef814d-e1a6-4c66-aadc-0fc16346b208 could not be found. Jul 20 04:39:16.829514 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.830160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] Returning 404 to user: Instance 11ef814d-e1a6-4c66-aadc-0fc16346b208 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:16.830826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad3811f2-aefb-4bbe-8c6e-a9dcb1ea356a tempest-ServerShowV254Test-470916507 tempest-ServerShowV254Test-470916507-project] 10.222.0.49 "GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208" status: 404 len: 111 microversion: 2.54 time: 0.095114 Jul 20 04:39:16.837586 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2957/4082] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:16 2022] GET /compute/v2.1/servers/11ef814d-e1a6-4c66-aadc-0fc16346b208 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:39:16.847425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.848498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:16.874162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.875012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.876250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.877014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.898578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca HTTP/1.1 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3b30e3fc-c298-405f-a67e-331633e972ca'} Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.900564 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:16.906740 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:16.906740 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:16.906740 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:16.906740 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:16.906740 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:39:16.906740 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:16.910096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:16.911230 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9a78c75-336d-44ce-a48a-4d141c0b0447 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca" status: 404 len: 111 microversion: 2.1 time: 0.072570 Jul 20 04:39:16.914201 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2958/4083] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:16 2022] GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:16.921132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:16.927678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:16.935617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:16.956899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.957371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:16.958224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:16.968219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.306385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.328029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e85d86c-e8c7-4b0d-9c04-9340ef353805 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1315 microversion: 2.1 time: 0.412205 Jul 20 04:39:17.348875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2959/4084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:16 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:17.363049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5ad619e4-1230-4439-9899-98c5c77891ee req-dbe5aa05-752c-4b08-9eb4-6fb685e7b7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:17.401691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5ad619e4-1230-4439-9899-98c5c77891ee req-dbe5aa05-752c-4b08-9eb4-6fb685e7b7bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:17.402700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5ad619e4-1230-4439-9899-98c5c77891ee req-dbe5aa05-752c-4b08-9eb4-6fb685e7b7bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:17.421087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5ad619e4-1230-4439-9899-98c5c77891ee req-dbe5aa05-752c-4b08-9eb4-6fb685e7b7bc service nova] Creating event network-changed:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h1-764486-11 Jul 20 04:39:17.430058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5ad619e4-1230-4439-9899-98c5c77891ee req-dbe5aa05-752c-4b08-9eb4-6fb685e7b7bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079481 Jul 20 04:39:17.430686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2960/4085] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:17.459384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b797c289-f9bc-4636-a718-f85ba31cd97f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:17.461852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b797c289-f9bc-4636-a718-f85ba31cd97f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:17.572918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b797c289-f9bc-4636-a718-f85ba31cd97f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.583071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b797c289-f9bc-4636-a718-f85ba31cd97f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.585164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b797c289-f9bc-4636-a718-f85ba31cd97f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:17.586468 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b797c289-f9bc-4636-a718-f85ba31cd97f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1284 microversion: 2.42 time: 0.154691 Jul 20 04:39:17.600390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2961/4086] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:17 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:17.600390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-391847894", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:17.709639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:18.379690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:18.380933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:18.381528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:18.382190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:18.382993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:18.395854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.396921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.397989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.398626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.458780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:18.480667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:18.520086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:18.522764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:18.615789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-831aaf3b-4341-47f3-b153-2306568abf49 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025407 Jul 20 04:39:18.618158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2962/4087] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:18.633425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:18.635528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:18.645903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.646416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:18.647375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:18.647830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.115735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:19.156522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca85839c-54bd-4f95-bf3b-c6a039a8eee9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1315 microversion: 2.1 time: 0.536831 Jul 20 04:39:19.173590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2963/4088] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:18 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:19.182321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:19.183360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:19.194789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.195881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.197699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.198307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.368078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:19.384688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:19.394536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:19.397617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ca2a90f-b1ce-4320-9e9f-0c2a11b4ae63 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1592 microversion: 2.42 time: 0.222358 Jul 20 04:39:19.401250 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2964/4089] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:19 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1592 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:19.422811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:19.428791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:19.513779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.518271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.526220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.528083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.845757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:19.854400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04f3b726-ec39-4d66-b4ae-71b646fa91d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1224 microversion: 2.1 time: 0.447888 Jul 20 04:39:19.855010 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2965/4090] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:19 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1224 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:19.874575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-25ccaf36-933b-428e-8b5e-5cc16ae12f83 req-41ddb2f8-51b4-423c-984a-57757d5f2ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7", "tag": "6be20eae-9e36-4a37-949e-1dd0b2336f0d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:19.905178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-25ccaf36-933b-428e-8b5e-5cc16ae12f83 req-41ddb2f8-51b4-423c-984a-57757d5f2ea4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:19.910231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-25ccaf36-933b-428e-8b5e-5cc16ae12f83 req-41ddb2f8-51b4-423c-984a-57757d5f2ea4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:19.936457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:20.003672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-25ccaf36-933b-428e-8b5e-5cc16ae12f83 req-41ddb2f8-51b4-423c-984a-57757d5f2ea4 service nova] Creating event network-changed:6be20eae-9e36-4a37-949e-1dd0b2336f0d for instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 on n-h1-764486-11 Jul 20 04:39:20.014293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-25ccaf36-933b-428e-8b5e-5cc16ae12f83 req-41ddb2f8-51b4-423c-984a-57757d5f2ea4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157521 Jul 20 04:39:20.015050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2966/4091] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:20.247916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36b4ebe7-fb37-49ef-a8bc-aa257c7b1bdf tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Action: 'create', calling method: .version_select at 0x7f838b231940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1126982565"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:20.798938 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36b4ebe7-fb37-49ef-a8bc-aa257c7b1bdf tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.782345 Jul 20 04:39:20.800463 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2967/4092] 10.222.0.49 () {60 vars in 1154 bytes} [Wed Jul 20 04:39:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 785 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:39:20.805987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:20.811150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:20.826983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:20.829078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:20.832375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:20.833080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.521992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:21.534526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d3ec930-b1d6-408e-96b1-4aa6bd3fe766 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1315 microversion: 2.1 time: 0.730154 Jul 20 04:39:21.536375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2968/4093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:20 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:21.547538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.549879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:21.567201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.567943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.572968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:21.573653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:21.825966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:21.840513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:21.844266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:21.849636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38057833-c1c2-4257-a543-e63ff644c753 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1659 microversion: 2.42 time: 0.306518 Jul 20 04:39:21.862899 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2969/4094] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1659 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:21.869875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc4b62d0-ee49-4cc8-a162-05d3dbadcad7 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838aec3a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.960803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc4b62d0-ee49-4cc8-a162-05d3dbadcad7 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 200 len: 345 microversion: 2.1 time: 0.096066 Jul 20 04:39:21.966012 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2970/4095] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:21.973871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:21.982791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:22.025254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.027244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.030095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.032599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.187500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:22.275729 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a7ec21a-6832-4b07-8be3-892c97f3f4d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1278 microversion: 2.1 time: 0.300817 Jul 20 04:39:22.290228 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2971/4096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:21 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:22.304845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-eb96371a-8dde-4a85-8e7c-148b6065005e req-523f84e8-aad4-4b3d-9896-1ddd9dd46722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7", "name": "network-vif-plugged", "status": "completed", "tag": "6be20eae-9e36-4a37-949e-1dd0b2336f0d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:22.371364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb96371a-8dde-4a85-8e7c-148b6065005e req-523f84e8-aad4-4b3d-9896-1ddd9dd46722 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.371895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb96371a-8dde-4a85-8e7c-148b6065005e req-523f84e8-aad4-4b3d-9896-1ddd9dd46722 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.414149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eb96371a-8dde-4a85-8e7c-148b6065005e req-523f84e8-aad4-4b3d-9896-1ddd9dd46722 service nova] Creating event network-vif-plugged:6be20eae-9e36-4a37-949e-1dd0b2336f0d for instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 on n-h1-764486-11 Jul 20 04:39:22.434695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-eb96371a-8dde-4a85-8e7c-148b6065005e req-523f84e8-aad4-4b3d-9896-1ddd9dd46722 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142445 Jul 20 04:39:22.445594 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2972/4097] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:22.560014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:22.561533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:22.589385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.591018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:22.592095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:22.598325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.447489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.459531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-588e81da-0f17-4112-9e10-3fdaf9f0bec9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1315 microversion: 2.1 time: 0.906922 Jul 20 04:39:23.471089 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2973/4098] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:22 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:23.478553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:23.480177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:23.489666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.490762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.492987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:23.493834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:23.946423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.962759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.968659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:23.975255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a8d0d8a8-5341-479d-bf09-8edcf8938821 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1659 microversion: 2.42 time: 0.499238 Jul 20 04:39:23.976576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2974/4099] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1659 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:23.996291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51654527-73d4-475f-8423-ec0c5c01d67a tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838ae7f5e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.135228 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51654527-73d4-475f-8423-ec0c5c01d67a tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 200 len: 346 microversion: 2.1 time: 0.156573 Jul 20 04:39:24.136053 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2975/4100] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:39:23 2022] GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:24.145746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:24.148799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:24.170018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.170870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.176953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:24.178251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:24.738786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:24.759597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d206727a-09e0-479d-a0db-79a7e8a6d6d6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1320 microversion: 2.1 time: 0.621106 Jul 20 04:39:24.764032 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2976/4101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:24 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:24.781410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a851884f-9c01-41aa-bdaa-01b259307b9a tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Action: 'create', calling method: .version_select at 0x7f838af32dc0>, body: {"snapshot": {"volume_id": "1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1766183346"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:25.149658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a851884f-9c01-41aa-bdaa-01b259307b9a tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.382815 Jul 20 04:39:25.151269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2977/4102] 10.222.0.49 () {60 vars in 1161 bytes} [Wed Jul 20 04:39:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:25.175740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:25.176808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:25.193974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.194771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.195858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:25.196600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:25.908518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:25.958582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aac32d6a-c5e5-484e-afbb-df5c9096d6c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1502 microversion: 2.1 time: 0.802867 Jul 20 04:39:25.961301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2978/4103] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:25 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1502 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:26.013268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.013844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.035761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.036237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.037078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.039897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.684980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:26.707637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:26.709207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:26.710402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4480fc37-26cb-4c06-8434-dd3c346b8419 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1751 microversion: 2.42 time: 0.717149 Jul 20 04:39:26.710974 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2979/4104] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:25 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1751 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:26.728260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-880cea59-ab0d-43f6-a98d-2ba96f886a41 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838af32f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.815616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-880cea59-ab0d-43f6-a98d-2ba96f886a41 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69" status: 200 len: 287 microversion: 2.1 time: 0.093525 Jul 20 04:39:26.816882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2980/4105] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:26.841172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:26.841860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:26.857941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.858314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:26.859135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:26.859575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.189617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:27.203407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91d2c9c5-835c-4215-966b-b7abdff1989c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1320 microversion: 2.1 time: 0.377134 Jul 20 04:39:27.218388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2981/4106] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:26 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:27.237709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7c105f11-7439-4685-87ae-764e892e05c7 req-76f63dd7-0e2f-4cc3-9dde-baf8e9687a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a175cb7-41da-443e-9250-89fc41195b62", "tag": "033fac37-0e18-4253-a579-03098f58faf6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:27.259437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c105f11-7439-4685-87ae-764e892e05c7 req-76f63dd7-0e2f-4cc3-9dde-baf8e9687a6d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.262224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c105f11-7439-4685-87ae-764e892e05c7 req-76f63dd7-0e2f-4cc3-9dde-baf8e9687a6d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.284626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7c105f11-7439-4685-87ae-764e892e05c7 req-76f63dd7-0e2f-4cc3-9dde-baf8e9687a6d service nova] Creating event network-changed:033fac37-0e18-4253-a579-03098f58faf6 for instance 3a175cb7-41da-443e-9250-89fc41195b62 on n-h2-764486-11 Jul 20 04:39:27.300484 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7c105f11-7439-4685-87ae-764e892e05c7 req-76f63dd7-0e2f-4cc3-9dde-baf8e9687a6d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073530 Jul 20 04:39:27.302431 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2982/4107] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:27.313115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:27.319280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:27.344813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.345859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.346947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.347562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.523287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce84a688-7cc0-42b4-9401-2fa42b8a1a4d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.217496 Jul 20 04:39:27.524367 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2983/4108] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:27 2022] POST /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:27.534829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b337b66-915a-475d-8cc0-2358c7e9305b tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838b231dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:27.679062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b337b66-915a-475d-8cc0-2358c7e9305b tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.153039 Jul 20 04:39:27.680462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2984/4109] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jul 20 04:39:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:27.686812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:27.689331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:27.734848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.740523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:27.750862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:27.752158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.414080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:28.442222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:28.450924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3cbfcecc-2076-4eb6-a891-4e646ef2b373 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1507 microversion: 2.1 time: 0.769210 Jul 20 04:39:28.459248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2985/4110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:27 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1507 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:28.468943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2380f0b6-ea20-4049-84d1-263810f73b97 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f839809d0d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.505183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=32 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:28.596161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2380f0b6-ea20-4049-84d1-263810f73b97 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69" status: 200 len: 287 microversion: 2.1 time: 0.133025 Jul 20 04:39:28.596161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2986/4111] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:28.608033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:28.617473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:28.632644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.633414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:28.637080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:28.637748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.226189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.266615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.275637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.284038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a86c1c44-a7a8-439c-a61e-784732a5d406 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1751 microversion: 2.42 time: 0.688153 Jul 20 04:39:29.285643 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2987/4112] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:28 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1751 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:29.304144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:29.305947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:29.321847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.323094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.324889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.326056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.778361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:29.795200 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00a68d36-0b78-49ae-8a43-a4cacd260af4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1320 microversion: 2.1 time: 0.507256 Jul 20 04:39:29.797429 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2988/4113] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:29 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:29.819714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:29.821741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:29.838299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.841193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:29.843826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:29.844321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.229049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:30.243525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70a056c7-482c-4b57-a792-6903c3c324da tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1487 microversion: 2.1 time: 0.443738 Jul 20 04:39:30.244118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2989/4114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:29 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1487 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:30.249129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c542c4d-fe19-4190-b35d-0b82034ab893 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838bbc1a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:30.331596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c542c4d-fe19-4190-b35d-0b82034ab893 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69" status: 200 len: 288 microversion: 2.1 time: 0.086156 Jul 20 04:39:30.332201 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2990/4115] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:39:30 2022] GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:30.337471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:30.337952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:30.360568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.361046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.361862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.365111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.410687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lazy-loading 'flavor' on Instance uuid 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:30.415743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:30.881841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-755f0c51-5496-44a3-9d97-79af9f215a00 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7/action" status: 202 len: 0 microversion: 2.1 time: 0.547939 Jul 20 04:39:30.890642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2991/4116] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:39:30 2022] POST /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:30.902172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:30.903533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:30.913749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.914269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:30.915526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:30.916118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.225201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.237413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.239287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:31.240794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71bf9b47-c687-44a1-911d-8b16f2cb37ef tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1843 microversion: 2.42 time: 0.347872 Jul 20 04:39:31.241666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2992/4117] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:30 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1843 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:31.246706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27b001bb-fbf4-4df6-a9d9-a61092da94d7 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838b00a160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:31.429140 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27b001bb-fbf4-4df6-a9d9-a61092da94d7 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69" status: 202 len: 0 microversion: 2.1 time: 0.186620 Jul 20 04:39:31.430193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2993/4118] 10.222.0.49 () {58 vars in 1253 bytes} [Wed Jul 20 04:39:31 2022] DELETE /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:31.436584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:31.437199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:31.467956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.468463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:31.469234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:31.469668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.504217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:32.525673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-484f6202-0b8e-47eb-b40a-2800f938a52e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1320 microversion: 2.1 time: 1.093931 Jul 20 04:39:32.527806 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2994/4119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:31 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1320 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:32.555503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:32.558635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:32.598898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.609609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.611135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:32.612320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:32.928953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:32.941276 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7669f288-cc55-4297-882c-c548093cabe1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1514 microversion: 2.1 time: 0.412006 Jul 20 04:39:32.942485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2995/4120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:32 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:32.955616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a84d628-5fbf-4988-8d70-8fe069193376 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838aec34c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:33.090494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a84d628-5fbf-4988-8d70-8fe069193376 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69" status: 200 len: 287 microversion: 2.1 time: 0.139609 Jul 20 04:39:33.099114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2996/4121] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:39:32 2022] GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:33.109852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fbe4dd72-e870-42fa-a246-825fa94e18b4 req-2df26db2-9362-41b0-b58b-50245f8ba568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a175cb7-41da-443e-9250-89fc41195b62", "name": "network-vif-plugged", "status": "completed", "tag": "033fac37-0e18-4253-a579-03098f58faf6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:33.135594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fbe4dd72-e870-42fa-a246-825fa94e18b4 req-2df26db2-9362-41b0-b58b-50245f8ba568 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.136941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fbe4dd72-e870-42fa-a246-825fa94e18b4 req-2df26db2-9362-41b0-b58b-50245f8ba568 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:33.174903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fbe4dd72-e870-42fa-a246-825fa94e18b4 req-2df26db2-9362-41b0-b58b-50245f8ba568 service nova] Creating event network-vif-plugged:033fac37-0e18-4253-a579-03098f58faf6 for instance 3a175cb7-41da-443e-9250-89fc41195b62 on n-h2-764486-11 Jul 20 04:39:33.184463 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fbe4dd72-e870-42fa-a246-825fa94e18b4 req-2df26db2-9362-41b0-b58b-50245f8ba568 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080973 Jul 20 04:39:33.185510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2997/4122] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:33.206691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:33.212876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:33.242492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.242944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:33.243762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:33.244209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.042466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.062429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.064733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.067153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59faa4f1-89c3-4d7b-9864-81eb9b047b76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1843 microversion: 2.42 time: 0.879759 Jul 20 04:39:34.068625 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2998/4123] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:33 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1843 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:34.074432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7f324640-b26a-4dbb-9834-8f03e8976655 req-e5fc0b24-89f0-4843-8e7c-fba0ce5412e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:34.085117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7f324640-b26a-4dbb-9834-8f03e8976655 req-e5fc0b24-89f0-4843-8e7c-fba0ce5412e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.086396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7f324640-b26a-4dbb-9834-8f03e8976655 req-e5fc0b24-89f0-4843-8e7c-fba0ce5412e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.110606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7f324640-b26a-4dbb-9834-8f03e8976655 req-e5fc0b24-89f0-4843-8e7c-fba0ce5412e5 service nova] Creating event network-changed:4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:34.123744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7f324640-b26a-4dbb-9834-8f03e8976655 req-e5fc0b24-89f0-4843-8e7c-fba0ce5412e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051949 Jul 20 04:39:34.125018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 2999/4124] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:34.140841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:34.143465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:34.164315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.169720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.171425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.172343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.664619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:34.687845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba1e9cd4-fcfc-4dbe-a52a-879bd10173f5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1320 microversion: 2.1 time: 0.561333 Jul 20 04:39:34.710394 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3000/4125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:34 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1320 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:34.716071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:34.725561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:34.760416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.761753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:34.762786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:34.766028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.411620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:35.427561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ddd9cf0-416e-49d0-ac9a-b81afe81be84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.715492 Jul 20 04:39:35.444256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3001/4126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:34 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:35.463324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36deb07c-2cfd-4f78-a061-bce08c466e8c tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838ae7f280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:35.514976 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-36deb07c-2cfd-4f78-a061-bce08c466e8c tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] HTTP exception thrown: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36deb07c-2cfd-4f78-a061-bce08c466e8c tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Request method failure captured: Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 HTTP/1.1 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14b36MwMBkoTsrm7EyER0ZJvE33gZ7P6Dg35d3jS6FALcQF_VpVHmYUi1Or94JqoRhROYiUb_cd__RKclj9j3aMIvxXPeorPL78FMOyP0PuUbGZd7hnFz7F8GvuJbBcCf8PBnEdYdtRmG6XBGfjYOS6MvjfLW_1N57AZUnP--3vRbRc Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab2abc83dffb4205865cee92f0579116", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f6d6466fdcc04fd882fe5f47889b151d Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: exception: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'dfad26f4-1786-4df1-ac68-8ac39287ea69'} Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. (HTTP 404) (Request-ID: req-21aa55d5-3a61-4534-8930-2140682cabaa) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:39:35.525177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. Jul 20 04:39:35.530065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:35.542288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36deb07c-2cfd-4f78-a061-bce08c466e8c tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Returning 404 to user: Snapshot dfad26f4-1786-4df1-ac68-8ac39287ea69 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:35.543900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36deb07c-2cfd-4f78-a061-bce08c466e8c tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69" status: 404 len: 111 microversion: 2.1 time: 0.097871 Jul 20 04:39:35.570436 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3002/4127] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 04:39:35 2022] GET /compute/v2.1/os-snapshots/dfad26f4-1786-4df1-ac68-8ac39287ea69 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:35.631266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:35.632569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:35.712266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.713410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:35.716020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:35.717059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.426493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:36.447871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:36.458482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:36.461189 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc8271b8-d1ba-42be-b685-d6969bff35cc tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1864 microversion: 2.42 time: 0.887352 Jul 20 04:39:36.475882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3003/4128] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:35 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1864 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:36.486322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33f0a2ca-d95d-432b-ac75-8848e10af9a0 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838b001f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:36.593167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33f0a2ca-d95d-432b-ac75-8848e10af9a0 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 202 len: 0 microversion: 2.1 time: 0.115686 Jul 20 04:39:36.594176 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3004/4129] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:39:36 2022] DELETE /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:36.600525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6cade119-0ee9-4e71-99d2-2e269b19d8d5 req-b25c5f97-b636-407b-966b-fb9050c04d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7", "name": "network-vif-plugged", "status": "completed", "tag": "6be20eae-9e36-4a37-949e-1dd0b2336f0d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:36.623144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6cade119-0ee9-4e71-99d2-2e269b19d8d5 req-b25c5f97-b636-407b-966b-fb9050c04d06 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.623803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6cade119-0ee9-4e71-99d2-2e269b19d8d5 req-b25c5f97-b636-407b-966b-fb9050c04d06 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.652529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6cade119-0ee9-4e71-99d2-2e269b19d8d5 req-b25c5f97-b636-407b-966b-fb9050c04d06 service nova] Creating event network-vif-plugged:6be20eae-9e36-4a37-949e-1dd0b2336f0d for instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 on n-h1-764486-11 Jul 20 04:39:36.666122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6cade119-0ee9-4e71-99d2-2e269b19d8d5 req-b25c5f97-b636-407b-966b-fb9050c04d06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066844 Jul 20 04:39:36.668108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3005/4130] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:36.679890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:36.681889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:36.699614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.703023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:36.704140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:36.705390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:37.097140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:37.109899 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd8561bd-57d3-4dee-9b0b-e32e11c8d43d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1501 microversion: 2.1 time: 0.440044 Jul 20 04:39:37.112603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3006/4131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:36 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1501 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:37.129522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9ac6cc61-2174-45e4-ae10-ec0cc75953c0 req-127139bc-3523-4239-9fa7-70f76d860bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "20c95765-ee3c-4e38-9205-ccc73ae4a263"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:37.152640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ac6cc61-2174-45e4-ae10-ec0cc75953c0 req-127139bc-3523-4239-9fa7-70f76d860bc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:37.154366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ac6cc61-2174-45e4-ae10-ec0cc75953c0 req-127139bc-3523-4239-9fa7-70f76d860bc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:37.231581 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9ac6cc61-2174-45e4-ae10-ec0cc75953c0 req-127139bc-3523-4239-9fa7-70f76d860bc8 service nova] Creating event network-changed:20c95765-ee3c-4e38-9205-ccc73ae4a263 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:37.258369 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9ac6cc61-2174-45e4-ae10-ec0cc75953c0 req-127139bc-3523-4239-9fa7-70f76d860bc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139758 Jul 20 04:39:37.259376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3007/4132] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:37.264945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:37.285474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:37.299269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:37.301582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:37.309396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:37.310172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.016494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:38.039467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d5deb5b-3cae-4e26-95bf-1a7efeacac2b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.778592 Jul 20 04:39:38.040765 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3008/4133] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:37 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:38.053409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-704ad609-78d6-47df-bc09-175e2d91b0d2 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838aedea60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:38.185436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-704ad609-78d6-47df-bc09-175e2d91b0d2 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 200 len: 345 microversion: 2.1 time: 0.143388 Jul 20 04:39:38.186047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3009/4134] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:39:38 2022] GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:38.197590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:38.200440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:38.220932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.221541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:38.222386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:38.223271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:39.316215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:39.329565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7458f32c-0a34-455d-8efe-581eec7ce9be tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1501 microversion: 2.1 time: 1.142299 Jul 20 04:39:39.330476 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3010/4135] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:38 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1501 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:39.335094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:39.335695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:39.352701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.355325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:39.356577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:39.356577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.131484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.163528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.176121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.185793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd50f3db-b850-415e-af0f-fd53c10c775f tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.850211 Jul 20 04:39:40.190548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3011/4136] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:39 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:40.211490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:40.212127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:40.237559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:40.265255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.266034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.266866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:40.267305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:40.833528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:40.860311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0413d3e5-9a15-4f52-941c-76d79c6ccc84 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.668082 Jul 20 04:39:40.863177 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3012/4137] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:40 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:40.880582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2a4378a-098b-48d2-be33-7a2a190d780d tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838b078310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:41.022423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2a4378a-098b-48d2-be33-7a2a190d780d tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 200 len: 345 microversion: 2.1 time: 0.154265 Jul 20 04:39:41.023322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3013/4138] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:39:40 2022] GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:41.051600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6225ffc3-7fa4-410c-98bb-b09d0db6b221 req-961f318f-b47f-4f2f-a64d-a721db7fb4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "77fc1372-a850-48e8-9faa-d9368e1c1727"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:41.117256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6225ffc3-7fa4-410c-98bb-b09d0db6b221 req-961f318f-b47f-4f2f-a64d-a721db7fb4ac service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.121695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6225ffc3-7fa4-410c-98bb-b09d0db6b221 req-961f318f-b47f-4f2f-a64d-a721db7fb4ac service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.179025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6225ffc3-7fa4-410c-98bb-b09d0db6b221 req-961f318f-b47f-4f2f-a64d-a721db7fb4ac service nova] Creating event network-changed:77fc1372-a850-48e8-9faa-d9368e1c1727 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:41.196083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6225ffc3-7fa4-410c-98bb-b09d0db6b221 req-961f318f-b47f-4f2f-a64d-a721db7fb4ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163136 Jul 20 04:39:41.202289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3014/4139] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:41.207944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:41.212385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:41.228396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.230293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.231285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.232835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.321004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:39:41.329674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:41.529555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2c7cd35-8814-42c2-9a5b-5e04e1f284d4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 204 len: 0 microversion: 2.1 time: 0.325636 Jul 20 04:39:41.532720 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3015/4140] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:39:41 2022] DELETE /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:41.552102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:41.556648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:41.597315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.598852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:41.600701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:41.603208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.171328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:43.185340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:43.191051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:43.194022 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09c1b237-9d68-4a7b-8396-dee4880629a1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 1.657773 Jul 20 04:39:43.210273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3016/4141] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:41 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:43.216102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.226884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.234383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.235110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.243180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.243888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.774542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:43.784869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-43656eb1-5544-4d3f-bf70-7dbbf0cb5d30 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1507 microversion: 2.1 time: 0.573057 Jul 20 04:39:43.785751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3017/4142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:43 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1507 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:43.799053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:43.807581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:43.828446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.841338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:43.844199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:43.849242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.153827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:44.162492 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a08cf72b-d42e-495f-a150-54735490aba5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.375479 Jul 20 04:39:44.167323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3018/4143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:43 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:44.179449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be29b9a6-77f2-4232-bba3-1d9dbc041595 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838b296940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:44.244094 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-be29b9a6-77f2-4232-bba3-1d9dbc041595 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] HTTP exception thrown: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be29b9a6-77f2-4232-bba3-1d9dbc041595 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Request method failure captured: Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b HTTP/1.1 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14b36MwMBkoTsrm7EyER0ZJvE33gZ7P6Dg35d3jS6FALcQF_VpVHmYUi1Or94JqoRhROYiUb_cd__RKclj9j3aMIvxXPeorPL78FMOyP0PuUbGZd7hnFz7F8GvuJbBcCf8PBnEdYdtRmG6XBGfjYOS6MvjfLW_1N57AZUnP--3vRbRc Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab2abc83dffb4205865cee92f0579116", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f6d6466fdcc04fd882fe5f47889b151d Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b'} Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. (HTTP 404) (Request-ID: req-dd930aa3-96f7-4bfe-8158-ac23d0726efd) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:39:44.247312 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be29b9a6-77f2-4232-bba3-1d9dbc041595 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Returning 404 to user: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:44.252012 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be29b9a6-77f2-4232-bba3-1d9dbc041595 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 404 len: 109 microversion: 2.1 time: 0.079732 Jul 20 04:39:44.263489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3019/4144] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:39:44 2022] GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:44.270158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:44.270720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:44.278815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.279407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.280653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.281099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.314153 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4079b3a7-2516-49b8-bfe4-71b4672163f1 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/ips" status: 200 len: 151 microversion: 2.20 time: 0.048793 Jul 20 04:39:44.314758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3020/4145] 10.222.0.49 () {60 vars in 1288 bytes} [Wed Jul 20 04:39:44 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:39:44.320711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5e05b72c-ebcd-40df-a6eb-df477a3dfd80 req-4a05ba3a-7b17-4d11-8747-fd2d03c9e05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "75a5af4e-82a6-4b12-957a-046b8af7dc3d"}, {"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "a3d8da46-0316-4823-9384-cf6668ebebab"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:44.333716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5e05b72c-ebcd-40df-a6eb-df477a3dfd80 req-4a05ba3a-7b17-4d11-8747-fd2d03c9e05b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.334545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5e05b72c-ebcd-40df-a6eb-df477a3dfd80 req-4a05ba3a-7b17-4d11-8747-fd2d03c9e05b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.355096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5e05b72c-ebcd-40df-a6eb-df477a3dfd80 req-4a05ba3a-7b17-4d11-8747-fd2d03c9e05b service nova] Creating event network-changed:75a5af4e-82a6-4b12-957a-046b8af7dc3d for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:44.355942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5e05b72c-ebcd-40df-a6eb-df477a3dfd80 req-4a05ba3a-7b17-4d11-8747-fd2d03c9e05b service nova] Creating event network-changed:a3d8da46-0316-4823-9384-cf6668ebebab for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:44.362500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5e05b72c-ebcd-40df-a6eb-df477a3dfd80 req-4a05ba3a-7b17-4d11-8747-fd2d03c9e05b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045895 Jul 20 04:39:44.363851 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3021/4146] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:44.370930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:44.372149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:44.397812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.398535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:44.399545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:44.400211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:45.837913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:45.862651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:45.876513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:45.884670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3556c84-3657-4cb1-84f7-b3e4fca90e65 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 1.518906 Jul 20 04:39:45.898985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3022/4147] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:44 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:45.921072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee10e37e-11b5-414f-bda0-0ace910feec8 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838b00a670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:46.446709 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ee10e37e-11b5-414f-bda0-0ace910feec8 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] HTTP exception thrown: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee10e37e-11b5-414f-bda0-0ace910feec8 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Request method failure captured: Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b HTTP/1.1 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14b36MwMBkoTsrm7EyER0ZJvE33gZ7P6Dg35d3jS6FALcQF_VpVHmYUi1Or94JqoRhROYiUb_cd__RKclj9j3aMIvxXPeorPL78FMOyP0PuUbGZd7hnFz7F8GvuJbBcCf8PBnEdYdtRmG6XBGfjYOS6MvjfLW_1N57AZUnP--3vRbRc Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab2abc83dffb4205865cee92f0579116", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f6d6466fdcc04fd882fe5f47889b151d Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b'} Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. (HTTP 404) (Request-ID: req-73346361-2a79-4e6f-9fd9-9ec45a03cfc2) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:39:46.449762 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:46.454377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:46.458331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee10e37e-11b5-414f-bda0-0ace910feec8 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Returning 404 to user: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:46.459397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee10e37e-11b5-414f-bda0-0ace910feec8 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 404 len: 109 microversion: 2.1 time: 0.559005 Jul 20 04:39:46.460534 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3023/4148] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:39:45 2022] DELETE /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 109 bytes in 561 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:46.468431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:46.477414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:46.503475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.504335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.507635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.511896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.617435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.622144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.623451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lazy-loading 'fault' on Instance uuid 3a175cb7-41da-443e-9250-89fc41195b62 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:46.783013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:46.796436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb8529b0-ba87-4d16-98b7-173d039b59fe tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 200 len: 1310 microversion: 2.1 time: 0.334434 Jul 20 04:39:46.808578 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3024/4149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:46 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 1310 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:46.816173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:46.821548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:46.835207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.841037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:46.842582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:46.845389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.127799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:47.142966 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7294980d-e6bd-4da9-a839-6a630ed7ce19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.332824 Jul 20 04:39:47.143588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3025/4150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:46 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:47.164225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-857b3256-a195-46ae-be89-1ff2937eae69 req-3ee00647-65a6-4f9b-871e-09b137e0d200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a175cb7-41da-443e-9250-89fc41195b62", "name": "network-vif-deleted", "tag": "033fac37-0e18-4253-a579-03098f58faf6"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:47.205096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-857b3256-a195-46ae-be89-1ff2937eae69 req-3ee00647-65a6-4f9b-871e-09b137e0d200 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.208671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-857b3256-a195-46ae-be89-1ff2937eae69 req-3ee00647-65a6-4f9b-871e-09b137e0d200 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.248053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-857b3256-a195-46ae-be89-1ff2937eae69 req-3ee00647-65a6-4f9b-871e-09b137e0d200 service nova] Creating event network-vif-deleted:033fac37-0e18-4253-a579-03098f58faf6 for instance 3a175cb7-41da-443e-9250-89fc41195b62 on n-h2-764486-11 Jul 20 04:39:47.266973 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-857b3256-a195-46ae-be89-1ff2937eae69 req-3ee00647-65a6-4f9b-871e-09b137e0d200 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118088 Jul 20 04:39:47.276530 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3026/4151] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:47.290531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-486e081e-4bce-4ab2-be07-3cb265b7ae81 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Calling method '.version_select at 0x7f838be8eee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.543290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-486e081e-4bce-4ab2-be07-3cb265b7ae81 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] HTTP exception thrown: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-486e081e-4bce-4ab2-be07-3cb265b7ae81 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Request method failure captured: Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b HTTP/1.1 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14b36MwMBkoTsrm7EyER0ZJvE33gZ7P6Dg35d3jS6FALcQF_VpVHmYUi1Or94JqoRhROYiUb_cd__RKclj9j3aMIvxXPeorPL78FMOyP0PuUbGZd7hnFz7F8GvuJbBcCf8PBnEdYdtRmG6XBGfjYOS6MvjfLW_1N57AZUnP--3vRbRc Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab2abc83dffb4205865cee92f0579116"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab2abc83dffb4205865cee92f0579116", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ab2abc83dffb4205865cee92f0579116 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-988128717 Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f6d6466fdcc04fd882fe5f47889b151d Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-988128717-project Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b'} Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. (HTTP 404) (Request-ID: req-a4633580-5b21-4514-96e5-82b8c8cfa569) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:39:47.545842 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. Jul 20 04:39:47.550404 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:47.554657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-486e081e-4bce-4ab2-be07-3cb265b7ae81 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] Returning 404 to user: Volume 1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:47.555604 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-486e081e-4bce-4ab2-be07-3cb265b7ae81 tempest-VolumesSnapshotsTestJSON-988128717 tempest-VolumesSnapshotsTestJSON-988128717-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b" status: 404 len: 109 microversion: 2.1 time: 0.276270 Jul 20 04:39:47.556607 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3027/4152] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/os-volumes/1d16a82e-781f-4c9f-a6f6-4efb7a0ba76b => generated 109 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:47.573149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-64ac4b18-39f1-448f-9b68-aeddd2532452 req-7aa57125-23cf-4dba-97d0-53f1df230a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "ab96e253-e462-44ed-b5d9-1f77c8750bc9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:47.602896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-64ac4b18-39f1-448f-9b68-aeddd2532452 req-7aa57125-23cf-4dba-97d0-53f1df230a40 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.603641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-64ac4b18-39f1-448f-9b68-aeddd2532452 req-7aa57125-23cf-4dba-97d0-53f1df230a40 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.648601 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-64ac4b18-39f1-448f-9b68-aeddd2532452 req-7aa57125-23cf-4dba-97d0-53f1df230a40 service nova] Creating event network-changed:ab96e253-e462-44ed-b5d9-1f77c8750bc9 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:47.678214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-64ac4b18-39f1-448f-9b68-aeddd2532452 req-7aa57125-23cf-4dba-97d0-53f1df230a40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120004 Jul 20 04:39:47.696629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3028/4153] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:47.714613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:47.715605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:47.726547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.727398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:47.729938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:47.730690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.409134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.479931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.495313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:48.506394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79062c44-66aa-4b5f-a1ab-5bc74e706ef1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.806087 Jul 20 04:39:48.517527 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3029/4154] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:47 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:48.548832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:48.554105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:48.585598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.589273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.593729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:48.596719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:48.945887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lazy-loading 'services' on Instance uuid 1abeb4b9-6957-48ea-87f9-ef46fc67c93d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:49.220005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fddf0e04-2902-4cff-8ff0-5ac69c1a38f5 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d/os-volume_attachments/5584f01a-2e10-4fa4-89b7-93698e63bfec" status: 202 len: 0 microversion: 2.1 time: 0.700594 Jul 20 04:39:49.220639 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3030/4155] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:39:48 2022] DELETE /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d/os-volume_attachments/5584f01a-2e10-4fa4-89b7-93698e63bfec => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:39:49.231053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:49.246450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:49.278571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.279745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.288119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.288984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.319457 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 HTTP/1.1 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3a175cb7-41da-443e-9250-89fc41195b62'} Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:49.332676 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:39:49.338140 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:39:49.338140 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:39:49.338140 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:39:49.338140 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:39:49.338140 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:39:49.338140 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:39:49.341079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:39:49.342365 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a47a18ce-d4d0-4712-8323-db94f6f53e65 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 404 len: 111 microversion: 2.1 time: 0.120483 Jul 20 04:39:49.343603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3031/4156] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:49 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:39:49.348711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:49.349552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:49.371936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.373084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.380332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.381230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.769198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:49.789743 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36d45687-6d5b-4143-ab76-19ac57849f1e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.444728 Jul 20 04:39:49.794314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3032/4157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:49 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:49.804219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:49.805060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:49.820013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.821232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.823532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:49.825069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:49.867114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lazy-loading 'flavor' on Instance uuid 51930690-d603-42a9-a0b7-cbe01343dc93 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:39:50.111526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:50.428893 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f9a0d84-b843-4318-8448-487e9c416c31 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/action" status: 202 len: 0 microversion: 2.20 time: 0.632893 Jul 20 04:39:50.436958 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3033/4158] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:39:49 2022] POST /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:39:50.453077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8662d74d-9c31-4f0a-a088-b719e05cc1f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: .version_select at 0x7f838b0f4820>, body: {"keypair": {"name": "tempest-key-396942005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3oGKszQLiUgnxHN3fgf75pSPpnflzenZUlqitdjMazZvrzI/D4VGb8SjnyrlokouoxGOnD/ic1JpzwiBkTmNwBOF41ybS08w5cBo+Ad+fRFYvW4fV74NDLGlSCvFTIBQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:50.503788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8662d74d-9c31-4f0a-a088-b719e05cc1f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:50.516002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8662d74d-9c31-4f0a-a088-b719e05cc1f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:50.585716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8662d74d-9c31-4f0a-a088-b719e05cc1f9 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.146019 Jul 20 04:39:50.597094 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3034/4159] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:39:50 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:50.606896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:50.611163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:50.632302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.633206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:50.636879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:50.637722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.530780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:51.563091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:51.566249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:51.568502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e55a6dc-e33b-4a0d-a4f6-08990fa78cd0 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.969306 Jul 20 04:39:51.589668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3035/4160] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:50 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:51.619857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5f45ef70-4bc9-453f-adc3-5f4dc85a08f2 req-a6784ae6-5fb7-41d0-8dd7-4ca307a24019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "e39d80c0-e592-4c50-a7d6-f1e0c9a60503"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:51.651102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f45ef70-4bc9-453f-adc3-5f4dc85a08f2 req-a6784ae6-5fb7-41d0-8dd7-4ca307a24019 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.651102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f45ef70-4bc9-453f-adc3-5f4dc85a08f2 req-a6784ae6-5fb7-41d0-8dd7-4ca307a24019 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.683377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5f45ef70-4bc9-453f-adc3-5f4dc85a08f2 req-a6784ae6-5fb7-41d0-8dd7-4ca307a24019 service nova] Creating event network-changed:e39d80c0-e592-4c50-a7d6-f1e0c9a60503 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:39:51.690439 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5f45ef70-4bc9-453f-adc3-5f4dc85a08f2 req-a6784ae6-5fb7-41d0-8dd7-4ca307a24019 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098935 Jul 20 04:39:51.691658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3036/4161] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:51.698815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:51.699801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:51.708114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.708858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:51.709833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:51.710436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.177707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.188080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.193161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.201590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4280637c-5329-48ca-bb49-28ba8c596ede tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1724 microversion: 2.20 time: 0.508459 Jul 20 04:39:52.207085 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3037/4162] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:51 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1724 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:52.223369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f79788f9-6e03-409d-8063-8d9626e0b4d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '.version_select at 0x7f839ce60310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:52.231750 n-d-764486-11 devstack@n-api.service[123724]: WARNING oslo_db.sqlalchemy.utils [None req-f79788f9-6e03-409d-8063-8d9626e0b4d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 04:39:52.255427 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f79788f9-6e03-409d-8063-8d9626e0b4d7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.046928 Jul 20 04:39:52.256478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3038/4163] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:39:52 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:39:52.266458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:52.267814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:52.277546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:52.278006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.278851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:52.279300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:52.554238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:52.569536 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-481303ca-4581-4996-9f66-a25eeb6dad54 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.311543 Jul 20 04:39:52.580307 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3039/4164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:52 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:52.586605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1129788209", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-key-396942005", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:39:52.657552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:39:53.307879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:39:53.308803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:39:53.309510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:39:53.311059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:39:53.312388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:39:53.367860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.368685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.369782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.370407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.407112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:39:53.415521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:39:53.476381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:39:53.483314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:39:53.600145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5954c6e5-5614-4cc1-afd2-1071f40892dd tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.017847 Jul 20 04:39:53.605872 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3040/4165] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:39:53.605872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:53.606899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:53.612422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.612876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:53.613948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:53.614058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.340083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.352326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.359766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.366689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c930dd2-c1fa-47b0-bee7-6b8775fa1d98 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.764804 Jul 20 04:39:54.376705 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3041/4166] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:53 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:54.396391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:54.397628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:54.416437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.418617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.419660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.423324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.840962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.858518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.866614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:54.877064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ac5b393-aa75-4d9d-ab37-f8c228841801 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1724 microversion: 2.20 time: 0.498773 Jul 20 04:39:54.880909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3042/4167] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:54 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:54.897481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:54.900325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:54.937957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.938822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:54.939889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:54.941223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.520688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.531186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aab1cabe-6087-4265-9ec6-a0a414fd9c68 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.648949 Jul 20 04:39:55.534024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3043/4168] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:54 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:55.548831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.550337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.566238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.569833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.571092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.572799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.806363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:55.827967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e38405c-da84-48e6-b303-87233a3f9885 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1298 microversion: 2.1 time: 0.291192 Jul 20 04:39:55.829985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3044/4169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:55 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1298 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:55.846673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:55.851487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:55.868037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.869222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:55.870226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:55.870898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.774295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.818663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.826133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:56.829654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbe603b9-6d51-48b6-b81d-d1c2152e138d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.998206 Jul 20 04:39:56.861582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3045/4170] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:55 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:56.866592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:56.867182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:56.878694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.879490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:56.880503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:56.881118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.320380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.333395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.334884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.336086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec8a1181-78e3-4697-8d6f-cf69ba81e92a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1724 microversion: 2.20 time: 0.473503 Jul 20 04:39:57.344769 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3046/4171] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:56 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:57.350403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:57.351290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:57.370111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.370866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.371802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.372432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.679788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:57.709053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b72c5016-93c3-4ac7-b27d-1dcbf18e3926 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.353933 Jul 20 04:39:57.710084 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3047/4172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:57 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:57.724283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:57.725156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:57.735717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.742170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:57.743557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:57.744743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.340920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.350565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d805bbe-0146-4e6f-9252-693a0f57788b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1286 microversion: 2.1 time: 0.639175 Jul 20 04:39:58.357986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3048/4173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:57 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1286 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:39:58.363184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.367583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.375203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:39:58.385175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.386032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.391747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.392469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:58.935623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.946318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.947866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:58.949081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-201bb8c6-2c15-4e16-8af5-f6f097815fe8 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.589793 Jul 20 04:39:58.949654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3049/4174] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:58.977436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:58.978053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:58.989725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:58.990171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.001042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.001522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.660622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.673856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.679889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:39:59.681197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0eb63be5-be3a-4150-8fc9-ed4ea6f59a98 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1724 microversion: 2.20 time: 0.707710 Jul 20 04:39:59.681803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3050/4175] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:39:58 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1724 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:39:59.694507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:39:59.695530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:39:59.715252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.715954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:39:59.716985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:39:59.717617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.437882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:00.452885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-583cc18f-af19-42d6-8824-975198c4b110 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.769713 Jul 20 04:40:00.465417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3051/4176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:39:59 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:00.479909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:00.480575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:00.514965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.553756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:00.558998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:00.565208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.087334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:01.106204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da133939-2f15-468a-a4f9-0d62580fad51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1328 microversion: 2.1 time: 0.639457 Jul 20 04:40:01.107260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3052/4177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:00 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1328 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:01.125077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:01.125630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:01.156443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.157155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.159189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.160757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.256036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:40:01.259853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:01.455509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8cedaf2-a932-4fe4-954a-d1cd84941651 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 204 len: 0 microversion: 2.1 time: 0.345284 Jul 20 04:40:01.459844 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3053/4178] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:01 2022] DELETE /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:01.469086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:01.470397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:01.479059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.479856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:01.481114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:01.481850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.119410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.129756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.131672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.133599 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-133c04ea-bd96-4044-9887-cf79674b7d10 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1885 microversion: 2.42 time: 0.671926 Jul 20 04:40:02.134468 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3054/4179] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:01 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1885 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:02.161921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:02.163299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.176033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.176858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.178383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.179163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.421177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.432201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.435504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.436747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1985ee37-b19a-4caf-8f22-18c2c3113455 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1745 microversion: 2.20 time: 0.279947 Jul 20 04:40:02.443099 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3055/4180] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:02 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1745 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:02.455898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-894cf96c-626c-4dfa-a25c-a521ecf67076 req-852670cd-d7df-4c61-bb35-a4a7992cc720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e311fcde-fc48-4d7f-aaab-a95970ecfe43", "tag": "4c25d7e0-5745-4567-acfc-bdf501eb6331"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:02.474604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-894cf96c-626c-4dfa-a25c-a521ecf67076 req-852670cd-d7df-4c61-bb35-a4a7992cc720 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.475765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-894cf96c-626c-4dfa-a25c-a521ecf67076 req-852670cd-d7df-4c61-bb35-a4a7992cc720 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.492190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-894cf96c-626c-4dfa-a25c-a521ecf67076 req-852670cd-d7df-4c61-bb35-a4a7992cc720 service nova] Creating event network-changed:4c25d7e0-5745-4567-acfc-bdf501eb6331 for instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 on n-h1-764486-11 Jul 20 04:40:02.498744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-894cf96c-626c-4dfa-a25c-a521ecf67076 req-852670cd-d7df-4c61-bb35-a4a7992cc720 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052666 Jul 20 04:40:02.500118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3056/4181] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:02.508854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:02.510475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.518895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.520249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.520855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.521601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.727416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.764027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-923bcf4a-d923-4592-9e45-490661b2d8d1 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1513 microversion: 2.1 time: 0.261964 Jul 20 04:40:02.765707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3057/4182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:02 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:02.781470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:02.783168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.794683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.795328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.796410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.796919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.952737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:02.961788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ccf2f4b-84db-4185-9199-0fa5024adbcf tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1509 microversion: 2.1 time: 0.194299 Jul 20 04:40:02.962779 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3058/4183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:02 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:02.976951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:02.977737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:02.984210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.984920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:02.985707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:02.986116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.145547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.160515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-259a514d-2221-4851-9959-56bd2a961624 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1328 microversion: 2.1 time: 0.187173 Jul 20 04:40:03.161585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3059/4184] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:02 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1328 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:03.170298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.171213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.201345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.202001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.206105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.206581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.378690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:03.453047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:03.473252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.485169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.486911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:03.488116 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e94b3ee4-66e0-4a24-9a8e-20b2ddb6c5b1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.324498 Jul 20 04:40:03.489046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3060/4185] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:03.493907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1d92054a-37a3-4431-90f9-bea906eebeb3 req-fa3e516e-305e-41e8-9150-1026358dc29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "name": "network-vif-plugged", "status": "completed", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:03.505313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1d92054a-37a3-4431-90f9-bea906eebeb3 req-fa3e516e-305e-41e8-9150-1026358dc29e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.506025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1d92054a-37a3-4431-90f9-bea906eebeb3 req-fa3e516e-305e-41e8-9150-1026358dc29e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.519976 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1d92054a-37a3-4431-90f9-bea906eebeb3 req-fa3e516e-305e-41e8-9150-1026358dc29e service nova] Creating event network-vif-plugged:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h1-764486-11 Jul 20 04:40:03.525927 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1d92054a-37a3-4431-90f9-bea906eebeb3 req-fa3e516e-305e-41e8-9150-1026358dc29e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034959 Jul 20 04:40:03.527066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3061/4186] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:03.533233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:03.541797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:03.552282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.553039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.553894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:03.554369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:03.989708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.004289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.006137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.007328 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a8adada9-cd20-4a96-b6d1-1b8cbb46ec3b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1745 microversion: 2.20 time: 0.478997 Jul 20 04:40:04.007891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3062/4187] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:03 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1745 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:04.016065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:04.016914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.029736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.029919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.030602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.031073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.480591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:04.490322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-def95bf9-7a39-42cb-87ed-fcedd0538852 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1513 microversion: 2.1 time: 0.478359 Jul 20 04:40:04.493173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3063/4188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:04 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1513 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:04.500391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:04.507815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:04.517851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.518639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:04.520627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:04.521487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.176958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.191460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5540d46-2f26-4eeb-a76c-e1d0cdb295db tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1506 microversion: 2.1 time: 0.694872 Jul 20 04:40:05.192337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3064/4189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:04 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:05.199688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.201164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.210226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.210980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.212204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.212844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.409277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.422529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aaf9021c-00f0-4b0d-96f3-44e18dbc23e6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1328 microversion: 2.1 time: 0.227659 Jul 20 04:40:05.423712 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3065/4190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1328 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:05.436155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.436821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.455953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.456436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.457228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.460492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.734772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.751745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.753364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:05.758187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7413040-5678-4316-948f-1d8dfcb04e54 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.329846 Jul 20 04:40:05.761577 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3066/4191] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:05.767845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-05b45937-c00c-4b44-9acf-563b05e5840c req-b7edd0ac-5174-4470-bca2-9133bb57348f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abeb4b9-6957-48ea-87f9-ef46fc67c93d", "name": "network-vif-deleted", "tag": "9bbd9324-ebac-4358-be55-41a1e3b88e9c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:05.778372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-05b45937-c00c-4b44-9acf-563b05e5840c req-b7edd0ac-5174-4470-bca2-9133bb57348f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.778822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-05b45937-c00c-4b44-9acf-563b05e5840c req-b7edd0ac-5174-4470-bca2-9133bb57348f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.798797 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-05b45937-c00c-4b44-9acf-563b05e5840c req-b7edd0ac-5174-4470-bca2-9133bb57348f service nova] Creating event network-vif-deleted:9bbd9324-ebac-4358-be55-41a1e3b88e9c for instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d on n-h1-764486-11 Jul 20 04:40:05.806044 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-05b45937-c00c-4b44-9acf-563b05e5840c req-b7edd0ac-5174-4470-bca2-9133bb57348f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043110 Jul 20 04:40:05.807439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3067/4192] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:05.815628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:05.816809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:05.824890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.825620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:05.826731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:05.827366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.011711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.021344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.023292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.024711 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0eac34b2-b93d-47c8-9974-fc85fc2fc265 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.215351 Jul 20 04:40:06.026045 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3068/4193] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:05 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:06.030908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:06.031765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.038827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.039634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.040757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.041373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.139360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.142350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.143195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lazy-loading 'fault' on Instance uuid 1abeb4b9-6957-48ea-87f9-ef46fc67c93d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:06.219147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.228505 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf151dd2-3015-45de-ba06-59ae53509ca7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1308 microversion: 2.1 time: 0.200593 Jul 20 04:40:06.243272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3069/4194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:06 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:06.250003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:06.250907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.261792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.262480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.263434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.264036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.288221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:06.505006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.523904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54a1f8aa-6db3-4e2b-9af8-2728f43e0ffe tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1506 microversion: 2.1 time: 0.275289 Jul 20 04:40:06.535728 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3070/4195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:06 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:06.549005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:06.549633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.560790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.561542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.562940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.563719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.826277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:06.837623 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a729998c-bf58-4333-af0d-6f835c29be18 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1328 microversion: 2.1 time: 0.292243 Jul 20 04:40:06.838524 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3071/4196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:06 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1328 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:06.853077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:06.856164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:06.865816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.866581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:06.867591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:06.868245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.224665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.240547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.242635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.248479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f524443c-7c05-4336-9a30-c20912062303 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.407282 Jul 20 04:40:07.249652 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3072/4197] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:06 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:07.254745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.264262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.276725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.279508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.282468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.284427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.615494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.633340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.638812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.642271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3aeb4b26-733f-4769-b4b6-a05434cb148c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.391396 Jul 20 04:40:07.648522 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3073/4198] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:07.668657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.674901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.689807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.690264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.691062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.691499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.762175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.762889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.763926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lazy-loading 'fault' on Instance uuid 1abeb4b9-6957-48ea-87f9-ef46fc67c93d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:07.857965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:07.872555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62e5b336-1e19-4671-a78d-aedd2e12b8a4 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 200 len: 1308 microversion: 2.1 time: 0.205730 Jul 20 04:40:07.883095 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3074/4199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:07.889033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4f4f7819-2c70-4db4-8b1e-01402646c123 req-e9cad21b-bad0-4ffc-8a14-33ff5994a3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7", "name": "network-vif-unplugged", "status": "completed", "tag": "6be20eae-9e36-4a37-949e-1dd0b2336f0d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:07.898965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f4f7819-2c70-4db4-8b1e-01402646c123 req-e9cad21b-bad0-4ffc-8a14-33ff5994a3cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.900398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f4f7819-2c70-4db4-8b1e-01402646c123 req-e9cad21b-bad0-4ffc-8a14-33ff5994a3cf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.926422 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4f4f7819-2c70-4db4-8b1e-01402646c123 req-e9cad21b-bad0-4ffc-8a14-33ff5994a3cf service nova] Creating event network-vif-unplugged:6be20eae-9e36-4a37-949e-1dd0b2336f0d for instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 on n-h1-764486-11 Jul 20 04:40:07.944959 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4f4f7819-2c70-4db4-8b1e-01402646c123 req-e9cad21b-bad0-4ffc-8a14-33ff5994a3cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058635 Jul 20 04:40:07.945915 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3075/4200] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:07.955610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:07.957001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:07.972935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.974672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:07.976345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:07.978172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.337986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:08.357134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2b4d717-f6a9-44b6-96f7-6e3465c5b230 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1506 microversion: 2.1 time: 0.407154 Jul 20 04:40:08.357964 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3076/4201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:07 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:08.370340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.372871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:08.385994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.386746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.388992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.389788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.710220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:08.737992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f9033ed-3d20-4f2c-a6d4-70086b9c7528 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1328 microversion: 2.1 time: 0.378025 Jul 20 04:40:08.753003 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3077/4202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:08.760812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:08.763383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:08.778288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.779345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:08.780509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:08.781403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.132136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.144549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.146599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.147862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f68a0eb5-41b7-45f5-aebf-bbf25afe509d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.393692 Jul 20 04:40:09.148843 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3078/4203] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:08 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:09.153878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:09.154485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:09.164247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.164770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.165677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.166118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.421306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.435614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.438358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:09.442236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e006b32-18fe-4bb4-93c8-a8e888e1c1e2 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.290959 Jul 20 04:40:09.442863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3079/4204] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:09 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:09.456545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:09.458296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 1abeb4b9-6957-48ea-87f9-ef46fc67c93d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:09.474894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.475761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.476629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.477068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.515974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] HTTP exception thrown: Instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d could not be found. Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Request method failure captured: Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d HTTP/1.1 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14YmHgALtYUjMFQJmcU8xMo1Bme0A2oENQBPzfejtIsuYz1ayyfhAEzTHHKai36pm3H5gJWgbh9tCG8h1LUz-Jd1gDkF_ynQK-V7UQdtNKXOih1aZqnHrPTIrdEa11gs0Fj8dOqMR2URs-WEKdOk2td2eMsd2SwB8QROFR292VdZ5Jo Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d6a0c385f4394e8fa2398bd01c3d635f Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesSnapshotTestJSON-206892692 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6a0c385f4394e8fa2398bd01c3d635f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6a0c385f4394e8fa2398bd01c3d635f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6a0c385f4394e8fa2398bd01c3d635f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6a0c385f4394e8fa2398bd01c3d635f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesSnapshotTestJSON-206892692 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d6a0c385f4394e8fa2398bd01c3d635f Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-206892692 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesSnapshotTestJSON-206892692-project Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9e90538f47054eacb99903b93b6b1d15 Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesSnapshotTestJSON-206892692-project Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d could not be found. Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1abeb4b9-6957-48ea-87f9-ef46fc67c93d'} Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d could not be found. Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d could not be found. Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:09.523948 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d could not be found. Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Returning 404 to user: Instance 1abeb4b9-6957-48ea-87f9-ef46fc67c93d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c856d7e-2708-4d54-9a02-cb9db4c337f6 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d" status: 404 len: 111 microversion: 2.1 time: 0.088629 Jul 20 04:40:09.546014 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3080/4205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:09 2022] GET /compute/v2.1/servers/1abeb4b9-6957-48ea-87f9-ef46fc67c93d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:09.553457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:09.558386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:09.582440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.582440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:09.589353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:09.589807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.031220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.048682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c50c2919-315f-43c0-951a-a1629c095172 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 200 len: 1449 microversion: 2.1 time: 0.512938 Jul 20 04:40:10.050120 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3081/4206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:09 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 1449 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.065807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.066882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.079993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.081728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.083127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.085015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.422940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.432984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff91968c-8031-4a21-aff3-93f7b80cd47f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1328 microversion: 2.1 time: 0.381175 Jul 20 04:40:10.436225 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3082/4207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1328 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:10.445062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-098cc30e-7164-4f54-be71-f9d56253a6a8 req-f24417d8-6e77-4fea-9d25-a0b863ae5278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e311fcde-fc48-4d7f-aaab-a95970ecfe43", "name": "network-vif-plugged", "status": "completed", "tag": "4c25d7e0-5745-4567-acfc-bdf501eb6331"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:10.464180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-098cc30e-7164-4f54-be71-f9d56253a6a8 req-f24417d8-6e77-4fea-9d25-a0b863ae5278 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.466742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-098cc30e-7164-4f54-be71-f9d56253a6a8 req-f24417d8-6e77-4fea-9d25-a0b863ae5278 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.487298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-098cc30e-7164-4f54-be71-f9d56253a6a8 req-f24417d8-6e77-4fea-9d25-a0b863ae5278 service nova] Creating event network-vif-plugged:4c25d7e0-5745-4567-acfc-bdf501eb6331 for instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 on n-h1-764486-11 Jul 20 04:40:10.501524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-098cc30e-7164-4f54-be71-f9d56253a6a8 req-f24417d8-6e77-4fea-9d25-a0b863ae5278 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063519 Jul 20 04:40:10.501733 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3083/4208] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:10.558607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:10.559158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:10.583260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.583750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.584684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:10.596113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:10.978751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:10.997438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c63977ce-4459-46d8-aeb6-ecd9b51c9ade tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.487962 Jul 20 04:40:10.998453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3084/4209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:11.003623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.004600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.011666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.012459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.013519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.014398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.440393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.453754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.459413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.461144 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee8cd826-c241-412b-9d58-4a115549ce45 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.461382 Jul 20 04:40:11.466328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3085/4210] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:10 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:11.476811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.478265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.490048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.490772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.491802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.501736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.869805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.882140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.884100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:11.885647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42968c42-5ac1-463f-a1c9-e51d4622ea86 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.418049 Jul 20 04:40:11.887256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3086/4211] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:11.893745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:11.894753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:11.902876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.903601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:11.904803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:11.905472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.164325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.176013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a879cd4-7909-43a4-97aa-ecac56131475 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.287333 Jul 20 04:40:12.193451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3087/4212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:11 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:12.204231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:12.209354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:12.222187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.224866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.225621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.226068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.541824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:12.545783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:12.555115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31119d19-4642-4b19-a369-8bee10fb7aac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1509 microversion: 2.1 time: 0.359570 Jul 20 04:40:12.555657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3088/4213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:12 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:12.571985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:12.573603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:12.587653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.588094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:12.589295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:12.590059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.288460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:13.298560 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b29327d4-1b9b-41d0-a8a1-385543245b98 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.742218 Jul 20 04:40:13.303377 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3089/4214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:12 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:13.308674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.316341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.326728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.327430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.328425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.330626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.888088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:13.899229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:13.926374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:13.927925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01e544b8-36aa-443b-b3da-bed35c268675 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.623156 Jul 20 04:40:13.934619 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3090/4215] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:13.939826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:13.942144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:13.964506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.967569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:13.968927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:13.971030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.478802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.488274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ab918e0-5e8e-427b-bfec-bf20a07ca891 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1509 microversion: 2.1 time: 0.552349 Jul 20 04:40:14.489977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3091/4216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:13 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:14.496426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:14.497381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:14.504498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.505293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.506293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.506958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.857030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.879009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.893233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:14.894527 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38c534cc-6102-484b-b9e5-369527defdca tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.402792 Jul 20 04:40:14.909561 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3092/4217] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:14 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:14.920052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:14.931391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:14.942737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.943196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:14.943964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:14.944427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.172233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.190291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e38a4463-ecef-43de-a09f-43f249a07ec2 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.279187 Jul 20 04:40:15.191604 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3093/4218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:14 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:15.197194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:15.197962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:15.219297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:15.221172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.221870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.222812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.223429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.272115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:40:15.432152 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83be6751-299a-45c4-a554-b688cc8afbc6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 204 len: 0 microversion: 2.1 time: 0.238269 Jul 20 04:40:15.433098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3094/4219] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:15 2022] DELETE /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:15.438686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:15.439392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:15.447328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.447781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.448904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.449434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:15.918505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.939670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.947828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:15.950401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0439f39d-57a3-47a9-9825-98f8daffc638 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.515922 Jul 20 04:40:15.952642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3095/4220] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:15 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:15.958307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-789a34e1-3fcd-469c-b71e-6ef08fe9b905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:15.978205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789a34e1-3fcd-469c-b71e-6ef08fe9b905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:15.982287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789a34e1-3fcd-469c-b71e-6ef08fe9b905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.034530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-789a34e1-3fcd-469c-b71e-6ef08fe9b905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:40:16.118845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-789a34e1-3fcd-469c-b71e-6ef08fe9b905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.160732 Jul 20 04:40:16.120289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3096/4221] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:15 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:16.146920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:16.148106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.170224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.170380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.171120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.173787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.671117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:16.680233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a0ad74e-b723-40c5-99fb-a3410441e11c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1515 microversion: 2.1 time: 0.546552 Jul 20 04:40:16.681443 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3097/4222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:16 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:16.695422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:16.696049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:16.711400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.711854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:16.712682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:16.713122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.001391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.072790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.082545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.107603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46eaa9f8-58a0-4404-8209-a4143656b1ec tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.422705 Jul 20 04:40:17.115384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3098/4223] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:16 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:17.131048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.133696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.140890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.141434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.142375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.142946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.387965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:17.398656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e901186-8fd5-4c61-b8b4-3e6969f9f730 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.280632 Jul 20 04:40:17.400949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3099/4224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:17.435658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:17.436145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:17.456888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.457356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:17.458258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:17.458704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.313961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.324844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.330129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.334092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc76dd4a-bc28-4149-97f6-bc801d07149a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.931329 Jul 20 04:40:18.355690 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3100/4225] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:17 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:18.363226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:18.364089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:18.377707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.379876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.380707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.383735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.445467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.446101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.446722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lazy-loading 'fault' on Instance uuid e311fcde-fc48-4d7f-aaab-a95970ecfe43 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:18.602850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:18.615680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae7e0194-27ec-4351-8bab-8fd86ca8b127 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 200 len: 1318 microversion: 2.1 time: 0.258541 Jul 20 04:40:18.628802 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3101/4226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:18 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:18.628802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f1f7be27-6bc0-497e-95ee-30de21e67d29 req-e66e3cd7-8de2-46f3-94c7-cee30249b082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e311fcde-fc48-4d7f-aaab-a95970ecfe43", "name": "network-vif-deleted", "tag": "4c25d7e0-5745-4567-acfc-bdf501eb6331"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:18.647201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f1f7be27-6bc0-497e-95ee-30de21e67d29 req-e66e3cd7-8de2-46f3-94c7-cee30249b082 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.647653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f1f7be27-6bc0-497e-95ee-30de21e67d29 req-e66e3cd7-8de2-46f3-94c7-cee30249b082 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.663617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f1f7be27-6bc0-497e-95ee-30de21e67d29 req-e66e3cd7-8de2-46f3-94c7-cee30249b082 service nova] Creating event network-vif-deleted:4c25d7e0-5745-4567-acfc-bdf501eb6331 for instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 on n-h1-764486-11 Jul 20 04:40:18.670037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f1f7be27-6bc0-497e-95ee-30de21e67d29 req-e66e3cd7-8de2-46f3-94c7-cee30249b082 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047403 Jul 20 04:40:18.672298 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3102/4227] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:18.680345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:18.681099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:18.690127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.694897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.700854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:18.702901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:18.710152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:19.037433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:19.052272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:19.056458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:19.061187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9fbfc15-3878-48f6-817f-ab131521ebba tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.384208 Jul 20 04:40:19.062236 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3103/4228] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:18 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:19.074070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:19.074915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:19.089023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.091794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.093196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.093811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.443336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:19.475940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b8414cf-6052-46d7-ba53-a616fa515e7e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.412320 Jul 20 04:40:19.477864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3104/4229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:19 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:19.485654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:19.486684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:19.494235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.494975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:19.495980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:19.496734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.004169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.017509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.019194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.025274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f99f56bd-422a-40c4-9851-750f5458f247 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.542792 Jul 20 04:40:20.036344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3105/4230] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:19 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:20.044537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.045813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.062560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.063258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.064288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.064959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.082405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 HTTP/1.1 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e311fcde-fc48-4d7f-aaab-a95970ecfe43'} Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.084542 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:40:20.094834 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:40:20.094834 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:40:20.094834 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:40:20.094834 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:40:20.094834 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:40:20.094834 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:40:20.099343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:40:20.100590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be30deb7-2f36-46ee-a377-074c455d924f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 404 len: 111 microversion: 2.1 time: 0.060646 Jul 20 04:40:20.101376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3106/4231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:40:20.110291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.111240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.117616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.119671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.120743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.121430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.534100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.548866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.556035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:20.558636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9cca76cf-5a07-4b9e-b2be-9b3de91abb7e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.452587 Jul 20 04:40:20.578112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3107/4232] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:20.578112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9740d08e-5690-462b-8050-edc4df0b4f81 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '.version_select at 0x7f838a1f4dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.623574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9740d08e-5690-462b-8050-edc4df0b4f81 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-key-396942005" status: 202 len: 0 microversion: 2.1 time: 0.057390 Jul 20 04:40:20.641611 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3108/4233] 10.222.0.49 () {58 vars in 1205 bytes} [Wed Jul 20 04:40:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-396942005 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:20.669006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:20.669876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:20.683868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.687615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:20.690191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:20.690905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.042311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:21.052033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3914ed0d-bb30-422d-99d8-4278c618a0a8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.399271 Jul 20 04:40:21.067541 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3109/4234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:20 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:21.075306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1723865308", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:21.142201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:21.836148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:21.837528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:21.838104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:21.838528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:21.839037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:21.862023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.868643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.869605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:21.877421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:21.922808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:21.935315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:21.966751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:21.981151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:22.135091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6365c489-08d0-484b-8e6c-49123f425676 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066005 Jul 20 04:40:22.136162 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3110/4235] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:22.147285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2036611912", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "f1b7c130-08ff-4ac9-aa1e-8f8cc2b73300"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:22.240602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] validate_networks() for [('f1b7c130-08ff-4ac9-aa1e-8f8cc2b73300', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:22.786146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:22.786480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:22.787158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:22.787753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:22.788326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:22.802123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.802823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.803791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:22.804411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:22.855175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Getting quotas for project d6a0c385f4394e8fa2398bd01c3d635f. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:22.888598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Getting quotas for user 9e90538f47054eacb99903b93b6b1d15 and project d6a0c385f4394e8fa2398bd01c3d635f. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:22.924025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:22.928004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:23.015663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ffe86f92-702f-4568-9e70-bdb2ad0f423d tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878274 Jul 20 04:40:23.016765 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3111/4236] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:23.035549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.038376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.051148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.052956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.055948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.057025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.496301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.535845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.540320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:23.546476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5801d10-9dab-4610-91b2-15cf84fe3088 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.528336 Jul 20 04:40:23.553564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3112/4237] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:23.572823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:23.579306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:23.592731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.593617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:23.594628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:23.595336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.113441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.124620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.134773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:24.139622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4ea4a68-067a-4a3d-a8bd-369adc0c872f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1740 microversion: 2.20 time: 0.580250 Jul 20 04:40:24.140582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3113/4238] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:23 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1740 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:24.145359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:24.145964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:24.189228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.193692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:24.205021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:24.206012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.021804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.030704 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a8c98cac-104d-43d1-bc77-23b77dac1cb1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.889014 Jul 20 04:40:25.031376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3114/4239] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:24 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:25.038180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.039171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.051347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.052107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.054149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.062163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.662615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.689525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e61df711-ba33-49ac-ab67-1a50659166a5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.656668 Jul 20 04:40:25.699864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3115/4240] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:25.707156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.708323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.721659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.722239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.723337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.723912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.859669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:25.873625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8107ab80-da27-4c99-9673-39d32bfbda13 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1277 microversion: 2.1 time: 0.172164 Jul 20 04:40:25.874238 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3116/4241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:25.882894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:25.887367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:25.911789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.912264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:25.916714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:25.919559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.457228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.486870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.489097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:26.490734 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89c34b87-3f81-4408-b7ec-9b05daf5c433 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.615547 Jul 20 04:40:26.491989 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3117/4242] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:25 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:26.500936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:26.502455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:26.510700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.511960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.513214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:26.514044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:26.994211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.005760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.009395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.010874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1bf48f9-d883-4531-a56e-b314f11a93bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1722 microversion: 2.20 time: 0.515530 Jul 20 04:40:27.012134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3118/4243] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:26 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:27.018583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.019598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.028522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.029547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.030771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.031427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.373922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.383653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6abcf615-8b8d-4291-9e49-92bb96a7496f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.369535 Jul 20 04:40:27.384221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3119/4244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:27.545599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-60b6beaa-1a66-4c88-a82a-a922568b28e9 req-6be32d15-f452-4271-9d18-66fde4a10aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5606b7c0-92ec-48cb-9ce5-2e206b08f84e", "tag": "0ed8fd13-7810-423d-abe9-35828be346be"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:27.558380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-60b6beaa-1a66-4c88-a82a-a922568b28e9 req-6be32d15-f452-4271-9d18-66fde4a10aa1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.558835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-60b6beaa-1a66-4c88-a82a-a922568b28e9 req-6be32d15-f452-4271-9d18-66fde4a10aa1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.571578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-60b6beaa-1a66-4c88-a82a-a922568b28e9 req-6be32d15-f452-4271-9d18-66fde4a10aa1 service nova] Creating event network-changed:0ed8fd13-7810-423d-abe9-35828be346be for instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e on n-h1-764486-11 Jul 20 04:40:27.578159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-60b6beaa-1a66-4c88-a82a-a922568b28e9 req-6be32d15-f452-4271-9d18-66fde4a10aa1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192289 Jul 20 04:40:27.578819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3120/4245] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:27.587809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.588669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.595666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.596129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.597016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.597458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.817384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:27.827962 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-200755da-67fc-4097-84f2-f83025818e64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.247335 Jul 20 04:40:27.838069 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3121/4246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:27.844558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:27.846433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:27.854455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.854912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:27.856027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:27.856645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.269233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:28.278459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3371965e-50a2-4120-81f2-826821236484 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1319 microversion: 2.1 time: 0.438860 Jul 20 04:40:28.279373 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3122/4247] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:27 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:28.284608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:28.285450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:28.292703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.293549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.295320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:28.295717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:28.317642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:29.088823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.099540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.101088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.102257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a265f708-108c-47e0-b315-b021aea52e5a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.821712 Jul 20 04:40:29.104697 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3123/4248] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:28 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:29.114489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.115098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.122170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.122931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.123783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.124402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.506651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.527349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.529569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.531592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1f76d84-ae1d-48a7-80d1-a4ede14fe001 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1665 microversion: 2.20 time: 0.427364 Jul 20 04:40:29.533056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3124/4249] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1665 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:29.540080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.541360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.548741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:29.561605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.562161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.564250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.565728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.958811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:29.974748 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e52cfc24-be11-4ac7-99d1-eadb4de9724c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.440266 Jul 20 04:40:29.975347 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3125/4250] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:29.982985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:29.983654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:29.993837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.994214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:29.995080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:29.995604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.232861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.240876 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78784b3a-6f33-4fc5-92b6-9c5cfeb12f3b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.264427 Jul 20 04:40:30.241573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3126/4251] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:29 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:30.246456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.247440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.254536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.255101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.256036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.256615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.473407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:30.483270 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d945c036-4b16-41b6-8376-8d71b27b6051 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1319 microversion: 2.1 time: 0.240411 Jul 20 04:40:30.483981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3127/4252] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:30.489738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b355a625-04e5-4431-bc86-ad60034d8c86"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:30.491455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.499789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.500252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.501097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.501533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.841255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d5a0cef-95a6-4ac7-86b1-b0db25ca9a8c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.355176 Jul 20 04:40:30.842519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3128/4253] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Jul 20 04:40:30 2022] POST /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-volume_attachments => generated 188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:40:30.848285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1f3efcd9-182f-40c4-8e24-8d7bd7706859 req-d75dd35c-6b95-4598-a08d-85ce724dc6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "name": "network-vif-unplugged", "status": "completed", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:30.864257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1f3efcd9-182f-40c4-8e24-8d7bd7706859 req-d75dd35c-6b95-4598-a08d-85ce724dc6d8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.864818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1f3efcd9-182f-40c4-8e24-8d7bd7706859 req-d75dd35c-6b95-4598-a08d-85ce724dc6d8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.879215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_external_events [req-1f3efcd9-182f-40c4-8e24-8d7bd7706859 req-d75dd35c-6b95-4598-a08d-85ce724dc6d8 service nova] Unable to find a host for instance 51930690-d603-42a9-a0b7-cbe01343dc93. Dropping event network-vif-unplugged {{(pid=123724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:40:30.880723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1f3efcd9-182f-40c4-8e24-8d7bd7706859 req-d75dd35c-6b95-4598-a08d-85ce724dc6d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036941 Jul 20 04:40:30.881798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3129/4254] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:40:30.887512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-648fd7f3-c497-4115-b7d4-6deeb12a7215 req-e90192aa-2621-4be5-94fd-394e8b88df11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88af1bc3-6cee-4077-b5e8-8f477136b9dd", "tag": "a691c8ef-0af6-43c3-ad6b-98f74e4d0fcc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:30.897767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-648fd7f3-c497-4115-b7d4-6deeb12a7215 req-e90192aa-2621-4be5-94fd-394e8b88df11 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.898215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-648fd7f3-c497-4115-b7d4-6deeb12a7215 req-e90192aa-2621-4be5-94fd-394e8b88df11 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.910428 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-648fd7f3-c497-4115-b7d4-6deeb12a7215 req-e90192aa-2621-4be5-94fd-394e8b88df11 service nova] Creating event network-changed:a691c8ef-0af6-43c3-ad6b-98f74e4d0fcc for instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd on n-h1-764486-11 Jul 20 04:40:30.917099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-648fd7f3-c497-4115-b7d4-6deeb12a7215 req-e90192aa-2621-4be5-94fd-394e8b88df11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034053 Jul 20 04:40:30.918732 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3130/4255] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:30.925418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:30.926894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:30.939272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.939534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:30.940296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:30.940919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.155251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.166763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.168281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.169473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-254f3f3f-2a9a-4ec3-a5c5-54cff624df34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.249721 Jul 20 04:40:31.170041 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3131/4256] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:30 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:31.174560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.175161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.181326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.182304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.183268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.183896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.362920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:31.373867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b563a765-eacc-4e09-83b1-176a71f50916 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.202187 Jul 20 04:40:31.377942 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3132/4257] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:31.387595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.388975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.399223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.399969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.400960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.402074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.792322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a4e5e49-ffd3-442b-b53b-fc896db78e4f tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-volume_attachments/b355a625-04e5-4431-bc86-ad60034d8c86" status: 202 len: 0 microversion: 2.20 time: 0.412737 Jul 20 04:40:31.793183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3133/4258] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Jul 20 04:40:31 2022] DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-volume_attachments/b355a625-04e5-4431-bc86-ad60034d8c86 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:31.816511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:31.817247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:31.837180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.843543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:31.846938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:31.849279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.069690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.077598 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04cf7d4a-844a-49cb-af00-ba65ad32ae2a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.283228 Jul 20 04:40:32.078200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3134/4259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:31 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:32.095252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.095881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.116720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.117390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.118197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.118969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.306498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.317251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d193cbc-74e1-4333-b3a2-88d3803ba56a tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1319 microversion: 2.1 time: 0.225457 Jul 20 04:40:32.318036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3135/4260] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:32.323541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:32.332434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.343049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.343906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.345122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.345726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.375216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:32.482759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba854ab5-7d72-4e1b-ba0f-1865a7c8ea52 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "POST /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/action" status: 202 len: 0 microversion: 2.20 time: 0.163286 Jul 20 04:40:32.483403 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3136/4261] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jul 20 04:40:32 2022] POST /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:40:32.490828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.491440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.504743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.505453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.506571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.507316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.819403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:32.869011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.892379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.894902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:32.899713 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf45f192-6245-4288-a293-3b7ee5411fdf tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.414619 Jul 20 04:40:32.913172 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3137/4262] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:32.921539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:32.922447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:32.928648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:32.932759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.933917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:32.935310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:32.935975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.280119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.288618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01446531-8ecb-47db-808e-15054f4b7c1f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.373347 Jul 20 04:40:33.289235 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3138/4263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:32 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:33.303355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.303974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.310602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.311296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.312252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.312877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.621069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.638736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.650157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.652244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a565c1a-b5b8-4f3c-84c4-3ba8a1e54ccc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1673 microversion: 2.20 time: 0.360131 Jul 20 04:40:33.656398 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3139/4264] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:33.667751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d4b47924-e34a-4b99-bc9e-74416c3ab381 req-b902a3f1-01c1-4c08-b827-ca0da3c26b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "75a5af4e-82a6-4b12-957a-046b8af7dc3d"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "a3d8da46-0316-4823-9384-cf6668ebebab"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:33.689878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d4b47924-e34a-4b99-bc9e-74416c3ab381 req-b902a3f1-01c1-4c08-b827-ca0da3c26b69 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.690324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d4b47924-e34a-4b99-bc9e-74416c3ab381 req-b902a3f1-01c1-4c08-b827-ca0da3c26b69 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.715773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d4b47924-e34a-4b99-bc9e-74416c3ab381 req-b902a3f1-01c1-4c08-b827-ca0da3c26b69 service nova] Creating event network-vif-plugged:75a5af4e-82a6-4b12-957a-046b8af7dc3d for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:33.716206 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d4b47924-e34a-4b99-bc9e-74416c3ab381 req-b902a3f1-01c1-4c08-b827-ca0da3c26b69 service nova] Creating event network-vif-plugged:a3d8da46-0316-4823-9384-cf6668ebebab for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:33.732031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d4b47924-e34a-4b99-bc9e-74416c3ab381 req-b902a3f1-01c1-4c08-b827-ca0da3c26b69 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074046 Jul 20 04:40:33.732668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3140/4265] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:33.747315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:33.749842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:33.759241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.759923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.760988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:33.762001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:33.972095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:33.981678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81c98b88-f999-46df-ab76-cf795762c841 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.244331 Jul 20 04:40:33.996044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3141/4266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:34.001542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.003055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.013243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.013759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.014909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.015985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.379668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.388324 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15ef2b68-e208-4dac-aa93-bcef7c5fe99e tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1319 microversion: 2.1 time: 0.390732 Jul 20 04:40:34.389203 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3142/4267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:33 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:34.402080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.403056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.411175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.411772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.412708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.413269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.769282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.782113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.783552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:34.785734 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20979e5c-adac-4672-b4d9-718b23eee655 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.394332 Jul 20 04:40:34.786323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3143/4268] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:34 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:34.802803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:34.803792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:34.811558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.812437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:34.813597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:34.814326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.477463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.508935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9028b5e-c0e8-4789-82d8-07af15de5dcc tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1679 microversion: 2.1 time: 0.721259 Jul 20 04:40:35.509510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3144/4269] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:34 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1679 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:35.526956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:35.528237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:35.542991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.543781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.544977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:35.545779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:35.958763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.982165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.983707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:35.990774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f19279ba-db69-4e00-a33a-efa4f2e8703b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.477539 Jul 20 04:40:35.991407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3145/4270] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:36.006482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.012657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.029732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.030642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.031709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.034102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.372963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.396983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2f11188-d822-43d9-9e27-013d4b8265b5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.404469 Jul 20 04:40:36.397778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3146/4271] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:35 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:36.407354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.408382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.418284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.419015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.420055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.420786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.703309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:36.711904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac212fff-3562-4c72-9c40-ffde0ced16fb tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1319 microversion: 2.1 time: 0.312070 Jul 20 04:40:36.713285 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3147/4272] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:36 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:36.719021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "ab96e253-e462-44ed-b5d9-1f77c8750bc9"}, {"server_uuid": "5606b7c0-92ec-48cb-9ce5-2e206b08f84e", "name": "network-vif-plugged", "status": "completed", "tag": "0ed8fd13-7810-423d-abe9-35828be346be"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "77fc1372-a850-48e8-9faa-d9368e1c1727"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "20c95765-ee3c-4e38-9205-ccc73ae4a263"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-plugged", "status": "completed", "tag": "e39d80c0-e592-4c50-a7d6-f1e0c9a60503"}, {"server_uuid": "88af1bc3-6cee-4077-b5e8-8f477136b9dd", "name": "network-vif-plugged", "status": "completed", "tag": "a691c8ef-0af6-43c3-ad6b-98f74e4d0fcc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:36.740402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.741276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.781220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:36.781738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:ab96e253-e462-44ed-b5d9-1f77c8750bc9 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:36.782273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:0ed8fd13-7810-423d-abe9-35828be346be for instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e on n-h1-764486-11 Jul 20 04:40:36.788645 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:77fc1372-a850-48e8-9faa-d9368e1c1727 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:36.789490 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:20c95765-ee3c-4e38-9205-ccc73ae4a263 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:36.792372 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:e39d80c0-e592-4c50-a7d6-f1e0c9a60503 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:36.793090 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] Creating event network-vif-plugged:a691c8ef-0af6-43c3-ad6b-98f74e4d0fcc for instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd on n-h1-764486-11 Jul 20 04:40:36.810515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a9e0fcd8-8046-448e-8de2-98f07f50f706 req-a2e071d2-7b53-459d-88fd-c44b00e11de3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.095796 Jul 20 04:40:36.811853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3148/4273] 10.222.0.49 () {64 vars in 1318 bytes} [Wed Jul 20 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:36.818601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:36.819559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:36.827159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.827906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:36.828939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:36.829566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.256501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.271555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.273205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.275014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3db0eb7-1fac-4bba-94df-0b4b56300e8a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.461141 Jul 20 04:40:37.286623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3149/4274] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:36 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:37.291771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6fdea4e1-a509-4aec-92fb-f79c8c008571 req-0cd7b81d-c6f1-45f7-ab98-8e762dfb87c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:37.300558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6fdea4e1-a509-4aec-92fb-f79c8c008571 req-0cd7b81d-c6f1-45f7-ab98-8e762dfb87c6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.300959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6fdea4e1-a509-4aec-92fb-f79c8c008571 req-0cd7b81d-c6f1-45f7-ab98-8e762dfb87c6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.315533 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6fdea4e1-a509-4aec-92fb-f79c8c008571 req-0cd7b81d-c6f1-45f7-ab98-8e762dfb87c6 service nova] Creating event network-changed:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h2-764486-11 Jul 20 04:40:37.321991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6fdea4e1-a509-4aec-92fb-f79c8c008571 req-0cd7b81d-c6f1-45f7-ab98-8e762dfb87c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033832 Jul 20 04:40:37.323026 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3150/4275] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:37.327938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.328668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.335439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.336518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.337775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.338373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.785076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:37.795145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c32cd809-385c-48d1-b7a8-93c5ff73ab2e tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1656 microversion: 2.1 time: 0.471097 Jul 20 04:40:37.799206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3151/4276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1656 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:37.804245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:37.810061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:37.831737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.834269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:37.835403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:37.837792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.145773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.170976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.172865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.176637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f0f52f0-50b0-4e26-bf59-d4d86bd2204b tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.374793 Jul 20 04:40:38.178227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3152/4277] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:37 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:38.194076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:38.197687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:38.216088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.217301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.219407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.220325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.670805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:38.687665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6c85428-7a24-4232-b0f0-158f2c495490 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1309 microversion: 2.1 time: 0.504085 Jul 20 04:40:38.689654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3153/4278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:38 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:38.701217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:38.702984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:38.709813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.710357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.711818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:38.712308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:38.795274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:39.080934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.094333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d9fa2af-f7c5-4065-82fa-567f0c0572e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1508 microversion: 2.1 time: 0.403119 Jul 20 04:40:39.106876 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3154/4279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:38 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:39.110512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c39a90db-d1ba-4692-aba9-4f37b515b41a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:39.119214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c39a90db-d1ba-4692-aba9-4f37b515b41a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.120793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c39a90db-d1ba-4692-aba9-4f37b515b41a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.190301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c39a90db-d1ba-4692-aba9-4f37b515b41a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 04:40:39.301163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c39a90db-d1ba-4692-aba9-4f37b515b41a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.195114 Jul 20 04:40:39.304178 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3155/4280] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:39 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:39.319998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:39.321194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.337505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.340457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.341867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.342494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.715051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.725694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.728730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:39.740095 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad4ce067-c431-4e42-bff5-493368fca8d4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1873 microversion: 2.42 time: 0.433036 Jul 20 04:40:39.761308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3156/4281] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:39 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1873 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:39.768724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97b3ee2b-5bba-426a-b144-e897caf4a6ba", "device": "/dev/sdb"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:39.770076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:39.797184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.798956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:39.800534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:39.801751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.221568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59ebc096-e267-4a90-9960-e38d89242654 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "POST /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458088 Jul 20 04:40:40.222458 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3157/4282] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:40:39 2022] POST /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:40.251677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.253135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.266376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.267166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.268448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.269616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.608226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.623555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.627811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:40.633505 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eced7bd6-72b4-4a62-9bfd-5a6df32384e6 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.404682 Jul 20 04:40:40.653831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3158/4283] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:40.658825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:40.662700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:40.679766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.680216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:40.683693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:40.684199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.017493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.027695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b846cf66-c067-43b9-b54f-bdbbd4a6f5d1 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1665 microversion: 2.1 time: 0.372773 Jul 20 04:40:41.029941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3159/4284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:40 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1665 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:41.034874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.035719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.043471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.045858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.047643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.048411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.346950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.369539 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90664580-cc7c-4342-9819-10c6b172cef8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1491 microversion: 2.1 time: 0.338130 Jul 20 04:40:41.371324 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3160/4285] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1491 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:41.383619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:41.383619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:41.399762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.401438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.406381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:41.407156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:41.813486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.829001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.830718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:41.832342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09fdbd21-2377-4555-a6d1-22e3656ab712 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2831 microversion: 2.42 time: 0.459505 Jul 20 04:40:41.833930 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3161/4286] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:41 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2831 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:41.840488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1723865308", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:41.968016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:40:43.394215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:40:43.395351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:40:43.395351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:40:43.395695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:40:43.395889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:40:43.412960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.416737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.417898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.423034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.448183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:40:43.454548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:40:43.483155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:40:43.485874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:40:43.590691 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fca73bca-566f-4299-9995-0a5d95661e25 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755293 Jul 20 04:40:43.595800 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3162/4287] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:40:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:40:43.615382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:43.619986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:43.634982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.635655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:43.637356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:43.645577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.194856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.213509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.219370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:44.229993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-429d166f-ebee-4c26-a44e-6e78cdb9cbae tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.624949 Jul 20 04:40:44.232602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3163/4288] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:43 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:44.247784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.249754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.272129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.275498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.278317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.279312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.762274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-619ba222-ca1a-4d92-bda2-f2d177282c76 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.527652 Jul 20 04:40:44.772134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3164/4289] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3/os-interface => generated 1831 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:44.803889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:44.811776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:44.842234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.846984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:44.855181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:44.855661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.440948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.449798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5c9f525-7d2a-46f0-b73a-dc7a79612392 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.675395 Jul 20 04:40:45.452572 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3165/4290] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:44 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.459325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.489251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.506436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.509465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.514076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:45.514991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:45.953688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:45.962410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b3bd28c-dd21-4413-9324-49b10cbba043 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1213 microversion: 2.1 time: 0.506846 Jul 20 04:40:45.972131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3166/4291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1213 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:45.978119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:45.978968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:45.987008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:46.025765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.026585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.027597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.028233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.332659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.342332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.348664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:46.353474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1daf8d03-3fb3-4dbd-9e0f-4388c8ba07bb tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.379719 Jul 20 04:40:46.365056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3167/4292] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:45 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:46.370107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:46.370832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:46.382987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.383573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:46.384747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:46.385272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.213141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:47.222788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-569fb495-be6b-4675-a3be-dbaa07cea0d7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.856427 Jul 20 04:40:47.230620 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3168/4293] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:46 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.235880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.240112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:47.253626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.256682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.259308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.260077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.325488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:47.507538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:47.537919 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a355497-5653-4dd0-888d-c7007e83f3ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1261 microversion: 2.1 time: 0.305768 Jul 20 04:40:47.543223 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3169/4294] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1261 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:47.566683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:47.568821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:47.595092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.597374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:47.601749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:47.603320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.063172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.075904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e9de20f-71ed-4077-b880-5164f1df1828 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.530642 Jul 20 04:40:48.084626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3170/4295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:47 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:48.097035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.097035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.132121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.136452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.137616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.138211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.821931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.832693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.834303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:48.836878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ada31ab7-7ecc-455b-aade-0afc6299c5ac tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.750903 Jul 20 04:40:48.850522 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3171/4296] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:48.850522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:48.850522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:48.855281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.856548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:48.857718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:48.858305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.831131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:49.849313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afc579f2-1d8b-4ffd-bacc-acabb3ef416b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 1.009877 Jul 20 04:40:49.850625 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3172/4297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:48 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:49.866146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:49.867133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:49.885643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.886435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:49.887422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:49.888035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.010664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:50.022439 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f5b279d-47d1-4adf-be39-1b810adc96b2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1267 microversion: 2.1 time: 0.170376 Jul 20 04:40:50.028333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3173/4298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:49 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:50.038865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bdb99175-0e7b-4122-a838-e4cc69d77dad req-795e1a02-2261-4d2b-9753-68d1900fcc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "tag": "4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:50.060248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bdb99175-0e7b-4122-a838-e4cc69d77dad req-795e1a02-2261-4d2b-9753-68d1900fcc0f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.063999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bdb99175-0e7b-4122-a838-e4cc69d77dad req-795e1a02-2261-4d2b-9753-68d1900fcc0f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.101270 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bdb99175-0e7b-4122-a838-e4cc69d77dad req-795e1a02-2261-4d2b-9753-68d1900fcc0f service nova] Creating event network-changed:4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:40:50.110138 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bdb99175-0e7b-4122-a838-e4cc69d77dad req-795e1a02-2261-4d2b-9753-68d1900fcc0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080247 Jul 20 04:40:50.112234 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3174/4299] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:50.122904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:50.124732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:50.157882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.158496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:50.159444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:50.160079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.165205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.175907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.177557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.179218 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d48dc3b7-5570-4af6-9034-7a5ffc0d5430 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 1.065557 Jul 20 04:40:51.191570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3175/4300] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:50 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:51.197722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:51.198681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.205443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.206167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.207045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.207518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.705974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:51.717189 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-153aeaef-5416-4446-ad99-5acc2434ebe5 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.524113 Jul 20 04:40:51.717875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3176/4301] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:51 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:51.722690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:51.733270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:51.741735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.741735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:51.748878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:51.749705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.233122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.242142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4b72970-7100-4198-b2c0-e8526701a0bb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1309 microversion: 2.1 time: 0.523019 Jul 20 04:40:52.243971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3177/4302] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:51 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:52.255248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c6576283-a4f7-43ae-b3b9-e3668441b9c8 req-ebe2ec72-c0fa-4614-8d95-24854414f375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7969f36-6883-463c-9528-32e9d6fd120c", "tag": "763006ad-ac4e-4e19-ab41-3b1317c88667"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:52.264908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c6576283-a4f7-43ae-b3b9-e3668441b9c8 req-ebe2ec72-c0fa-4614-8d95-24854414f375 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.265496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c6576283-a4f7-43ae-b3b9-e3668441b9c8 req-ebe2ec72-c0fa-4614-8d95-24854414f375 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.287833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c6576283-a4f7-43ae-b3b9-e3668441b9c8 req-ebe2ec72-c0fa-4614-8d95-24854414f375 service nova] Creating event network-changed:763006ad-ac4e-4e19-ab41-3b1317c88667 for instance a7969f36-6883-463c-9528-32e9d6fd120c on n-h2-764486-11 Jul 20 04:40:52.293164 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c6576283-a4f7-43ae-b3b9-e3668441b9c8 req-ebe2ec72-c0fa-4614-8d95-24854414f375 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047478 Jul 20 04:40:52.294101 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3178/4303] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:52.299889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:52.300611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.307416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.307867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.309155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.309155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.337165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lazy-loading 'flavor' on Instance uuid 0574120e-c5ec-4131-9fd9-def29f85a93a {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:40:52.408583 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3da25691-dadc-4611-a4df-65a858734eda tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.112884 Jul 20 04:40:52.412324 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3179/4304] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:52 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:52.416079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:52.416897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.423534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.424102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.424904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.425338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.708196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.717272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.719390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:52.720659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-782aca68-3efa-41ee-b0e9-82f604cb6099 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.309899 Jul 20 04:40:52.721227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3180/4305] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:52 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:52.726951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:52.727567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:52.734050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.734416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:52.735194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:52.735629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.079646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:53.091177 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9612f6f9-65a0-49d5-aea7-be9f3de3532c tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1677 microversion: 2.1 time: 0.368378 Jul 20 04:40:53.092268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3181/4306] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:52 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1677 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:53.263544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:53.264269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.275017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.275754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.277717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.278320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.440017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:53.471668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:53.856315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:53.865460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae6268e2-08e3-48b6-b7df-234fac2917b4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1309 microversion: 2.1 time: 0.609105 Jul 20 04:40:53.866480 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3182/4307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:53 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1309 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:53.871761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:53.872395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:53.879233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.879683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:53.880503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:53.880935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.137962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.149154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.151846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.156132 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35e31182-e674-48e3-a261-b9be49efae5a tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.288310 Jul 20 04:40:54.157910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3183/4308] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:53 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:54.164272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.165276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.172309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.173538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.174578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.175251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.430855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.440767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9358dc39-abb3-4902-a603-1ea309907c99 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1660 microversion: 2.1 time: 0.281491 Jul 20 04:40:54.454168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3184/4309] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1660 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:54.459586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:54.461554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.468853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.469621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.470666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.471363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.512746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:40:54.570732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa507609-6d30-4e12-a29d-4e8a4f1a5e8b tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action" status: 202 len: 0 microversion: 2.1 time: 0.112976 Jul 20 04:40:54.576265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3185/4310] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:40:54 2022] POST /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:40:54.584391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:54.586396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:54.597798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.598775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.600763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:54.601688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:54.910981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:54.926312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1319446-97b8-4ce3-a653-a72ed226cb74 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1666 microversion: 2.1 time: 0.347125 Jul 20 04:40:54.927400 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3186/4311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:54 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1666 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:55.195232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d5a42832-289d-4e9f-8a73-92854afe2aea req-c8e2fff5-2fef-4c79-b9f5-2bbd457ff1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "name": "network-vif-plugged", "status": "completed", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:55.211381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d5a42832-289d-4e9f-8a73-92854afe2aea req-c8e2fff5-2fef-4c79-b9f5-2bbd457ff1a2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.211825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d5a42832-289d-4e9f-8a73-92854afe2aea req-c8e2fff5-2fef-4c79-b9f5-2bbd457ff1a2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.236782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d5a42832-289d-4e9f-8a73-92854afe2aea req-c8e2fff5-2fef-4c79-b9f5-2bbd457ff1a2 service nova] Creating event network-vif-plugged:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h2-764486-11 Jul 20 04:40:55.243319 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d5a42832-289d-4e9f-8a73-92854afe2aea req-c8e2fff5-2fef-4c79-b9f5-2bbd457ff1a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314114 Jul 20 04:40:55.245199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3187/4312] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:55.252092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.255843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.278927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.279377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.280807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.281455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.633837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:55.655888 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d650b67-7168-4f2a-9bda-cf91f71713b1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1309 microversion: 2.1 time: 0.409110 Jul 20 04:40:55.665595 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3188/4313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1309 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:55.670962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:55.671584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:55.682529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.682987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:55.683999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:55.684626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.002339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.012662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.014564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.016620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d96f8394-8aae-4dc6-b99e-4ce1da871fd4 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.349292 Jul 20 04:40:56.016938 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3189/4314] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:55 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:56.022756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.027924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.037669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.038658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.039465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.039906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.281487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:56.301524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-680d8953-a9dd-42c9-92e1-6bac827ea290 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1666 microversion: 2.1 time: 0.282968 Jul 20 04:40:56.313152 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3190/4315] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1666 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:56.689233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:56.690409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:56.727774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.755613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:56.756847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:56.766038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.245263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.263916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f98f310e-f689-47f1-bdbe-d73f2c21cdf7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1309 microversion: 2.1 time: 0.594184 Jul 20 04:40:57.264547 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3191/4316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:56 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1309 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:57.276114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:57.276762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.311353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.312217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.313317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.314015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.757521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.769693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.778980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:57.778980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32bef6cb-fd0b-4c76-9311-28b4afb959bc tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1731 microversion: 2.20 time: 0.511852 Jul 20 04:40:57.778980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3192/4317] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:40:57 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1731 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:40:57.786954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e9f3893a-3748-44c4-9ef3-91d1dde3e570 req-9d2d5eed-5e9c-43a2-95fd-b1882ae8b61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7969f36-6883-463c-9528-32e9d6fd120c", "name": "network-vif-plugged", "status": "completed", "tag": "763006ad-ac4e-4e19-ab41-3b1317c88667"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:40:57.816872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e9f3893a-3748-44c4-9ef3-91d1dde3e570 req-9d2d5eed-5e9c-43a2-95fd-b1882ae8b61d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.817850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e9f3893a-3748-44c4-9ef3-91d1dde3e570 req-9d2d5eed-5e9c-43a2-95fd-b1882ae8b61d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.845653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e9f3893a-3748-44c4-9ef3-91d1dde3e570 req-9d2d5eed-5e9c-43a2-95fd-b1882ae8b61d service nova] Creating event network-vif-plugged:763006ad-ac4e-4e19-ab41-3b1317c88667 for instance a7969f36-6883-463c-9528-32e9d6fd120c on n-h2-764486-11 Jul 20 04:40:57.853668 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e9f3893a-3748-44c4-9ef3-91d1dde3e570 req-9d2d5eed-5e9c-43a2-95fd-b1882ae8b61d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070410 Jul 20 04:40:57.856106 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3193/4318] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:40:57.866569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:57.878524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:57.887791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.888620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:57.889651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:57.890325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.084206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.094688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f7c193c-8566-4c1e-865d-e485e6e42905 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.236465 Jul 20 04:40:58.096034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3194/4319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:57 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.113055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.113676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.122963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.124288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.125853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.126547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.319844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.330335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6b6a459-e4c8-4989-a714-70e7654f2ba9 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1669 microversion: 2.1 time: 0.221019 Jul 20 04:40:58.341379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3195/4320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1669 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:40:58.355129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.355869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.362819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.363414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.364687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.365357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.782388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:40:58.807340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76e5ca81-e6ea-49cf-a5a3-3e41f8362610 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1309 microversion: 2.1 time: 0.460781 Jul 20 04:40:58.808016 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3196/4321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:40:58 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:40:58.837057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:40:58.843058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:40:58.876028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.876652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.879623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:58.882355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:58.949914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:40:58.971120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Working on deleting snapshot e7e5f9f6-35f8-4c14-b8e0-577d251c1dc4 from shelved instance... Jul 20 04:40:59.825662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Doing local delete in cell 23363e6a-51fb-4308-934e-3fa03f8bc04e(cell1) {{(pid=123724) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 04:40:59.828229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:40:59.828959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:40:59.829591 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 04:40:59.836629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] deallocate_for_instance() {{(pid=123724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 04:41:01.373427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Updating instance_info_cache with network_info: [] {{(pid=123724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 04:41:01.916018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=10,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:02.003820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20275aa3-6198-495b-b050-bfe3f05f1d19 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 204 len: 0 microversion: 2.1 time: 3.191794 Jul 20 04:41:02.005338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3197/4322] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:40:58 2022] DELETE /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 0 bytes in 3194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:02.012438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.013679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.025489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.026264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.027273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.027874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.276047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.286540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.288649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.290220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-24fd79e0-1005-498a-ba29-ad642782222c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1718 microversion: 2.20 time: 0.283567 Jul 20 04:41:02.291746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3198/4323] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1718 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:02.301680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.304309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.312999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.313810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.315365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.316196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.565341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.578530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d08d2e11-8c4b-431d-93b0-b5adbfd1a6ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1490 microversion: 2.1 time: 0.285158 Jul 20 04:41:02.592079 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3199/4324] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1490 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:02.608318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d8cd9f36-4716-4c5b-82d3-9086a4d09651 req-fdda21ee-855b-482d-8090-87ee208c2776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7", "name": "network-vif-deleted", "tag": "6be20eae-9e36-4a37-949e-1dd0b2336f0d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:02.619539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d8cd9f36-4716-4c5b-82d3-9086a4d09651 req-fdda21ee-855b-482d-8090-87ee208c2776 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.620374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d8cd9f36-4716-4c5b-82d3-9086a4d09651 req-fdda21ee-855b-482d-8090-87ee208c2776 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.637143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_external_events [req-d8cd9f36-4716-4c5b-82d3-9086a4d09651 req-fdda21ee-855b-482d-8090-87ee208c2776 service nova] Unable to find a host for instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7. Dropping event network-vif-deleted {{(pid=123724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:41:02.638524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d8cd9f36-4716-4c5b-82d3-9086a4d09651 req-fdda21ee-855b-482d-8090-87ee208c2776 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034742 Jul 20 04:41:02.639357 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3200/4325] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:41:02.646340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.648895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.658601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.659824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.660862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.662140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.682349 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] HTTP exception thrown: Instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 could not be found. Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Request method failure captured: Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 HTTP/1.1 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14T22iRK6Sa_9H5Jpqs_BLJz2nevKLy_ccLoCksC65mmIChHCut8qFaUQpr22YOnwPQOWxZfsfvnbBLW-Lz9RbeapZjTIKfEK7AYU0z0km67942gu8s_OfQ33rnSvU6W4eFzLDwPi3RuXRdkWHpGtuGxD2FNaOjWD5G8_aL5DFJg1pk Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ee53c54f478471c951962c22855b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ee53c54f478471c951962c22855b465", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4d4ae756d3714b598164985ed7d7876c Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 could not be found. Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7'} Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 could not be found. Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 could not be found. Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:02.684413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 could not be found. Jul 20 04:41:02.690657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:02.693353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Returning 404 to user: Instance 9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:02.695109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e59ccc5e-6031-4315-91ce-527ca44e2510 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7" status: 404 len: 111 microversion: 2.1 time: 0.054503 Jul 20 04:41:02.695986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3201/4326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/9c0b22d6-f8d9-497b-b59d-b8caea5b2ac7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:02.704263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.705300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:02.714666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.715472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.716610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:02.717296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:02.966653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:02.974839 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2771cca2-24c8-4853-b31b-5b33ec2dcc44 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1491 microversion: 2.1 time: 0.277461 Jul 20 04:41:02.976242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3202/4327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:02 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1491 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:02.992913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:02.993778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.001162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.001651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.002907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.003529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.034894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:03.153402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-605e939b-a116-4927-ae4e-2aa9881175a7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "DELETE /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 204 len: 0 microversion: 2.1 time: 0.165236 Jul 20 04:41:03.157460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3203/4328] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:02 2022] DELETE /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:03.161053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.162342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.170561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.171065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.171924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.172379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.434151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.445442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c4cb9df-bae6-4394-8f4c-3e54c8ca0896 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1490 microversion: 2.1 time: 0.288990 Jul 20 04:41:03.448151 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3204/4329] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1490 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:03.460277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.462315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.477649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.479083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.480286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.484265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.634420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:03.647215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ccf390b-796e-4a98-8faa-b81454f6173d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1466 microversion: 2.1 time: 0.197686 Jul 20 04:41:03.648284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3205/4330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1466 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:03.655303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.656054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.664261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.665716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.666429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.666921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.713746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:03.839027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2375aa86-2352-42d3-8432-272e69f49c4d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 204 len: 0 microversion: 2.1 time: 0.188577 Jul 20 04:41:03.841078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3206/4331] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:03 2022] DELETE /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:03.862780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:03.863522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:03.869378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:03.880152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.880645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:03.882010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:03.882458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.301067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.312307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-baf54eef-73d6-4ca0-ac34-ddc09c6289cf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1496 microversion: 2.1 time: 0.464082 Jul 20 04:41:04.323488 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3207/4332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:03 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1496 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:04.665843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:04.667790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:04.675124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.676193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.677159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:04.677873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:04.849146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:04.865479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81c6b380-f2fd-4751-8891-30f276fd28d8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1466 microversion: 2.1 time: 0.203845 Jul 20 04:41:04.867261 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3208/4333] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:04 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1466 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:05.333897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:05.335149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:05.344408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.345639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:05.347012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:05.349150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.136373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.150750 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85372cf8-4e0e-412f-94d5-e3bdaa5dd15b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1496 microversion: 2.1 time: 0.823539 Jul 20 04:41:06.151450 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3209/4334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:05 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1496 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.166333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:06.167284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:06.174506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.175318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.176267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.177028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.391413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:06.400948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b00ef87e-eaa3-420c-b487-d3c84bcb7af7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 200 len: 1466 microversion: 2.1 time: 0.239180 Jul 20 04:41:06.401777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3210/4335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:06 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 1466 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:06.537961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-05f14b0e-f5f2-4311-8e9c-705ab9ee6920 req-5887781b-a49e-4663-aef3-f4e8084324ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29727f32-3dfd-4243-a196-c09cfa2bb9b8", "name": "network-vif-deleted", "tag": "5fc18a82-55dc-44bb-9bf5-96bad73b68a7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:06.562380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-05f14b0e-f5f2-4311-8e9c-705ab9ee6920 req-5887781b-a49e-4663-aef3-f4e8084324ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:06.562830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-05f14b0e-f5f2-4311-8e9c-705ab9ee6920 req-5887781b-a49e-4663-aef3-f4e8084324ce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:06.567589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:UPDATE=9,nova_cell1:DELETE=2,nova_cell1:SELECT=87,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:06.605864 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-05f14b0e-f5f2-4311-8e9c-705ab9ee6920 req-5887781b-a49e-4663-aef3-f4e8084324ce service nova] Creating event network-vif-deleted:5fc18a82-55dc-44bb-9bf5-96bad73b68a7 for instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 on n-h2-764486-11 Jul 20 04:41:06.615781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-05f14b0e-f5f2-4311-8e9c-705ab9ee6920 req-5887781b-a49e-4663-aef3-f4e8084324ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081730 Jul 20 04:41:06.617156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3211/4336] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:41:07.171679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:07.172944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:07.211444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.219682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:07.220996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:07.221634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.147869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:08.168888 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f79e30a7-8fd3-414d-a4f4-97ee5330ef4e tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 200 len: 1496 microversion: 2.1 time: 1.004238 Jul 20 04:41:08.173751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3212/4337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:07 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 1496 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:08.195752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:08.196253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 29727f32-3dfd-4243-a196-c09cfa2bb9b8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:08.233157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.237780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.238655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.245273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.889522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] HTTP exception thrown: Instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 could not be found. Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Request method failure captured: Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 HTTP/1.1 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14T22iRK6Sa_9H5Jpqs_BLJz2nevKLy_ccLoCksC65mmIChHCut8qFaUQpr22YOnwPQOWxZfsfvnbBLW-Lz9RbeapZjTIKfEK7AYU0z0km67942gu8s_OfQ33rnSvU6W4eFzLDwPi3RuXRdkWHpGtuGxD2FNaOjWD5G8_aL5DFJg1pk Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ee53c54f478471c951962c22855b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ee53c54f478471c951962c22855b465", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4d4ae756d3714b598164985ed7d7876c Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 could not be found. Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '29727f32-3dfd-4243-a196-c09cfa2bb9b8'} Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 could not be found. Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 could not be found. Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:08.891528 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 could not be found. Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Returning 404 to user: Instance 29727f32-3dfd-4243-a196-c09cfa2bb9b8 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b6d2324-03ce-4f0e-9c8c-3c8f1b83f5c7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8" status: 404 len: 111 microversion: 2.1 time: 0.718001 Jul 20 04:41:08.899301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3213/4338] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:08 2022] GET /compute/v2.1/servers/29727f32-3dfd-4243-a196-c09cfa2bb9b8 => generated 111 bytes in 719 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:08.903309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f539d331-051a-40b0-8521-e5b1af96b408 req-76133698-5f3c-4600-b23a-e494ddf9ac94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7969f36-6883-463c-9528-32e9d6fd120c", "name": "network-vif-deleted", "tag": "763006ad-ac4e-4e19-ab41-3b1317c88667"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:08.926959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f539d331-051a-40b0-8521-e5b1af96b408 req-76133698-5f3c-4600-b23a-e494ddf9ac94 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:08.927422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f539d331-051a-40b0-8521-e5b1af96b408 req-76133698-5f3c-4600-b23a-e494ddf9ac94 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:08.988314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f539d331-051a-40b0-8521-e5b1af96b408 req-76133698-5f3c-4600-b23a-e494ddf9ac94 service nova] Creating event network-vif-deleted:763006ad-ac4e-4e19-ab41-3b1317c88667 for instance a7969f36-6883-463c-9528-32e9d6fd120c on n-h2-764486-11 Jul 20 04:41:09.007614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f539d331-051a-40b0-8521-e5b1af96b408 req-76133698-5f3c-4600-b23a-e494ddf9ac94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100497 Jul 20 04:41:09.008894 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3214/4339] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:09.017074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:09.018270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:09.035521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.036459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.038194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.038914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.113266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:09.347954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d672ee2c-23cd-4540-bcec-e11e328ee9f6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 204 len: 0 microversion: 2.1 time: 0.336862 Jul 20 04:41:09.351594 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3215/4340] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:09 2022] DELETE /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:09.362826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:09.364020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:09.372127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.372927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.373935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.374720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.397287 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c HTTP/1.1 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a7969f36-6883-463c-9528-32e9d6fd120c'} Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:09.399468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:09.405468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:09.405468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:09.405468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:09.405468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:09.405468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:41:09.405468 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:09.409030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:09.410312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22fc3cf5-f95d-44b1-9f7c-22caddf96067 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 404 len: 111 microversion: 2.1 time: 0.055440 Jul 20 04:41:09.411136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3216/4341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:09 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:09.420004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:09.421044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:09.430787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.431771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.432984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.433718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.820895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:09.857935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d28c9226-3b18-4c98-a298-8640f11702c6 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1508 microversion: 2.1 time: 0.444614 Jul 20 04:41:09.858918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3217/4342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:09 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:09.882846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:09.884504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:09.894285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.894739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.895802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:09.897051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:09.946359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:10.090161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b837a76-81ef-491f-8082-028740d6eecb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 204 len: 0 microversion: 2.1 time: 0.230038 Jul 20 04:41:10.095891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3218/4343] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:09 2022] DELETE /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:10.104671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:10.105661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:10.114509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.114968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:10.116097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.117047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:10.286459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lazy-loading 'services' on Instance uuid 88af1bc3-6cee-4077-b5e8-8f477136b9dd {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:10.518905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04094b92-a252-45f3-8107-102472d48921 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd/os-volume_attachments/97b3ee2b-5bba-426a-b144-e897caf4a6ba" status: 202 len: 0 microversion: 2.1 time: 0.423799 Jul 20 04:41:10.520007 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3219/4344] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:41:10 2022] DELETE /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd/os-volume_attachments/97b3ee2b-5bba-426a-b144-e897caf4a6ba => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:41:10.533678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:10.535366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:10.554703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.555228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:10.559032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:10.563027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.474377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:11.485755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a82c68f-f942-49da-9c7c-4b6e8b18ea64 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1497 microversion: 2.1 time: 0.963642 Jul 20 04:41:11.486186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3220/4345] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:10 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1497 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:11.502441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:11.507097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:11.532642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.534982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:11.538879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:11.539970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.076472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:12.084923 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29938598-bb3f-459d-a583-ff241b534b6f tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 200 len: 1508 microversion: 2.1 time: 0.597512 Jul 20 04:41:12.089638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3221/4346] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:11 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:12.104255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-67c60381-0393-4452-bcb7-0070ce0d69a6 req-e249f148-c257-4528-84ca-897ee8445265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd", "name": "network-vif-unplugged", "status": "completed", "tag": "d7eeae4f-9129-45fa-854a-0be7c3325b13"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:12.122119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-67c60381-0393-4452-bcb7-0070ce0d69a6 req-e249f148-c257-4528-84ca-897ee8445265 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.122991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-67c60381-0393-4452-bcb7-0070ce0d69a6 req-e249f148-c257-4528-84ca-897ee8445265 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.144127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-67c60381-0393-4452-bcb7-0070ce0d69a6 req-e249f148-c257-4528-84ca-897ee8445265 service nova] Creating event network-vif-unplugged:d7eeae4f-9129-45fa-854a-0be7c3325b13 for instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd on n-h2-764486-11 Jul 20 04:41:12.160859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-67c60381-0393-4452-bcb7-0070ce0d69a6 req-e249f148-c257-4528-84ca-897ee8445265 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069679 Jul 20 04:41:12.161777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3222/4347] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:12.167551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-49b5039b-ccf1-4e82-9f35-336c3dfdbdd0 req-c1f19ce6-e1ea-4681-ab4d-dd9a9909a581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd", "name": "network-vif-deleted", "tag": "d7eeae4f-9129-45fa-854a-0be7c3325b13"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:12.192686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-49b5039b-ccf1-4e82-9f35-336c3dfdbdd0 req-c1f19ce6-e1ea-4681-ab4d-dd9a9909a581 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.193135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-49b5039b-ccf1-4e82-9f35-336c3dfdbdd0 req-c1f19ce6-e1ea-4681-ab4d-dd9a9909a581 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.222221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-49b5039b-ccf1-4e82-9f35-336c3dfdbdd0 req-c1f19ce6-e1ea-4681-ab4d-dd9a9909a581 service nova] Creating event network-vif-deleted:d7eeae4f-9129-45fa-854a-0be7c3325b13 for instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd on n-h2-764486-11 Jul 20 04:41:12.245949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-49b5039b-ccf1-4e82-9f35-336c3dfdbdd0 req-c1f19ce6-e1ea-4681-ab4d-dd9a9909a581 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080683 Jul 20 04:41:12.246604 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3223/4348] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:12.503605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:12.504762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:12.519791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.520771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:12.522150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:12.522823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.091554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:13.102820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7360d134-1313-4a50-bcb5-43ffc8f8b580 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1497 microversion: 2.1 time: 0.603312 Jul 20 04:41:13.104027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3224/4349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:12 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1497 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:13.110714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:13.111958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:13.120328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.121291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.122303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.122939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.146230 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] HTTP exception thrown: Instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd could not be found. Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Request method failure captured: Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd HTTP/1.1 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14T22iRK6Sa_9H5Jpqs_BLJz2nevKLy_ccLoCksC65mmIChHCut8qFaUQpr22YOnwPQOWxZfsfvnbBLW-Lz9RbeapZjTIKfEK7AYU0z0km67942gu8s_OfQ33rnSvU6W4eFzLDwPi3RuXRdkWHpGtuGxD2FNaOjWD5G8_aL5DFJg1pk Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ee53c54f478471c951962c22855b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ee53c54f478471c951962c22855b465", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4d4ae756d3714b598164985ed7d7876c Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd could not be found. Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd'} Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd could not be found. Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd could not be found. Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:13.149139 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd could not be found. Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Returning 404 to user: Instance a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:13.154679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16e4e267-203c-46e2-9432-47585298a3d3 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd" status: 404 len: 111 microversion: 2.1 time: 0.048428 Jul 20 04:41:13.160515 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3225/4350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:13 2022] GET /compute/v2.1/servers/a8d981d1-c92f-44fc-ad3b-fd8fe88bdefd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:13.166674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:13.167389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:13.174895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.175621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.177418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.178380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.233952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:13.305132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:13.371455 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c45bfc7-98ad-4243-a0d2-4d48e74dd1e7 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "DELETE /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 204 len: 0 microversion: 2.1 time: 0.209219 Jul 20 04:41:13.372378 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3226/4351] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:13 2022] DELETE /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:13.382921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:13.383657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:13.405756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.406262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.408855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:13.412180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:13.847410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:13.861215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-555e45d8-9d7b-4ca3-8bbe-deb65131e215 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1494 microversion: 2.1 time: 0.483670 Jul 20 04:41:13.862540 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3227/4352] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:13 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1494 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:14.121659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:14.122315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:14.137880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.138338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.139130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.139567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.205806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.207094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.207823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lazy-loading 'fault' on Instance uuid 5606b7c0-92ec-48cb-9ce5-2e206b08f84e {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:14.391481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:14.410902 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75038dbd-60f1-49ba-b08f-c1d95b3ae7c6 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 200 len: 1299 microversion: 2.1 time: 0.293210 Jul 20 04:41:14.411794 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3228/4353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:14 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:14.445454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b58d44af-59b1-4252-8fd4-d11aa6df889c req-f07f5022-7a38-4e04-8a40-4b8d766b43f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5606b7c0-92ec-48cb-9ce5-2e206b08f84e", "name": "network-vif-deleted", "tag": "0ed8fd13-7810-423d-abe9-35828be346be"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:14.503388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b58d44af-59b1-4252-8fd4-d11aa6df889c req-f07f5022-7a38-4e04-8a40-4b8d766b43f6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.503812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b58d44af-59b1-4252-8fd4-d11aa6df889c req-f07f5022-7a38-4e04-8a40-4b8d766b43f6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.525492 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b58d44af-59b1-4252-8fd4-d11aa6df889c req-f07f5022-7a38-4e04-8a40-4b8d766b43f6 service nova] Creating event network-vif-deleted:0ed8fd13-7810-423d-abe9-35828be346be for instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e on n-h1-764486-11 Jul 20 04:41:14.531695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b58d44af-59b1-4252-8fd4-d11aa6df889c req-f07f5022-7a38-4e04-8a40-4b8d766b43f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103581 Jul 20 04:41:14.536526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3229/4354] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:14.542654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2b10ffbc-0b1a-441c-8b7a-64e42182af4f req-f716fa2d-885c-4a79-a297-165ecdfcb99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18302633-ec26-4ab7-a37c-2078988a1f96", "name": "network-vif-deleted", "tag": "0f0803ef-2cdc-46da-82b6-9e1d797e76ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:14.560016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2b10ffbc-0b1a-441c-8b7a-64e42182af4f req-f716fa2d-885c-4a79-a297-165ecdfcb99c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.560497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2b10ffbc-0b1a-441c-8b7a-64e42182af4f req-f716fa2d-885c-4a79-a297-165ecdfcb99c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.601452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2b10ffbc-0b1a-441c-8b7a-64e42182af4f req-f716fa2d-885c-4a79-a297-165ecdfcb99c service nova] Creating event network-vif-deleted:0f0803ef-2cdc-46da-82b6-9e1d797e76ef for instance 18302633-ec26-4ab7-a37c-2078988a1f96 on n-h1-764486-11 Jul 20 04:41:14.608181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2b10ffbc-0b1a-441c-8b7a-64e42182af4f req-f716fa2d-885c-4a79-a297-165ecdfcb99c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069492 Jul 20 04:41:14.609897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3230/4355] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:14.882191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:14.882907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:14.889559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.890009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.891252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.891697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.925461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:14.926181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:14.927374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lazy-loading 'fault' on Instance uuid 18302633-ec26-4ab7-a37c-2078988a1f96 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:41:15.026357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:15.047053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc5db59f-a559-40e8-8c18-78905eae15f8 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 200 len: 1304 microversion: 2.1 time: 0.169746 Jul 20 04:41:15.049931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3231/4356] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:14 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:15.431407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:15.432261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:15.441992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.442852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.443903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:15.444646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:15.460199 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e HTTP/1.1 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5606b7c0-92ec-48cb-9ce5-2e206b08f84e'} Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:15.462277 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6e87329-1ce6-4b5f-bf32-492ea6b0af22 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 404 len: 111 microversion: 2.1 time: 0.037795 Jul 20 04:41:15.467239 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3232/4357] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:15 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:41:15.608235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1622312544", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:15.670042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:16.716079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:16.717208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:16.718213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:16.718988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:16.719593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:16.755427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:16.755935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:16.762226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:16.763545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:16.811696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:16.825849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:16.853193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:16.855948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:16.917031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc4e480b-0051-4f76-9e43-a311c9a1d01d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.312489 Jul 20 04:41:16.925728 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3233/4358] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:16.941885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:16.942429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 18302633-ec26-4ab7-a37c-2078988a1f96] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:16.978797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:16.980437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:16.981285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:16.981738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.009886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] HTTP exception thrown: Instance 18302633-ec26-4ab7-a37c-2078988a1f96 could not be found. Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Request method failure captured: Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 HTTP/1.1 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14T22iRK6Sa_9H5Jpqs_BLJz2nevKLy_ccLoCksC65mmIChHCut8qFaUQpr22YOnwPQOWxZfsfvnbBLW-Lz9RbeapZjTIKfEK7AYU0z0km67942gu8s_OfQ33rnSvU6W4eFzLDwPi3RuXRdkWHpGtuGxD2FNaOjWD5G8_aL5DFJg1pk Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ee53c54f478471c951962c22855b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ee53c54f478471c951962c22855b465", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4d4ae756d3714b598164985ed7d7876c Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 18302633-ec26-4ab7-a37c-2078988a1f96 could not be found. Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '18302633-ec26-4ab7-a37c-2078988a1f96'} Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18302633-ec26-4ab7-a37c-2078988a1f96 could not be found. Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18302633-ec26-4ab7-a37c-2078988a1f96 could not be found. Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:17.011979 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18302633-ec26-4ab7-a37c-2078988a1f96 could not be found. Jul 20 04:41:17.016769 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:17.019256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Returning 404 to user: Instance 18302633-ec26-4ab7-a37c-2078988a1f96 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:17.020633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6001987a-8bdd-4000-85ac-53c64ebc4187 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96" status: 404 len: 111 microversion: 2.1 time: 0.094112 Jul 20 04:41:17.025771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3234/4359] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:16 2022] GET /compute/v2.1/servers/18302633-ec26-4ab7-a37c-2078988a1f96 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:17.032631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-591aed47-6ed6-4139-9fbd-32fb9b768a69 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.033760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-591aed47-6ed6-4139-9fbd-32fb9b768a69 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.109734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-591aed47-6ed6-4139-9fbd-32fb9b768a69 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:17.117999 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-591aed47-6ed6-4139-9fbd-32fb9b768a69 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1209 microversion: 2.1 time: 0.090733 Jul 20 04:41:17.121117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3235/4360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:17 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:17.127716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.133193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.153925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.154384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.155186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.155621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.235624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:17.390665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:17.407323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-826b65f3-3e91-4820-9070-51076e98cf83 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 204 len: 0 microversion: 2.1 time: 0.284343 Jul 20 04:41:17.408617 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3236/4361] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:17 2022] DELETE /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:41:17.420635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:17.421845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:17.431931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.433067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.443609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:17.446570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:17.684907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:17.699876 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94f3faa3-68fe-470c-bd78-b7b9c6c1c27a tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1675 microversion: 2.1 time: 0.286041 Jul 20 04:41:17.700810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3237/4362] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:17 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:18.138713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:18.139393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.146701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.147228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.148022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.148518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.257288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.269009 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ef8e42a-8dc1-4ffe-9484-3a31d9df3385 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1261 microversion: 2.1 time: 0.134562 Jul 20 04:41:18.280409 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3238/4363] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:18 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:18.336863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:18.338551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.348172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.348865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.350600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.351266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.397350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:18.532097 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb019443-a6f4-4e74-b58d-c1df6be735e7 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 204 len: 0 microversion: 2.1 time: 0.199973 Jul 20 04:41:18.536035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3239/4364] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:18 2022] DELETE /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:41:18.545501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:18.546237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.557941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.558915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.560240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.560787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.813048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:18.822292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2eb9a57f-5eeb-4360-87f8-ea19836e5a98 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1514 microversion: 2.1 time: 0.283674 Jul 20 04:41:18.823734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3240/4365] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:18 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:18.837800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:18.838867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:18.845400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.846149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:18.846886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:18.847355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.172699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:19.194206 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aedcaa9b-254c-4e63-9924-cef008800624 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1675 microversion: 2.1 time: 0.370116 Jul 20 04:41:19.195321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3241/4366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:18 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1675 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:19.288767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:19.289662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:19.305583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.306615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.307942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.308643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.758347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:19.771859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70f3c5d3-a2ed-425a-848b-b5ec97b35489 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1279 microversion: 2.1 time: 0.488097 Jul 20 04:41:19.772856 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3242/4367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:19 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1279 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:19.840835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:19.841394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:19.849531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.850567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:19.851981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:19.852774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.397014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:20.400787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:20.411698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa9be1bf-9385-478c-8bde-78245c729cfa tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1514 microversion: 2.1 time: 0.574761 Jul 20 04:41:20.413230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3243/4368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:19 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:20.419760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:20.420761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:20.433700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.434809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.436059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:20.436872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:20.998985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:21.013143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73ab8e43-e999-4362-8ede-1aa6977ca254 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1675 microversion: 2.1 time: 0.598244 Jul 20 04:41:21.027220 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3244/4369] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:20 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1675 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:21.033180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:21.033912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:21.042244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.042830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.043932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.044494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.584882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:21.595161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e34354a6-fd9c-4ba8-bd6a-70bbcfef6a7f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.566505 Jul 20 04:41:21.597703 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3245/4370] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:21 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:21.603837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:21.604771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:21.612377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.612915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.613781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.614280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.784281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e90538f47054eacb99903b93b6b1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a0c385f4394e8fa2398bd01c3d635f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:21.798607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc6c0f83-7eee-45aa-9b56-af1ec177c3ca tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 200 len: 1472 microversion: 2.1 time: 0.197957 Jul 20 04:41:21.801368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3246/4371] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:21 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:21.902472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a1c21d15-e4fa-43fe-ab8d-8dd6eed2a359 req-d63970ab-a26c-4b52-8aa1-99a237279dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88af1bc3-6cee-4077-b5e8-8f477136b9dd", "name": "network-vif-deleted", "tag": "a691c8ef-0af6-43c3-ad6b-98f74e4d0fcc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:21.935906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1c21d15-e4fa-43fe-ab8d-8dd6eed2a359 req-d63970ab-a26c-4b52-8aa1-99a237279dfa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:21.937408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1c21d15-e4fa-43fe-ab8d-8dd6eed2a359 req-d63970ab-a26c-4b52-8aa1-99a237279dfa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:21.968530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a1c21d15-e4fa-43fe-ab8d-8dd6eed2a359 req-d63970ab-a26c-4b52-8aa1-99a237279dfa service nova] Creating event network-vif-deleted:a691c8ef-0af6-43c3-ad6b-98f74e4d0fcc for instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd on n-h1-764486-11 Jul 20 04:41:21.983632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a1c21d15-e4fa-43fe-ab8d-8dd6eed2a359 req-d63970ab-a26c-4b52-8aa1-99a237279dfa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108705 Jul 20 04:41:21.984252 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3247/4372] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:22.033787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.034527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.049694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.050171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.055951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.056565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.194154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4ae756d3714b598164985ed7d7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee53c54f478471c951962c22855b465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.205618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac0baf2c-bccd-4c1e-b14c-3e0d91b33055 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 200 len: 1323 microversion: 2.1 time: 0.177154 Jul 20 04:41:22.220846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3248/4373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:22.614636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.615348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.627162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.627624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.637065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.637901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.883611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:22.895400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fbd5bc4-975f-4efa-8696-f9482e065813 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.285366 Jul 20 04:41:22.899172 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3249/4374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:22.906156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:22.907291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] [instance: 88af1bc3-6cee-4077-b5e8-8f477136b9dd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:22.921509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.924851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.926507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:22.927130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:22.956767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] HTTP exception thrown: Instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd could not be found. Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Request method failure captured: Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd HTTP/1.1 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14YmHgALtYUjMFQJmcU8xMo1Bme0A2oENQBPzfejtIsuYz1ayyfhAEzTHHKai36pm3H5gJWgbh9tCG8h1LUz-Jd1gDkF_ynQK-V7UQdtNKXOih1aZqnHrPTIrdEa11gs0Fj8dOqMR2URs-WEKdOk2td2eMsd2SwB8QROFR292VdZ5Jo Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d6a0c385f4394e8fa2398bd01c3d635f Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesSnapshotTestJSON-206892692 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6a0c385f4394e8fa2398bd01c3d635f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6a0c385f4394e8fa2398bd01c3d635f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6a0c385f4394e8fa2398bd01c3d635f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6a0c385f4394e8fa2398bd01c3d635f", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesSnapshotTestJSON-206892692 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d6a0c385f4394e8fa2398bd01c3d635f Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-206892692 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesSnapshotTestJSON-206892692-project Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9e90538f47054eacb99903b93b6b1d15 Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesSnapshotTestJSON-206892692-project Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd could not be found. Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '88af1bc3-6cee-4077-b5e8-8f477136b9dd'} Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd could not be found. Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd could not be found. Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:22.959704 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd could not be found. Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] Returning 404 to user: Instance 88af1bc3-6cee-4077-b5e8-8f477136b9dd could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad2f6c6c-6c65-4161-aa36-cd0501cb8d92 tempest-VolumesSnapshotTestJSON-206892692 tempest-VolumesSnapshotTestJSON-206892692-project] 10.222.0.49 "GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd" status: 404 len: 111 microversion: 2.1 time: 0.062696 Jul 20 04:41:22.966932 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3250/4375] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:22 2022] GET /compute/v2.1/servers/88af1bc3-6cee-4077-b5e8-8f477136b9dd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:23.001388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ea2e9a0c-d9d6-4cda-a30b-133cb85e12cf req-b0ddf60c-7a1d-4195-9b8a-86f453de8fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3cd6e1f-4f33-48f6-8f7a-61919075b43f", "tag": "7b57a270-d953-414b-982a-d9bdb6fb4b5d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:23.023596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ea2e9a0c-d9d6-4cda-a30b-133cb85e12cf req-b0ddf60c-7a1d-4195-9b8a-86f453de8fa2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.024158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ea2e9a0c-d9d6-4cda-a30b-133cb85e12cf req-b0ddf60c-7a1d-4195-9b8a-86f453de8fa2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.068119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ea2e9a0c-d9d6-4cda-a30b-133cb85e12cf req-b0ddf60c-7a1d-4195-9b8a-86f453de8fa2 service nova] Creating event network-changed:7b57a270-d953-414b-982a-d9bdb6fb4b5d for instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f on n-h1-764486-11 Jul 20 04:41:23.076186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ea2e9a0c-d9d6-4cda-a30b-133cb85e12cf req-b0ddf60c-7a1d-4195-9b8a-86f453de8fa2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111126 Jul 20 04:41:23.083942 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3251/4376] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:23.225973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:23.226773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] [instance: 0574120e-c5ec-4131-9fd9-def29f85a93a] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:23.240810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.241591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.242806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.244477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.281847 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] HTTP exception thrown: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a could not be found. Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Request method failure captured: Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a HTTP/1.1 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14T22iRK6Sa_9H5Jpqs_BLJz2nevKLy_ccLoCksC65mmIChHCut8qFaUQpr22YOnwPQOWxZfsfvnbBLW-Lz9RbeapZjTIKfEK7AYU0z0km67942gu8s_OfQ33rnSvU6W4eFzLDwPi3RuXRdkWHpGtuGxD2FNaOjWD5G8_aL5DFJg1pk Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9ee53c54f478471c951962c22855b465"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9ee53c54f478471c951962c22855b465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9ee53c54f478471c951962c22855b465", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 9ee53c54f478471c951962c22855b465 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-160176566 Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 4d4ae756d3714b598164985ed7d7876c Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-160176566-project Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a could not be found. Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0574120e-c5ec-4131-9fd9-def29f85a93a'} Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a could not be found. Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a could not be found. Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:23.285882 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a could not be found. Jul 20 04:41:23.296898 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:23.301043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Returning 404 to user: Instance 0574120e-c5ec-4131-9fd9-def29f85a93a could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:23.303079 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b46b71ff-dcfd-46dd-b7b2-f21b768cb481 tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a" status: 404 len: 111 microversion: 2.1 time: 0.081740 Jul 20 04:41:23.304846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3252/4377] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:23 2022] GET /compute/v2.1/servers/0574120e-c5ec-4131-9fd9-def29f85a93a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:23.315595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0489978-9bda-479c-b0d9-bf9faf8bfa5d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] Calling method '.version_select at 0x7f838aef6280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:23.362210 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0489978-9bda-479c-b0d9-bf9faf8bfa5d tempest-ServerActionsTestJSON-160176566 tempest-ServerActionsTestJSON-160176566-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451666475" status: 202 len: 0 microversion: 2.1 time: 0.045195 Jul 20 04:41:23.362210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3253/4378] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451666475 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:41:23.916330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:23.917016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:23.925423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.925867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:23.926822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:23.927943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.273648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:24.296979 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8829530-8d50-418d-8a55-3ae95aa7d4ef tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.385419 Jul 20 04:41:24.299025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3254/4379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:23 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:24.306012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4c73b74d-0f20-4d0f-baf8-2be605352219 req-1fcc81a8-cc80-4cb8-9254-d1aa2696412e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0574120e-c5ec-4131-9fd9-def29f85a93a", "name": "network-vif-deleted", "tag": "01ff46e1-2572-4f44-9eac-b187b1d1f995"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:24.340276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4c73b74d-0f20-4d0f-baf8-2be605352219 req-1fcc81a8-cc80-4cb8-9254-d1aa2696412e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:24.342609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4c73b74d-0f20-4d0f-baf8-2be605352219 req-1fcc81a8-cc80-4cb8-9254-d1aa2696412e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:24.374218 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4c73b74d-0f20-4d0f-baf8-2be605352219 req-1fcc81a8-cc80-4cb8-9254-d1aa2696412e service nova] Creating event network-vif-deleted:01ff46e1-2572-4f44-9eac-b187b1d1f995 for instance 0574120e-c5ec-4131-9fd9-def29f85a93a on n-h2-764486-11 Jul 20 04:41:24.386300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4c73b74d-0f20-4d0f-baf8-2be605352219 req-1fcc81a8-cc80-4cb8-9254-d1aa2696412e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085663 Jul 20 04:41:24.387408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3255/4380] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:25.314832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:25.316145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:25.324871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:25.325612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:25.326593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:25.327206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:25.722198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:25.742302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36b31df0-85ad-4b4e-bcb2-b68a4b72a996 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.431628 Jul 20 04:41:25.750634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3256/4381] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:25 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:26.766645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:26.768678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:26.777755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:26.778953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:26.785581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:26.786173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:26.787378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:27.114921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:27.560297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:27.574338 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c82bfea6-f5e9-4e54-a2f0-c007a44e51ae tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.809578 Jul 20 04:41:27.590493 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3257/4382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:26 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:28.609355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:28.610003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:28.620873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.621325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.622120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:28.622560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:28.930224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:28.939423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ba3966d-ddce-45bd-9b9a-fa08b89af107 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.335209 Jul 20 04:41:28.945053 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3258/4383] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:28 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:29.960098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:29.960887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:29.972910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.975854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:29.976872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:29.977506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.337008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:30.345649 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60417eec-0b79-4386-a832-bca6283246a3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.390239 Jul 20 04:41:30.346241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3259/4384] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:29 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:30.351614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7bf841ed-ecf7-49db-98aa-6af423456482 req-abd74893-8936-4676-a034-cf259734596d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3cd6e1f-4f33-48f6-8f7a-61919075b43f", "name": "network-vif-plugged", "status": "completed", "tag": "7b57a270-d953-414b-982a-d9bdb6fb4b5d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:30.368777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7bf841ed-ecf7-49db-98aa-6af423456482 req-abd74893-8936-4676-a034-cf259734596d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:30.369764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7bf841ed-ecf7-49db-98aa-6af423456482 req-abd74893-8936-4676-a034-cf259734596d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:30.386900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7bf841ed-ecf7-49db-98aa-6af423456482 req-abd74893-8936-4676-a034-cf259734596d service nova] Creating event network-vif-plugged:7b57a270-d953-414b-982a-d9bdb6fb4b5d for instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f on n-h1-764486-11 Jul 20 04:41:30.393174 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7bf841ed-ecf7-49db-98aa-6af423456482 req-abd74893-8936-4676-a034-cf259734596d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045265 Jul 20 04:41:30.393629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3260/4385] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:31.367768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:31.369862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:31.388374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.389994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.392736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:31.394991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:31.902759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:31.934770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c875121a-3678-435c-b906-7c0ac58dd52c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1309 microversion: 2.1 time: 0.557670 Jul 20 04:41:31.935782 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3261/4386] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:31 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1309 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:32.327170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.328638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.338551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.339355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.340469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.341145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.650577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.669449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.671506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:32.678200 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c79fd19-667f-4567-805c-5202c0cdd0bb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2950 microversion: 2.42 time: 0.355302 Jul 20 04:41:32.681022 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3262/4387] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2950 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:32.704630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.705132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.716168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.717247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.718051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.718492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.966566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b090171-4180-4f95-be88-e986d4df7e2e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.266701 Jul 20 04:41:32.967348 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3263/4388] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3/os-interface => generated 1831 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:41:32.972486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:32.973403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:32.987295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.987782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:32.993239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:32.993872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.235469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:33.259796 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b53ffaf-81fe-46b7-b28e-986682168d5c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1491 microversion: 2.1 time: 0.291115 Jul 20 04:41:33.260673 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3264/4389] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:32 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1491 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:33.280456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:33.282664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:33.293566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.294306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.295318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.296073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.363785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:33.419607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b728482-6309-4b89-b331-ecff3cdb237d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "PUT /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1086 microversion: 2.1 time: 0.144316 Jul 20 04:41:33.420453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3265/4390] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:41:33 2022] PUT /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1086 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:33.438860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:33.439952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:33.462457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.463194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.465516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.468180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.888927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:33.900069 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf6793e7-1ce0-4d76-9581-ddfd4ba8a82f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1512 microversion: 2.1 time: 0.468631 Jul 20 04:41:33.913359 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3266/4391] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:33 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:33.921583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:33.922016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:33.929607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.930100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:33.930992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:33.931451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.651879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:34.663590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cafa7052-a280-4cb3-8268-de77dcecea78 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1512 microversion: 2.1 time: 0.749164 Jul 20 04:41:34.664548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3267/4392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:33 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:34.684922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:34.685805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:34.694293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.695500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.696921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.697965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.760514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:34.910632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86fb92b7-9480-47cd-8de8-4ee509cd4834 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 204 len: 0 microversion: 2.1 time: 0.228792 Jul 20 04:41:34.914626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3268/4393] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:41:34 2022] DELETE /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:41:34.952370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:34.953796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:34.968835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.968835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:34.970043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:34.970433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.229460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:35.242323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c09d11cf-efcb-42b3-9d04-f70495753893 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1518 microversion: 2.1 time: 0.323112 Jul 20 04:41:35.248401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3269/4394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:34 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1518 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:35.466399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.471542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.487357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.490626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.490626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.490626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.535307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6633326c-364f-4998-ba09-9e0b6209116c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075129 Jul 20 04:41:35.538824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3270/4395] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jul 20 04:41:35 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:35.675039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:35.675948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:35.693711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.696148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.697613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:35.699202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:35.777557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:41:36.015873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9afff346-b845-4759-90d4-9cf732dbc56c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 204 len: 0 microversion: 2.20 time: 0.345892 Jul 20 04:41:36.026748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3271/4396] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:41:35 2022] DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 04:41:36.053701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:36.062110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:36.079728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.080172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.081004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:36.081544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:36.963613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.981945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.983410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:36.985501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ffcb8c6-6eb3-4578-b5ab-c49746f56e6e tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1724 microversion: 2.20 time: 0.951442 Jul 20 04:41:36.986454 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3272/4397] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:36 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1724 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:36.996644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:36.999378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:37.005202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.005625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.006791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:37.009782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:37.441120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:37.455441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84afad0d-de10-44c6-8dbf-78f9f9b3551b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 200 len: 1518 microversion: 2.1 time: 0.467458 Jul 20 04:41:37.456027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3273/4398] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:36 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 1518 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:38.024901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:38.025596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:38.038730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.040036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:38.041713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:38.045002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.408640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.425985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.429906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:39.432025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0ed56ac-a17f-4b82-a0f9-2d5357da7a08 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1724 microversion: 2.20 time: 1.426955 Jul 20 04:41:39.433533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3274/4399] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:38 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1724 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:39.443315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:39.444270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:39.457014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:39.459766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.460900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.462965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.464296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.498873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f HTTP/1.1 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd3cd6e1f-4f33-48f6-8f7a-61919075b43f'} Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:39.505243 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:39.513788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d80986b-9548-4492-b1e7-022c4abc922b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 404 len: 111 microversion: 2.1 time: 0.078017 Jul 20 04:41:39.525325 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3275/4400] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:39 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:41:39.538104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-75a281fe-aeac-4974-badd-85d0b48705a0 req-0bdcb3c3-7667-4f42-9ee5-a53403cbe0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3cd6e1f-4f33-48f6-8f7a-61919075b43f", "name": "network-vif-deleted", "tag": "7b57a270-d953-414b-982a-d9bdb6fb4b5d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:39.552550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-75a281fe-aeac-4974-badd-85d0b48705a0 req-0bdcb3c3-7667-4f42-9ee5-a53403cbe0bf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:39.553166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-75a281fe-aeac-4974-badd-85d0b48705a0 req-0bdcb3c3-7667-4f42-9ee5-a53403cbe0bf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:39.572510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-75a281fe-aeac-4974-badd-85d0b48705a0 req-0bdcb3c3-7667-4f42-9ee5-a53403cbe0bf service nova] Creating event network-vif-deleted:7b57a270-d953-414b-982a-d9bdb6fb4b5d for instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f on n-h1-764486-11 Jul 20 04:41:39.586640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-75a281fe-aeac-4974-badd-85d0b48705a0 req-0bdcb3c3-7667-4f42-9ee5-a53403cbe0bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059372 Jul 20 04:41:39.587698 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3276/4401] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:39.694874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1975224081", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "63085ea2-a9c9-407e-93ff-99d5f3c018b8"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:39.803286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] validate_networks() for [('63085ea2-a9c9-407e-93ff-99d5f3c018b8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:41:41.448148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:41:41.448718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:41:41.448816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:41:41.449167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:41:41.449781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:41:41.478529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.481498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.483239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.485657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.542795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:41.549123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Getting quotas for user 995b6806ffed451b8f08f0b22491a091 and project 2d12e955b75d48dbbef0eaf710876e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:41.571752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:41:41.574473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:41:41.666792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0902b221-fc73-4133-b434-0fff40723fb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978225 Jul 20 04:41:41.672590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3277/4402] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:41:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:41:41.681908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:41.682528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:41.703173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.703633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:41.718149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:41.718717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.767275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.788185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.791366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b270c9997f31458ca90746e7dd495e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c40fb3817b94adb97d02e5a2bd1f206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:42.793214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-868023cd-df27-490e-8fd9-bba32f1c8570 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 200 len: 1656 microversion: 2.20 time: 1.124283 Jul 20 04:41:42.794744 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3278/4403] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:41 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 1656 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:41:42.839032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:42.839696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:42.851557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.852209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:42.854058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:42.855177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:43.430732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:43.443386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ac98209-0b89-441e-a8e9-f2a0f0342248 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1261 microversion: 2.1 time: 0.647321 Jul 20 04:41:43.444255 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3279/4404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:42 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1261 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:43.701644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d98d354-8194-4dd4-ad54-13332c06b8a5 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Action: 'create', calling method: .version_select at 0x7f838b296b80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:43.730928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0d98d354-8194-4dd4-ad54-13332c06b8a5 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Getting quotas for project bc0996f5572945d2b45c07896d7d04d5. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:43.737381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0d98d354-8194-4dd4-ad54-13332c06b8a5 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Getting quotas for user b65fcba0d1334f9cb6e6ca68c11336a1 and project bc0996f5572945d2b45c07896d7d04d5. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:43.882694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0d98d354-8194-4dd4-ad54-13332c06b8a5 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Getting quotas for project bc0996f5572945d2b45c07896d7d04d5. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:41:43.898043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0d98d354-8194-4dd4-ad54-13332c06b8a5 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Getting quotas for user b65fcba0d1334f9cb6e6ca68c11336a1 and project bc0996f5572945d2b45c07896d7d04d5. Resources: {'server_groups'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:41:43.915837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d98d354-8194-4dd4-ad54-13332c06b8a5 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.469681 Jul 20 04:41:43.919423 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3280/4405] 10.222.0.49 () {62 vars in 1213 bytes} [Wed Jul 20 04:41:43 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:41:44.099691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-814eb4f4-3d9a-4d6a-a9be-485caa2d49f1 req-1e4e4904-416f-4661-bdb7-ae49f2bcb04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51930690-d603-42a9-a0b7-cbe01343dc93", "name": "network-vif-deleted", "tag": "18ad46f7-35d3-4ae8-99a8-f5d04f63f95a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:44.134229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-814eb4f4-3d9a-4d6a-a9be-485caa2d49f1 req-1e4e4904-416f-4661-bdb7-ae49f2bcb04d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.134720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-814eb4f4-3d9a-4d6a-a9be-485caa2d49f1 req-1e4e4904-416f-4661-bdb7-ae49f2bcb04d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.163852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-814eb4f4-3d9a-4d6a-a9be-485caa2d49f1 req-1e4e4904-416f-4661-bdb7-ae49f2bcb04d service nova] Creating event network-vif-deleted:18ad46f7-35d3-4ae8-99a8-f5d04f63f95a for instance 51930690-d603-42a9-a0b7-cbe01343dc93 on n-h2-764486-11 Jul 20 04:41:44.184633 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-814eb4f4-3d9a-4d6a-a9be-485caa2d49f1 req-1e4e4904-416f-4661-bdb7-ae49f2bcb04d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263543 Jul 20 04:41:44.186461 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3281/4406] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:44.203196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.204549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:44.222317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.222786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.223619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.229194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.234871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:44.270702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] HTTP exception thrown: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Request method failure captured: Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 HTTP/1.1 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Wj7i-SInEGEtuvkhxCNJQ0RaM0VZS97rGCf7SkYPSo0wTYVi0Mp0w-z99OP57ciGn9ANOYvqTDNGDRm4s0pFSXnBQ0Va4C9FkuRek2C05pIQiFx_qChsOWjUxlYfjrfVITIWtt2jjujFHG94CJ63Ssd1UHYJim03KDb6VRghLeKjw Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c40fb3817b94adb97d02e5a2bd1f206", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b270c9997f31458ca90746e7dd495e78 Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '51930690-d603-42a9-a0b7-cbe01343dc93'} Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:44.274684 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:44.282460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:44.291787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Returning 404 to user: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:44.295315 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d98e7565-e92c-4460-b2ec-236eefb4c6a3 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 404 len: 111 microversion: 2.20 time: 0.107185 Jul 20 04:41:44.300637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3282/4407] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:41:44.312578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a0cd6d9-3ac1-4aac-90d8-6e83ec3cd75f tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.342121 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a0cd6d9-3ac1-4aac-90d8-6e83ec3cd75f tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031175 Jul 20 04:41:44.342706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3283/4408] 10.222.0.49 () {60 vars in 1192 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:41:44.364063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec0a5118-2321-4ad8-8d6b-4e0ea4a2bc4c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '.version_select at 0x7f83980c6700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.408345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec0a5118-2321-4ad8-8d6b-4e0ea4a2bc4c tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967071582" status: 204 len: 0 microversion: 2.20 time: 0.058801 Jul 20 04:41:44.410125 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3284/4409] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967071582 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:41:44.415892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8d9c0ab-28c3-4ef5-8339-525669ec63dc tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.435645 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8d9c0ab-28c3-4ef5-8339-525669ec63dc tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b" status: 200 len: 235 microversion: 2.64 time: 0.024277 Jul 20 04:41:44.436219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3285/4410] 10.222.0.49 () {60 vars in 1303 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b => generated 235 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:41:44.459462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46d00af0-3e62-4895-a54f-78003a1c242c tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.521771 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46d00af0-3e62-4895-a54f-78003a1c242c tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b" status: 204 len: 0 microversion: 2.64 time: 0.071025 Jul 20 04:41:44.524560 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3286/4411] 10.222.0.49 () {60 vars in 1306 bytes} [Wed Jul 20 04:41:44 2022] DELETE /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:41:44.543497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:44.544763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:44.563801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.564618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:44.565897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:44.566911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:45.135455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:45.148320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e4f28cc-9184-445d-9550-619fdd9f4638 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.620956 Jul 20 04:41:45.148954 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3287/4412] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:44 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:45.161285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef3428fe-cc12-449f-808f-5eff8e748845 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:45.177359 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ef3428fe-cc12-449f-808f-5eff8e748845 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] HTTP exception thrown: Instance group 96ac8d0a-758f-40bf-b305-13d6c60b2e6b could not be found. Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef3428fe-cc12-449f-808f-5eff8e748845 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Request method failure captured: Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b HTTP/1.1 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eGr4xhTPRypkssXWguVkCD_36qxGg5PN6zTt6pACzOoka6xiHdQeA1zpCFnQwKRxQy_vQyqG4MX3DcXHPCgShoiHyQ7omIeem-vK3fU53F3XcUS8mF-KASD4pi95fg-gHE04idLvYYLBFX_gsmIZdTDTgBh7U5Nnd1WAA0iu_tS8E Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.64 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: bc0996f5572945d2b45c07896d7d04d5 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerGroup264TestJSON-1005523725 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bc0996f5572945d2b45c07896d7d04d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc0996f5572945d2b45c07896d7d04d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bc0996f5572945d2b45c07896d7d04d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bc0996f5572945d2b45c07896d7d04d5", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerGroup264TestJSON-1005523725 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: bc0996f5572945d2b45c07896d7d04d5 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1005523725 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerGroup264TestJSON-1005523725-project Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b65fcba0d1334f9cb6e6ca68c11336a1 Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerGroup264TestJSON-1005523725-project Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance group 96ac8d0a-758f-40bf-b305-13d6c60b2e6b could not be found. Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '96ac8d0a-758f-40bf-b305-13d6c60b2e6b'} Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 96ac8d0a-758f-40bf-b305-13d6c60b2e6b could not be found. Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 96ac8d0a-758f-40bf-b305-13d6c60b2e6b could not be found. Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.179042 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 96ac8d0a-758f-40bf-b305-13d6c60b2e6b could not be found. Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef3428fe-cc12-449f-808f-5eff8e748845 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] Returning 404 to user: Instance group 96ac8d0a-758f-40bf-b305-13d6c60b2e6b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef3428fe-cc12-449f-808f-5eff8e748845 tempest-ServerGroup264TestJSON-1005523725 tempest-ServerGroup264TestJSON-1005523725-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b" status: 404 len: 117 microversion: 2.64 time: 0.026964 Jul 20 04:41:45.184588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3288/4413] 10.222.0.49 () {60 vars in 1306 bytes} [Wed Jul 20 04:41:45 2022] DELETE /compute/v2.1/os-server-groups/96ac8d0a-758f-40bf-b305-13d6c60b2e6b => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:41:46.166420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:46.167173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:46.181426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.189320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.191487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:46.192282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:46.575998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:46.584895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af779559-d4f8-4651-8b83-39ff0f8c41ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.422447 Jul 20 04:41:46.593702 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3289/4414] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:46 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:47.611478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:47.612163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:47.625019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.625466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:47.626257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:47.626682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.189503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:48.201736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf0b82b4-7813-4efb-bc01-60dbb41d581c tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.594908 Jul 20 04:41:48.203535 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3290/4415] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:47 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:48.216098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1f53aea8-d727-4f1a-b44d-1f72c11518f9 req-39af6973-0bf8-416c-949a-25d26aacaabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6afc0aa-9b55-4e4f-9b2d-17c265f00d89", "tag": "618aa944-356c-4529-bb5c-0faddba41b20"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:48.242975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1f53aea8-d727-4f1a-b44d-1f72c11518f9 req-39af6973-0bf8-416c-949a-25d26aacaabe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:48.245581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1f53aea8-d727-4f1a-b44d-1f72c11518f9 req-39af6973-0bf8-416c-949a-25d26aacaabe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:48.270329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1f53aea8-d727-4f1a-b44d-1f72c11518f9 req-39af6973-0bf8-416c-949a-25d26aacaabe service nova] Creating event network-changed:618aa944-356c-4529-bb5c-0faddba41b20 for instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 on n-h1-764486-11 Jul 20 04:41:48.277761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1f53aea8-d727-4f1a-b44d-1f72c11518f9 req-39af6973-0bf8-416c-949a-25d26aacaabe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070456 Jul 20 04:41:48.278927 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3291/4416] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:49.221145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:49.231615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:49.256808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.257316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.258041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:49.263307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:49.985574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:50.000699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fdee0e8-8dd6-4566-ab91-b724af7a0140 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.785093 Jul 20 04:41:50.010688 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3292/4417] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:49 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:51.017679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:51.018372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:51.041074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.041739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.042714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.043314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.512994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:51.636702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:51.671029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c691765-0619-40af-b958-051397523dd5 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.643008 Jul 20 04:41:51.674120 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3293/4418] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:51 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:51.972208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:51.973000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:51.989250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.990208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:51.991467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:51.991951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.028074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] HTTP exception thrown: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Request method failure captured: Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 HTTP/1.1 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Wj7i-SInEGEtuvkhxCNJQ0RaM0VZS97rGCf7SkYPSo0wTYVi0Mp0w-z99OP57ciGn9ANOYvqTDNGDRm4s0pFSXnBQ0Va4C9FkuRek2C05pIQiFx_qChsOWjUxlYfjrfVITIWtt2jjujFHG94CJ63Ssd1UHYJim03KDb6VRghLeKjw Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c40fb3817b94adb97d02e5a2bd1f206", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b270c9997f31458ca90746e7dd495e78 Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '51930690-d603-42a9-a0b7-cbe01343dc93'} Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:52.029840 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.035785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Returning 404 to user: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:52.037223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e49018ae-6194-46cd-9c07-72f38f3ec693 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 404 len: 111 microversion: 2.20 time: 0.063632 Jul 20 04:41:52.038006 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3294/4419] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:41:51 2022] DELETE /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:41:52.046372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:52.047005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 51930690-d603-42a9-a0b7-cbe01343dc93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:52.058832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.059296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.060095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.072367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.088934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] HTTP exception thrown: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Request method failure captured: Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 HTTP/1.1 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Wj7i-SInEGEtuvkhxCNJQ0RaM0VZS97rGCf7SkYPSo0wTYVi0Mp0w-z99OP57ciGn9ANOYvqTDNGDRm4s0pFSXnBQ0Va4C9FkuRek2C05pIQiFx_qChsOWjUxlYfjrfVITIWtt2jjujFHG94CJ63Ssd1UHYJim03KDb6VRghLeKjw Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c40fb3817b94adb97d02e5a2bd1f206", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b270c9997f31458ca90746e7dd495e78 Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '51930690-d603-42a9-a0b7-cbe01343dc93'} Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.090973 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. Jul 20 04:41:52.096428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:52.097997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Returning 404 to user: Instance 51930690-d603-42a9-a0b7-cbe01343dc93 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:52.099029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ba7cf8e-feb8-4f75-b1cc-4aae762198f5 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93" status: 404 len: 111 microversion: 2.20 time: 0.057368 Jul 20 04:41:52.100157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3295/4420] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:52 2022] GET /compute/v2.1/servers/51930690-d603-42a9-a0b7-cbe01343dc93 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:41:52.690647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:52.692617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:52.711142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.713156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:52.714179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:52.719534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:53.428298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:53.441098 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de9b6ec6-a0cf-47e4-b922-e5d733ceee70 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.755307 Jul 20 04:41:53.442613 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3296/4421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:52 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:54.474175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:54.474840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:54.486662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:54.504379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.505070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.506031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:54.506638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:54.980070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:54.992096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e380519d-8be2-49ea-914b-5e5ea2bb4743 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.535369 Jul 20 04:41:55.005441 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3297/4422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:54 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:56.009919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.011327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.023467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.026107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.027541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.041604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.471921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:56.505869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f03d3cfa-9c5d-45a4-9d2f-2abcbc3f16f7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.495181 Jul 20 04:41:56.515831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3298/4423] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:56 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:56.521187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1866012a-9d4b-4bd5-aa02-07b8766da116 req-4c8dae52-a825-441c-b878-7f0d9fa4b601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6afc0aa-9b55-4e4f-9b2d-17c265f00d89", "name": "network-vif-plugged", "status": "completed", "tag": "618aa944-356c-4529-bb5c-0faddba41b20"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:56.572273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1866012a-9d4b-4bd5-aa02-07b8766da116 req-4c8dae52-a825-441c-b878-7f0d9fa4b601 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.572796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1866012a-9d4b-4bd5-aa02-07b8766da116 req-4c8dae52-a825-441c-b878-7f0d9fa4b601 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.609261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1866012a-9d4b-4bd5-aa02-07b8766da116 req-4c8dae52-a825-441c-b878-7f0d9fa4b601 service nova] Creating event network-vif-plugged:618aa944-356c-4529-bb5c-0faddba41b20 for instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 on n-h1-764486-11 Jul 20 04:41:56.627501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1866012a-9d4b-4bd5-aa02-07b8766da116 req-4c8dae52-a825-441c-b878-7f0d9fa4b601 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109014 Jul 20 04:41:56.627501 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3299/4424] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:41:56.699785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.700564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.719456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.723478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.727296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.736174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.769536 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] HTTP exception thrown: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Request method failure captured: Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc HTTP/1.1 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Wj7i-SInEGEtuvkhxCNJQ0RaM0VZS97rGCf7SkYPSo0wTYVi0Mp0w-z99OP57ciGn9ANOYvqTDNGDRm4s0pFSXnBQ0Va4C9FkuRek2C05pIQiFx_qChsOWjUxlYfjrfVITIWtt2jjujFHG94CJ63Ssd1UHYJim03KDb6VRghLeKjw Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c40fb3817b94adb97d02e5a2bd1f206", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b270c9997f31458ca90746e7dd495e78 Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '784190f6-370f-4649-9bee-c669f705e6fc'} Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:56.772905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.778850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.780910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Returning 404 to user: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:56.781978 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37ef568a-2014-4159-b874-ce89feeafcde tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 404 len: 111 microversion: 2.20 time: 0.086752 Jul 20 04:41:56.786776 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3300/4425] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:41:56 2022] DELETE /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:41:56.793857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:56.794745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] [instance: 784190f6-370f-4649-9bee-c669f705e6fc] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:56.802683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.803443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.806236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:56.806914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:56.834482 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] HTTP exception thrown: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Request method failure captured: Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc HTTP/1.1 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14Wj7i-SInEGEtuvkhxCNJQ0RaM0VZS97rGCf7SkYPSo0wTYVi0Mp0w-z99OP57ciGn9ANOYvqTDNGDRm4s0pFSXnBQ0Va4C9FkuRek2C05pIQiFx_qChsOWjUxlYfjrfVITIWtt2jjujFHG94CJ63Ssd1UHYJim03KDb6VRghLeKjw Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c40fb3817b94adb97d02e5a2bd1f206"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c40fb3817b94adb97d02e5a2bd1f206", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7c40fb3817b94adb97d02e5a2bd1f206 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-197498640 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b270c9997f31458ca90746e7dd495e78 Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-197498640-project Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '784190f6-370f-4649-9bee-c669f705e6fc'} Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.836460 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. Jul 20 04:41:56.841914 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:41:56.843555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] Returning 404 to user: Instance 784190f6-370f-4649-9bee-c669f705e6fc could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:41:56.844894 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-763e02e4-f9e5-42f0-8dae-04eb7dca4e17 tempest-AttachVolumeShelveTestJSON-197498640 tempest-AttachVolumeShelveTestJSON-197498640-project] 10.222.0.49 "GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc" status: 404 len: 111 microversion: 2.20 time: 0.056774 Jul 20 04:41:56.849311 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3301/4426] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:41:56 2022] GET /compute/v2.1/servers/784190f6-370f-4649-9bee-c669f705e6fc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:41:57.526187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:57.527538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:57.534708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:41:57.556833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.560772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:57.561889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:57.567461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:58.059374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:58.072744 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a2e953d-2c81-4d05-b69b-eb278da6899d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1309 microversion: 2.1 time: 0.552649 Jul 20 04:41:58.075108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3302/4427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:57 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1309 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:41:59.101739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:41:59.101739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:59.113318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.113939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.114744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.115184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.943552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:41:59.952390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-adef1b90-4aff-4bfe-979a-af7b99839591 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1490 microversion: 2.1 time: 0.864233 Jul 20 04:41:59.957481 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3303/4428] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:41:59 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1490 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:41:59.977981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-855908224"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:41:59.979472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:41:59.994047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.994687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:41:59.995655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:41:59.996265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.166442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3bdd58d9-9405-48c5-8d8f-651c723ad85b tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "PUT /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1074 microversion: 2.1 time: 0.196670 Jul 20 04:42:00.171570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3304/4429] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:41:59 2022] PUT /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1074 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:00.197487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:00.198501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:00.218182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.219927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.222586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.224182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.750956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:00.765227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d151b92c-be46-46af-a624-1bf536ee7288 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1500 microversion: 2.1 time: 0.584090 Jul 20 04:42:00.766818 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3305/4430] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:00 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1500 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:00.786485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:00.787390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:00.821193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.821908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:00.822871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:00.823479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.338658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:01.388158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38a6cdd4-1b44-464c-9f36-c9f43deac575 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1500 microversion: 2.1 time: 0.607914 Jul 20 04:42:01.407391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3306/4431] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:00 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1500 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:01.414332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b58cbd2-1918-4cd2-90e9-e148aa5296ff tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:01.438457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b58cbd2-1918-4cd2-90e9-e148aa5296ff tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.466042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b58cbd2-1918-4cd2-90e9-e148aa5296ff tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.507185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b58cbd2-1918-4cd2-90e9-e148aa5296ff tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 04:42:01.517112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:01.602766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b58cbd2-1918-4cd2-90e9-e148aa5296ff tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "POST /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89/action" status: 202 len: 0 microversion: 2.1 time: 0.191424 Jul 20 04:42:01.603390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3307/4432] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:42:01 2022] POST /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:01.613647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:01.614704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:01.624344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.625222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:01.626281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:01.627188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:02.100274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:02.114467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9236aeee-2678-44e4-82cf-59d9df26b77d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.506153 Jul 20 04:42:02.125570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3308/4433] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:01 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:03.135098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:03.135763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:03.151546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:03.152001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:03.152914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:03.153353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:03.641488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:03.671504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3dce4f3-2b5d-4c23-abde-1e75d21874cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.540167 Jul 20 04:42:03.676875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3309/4434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:03 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:04.695501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:04.696941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:04.706575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:04.707691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:04.711411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:04.712218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:05.287224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:05.299246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c31df5cd-ca1e-49fc-ab29-0bf61f4b7d62 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.606666 Jul 20 04:42:05.308956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3310/4435] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:04 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:06.324659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:06.325253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:06.352406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.352872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.353690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:06.354133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:06.832997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:06.847660 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf16280d-0773-45bc-8c37-5ef6e1491a47 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.525182 Jul 20 04:42:06.860180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3311/4436] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:06 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:07.866898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:07.867495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:07.948505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:07.955284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:07.958182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:07.959456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:08.743070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:08.756291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d0a542f-0d36-423f-bcf1-355e3c225eb7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.895189 Jul 20 04:42:08.756938 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3312/4437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:07 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:09.072565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a10eca2-25bb-4ab0-aca4-bb9c5ef984b4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: .version_select at 0x7f838af50d30>, body: {"keypair": {"name": "tempest-keypair-2142117627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOTSudaOn+9dBOdM9ebylRoQgB9e7kx2X3ZZR7dsnfNPVoTkzJQNAyCghn8kcGKpoDX3v6RTPA+Ae5W6jhfXxwV4x+Q1shfY/plei+OvAQjWz+9nL+Fgv87mKV+FojB2w=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:09.097627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2a10eca2-25bb-4ab0-aca4-bb9c5ef984b4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:09.105454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2a10eca2-25bb-4ab0-aca4-bb9c5ef984b4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:09.179193 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a10eca2-25bb-4ab0-aca4-bb9c5ef984b4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.420724 Jul 20 04:42:09.179856 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3313/4438] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:42:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:09.774983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:09.775860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:09.794246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.798016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:09.800939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:09.803250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:10.179671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:10.192430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9b97616-ddd0-4aa1-9775-7e4512925304 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.422214 Jul 20 04:42:10.207303 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3314/4439] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:09 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:11.219947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:11.221538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:11.251116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:11.251705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:11.252610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:11.253733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:11.560749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:11.571033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02df3d21-3634-4fd1-b438-074c0bbfaeaf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.362290 Jul 20 04:42:11.571832 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3315/4440] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:11 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:11.993123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca3fc1f9-af06-4517-9447-9c54c9989fc3 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Action: 'create', calling method: .version_select at 0x7f838ae90040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-29878967", "metadata": {"Type": "work"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:12.866930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca3fc1f9-af06-4517-9447-9c54c9989fc3 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.293727 Jul 20 04:42:12.870051 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3316/4441] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jul 20 04:42:11 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1297 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 04:42:12.877247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-826607621", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2e3bd6f-916b-4434-a9b5-9f9d528c43af"}], "security_groups": [{"name": "tempest-securitygroup--380087083"}], "key_name": "tempest-keypair-2142117627", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:13.137071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] validate_networks() for [('d2e3bd6f-916b-4434-a9b5-9f9d528c43af', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:42:14.599594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:42:14.600436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:42:14.600583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:42:14.600910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:42:14.601332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:42:14.615898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:14.616371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:14.617182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:14.617617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:14.641584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:14.651001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:14.678765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:42:14.681779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:42:14.757132 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-345e6dc3-5da1-466a-b99e-d85064558180 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.885731 Jul 20 04:42:14.760981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3317/4442] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:42:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:42:14.772920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:14.773549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:14.783194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:14.783938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:14.785300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:14.787760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:15.289939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:15.316397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8c8fee9-07d9-4a23-b063-1e3702fead51 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.554106 Jul 20 04:42:15.330376 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3318/4443] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:14 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:15.335182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7fce5b4-9e1c-4a1b-8a58-486036c84310 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f838b078820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:15.464079 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7fce5b4-9e1c-4a1b-8a58-486036c84310 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 200 len: 352 microversion: 2.1 time: 0.139467 Jul 20 04:42:15.465035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3319/4444] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:15 2022] GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:15.470143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-517c70aa-02bc-4b2a-9d77-7661199a9ea4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:15.472527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-517c70aa-02bc-4b2a-9d77-7661199a9ea4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:15.657343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-517c70aa-02bc-4b2a-9d77-7661199a9ea4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:15.689792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-517c70aa-02bc-4b2a-9d77-7661199a9ea4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1241 microversion: 2.1 time: 0.221020 Jul 20 04:42:15.692911 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3320/4445] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:15 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1241 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:15.708446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-601b5b46-2e51-4513-80bb-6562abd8d89d tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f838b296310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:15.814251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-601b5b46-2e51-4513-80bb-6562abd8d89d tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 200 len: 352 microversion: 2.1 time: 0.110335 Jul 20 04:42:15.816070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3321/4446] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:15 2022] GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:15.828153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8fcdcb9-ba45-40b1-b247-cd47d5fcd8e8 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f838af19b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.051274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8fcdcb9-ba45-40b1-b247-cd47d5fcd8e8 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 202 len: 0 microversion: 2.1 time: 0.226799 Jul 20 04:42:16.052159 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3322/4447] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:42:15 2022] DELETE /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:42:16.063839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6322c6d2-ae61-46db-a88d-cf05a5e89ce3 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f838bbd6700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.272831 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6322c6d2-ae61-46db-a88d-cf05a5e89ce3 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 200 len: 351 microversion: 2.1 time: 0.215436 Jul 20 04:42:16.274138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3323/4448] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:16 2022] GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 351 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:16.341287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.342194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:16.350632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.351354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.352318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.353735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.885374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:16.902346 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f3cc765-1c3a-4bab-9737-4eac9784a1ac tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.565084 Jul 20 04:42:16.904599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3324/4449] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:16 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:16.926133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:16.934447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:16.981789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.982260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:16.989352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:16.995711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.274828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:17.289142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8eefadb4-d1f7-429c-b339-f5269f7a2487 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1311 microversion: 2.1 time: 0.381575 Jul 20 04:42:17.291941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3325/4450] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:16 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1311 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:17.301351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99326a21-913f-45fd-8814-6bc7077506fc tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f838a0f1dc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:17.408115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99326a21-913f-45fd-8814-6bc7077506fc tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 200 len: 351 microversion: 2.1 time: 0.112217 Jul 20 04:42:17.408908 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3326/4451] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:17 2022] GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:17.927107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:17.929815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:17.962215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:17.963407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:17.965236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:17.966318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.399672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.410018 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b07fa5e-441b-4364-acfa-ee425c0ce3a8 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.492580 Jul 20 04:42:18.422338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3327/4452] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:17 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:18.433755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:18.436936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:18.449985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.452315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.455497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:18.456535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:18.803328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:18.821181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d391394-65c5-4240-bfeb-8573430e7029 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.392798 Jul 20 04:42:18.832684 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3328/4453] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:18 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:18.860136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82860a00-9ef0-4e13-b69c-7e85c9486a83 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f839cda4790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:18.986549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82860a00-9ef0-4e13-b69c-7e85c9486a83 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 200 len: 351 microversion: 2.1 time: 0.152646 Jul 20 04:42:18.988478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3329/4454] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:18 2022] GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:19.429546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:19.430576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:19.471476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.476394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.481045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:19.484689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:19.936525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:19.969782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7caa36d-b577-4357-b072-95e54854d242 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.544111 Jul 20 04:42:19.974613 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3330/4455] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:19 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:19.996236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:19.998666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:20.018593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.019073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:20.019901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.020364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:20.567475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:20.586303 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2cc49ad7-c21e-4ff6-8c2e-962cd3a821fb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.604755 Jul 20 04:42:20.587917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3331/4456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:19 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:20.603455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dec1a01a-bbe7-4958-9aee-e15614e28349 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Calling method '.version_select at 0x7f839cda44c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:20.694945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dec1a01a-bbe7-4958-9aee-e15614e28349 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] HTTP exception thrown: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dec1a01a-bbe7-4958-9aee-e15614e28349 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Request method failure captured: Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f HTTP/1.1 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ejcABKCS_uH0ZdfsAzYd7FIZMDgBZocuK5nY5EKn0fAmavuD4vaBsoKRffuivvOssiK5x1AgXJSIjfXj77ZjAqnzLyKdfhRLKTRqRnvc8pYfiA0Ogj2mLZgyQiAmtV7gC5M73HclQSk9MITsaaa9BPqjlwAnWHP0XFFHYunFPxYw0 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1e4f313315d342a782830450069e74d8 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesGetTestJSON-1801300756 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1e4f313315d342a782830450069e74d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e4f313315d342a782830450069e74d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e4f313315d342a782830450069e74d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1e4f313315d342a782830450069e74d8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesGetTestJSON-1801300756 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1e4f313315d342a782830450069e74d8 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesGetTestJSON-1801300756 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesGetTestJSON-1801300756-project Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 82a07aa5326042aab50ee5c6ae423cd0 Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesGetTestJSON-1801300756-project Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3ea7bedf-fb2d-499a-a9e0-4a8c1819957f'} Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. (HTTP 404) (Request-ID: req-595b037e-00bf-4c4b-9fca-6c21ba2e69bc) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:42:20.711730 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dec1a01a-bbe7-4958-9aee-e15614e28349 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] Returning 404 to user: Volume 3ea7bedf-fb2d-499a-a9e0-4a8c1819957f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dec1a01a-bbe7-4958-9aee-e15614e28349 tempest-VolumesGetTestJSON-1801300756 tempest-VolumesGetTestJSON-1801300756-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f" status: 404 len: 109 microversion: 2.1 time: 0.124448 Jul 20 04:42:20.717779 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3332/4457] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:20 2022] GET /compute/v2.1/os-volumes/3ea7bedf-fb2d-499a-a9e0-4a8c1819957f => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:20.733099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c874fda5-dd3a-4414-adb1-1ad417f1e1d6 req-594eff7b-74d3-414a-bdb6-ba8c572f2934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac1974-1ab0-4cd6-8509-9a82ca7855d3", "tag": "79853aae-7bce-42a9-ad25-ae6e64357507"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:20.771093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c874fda5-dd3a-4414-adb1-1ad417f1e1d6 req-594eff7b-74d3-414a-bdb6-ba8c572f2934 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:20.772592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c874fda5-dd3a-4414-adb1-1ad417f1e1d6 req-594eff7b-74d3-414a-bdb6-ba8c572f2934 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:20.818762 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c874fda5-dd3a-4414-adb1-1ad417f1e1d6 req-594eff7b-74d3-414a-bdb6-ba8c572f2934 service nova] Creating event network-changed:79853aae-7bce-42a9-ad25-ae6e64357507 for instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 on n-h2-764486-11 Jul 20 04:42:20.837981 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c874fda5-dd3a-4414-adb1-1ad417f1e1d6 req-594eff7b-74d3-414a-bdb6-ba8c572f2934 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119174 Jul 20 04:42:20.841138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3333/4458] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:20.992644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:20.993975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:21.007894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.009285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.010306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.010925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.734688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:21.738643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:21.764034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6287bb9-e703-4334-8574-7c525bbfb3e7 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.776299 Jul 20 04:42:21.767433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3334/4459] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:20 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:21.790383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:21.795026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:21.817115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.817858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:21.819204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:21.819678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.344589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:22.361021 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b37754c-40c5-4fcf-b938-de1675b53cc3 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.591050 Jul 20 04:42:22.365697 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3335/4460] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:21 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:22.785716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:22.786466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:22.803947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.804489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:22.805811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:22.806454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.136462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.150898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77caf3b7-5bd1-42b3-b64f-56307eab6c9f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.369962 Jul 20 04:42:23.165011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3336/4461] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:22 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:23.388033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:23.388917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:23.434917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.436605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.442538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:23.446125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:23.907206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:23.922541 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2850bc20-08ee-430f-97e9-8b86418b5c46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.543489 Jul 20 04:42:23.923330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3337/4462] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:23 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:24.181318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:24.182070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:24.191719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.192580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.193624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:24.194292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:24.631304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:25.349585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:25.358688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-896dd7f2-819b-4099-9797-68aa2538d2fb tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 1.184669 Jul 20 04:42:25.363589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3338/4463] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:24 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:25.383668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:25.386362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:25.395155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.396019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.397660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:25.398503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:25.667544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:25.902560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:25.946368 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25695b43-b4ef-4b8d-a6d9-d5d11a765a49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.580760 Jul 20 04:42:25.951875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3339/4464] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:25 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:26.391870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:26.405939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:26.417725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.425366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:26.426800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:26.427575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.073804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:27.129404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e82210d-c3c3-4e4c-91c0-81724c125115 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1510 microversion: 2.1 time: 0.732869 Jul 20 04:42:27.146148 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3340/4465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:26 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1510 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:27.152482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:27.157455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:27.171832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.172284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.173096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.173529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.450643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:27.462226 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce738456-7d08-42a2-aa3d-386245b83602 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.311978 Jul 20 04:42:27.471967 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3341/4466] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:27 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:27.482349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9e73d69-9724-4e6d-a1fe-b0d4a785e8e2 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b296e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:27.574884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9e73d69-9724-4e6d-a1fe-b0d4a785e8e2 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e83e081f-a402-4bc7-94c5-2167089e2759" status: 200 len: 351 microversion: 2.1 time: 0.101704 Jul 20 04:42:27.575990 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3342/4467] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:27 2022] GET /compute/v2.1/os-volumes/e83e081f-a402-4bc7-94c5-2167089e2759 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:27.602691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a56d3a24-a240-457f-b259-439066061d21 req-40c68c01-24d4-4f26-a9bf-46b6f003d5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac1974-1ab0-4cd6-8509-9a82ca7855d3", "name": "network-vif-plugged", "status": "completed", "tag": "79853aae-7bce-42a9-ad25-ae6e64357507"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:27.613885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a56d3a24-a240-457f-b259-439066061d21 req-40c68c01-24d4-4f26-a9bf-46b6f003d5a3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:27.614447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a56d3a24-a240-457f-b259-439066061d21 req-40c68c01-24d4-4f26-a9bf-46b6f003d5a3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:27.646815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a56d3a24-a240-457f-b259-439066061d21 req-40c68c01-24d4-4f26-a9bf-46b6f003d5a3 service nova] Creating event network-vif-plugged:79853aae-7bce-42a9-ad25-ae6e64357507 for instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 on n-h2-764486-11 Jul 20 04:42:27.655624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a56d3a24-a240-457f-b259-439066061d21 req-40c68c01-24d4-4f26-a9bf-46b6f003d5a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056577 Jul 20 04:42:27.660399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3343/4468] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:28.153888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.155854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.171278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:28.176307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.179336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.180912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.181604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.665730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:28.684933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-452b1f28-f357-4673-9c7d-010828e2de02 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1487 microversion: 2.1 time: 0.529031 Jul 20 04:42:28.685626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3344/4469] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1487 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:28.692171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:28.693350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:28.702825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.705997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.716197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:28.717724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:28.970454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:28.979748 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8ea702b-f268-4919-baef-11fdd78f76ea tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1366 microversion: 2.1 time: 0.292630 Jul 20 04:42:28.984188 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3345/4470] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:28 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:29.007218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1487319036"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:29.011343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.025851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.026642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.028911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.032792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.206940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec51f6f6-939d-42c9-975a-d5a1bc5312c3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "PUT /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1061 microversion: 2.1 time: 0.221074 Jul 20 04:42:29.214880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3346/4471] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:42:28 2022] PUT /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1061 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:29.226581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:29.231139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.240849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.243580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.244659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.246886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.608387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:29.619176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17226e91-ab66-494e-973f-e0bcca75a15d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1488 microversion: 2.1 time: 0.400689 Jul 20 04:42:29.619746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3347/4472] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:29 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1488 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:29.637351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:29.638355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:29.649810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.657207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:29.658332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:29.658929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.008861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.019889 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5da51d32-a177-419e-bcf9-e065c1a8b263 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1488 microversion: 2.1 time: 0.387631 Jul 20 04:42:30.020331 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3348/4473] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:29 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:30.033292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.038084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.069013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.070162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.071342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.075696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.365379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:30.376192 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aad6a1ac-4b74-4942-baa9-a40e7da1ada9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1555 microversion: 2.1 time: 0.353481 Jul 20 04:42:30.377674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3349/4474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1555 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:30.384673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.385476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.393288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.394421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.396634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.399015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.457610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:30.615912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:42:30.692070 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-941d1a0e-3d5c-49d2-a66a-5b5eb1368f09 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 204 len: 0 microversion: 2.1 time: 0.312392 Jul 20 04:42:30.697832 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3350/4475] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:30 2022] DELETE /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:42:30.717102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:30.718057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:30.726350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.727234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.728453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:30.732647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:30.978983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec652113-a311-4458-9549-d09d62d7c308 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275066 Jul 20 04:42:30.980219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3351/4476] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-interface => generated 284 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:30.985821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7add3d66-4008-450e-a4e5-1febbf10e3d2 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838affedc0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:31.070568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7add3d66-4008-450e-a4e5-1febbf10e3d2 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ce119871-5834-4c5d-b022-52ed338f90bf" status: 200 len: 351 microversion: 2.1 time: 0.088756 Jul 20 04:42:31.071619 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3352/4477] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:30 2022] GET /compute/v2.1/os-volumes/ce119871-5834-4c5d-b022-52ed338f90bf => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:31.077183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:31.078304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:31.094052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.094589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.095305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:31.096333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:31.339545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:31.351369 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-828dce7a-b851-4b27-90b3-f4140e92b5cc tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1494 microversion: 2.1 time: 0.277955 Jul 20 04:42:31.351970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3353/4478] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:31 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1494 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:32.375863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:32.389106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:32.412262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.420958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:32.422290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:32.422902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:33.275025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:33.288988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b32c160-5828-49c1-9e74-28c0e6c34439 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1494 microversion: 2.1 time: 0.921661 Jul 20 04:42:33.291203 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3354/4479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:32 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1494 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:33.996809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cb87a461-ed62-4177-9f23-d919774e3ef2 req-a613fd53-0017-4cc0-a460-cc09b9ed29df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6afc0aa-9b55-4e4f-9b2d-17c265f00d89", "name": "network-vif-deleted", "tag": "618aa944-356c-4529-bb5c-0faddba41b20"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:34.087170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cb87a461-ed62-4177-9f23-d919774e3ef2 req-a613fd53-0017-4cc0-a460-cc09b9ed29df service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.087976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cb87a461-ed62-4177-9f23-d919774e3ef2 req-a613fd53-0017-4cc0-a460-cc09b9ed29df service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.151408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cb87a461-ed62-4177-9f23-d919774e3ef2 req-a613fd53-0017-4cc0-a460-cc09b9ed29df service nova] Creating event network-vif-deleted:618aa944-356c-4529-bb5c-0faddba41b20 for instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 on n-h1-764486-11 Jul 20 04:42:34.186206 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cb87a461-ed62-4177-9f23-d919774e3ef2 req-a613fd53-0017-4cc0-a460-cc09b9ed29df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194110 Jul 20 04:42:34.195467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3355/4480] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:34.307959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:34.309034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:34.319089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.323362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.329671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.330802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.438829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:34.440559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:34.441373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lazy-loading 'fault' on Instance uuid f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:34.529305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:34.558562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8794f29c-2811-4984-a5ef-9b3e1e531f46 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 200 len: 1310 microversion: 2.1 time: 0.250209 Jul 20 04:42:34.561539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3356/4481] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:34.576590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ded11e1b-3004-43d7-aff5-04595624aa9e tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838aede280>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:34.715644 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ded11e1b-3004-43d7-aff5-04595624aa9e tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7ce48ac9-8ebf-4151-9f91-d7077b0e5859" status: 200 len: 351 microversion: 2.1 time: 0.151282 Jul 20 04:42:34.716420 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3357/4482] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/os-volumes/7ce48ac9-8ebf-4151-9f91-d7077b0e5859 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:34.729898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd188cfc-c9f2-4562-9c12-09d2ae4d37a8 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b078940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:34.937120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd188cfc-c9f2-4562-9c12-09d2ae4d37a8 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.212044 Jul 20 04:42:34.938107 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3358/4483] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:34.950627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-917afb4f-e01c-4d2a-81ab-e1405a65b106 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f839ce18940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.128161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-917afb4f-e01c-4d2a-81ab-e1405a65b106 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.181229 Jul 20 04:42:35.135262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3359/4484] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jul 20 04:42:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:35.141712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8c242da-fcb2-4241-b417-052789bbbbde tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838af19790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.310568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8c242da-fcb2-4241-b417-052789bbbbde tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.173054 Jul 20 04:42:35.311756 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3360/4485] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.323083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8821d505-1b57-4329-bbad-a484d7023790 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b296e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.453792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8821d505-1b57-4329-bbad-a484d7023790 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.134186 Jul 20 04:42:35.462848 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3361/4486] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:35.468861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b962a28-3f6f-48ee-9a55-f40f2e670b1e tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b044670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.611710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b962a28-3f6f-48ee-9a55-f40f2e670b1e tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.147360 Jul 20 04:42:35.624343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3362/4487] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:35.631219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.632027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.649914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.650659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.652132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.652818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.684242 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 HTTP/1.1 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f6afc0aa-9b55-4e4f-9b2d-17c265f00d89'} Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.694378 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1539a85e-350f-4dfc-b1c5-18b071478acf tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 404 len: 111 microversion: 2.1 time: 0.069998 Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3363/4488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:35.705449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bab7e809-d15c-472b-80bd-fe1536603b26 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b296b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.852985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bab7e809-d15c-472b-80bd-fe1536603b26 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.155167 Jul 20 04:42:35.853682 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3364/4489] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:35.858436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.858988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:35.872924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.873382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.874404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:35.874704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:35.892868 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 HTTP/1.1 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f6afc0aa-9b55-4e4f-9b2d-17c265f00d89'} Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:35.894482 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df1a3c31-56c5-492c-b1bb-8e03e95ddd38 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 404 len: 111 microversion: 2.1 time: 0.041394 Jul 20 04:42:35.899683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3365/4490] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:35 2022] DELETE /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:35.902587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-efb633f6-12f6-448f-88dd-21b05f15d312 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b296b80>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.986749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-efb633f6-12f6-448f-88dd-21b05f15d312 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088590 Jul 20 04:42:35.987534 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3366/4491] 10.222.0.49 () {58 vars in 1187 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:35.992759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:35.993385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: f6afc0aa-9b55-4e4f-9b2d-17c265f00d89] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.006935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.008006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.009168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.009807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.027123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 HTTP/1.1 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f6afc0aa-9b55-4e4f-9b2d-17c265f00d89'} Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.029767 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b934a49-22f2-49c7-ba5e-f732ed0a74c1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89" status: 404 len: 111 microversion: 2.1 time: 0.042656 Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3367/4492] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:35 2022] GET /compute/v2.1/servers/f6afc0aa-9b55-4e4f-9b2d-17c265f00d89 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.039043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4578180-52db-48da-b8af-54ecfb85e8e5 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] Calling method '.version_select at 0x7f838b2965e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.145105 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4578180-52db-48da-b8af-54ecfb85e8e5 tempest-VolumesTestJSON-1419899229 tempest-VolumesTestJSON-1419899229-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.110755 Jul 20 04:42:36.146721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3368/4493] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:36.155292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.157693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.178900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.179406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.180847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.182305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.218239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f HTTP/1.1 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd3cd6e1f-4f33-48f6-8f7a-61919075b43f'} Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.219879 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.224803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54caef4e-7007-4c9a-9e6d-7d570926926a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 404 len: 111 microversion: 2.1 time: 0.076416 Jul 20 04:42:36.225679 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3369/4494] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:36 2022] DELETE /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.235443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.238862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: d3cd6e1f-4f33-48f6-8f7a-61919075b43f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.253446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.253899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.254688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.255118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.281078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f HTTP/1.1 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd3cd6e1f-4f33-48f6-8f7a-61919075b43f'} Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.283173 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance d3cd6e1f-4f33-48f6-8f7a-61919075b43f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.287934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65ddd8b0-76f7-4f63-97e2-b44ddf01373a tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f" status: 404 len: 111 microversion: 2.1 time: 0.055129 Jul 20 04:42:36.289381 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3370/4495] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/d3cd6e1f-4f33-48f6-8f7a-61919075b43f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.298159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.299277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.308978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.310017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.312964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.313367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.343154 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c HTTP/1.1 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a7969f36-6883-463c-9528-32e9d6fd120c'} Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.345457 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.350733 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.358731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.359834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ad2b338-292e-4726-b720-6d054fe085f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 404 len: 111 microversion: 2.1 time: 0.067633 Jul 20 04:42:36.360923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3371/4496] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:36 2022] DELETE /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.375544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.378932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: a7969f36-6883-463c-9528-32e9d6fd120c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.398904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.399359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.400146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.401024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.431235 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c HTTP/1.1 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a7969f36-6883-463c-9528-32e9d6fd120c'} Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.432843 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance a7969f36-6883-463c-9528-32e9d6fd120c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c4bda99-65b0-48f2-8e46-d2f3e42e80a1 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c" status: 404 len: 111 microversion: 2.1 time: 0.067427 Jul 20 04:42:36.438534 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3372/4497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/a7969f36-6883-463c-9528-32e9d6fd120c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.445120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f19cf394-3c39-4d62-a45a-61a41fd23fa2 req-a424bfeb-256d-4a6b-9e2d-8735467ca158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eac1974-1ab0-4cd6-8509-9a82ca7855d3", "tag": "79853aae-7bce-42a9-ad25-ae6e64357507"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:36.455523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f19cf394-3c39-4d62-a45a-61a41fd23fa2 req-a424bfeb-256d-4a6b-9e2d-8735467ca158 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.455974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f19cf394-3c39-4d62-a45a-61a41fd23fa2 req-a424bfeb-256d-4a6b-9e2d-8735467ca158 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.473816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f19cf394-3c39-4d62-a45a-61a41fd23fa2 req-a424bfeb-256d-4a6b-9e2d-8735467ca158 service nova] Creating event network-changed:79853aae-7bce-42a9-ad25-ae6e64357507 for instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 on n-h2-764486-11 Jul 20 04:42:36.480918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f19cf394-3c39-4d62-a45a-61a41fd23fa2 req-a424bfeb-256d-4a6b-9e2d-8735467ca158 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Jul 20 04:42:36.481789 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3373/4498] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:42:36.527234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.527828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.537433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.537903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.539212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.539809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.562286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e HTTP/1.1 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5606b7c0-92ec-48cb-9ce5-2e206b08f84e'} Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.564330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3a9d3ab-6dee-49f6-82c6-07acf2ccbf7d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 404 len: 111 microversion: 2.1 time: 0.078731 Jul 20 04:42:36.570096 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3374/4499] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:36 2022] DELETE /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.575706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.576438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 5606b7c0-92ec-48cb-9ce5-2e206b08f84e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.584583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.585143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.586060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.586504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.605239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e HTTP/1.1 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '5606b7c0-92ec-48cb-9ce5-2e206b08f84e'} Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.607846 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 5606b7c0-92ec-48cb-9ce5-2e206b08f84e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.613464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d413c0c1-6e32-4c81-82b1-67a2ead1d1d3 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e" status: 404 len: 111 microversion: 2.1 time: 0.038299 Jul 20 04:42:36.614284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3375/4500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/5606b7c0-92ec-48cb-9ce5-2e206b08f84e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.619094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.619872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.629434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.629967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.631019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.632232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.654812 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 HTTP/1.1 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e311fcde-fc48-4d7f-aaab-a95970ecfe43'} Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.678725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.685753 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.689619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.696002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2edb353-e42f-41ed-9336-93529a85cc1d tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 404 len: 111 microversion: 2.1 time: 0.076454 Jul 20 04:42:36.696679 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3376/4501] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:36 2022] DELETE /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.711848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.712804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: e311fcde-fc48-4d7f-aaab-a95970ecfe43] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.721468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.722208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.757898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.759882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.790592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 HTTP/1.1 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e311fcde-fc48-4d7f-aaab-a95970ecfe43'} Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.793024 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.802798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.802798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.802798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.802798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.802798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. Jul 20 04:42:36.802798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.804001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance e311fcde-fc48-4d7f-aaab-a95970ecfe43 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.808288 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c980d4d-e56d-420b-861a-94bfaa75fb13 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43" status: 404 len: 111 microversion: 2.1 time: 0.105715 Jul 20 04:42:36.813073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3377/4502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/e311fcde-fc48-4d7f-aaab-a95970ecfe43 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.828677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.829379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.843507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.846475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.847732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.848693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.898548 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 HTTP/1.1 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3a175cb7-41da-443e-9250-89fc41195b62'} Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.900706 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.906123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.907428 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a13e0c19-27d3-4f48-85d4-9d390ca3bc5f tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 404 len: 111 microversion: 2.1 time: 0.091034 Jul 20 04:42:36.915217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3378/4503] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:36 2022] DELETE /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.921979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:36.923364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3a175cb7-41da-443e-9250-89fc41195b62] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:36.937867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.939663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.941151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:36.943754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:36.974392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 HTTP/1.1 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3a175cb7-41da-443e-9250-89fc41195b62'} Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.977739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:36.982537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:36.982537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:36.982537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:36.982537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:36.982537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. Jul 20 04:42:36.982537 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:36.987049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 3a175cb7-41da-443e-9250-89fc41195b62 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:36.988522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-679a1739-1699-4167-bad6-dbeca7bb6153 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62" status: 404 len: 111 microversion: 2.1 time: 0.071876 Jul 20 04:42:36.990630 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3379/4504] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:36 2022] GET /compute/v2.1/servers/3a175cb7-41da-443e-9250-89fc41195b62 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:36.999013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.003624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.017024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.022437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.023601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.025785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.056844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca HTTP/1.1 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3b30e3fc-c298-405f-a67e-331633e972ca'} Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:37.069687 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.076611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.078819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:37.082003 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d535ce15-d29f-43ec-af82-af5981f447f4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca" status: 404 len: 111 microversion: 2.1 time: 0.084733 Jul 20 04:42:37.089118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3380/4505] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:36 2022] DELETE /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:37.099000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.107170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 3b30e3fc-c298-405f-a67e-331633e972ca] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.123021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.123535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.128030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.130844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.180653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca HTTP/1.1 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3b30e3fc-c298-405f-a67e-331633e972ca'} Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.193729 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:37.199393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:37.199393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:37.199393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:37.199393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:37.199393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. Jul 20 04:42:37.199393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:37.208833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 3b30e3fc-c298-405f-a67e-331633e972ca could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:37.210310 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d3585d4-9e8b-45a4-80a7-757eb93f8930 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca" status: 404 len: 111 microversion: 2.1 time: 0.117173 Jul 20 04:42:37.216530 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3381/4506] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/3b30e3fc-c298-405f-a67e-331633e972ca => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:42:37.230232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.244723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.279352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.284082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.295537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.300423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.384200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:42:37.598031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7adbe8a9-3638-48f8-9fef-adbc2c69a298 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 204 len: 0 microversion: 2.1 time: 0.373722 Jul 20 04:42:37.599056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3382/4507] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:42:37 2022] DELETE /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:42:37.621051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:37.623765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:37.646051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.648794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.650086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:37.655201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:37.955123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:37.964443 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eac80387-61fc-4856-96b0-3f61217547c2 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1479 microversion: 2.1 time: 0.360637 Jul 20 04:42:37.965355 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3383/4508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:37 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1479 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:38.983091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:38.983867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:39.012816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.020536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.022529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:39.023096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:39.844055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:39.862651 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20aaa39c-8c7c-44a6-bd27-1b5962e4d979 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1479 microversion: 2.1 time: 0.884403 Jul 20 04:42:39.871421 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3384/4509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:38 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1479 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:42:40.511662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a5216654-7abf-4f4c-b410-22d5c81e4c41 req-d8f9ae78-3e6a-4dc2-b6d6-0ecbf9690ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ed104c-b7f1-4a15-83e7-2ed46958128b", "name": "network-vif-deleted", "tag": "ec813c24-40cd-4f4d-b4cb-ca2bd40f4b85"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:40.535396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a5216654-7abf-4f4c-b410-22d5c81e4c41 req-d8f9ae78-3e6a-4dc2-b6d6-0ecbf9690ebf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.537385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a5216654-7abf-4f4c-b410-22d5c81e4c41 req-d8f9ae78-3e6a-4dc2-b6d6-0ecbf9690ebf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.568050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a5216654-7abf-4f4c-b410-22d5c81e4c41 req-d8f9ae78-3e6a-4dc2-b6d6-0ecbf9690ebf service nova] Creating event network-vif-deleted:ec813c24-40cd-4f4d-b4cb-ca2bd40f4b85 for instance 74ed104c-b7f1-4a15-83e7-2ed46958128b on n-h2-764486-11 Jul 20 04:42:40.582721 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a5216654-7abf-4f4c-b410-22d5c81e4c41 req-d8f9ae78-3e6a-4dc2-b6d6-0ecbf9690ebf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075616 Jul 20 04:42:40.592049 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3385/4510] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:42:40.881045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:40.881943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:40.899813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.901082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.902024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.906590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.989578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:40.990040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:40.990577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lazy-loading 'fault' on Instance uuid 74ed104c-b7f1-4a15-83e7-2ed46958128b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:42:41.147019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995b6806ffed451b8f08f0b22491a091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d12e955b75d48dbbef0eaf710876e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:42:41.161366 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0580b86-3b09-4c53-a546-5c121028e460 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 200 len: 1282 microversion: 2.1 time: 0.285545 Jul 20 04:42:41.161985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3386/4511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:40 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:42:42.201747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:42:42.207180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] [instance: 74ed104c-b7f1-4a15-83e7-2ed46958128b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:42:42.242961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.243756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.245144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:42:42.262613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:42:42.299945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] HTTP exception thrown: Instance 74ed104c-b7f1-4a15-83e7-2ed46958128b could not be found. Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Request method failure captured: Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b HTTP/1.1 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14bGh9a3pkdzjgaT4CQQyvHa68aXZ3MjIfX3rhpm4DXa_SLgV-Mz3Fwd-7q-HZEmc4MrdgJ4P86puFl7-GcLkXhCi9pJGcbaHkJa9WdgL6RgXPtzY9cG3f2vdnrsZZOVjXhqn1eFxHHVN8I6F8Gi2B_LdNdvDVMjdq_3LF1f1k1WMqQ Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2d12e955b75d48dbbef0eaf710876e1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2d12e955b75d48dbbef0eaf710876e1b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersTestJSON-455465248 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2d12e955b75d48dbbef0eaf710876e1b Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersTestJSON-455465248 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersTestJSON-455465248-project Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 995b6806ffed451b8f08f0b22491a091 Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersTestJSON-455465248-project Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 74ed104c-b7f1-4a15-83e7-2ed46958128b could not be found. Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '74ed104c-b7f1-4a15-83e7-2ed46958128b'} Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ed104c-b7f1-4a15-83e7-2ed46958128b could not be found. Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ed104c-b7f1-4a15-83e7-2ed46958128b could not be found. Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:42.303399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:42:42.310678 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:42:42.310678 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:42:42.310678 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:42:42.310678 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:42:42.310678 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ed104c-b7f1-4a15-83e7-2ed46958128b could not be found. Jul 20 04:42:42.310678 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:42:42.315778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] Returning 404 to user: Instance 74ed104c-b7f1-4a15-83e7-2ed46958128b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:42:42.317201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e5018a5-3c67-4688-9ed4-2e7c1e0b4ea4 tempest-ServersTestJSON-455465248 tempest-ServersTestJSON-455465248-project] 10.222.0.49 "GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b" status: 404 len: 111 microversion: 2.1 time: 0.123489 Jul 20 04:42:42.319117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3387/4512] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:42:42 2022] GET /compute/v2.1/servers/74ed104c-b7f1-4a15-83e7-2ed46958128b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:42:50.359292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2bb3d62a-4dba-4e7b-a746-f8c9c6ff3d6c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: .version_select at 0x7f839826caf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-934470033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKyIUUL1Gh05FTzoQPIdVfw2ytRsU7zEjbSvBRFxSurk4r23QL2/lr+pcczxFgcLXJFp5isqfLlarkFS1SYnGFRR91LKaxtST8VcOcYGwFu8ozs/IiyQbw3Dt3a4NNqbw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:42:50.433739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2bb3d62a-4dba-4e7b-a746-f8c9c6ff3d6c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:42:50.451282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2bb3d62a-4dba-4e7b-a746-f8c9c6ff3d6c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:42:50.529517 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2bb3d62a-4dba-4e7b-a746-f8c9c6ff3d6c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.991217 Jul 20 04:42:50.537042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3388/4513] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:42:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:05.418557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:05.422023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:05.425515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:06.221727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1799737212", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:06.348685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] validate_networks() for [('57ffe73c-ee73-4565-99e6-bb491d6105d3', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:08.159307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:08.159915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:08.160201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:08.160809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:08.161238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:08.179192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.179656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.186971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.187515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.268288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Getting quotas for project 2928abc9397241a3951cf0cd55b66d35. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:08.286936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Getting quotas for user bd3b5ee6cd244d7e80a42c0ce5f0b153 and project 2928abc9397241a3951cf0cd55b66d35. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:08.330035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:08.332321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:08.491007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49b2cec2-1ae9-43d7-8bd0-474a24c95627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.083612 Jul 20 04:43:08.492128 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3389/4514] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:08.504661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.511799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:08.534828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.535280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.536061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:08.547878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:08.602541 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32dfd288-a6b1-459a-bb3b-2ac04a61f751 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/ips" status: 200 len: 148 microversion: 2.1 time: 0.109075 Jul 20 04:43:08.604925 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3390/4515] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/ips => generated 148 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:08.626323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4129c39-6f03-4ce9-bb33-af89cbf61edf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:08.632212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4129c39-6f03-4ce9-bb33-af89cbf61edf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:09.090596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4129c39-6f03-4ce9-bb33-af89cbf61edf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:09.099571 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4129c39-6f03-4ce9-bb33-af89cbf61edf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1217 microversion: 2.1 time: 0.493386 Jul 20 04:43:09.100168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3391/4516] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:08 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1217 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:10.116559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:10.117175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:10.134990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.142212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.152633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:10.153327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:10.384053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:10.393946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e9d61f9-1642-460a-a4b0-ae0f385e9d4f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1213 microversion: 2.1 time: 0.281172 Jul 20 04:43:10.403386 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3392/4517] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:10 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1213 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:11.030099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-388826199", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "465a478f-1ab8-4048-808e-c98ec22fa872"}], "key_name": "tempest-TestNetworkAdvancedServerOps-934470033", "security_groups": [{"name": "tempest-secgroup-smoke-1475261940"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:11.298946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] validate_networks() for [('465a478f-1ab8-4048-808e-c98ec22fa872', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:12.202556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:12.208536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:12.209578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:12.210337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:12.211009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:12.232150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.243448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.244525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.248830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.368471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:12.380525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:12.413329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:12.415664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:12.550975 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f7ebf02-727b-4972-872a-fb00a3ca9fd2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.523584 Jul 20 04:43:12.554879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3393/4518] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:12.566624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:12.568190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:12.588148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.588854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.592251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:12.594663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:12.766198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:12.785390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2a4c679-1fe7-4a82-9ffc-04a80e9c8b63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1275 microversion: 2.1 time: 0.229060 Jul 20 04:43:12.785949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3394/4519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:12 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:12.806180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58ded238-341d-480a-a479-8223e54bf144 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:12.809009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58ded238-341d-480a-a479-8223e54bf144 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:12.927307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58ded238-341d-480a-a479-8223e54bf144 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:12.943104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58ded238-341d-480a-a479-8223e54bf144 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1265 microversion: 2.1 time: 0.151139 Jul 20 04:43:12.955627 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3395/4520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:12 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:12.980195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:12.992119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:13.032513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.033293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.034252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.034811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.689729 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f31aef85-113e-4d21-8cfd-beb2f8112777 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721313 Jul 20 04:43:13.717417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3396/4521] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:43:12 2022] POST /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:13.810504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:13.811665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:13.861467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.863605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:13.871214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:13.873324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.491193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.513513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80140324-7a97-44f9-8a11-ca208a887b60 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.706099 Jul 20 04:43:14.514437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3397/4522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:13 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:14.519566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:14.520408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:14.536454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.537103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.538081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:14.539948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:14.663889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:14.673123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3584082e-ff72-463b-8b86-91df47b4e2ab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1317 microversion: 2.1 time: 0.157371 Jul 20 04:43:14.673727 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3398/4523] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:14 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:15.531916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.532650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:15.541348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.541792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.542629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.583652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.900516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:15.916531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60c29fe1-eb0d-4073-bc26-ac35da6e33be tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.387994 Jul 20 04:43:15.919330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3399/4524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:15 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:15.933887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:15.940577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:15.951511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.953567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:15.954629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:15.956886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.146394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:16.159587 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5155ecda-afcc-494e-b636-30955d3d9d4e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1323 microversion: 2.1 time: 0.238614 Jul 20 04:43:16.165512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3400/4525] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:15 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:16.935773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:16.937663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:16.963268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.964006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:16.967455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:16.968159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.484787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:17.505794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd122d79-441f-4a80-ae09-6cc3e8692aac tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.575259 Jul 20 04:43:17.508678 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3401/4526] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:16 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:17.531264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-85622c47-2d5f-4555-b5fa-4ee9ff46107e req-63d16969-bd4d-472f-814a-fe7070eb0ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1748ffb-8279-402a-b67a-6fc77c5a022b", "tag": "00205810-62ce-4d7b-8b27-1bc9b842bc1f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:17.556229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-85622c47-2d5f-4555-b5fa-4ee9ff46107e req-63d16969-bd4d-472f-814a-fe7070eb0ec8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.566264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-85622c47-2d5f-4555-b5fa-4ee9ff46107e req-63d16969-bd4d-472f-814a-fe7070eb0ec8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.613294 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-85622c47-2d5f-4555-b5fa-4ee9ff46107e req-63d16969-bd4d-472f-814a-fe7070eb0ec8 service nova] Creating event network-changed:00205810-62ce-4d7b-8b27-1bc9b842bc1f for instance c1748ffb-8279-402a-b67a-6fc77c5a022b on n-h1-764486-11 Jul 20 04:43:17.636322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-85622c47-2d5f-4555-b5fa-4ee9ff46107e req-63d16969-bd4d-472f-814a-fe7070eb0ec8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123926 Jul 20 04:43:17.637244 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3402/4527] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:17.647425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:17.650953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:17.672815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.676636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.679129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:17.680882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:17.908945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:17.921718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8c5a1e4-3b1f-403c-9c7b-c8ef74694f8c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1323 microversion: 2.1 time: 0.282671 Jul 20 04:43:17.927284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3403/4528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:17 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:18.528412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.529996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:18.553616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.556039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.557294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:18.557739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:18.950980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:18.965059 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ae70c51-0a7c-4125-a254-c44ec530069d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.440421 Jul 20 04:43:18.966919 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3404/4529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:18 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:18.981867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:18.994520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:19.035036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.035504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.036329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:19.036901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:19.410709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:19.422610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-805667d1-a83e-47f8-a313-43b6642b5dfd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.453111 Jul 20 04:43:19.435291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3405/4530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:18 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:19.991366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:19.991989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:20.037620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.037997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.038836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.045190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.642326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:20.658503 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-118605a9-56bf-4cce-91cf-f816d859a4ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.678485 Jul 20 04:43:20.659124 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3406/4531] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:19 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:20.675226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:20.698569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:20.719606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.719909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:20.720743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:20.721184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.542709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:21.559290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12a91959-a8bb-4697-a458-b85b33ba9eb9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.887088 Jul 20 04:43:21.561148 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3407/4532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:20 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:21.575355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-391930fd-d16b-468b-94ca-5a00f69923b0 req-30d49f01-8744-4c1c-8364-716301f08234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:21.601606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-391930fd-d16b-468b-94ca-5a00f69923b0 req-30d49f01-8744-4c1c-8364-716301f08234 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.602550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-391930fd-d16b-468b-94ca-5a00f69923b0 req-30d49f01-8744-4c1c-8364-716301f08234 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.641697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-391930fd-d16b-468b-94ca-5a00f69923b0 req-30d49f01-8744-4c1c-8364-716301f08234 service nova] Creating event network-changed:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h2-764486-11 Jul 20 04:43:21.654120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-391930fd-d16b-468b-94ca-5a00f69923b0 req-30d49f01-8744-4c1c-8364-716301f08234 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091146 Jul 20 04:43:21.659661 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3408/4533] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:21.676070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:21.676878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:21.690119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.690583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.691382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:21.691819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:21.696619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:22.209441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:22.223745 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18b168dd-f3e7-4e61-a057-dce232f81b57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.552251 Jul 20 04:43:22.248855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3409/4534] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:21 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:22.578256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:22.578933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:22.587598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:22.595605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.596159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.599674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:22.600294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:22.941991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=16 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:23.348656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:23.358751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1cc2b183-2764-4019-97c5-e10933ac4c02 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.784864 Jul 20 04:43:23.362833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3410/4535] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:22 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:23.387455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:23.388090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:23.417714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.418174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.418978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:23.419422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:23.982822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:23.993261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-431cc4c8-214c-47db-bb7a-0132ce006efe tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.629074 Jul 20 04:43:23.998354 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3411/4536] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:23 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:24.379213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:24.380136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:24.394478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.395153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.396300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:24.399457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:24.712322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:24.727286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44ad0ef0-ffbf-4433-a295-546937379d0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.352346 Jul 20 04:43:24.728190 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3412/4537] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:24 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:25.018612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.019196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.034576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.040448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.041508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.043341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.603513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:25.622323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3787579f-271e-460c-a259-3ffd59b5a282 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.608270 Jul 20 04:43:25.634470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3413/4538] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:25.747474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:25.748674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:25.781588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.782058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:25.795131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:25.795788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.108692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.120990 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-788983c1-9736-4e47-993a-d50ccd575dd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.379990 Jul 20 04:43:26.131814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3414/4539] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:25 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:26.473798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d2a739df-2c75-4fa7-a6f3-01159b125a21 req-c435ecca-0a1b-41a6-a433-12c69d778819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1748ffb-8279-402a-b67a-6fc77c5a022b", "name": "network-vif-plugged", "status": "completed", "tag": "00205810-62ce-4d7b-8b27-1bc9b842bc1f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:26.489703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d2a739df-2c75-4fa7-a6f3-01159b125a21 req-c435ecca-0a1b-41a6-a433-12c69d778819 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.495913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d2a739df-2c75-4fa7-a6f3-01159b125a21 req-c435ecca-0a1b-41a6-a433-12c69d778819 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.542087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d2a739df-2c75-4fa7-a6f3-01159b125a21 req-c435ecca-0a1b-41a6-a433-12c69d778819 service nova] Creating event network-vif-plugged:00205810-62ce-4d7b-8b27-1bc9b842bc1f for instance c1748ffb-8279-402a-b67a-6fc77c5a022b on n-h1-764486-11 Jul 20 04:43:26.552635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d2a739df-2c75-4fa7-a6f3-01159b125a21 req-c435ecca-0a1b-41a6-a433-12c69d778819 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083234 Jul 20 04:43:26.554590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3415/4540] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:26.645582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:26.646468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:26.654171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.655119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.656098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:26.656849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:26.905986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:26.916151 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-682c70bc-6cb0-430e-962b-bc74ef423dce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.279097 Jul 20 04:43:26.929119 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3416/4541] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:26 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:27.139038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:27.139763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:27.152245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.152740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.153558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.154197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.367474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:27.377038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d035da6c-11b0-466b-a901-43b2dc8198ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.242258 Jul 20 04:43:27.377734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3417/4542] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:27 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:27.944345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:27.945561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:27.966753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.967850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:27.968938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:27.969534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.219988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:28.230161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da63d656-4fc0-4f98-903d-fbb407475221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1317 microversion: 2.1 time: 0.297320 Jul 20 04:43:28.241551 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3418/4543] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:27 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:28.396220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:28.397457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:28.424113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.428447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.429562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.430336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.695305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:28.715502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e87d791-ff77-447b-9fb6-ea9da4756668 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1391 microversion: 2.1 time: 0.323694 Jul 20 04:43:28.715946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3419/4544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:28 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:28.740844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f6601a13-a3cb-45a5-b0fa-8a6dff92ef97 req-b5b6f005-be3d-4375-bb45-2c96673b7c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "name": "network-vif-plugged", "status": "completed", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:28.757970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f6601a13-a3cb-45a5-b0fa-8a6dff92ef97 req-b5b6f005-be3d-4375-bb45-2c96673b7c33 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:28.758675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f6601a13-a3cb-45a5-b0fa-8a6dff92ef97 req-b5b6f005-be3d-4375-bb45-2c96673b7c33 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:28.780108 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f6601a13-a3cb-45a5-b0fa-8a6dff92ef97 req-b5b6f005-be3d-4375-bb45-2c96673b7c33 service nova] Creating event network-vif-plugged:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h2-764486-11 Jul 20 04:43:28.785988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f6601a13-a3cb-45a5-b0fa-8a6dff92ef97 req-b5b6f005-be3d-4375-bb45-2c96673b7c33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063641 Jul 20 04:43:28.788225 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3420/4545] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:29.249274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:29.249984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:29.253223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:29.259595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.260233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:29.261511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:29.262422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:29.466407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:29.477002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7bb760f-64f7-4d65-9ef8-10e4d61a78c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.232790 Jul 20 04:43:29.478263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3421/4546] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:29 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:29.645869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1066859648", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:29.741713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] validate_networks() for [('57ffe73c-ee73-4565-99e6-bb491d6105d3', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:30.490720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:30.491419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:30.491904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:30.492319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:30.492758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:30.515868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.516379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.517200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.517646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.541906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Getting quotas for project 2928abc9397241a3951cf0cd55b66d35. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:30.552148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Getting quotas for user bd3b5ee6cd244d7e80a42c0ce5f0b153 and project 2928abc9397241a3951cf0cd55b66d35. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:30.567499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:30.585582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:30.662316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e80fca5f-ade6-4372-a0aa-32d7e7881434 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020315 Jul 20 04:43:30.671782 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3422/4547] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:43:30.685191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:30.685853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:30.700176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.701477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.703189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:30.703847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:30.911627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:30.923299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74c1ca53-52f1-4b7e-8fa6-0c1aa0536484 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1564 microversion: 2.1 time: 0.247281 Jul 20 04:43:30.924262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3423/4548] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:30 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:30.935643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cee984d-b2e8-42f4-9eb9-fb0c1d22e402 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:30.939809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cee984d-b2e8-42f4-9eb9-fb0c1d22e402 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:31.080334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4cee984d-b2e8-42f4-9eb9-fb0c1d22e402 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:31.108906 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cee984d-b2e8-42f4-9eb9-fb0c1d22e402 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1217 microversion: 2.1 time: 0.182588 Jul 20 04:43:31.109503 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3424/4549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:30 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:31.135260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:31.135897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:31.157506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.157964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.161803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:31.162441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:31.580767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:31.591482 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f646b7b5-7090-42ee-aec1-8882b5c3923d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1564 microversion: 2.1 time: 0.460013 Jul 20 04:43:31.605294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3425/4550] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:31 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1564 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:32.132222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:32.133967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:32.144851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.146647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.147945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:32.148628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:32.330461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:32.345445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-708611a2-6396-4aee-b1b9-e850bd24280d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1269 microversion: 2.1 time: 0.222218 Jul 20 04:43:32.356098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3426/4551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:32 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:32.364372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f4ee169-b11b-4237-a7cf-c1b2d9e3155f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: .version_select at 0x7f838b1110d0>, body: {"keypair": {"name": "tempest-keypair-910217400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1lV1mVouAo4R0Zjweg6RNZlx8edhO4jJeYJPoSXYqF5wqCXZ0LbeGY4ggOpPuR2PU1o+UxlMmkHFpfvS1//CkcfPWT6XDjyVigYPW8QAhMqvyIt5OvtftT6X5sYfZnmQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:32.402679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3f4ee169-b11b-4237-a7cf-c1b2d9e3155f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:32.424312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3f4ee169-b11b-4237-a7cf-c1b2d9e3155f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:32.488887 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f4ee169-b11b-4237-a7cf-c1b2d9e3155f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128421 Jul 20 04:43:32.489818 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3427/4552] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:43:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:33.365701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:33.366364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:33.383648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.385038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.387202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:33.395513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:33.588521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:33.602080 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7afcaccc-c10e-44d1-ba97-8fad3451c4fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1275 microversion: 2.1 time: 0.242600 Jul 20 04:43:33.611100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3428/4553] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:33 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1275 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:34.633363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:34.635368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:34.657936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:34.658404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:34.659316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:34.659648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.463319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:35.470899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:35.475550 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df3fd020-be28-461d-b1e7-9678cc34755e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1317 microversion: 2.1 time: 0.852255 Jul 20 04:43:35.487857 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3429/4554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:34 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:35.493020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-58be7508-31f9-4688-9667-6896a0e2a90b req-ad506c9f-1753-496d-ad0e-c9129fc1a4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7bc54b-ce29-486c-9a00-1a1c15160146", "tag": "15b40b14-0262-4a2a-b3cd-1ff34087f791"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:35.504279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-58be7508-31f9-4688-9667-6896a0e2a90b req-ad506c9f-1753-496d-ad0e-c9129fc1a4e8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:35.505178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-58be7508-31f9-4688-9667-6896a0e2a90b req-ad506c9f-1753-496d-ad0e-c9129fc1a4e8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:35.521593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-58be7508-31f9-4688-9667-6896a0e2a90b req-ad506c9f-1753-496d-ad0e-c9129fc1a4e8 service nova] Creating event network-changed:15b40b14-0262-4a2a-b3cd-1ff34087f791 for instance fb7bc54b-ce29-486c-9a00-1a1c15160146 on n-h1-764486-11 Jul 20 04:43:35.529220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-58be7508-31f9-4688-9667-6896a0e2a90b req-ad506c9f-1753-496d-ad0e-c9129fc1a4e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038850 Jul 20 04:43:35.530816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3430/4555] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:36.495318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:36.496008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:36.517381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.517878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:36.518719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:36.519189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.285944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:37.306684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a5c6689-9704-4aa6-b754-35f93409beda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1317 microversion: 2.1 time: 0.815515 Jul 20 04:43:37.308609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3431/4556] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:36 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:37.808407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:37.809059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:37.833172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.833617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:37.834532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:37.836946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.665757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:38.678093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b74c66c-8de1-4782-b553-b7742d05b95c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1564 microversion: 2.1 time: 0.874746 Jul 20 04:43:38.697435 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3432/4557] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:37 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1564 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:38.705779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8a064714-29ec-4466-b034-18051f2fe84e req-dfcea7d3-589b-4185-b5cc-10c3e902eeec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:38.728893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8a064714-29ec-4466-b034-18051f2fe84e req-dfcea7d3-589b-4185-b5cc-10c3e902eeec service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.729445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8a064714-29ec-4466-b034-18051f2fe84e req-dfcea7d3-589b-4185-b5cc-10c3e902eeec service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.741379 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8a064714-29ec-4466-b034-18051f2fe84e req-dfcea7d3-589b-4185-b5cc-10c3e902eeec service nova] Creating event network-changed:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h2-764486-11 Jul 20 04:43:38.749848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8a064714-29ec-4466-b034-18051f2fe84e req-dfcea7d3-589b-4185-b5cc-10c3e902eeec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046947 Jul 20 04:43:38.751796 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3433/4558] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:38.777109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:38.781879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:38.795355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.796714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:38.797706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:38.802201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.136291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:39.144923 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7de5e058-f387-46bd-9c3d-5333a864d6cb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1317 microversion: 2.1 time: 0.391546 Jul 20 04:43:39.145533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3434/4559] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:38 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:39.612087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:39.612618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:39.633565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.634026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.637600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:39.638085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:39.721718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:39.981900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c79dca7-36b4-40e3-89c7-1abb4271a561 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 204 len: 0 microversion: 2.42 time: 0.821934 Jul 20 04:43:39.982776 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3435/4560] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:43:39 2022] DELETE /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:43:40.022259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-876903620", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2e3bd6f-916b-4434-a9b5-9f9d528c43af"}], "security_groups": [{"name": "tempest-securitygroup--1600491192"}], "key_name": "tempest-keypair-910217400", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:40.443081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] validate_networks() for [('d2e3bd6f-916b-4434-a9b5-9f9d528c43af', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:43:40.530854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:41.600318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:43:41.601183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:43:41.602103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:43:41.602925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:43:41.603764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:43:41.634394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.637574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.640752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.641785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.692192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:43:41.707721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:43:41.750902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:43:41.759811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:43:41.839923 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79139290-2408-4796-81a1-9f5837e2a553 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.835260 Jul 20 04:43:41.842627 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3436/4561] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:43:41.855373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:41.856802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:41.869868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.870663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:41.871667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:41.873939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.400885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:42.415779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:42.417519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:42.418853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db5b08a5-e67b-40d1-9f8b-f285626dbf34 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2956 microversion: 2.42 time: 0.574430 Jul 20 04:43:42.423787 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3437/4562] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:41 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2956 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:42.440868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.441498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:42.450739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.451891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.452731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.465208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.837048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:42.849596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37f1a876-d6de-4589-82cf-2fc6b19e7c84 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1317 microversion: 2.1 time: 0.424549 Jul 20 04:43:42.860185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3438/4563] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:42 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:42.864019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:42.864726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:42.878999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.882097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.882966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:42.883408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:42.987795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.011873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-915067ab-bad0-482d-9091-f96a9cfa3860 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1236 microversion: 2.1 time: 0.157500 Jul 20 04:43:43.013700 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3439/4564] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:42 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1236 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:43.027600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-350393d6-fefa-4c7a-ac3d-0151a1ce1c96 req-9fb4a18c-279a-4243-be6a-c3c2a7976407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7bc54b-ce29-486c-9a00-1a1c15160146", "name": "network-vif-plugged", "status": "completed", "tag": "15b40b14-0262-4a2a-b3cd-1ff34087f791"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:43.042615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-350393d6-fefa-4c7a-ac3d-0151a1ce1c96 req-9fb4a18c-279a-4243-be6a-c3c2a7976407 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.043078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-350393d6-fefa-4c7a-ac3d-0151a1ce1c96 req-9fb4a18c-279a-4243-be6a-c3c2a7976407 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.058804 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-350393d6-fefa-4c7a-ac3d-0151a1ce1c96 req-9fb4a18c-279a-4243-be6a-c3c2a7976407 service nova] Creating event network-vif-plugged:15b40b14-0262-4a2a-b3cd-1ff34087f791 for instance fb7bc54b-ce29-486c-9a00-1a1c15160146 on n-h1-764486-11 Jul 20 04:43:43.064524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-350393d6-fefa-4c7a-ac3d-0151a1ce1c96 req-9fb4a18c-279a-4243-be6a-c3c2a7976407 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044352 Jul 20 04:43:43.065303 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3440/4565] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:43.449659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:43.451929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:43.462347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.463170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.464137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:43.464677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:43.949176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.974849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.978873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:43.980206 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-815fc2c8-869b-4d05-a283-aa88c3016ff5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2956 microversion: 2.42 time: 0.536147 Jul 20 04:43:43.996414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3441/4566] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:43 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2956 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:43:43.997139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:43.997344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.008817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.009774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.011500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.012819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.493118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.501739 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed489923-d7ba-4aef-9be6-397e09eb3183 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1317 microversion: 2.1 time: 0.515644 Jul 20 04:43:44.513463 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3442/4567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:43 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:44.513463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:44.513463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:44.524649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.525101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.526043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:44.527562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:44.774460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:44.813629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d70bd7ba-c9db-44ca-b412-614917a687fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1298 microversion: 2.1 time: 0.307427 Jul 20 04:43:44.815790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3443/4568] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:44 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1298 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:45.012977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.014779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.032967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.033982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.035821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.038545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.865041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.880911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.883890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:45.888220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ccc55e5-06a0-41c8-ab4a-8dfacaafe228 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2935 microversion: 2.42 time: 0.882731 Jul 20 04:43:45.896496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3444/4569] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2935 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:43:45.914928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:45.915778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:45.925824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.926856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:45.932228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:45.933418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.365749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:46.378321 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7507aed1-8947-4379-ad75-fbcd5dec2ecd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1506 microversion: 2.1 time: 0.480551 Jul 20 04:43:46.380872 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3445/4570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:45 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:46.415611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:46.416448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:46.430739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.431371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:46.432326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:46.433042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.000390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.015061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed72662b-17b7-46fd-b306-b2c9170603ac tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.621923 Jul 20 04:43:47.016201 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3446/4571] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:46 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:47.045968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e9fd2b31-dc0a-494a-a9e9-9b2873ca129a req-ac479d90-9219-4372-8302-74e37983f333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-unplugged", "status": "completed", "tag": "75a5af4e-82a6-4b12-957a-046b8af7dc3d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:47.060089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:47.085906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e9fd2b31-dc0a-494a-a9e9-9b2873ca129a req-ac479d90-9219-4372-8302-74e37983f333 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.086986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e9fd2b31-dc0a-494a-a9e9-9b2873ca129a req-ac479d90-9219-4372-8302-74e37983f333 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.112833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e9fd2b31-dc0a-494a-a9e9-9b2873ca129a req-ac479d90-9219-4372-8302-74e37983f333 service nova] Creating event network-vif-unplugged:75a5af4e-82a6-4b12-957a-046b8af7dc3d for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:47.120469 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e9fd2b31-dc0a-494a-a9e9-9b2873ca129a req-ac479d90-9219-4372-8302-74e37983f333 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100221 Jul 20 04:43:47.121755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3447/4572] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:47.130005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.131044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.139497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.140372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.141489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.142109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.147703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:47.189046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:43:47.377419 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-818ccccf-63f3-4ff4-ab04-229ba2eb5d4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 204 len: 0 microversion: 2.1 time: 0.252604 Jul 20 04:43:47.378623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3448/4573] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:43:47 2022] DELETE /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:43:47.386947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.387604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.394417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.395114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.396076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.397005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.747128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.765598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.767530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:47.771278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5879c72-c44a-4d3a-ad8d-4e5f1e707067 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2868 microversion: 2.42 time: 0.391292 Jul 20 04:43:47.773021 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3449/4574] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:47 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2868 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:47.790524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:47.791294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:47.818076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.820932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:47.821826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:47.822535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.062293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:48.075571 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a1b3e1e-65dc-4651-ad75-5f31e9ce809f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1512 microversion: 2.1 time: 0.300675 Jul 20 04:43:48.077645 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3450/4575] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:47 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:48.095707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-52778b7f-6a7b-4a95-95d4-2bd717c74bf5 req-48299524-e8bc-4dff-b8d1-294a48bd6070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-deleted", "tag": "e39d80c0-e592-4c50-a7d6-f1e0c9a60503"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:48.126657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-52778b7f-6a7b-4a95-95d4-2bd717c74bf5 req-48299524-e8bc-4dff-b8d1-294a48bd6070 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.127132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-52778b7f-6a7b-4a95-95d4-2bd717c74bf5 req-48299524-e8bc-4dff-b8d1-294a48bd6070 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.168936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-52778b7f-6a7b-4a95-95d4-2bd717c74bf5 req-48299524-e8bc-4dff-b8d1-294a48bd6070 service nova] Creating event network-vif-deleted:e39d80c0-e592-4c50-a7d6-f1e0c9a60503 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:48.191723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-52778b7f-6a7b-4a95-95d4-2bd717c74bf5 req-48299524-e8bc-4dff-b8d1-294a48bd6070 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110745 Jul 20 04:43:48.196273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3451/4576] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:48.206342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.210969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.236067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.237858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.241805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.242498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.680318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:48.690649 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af3d481b-ff16-44ed-8cd1-1baf85c2bbc5 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.492885 Jul 20 04:43:48.693062 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3452/4577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:48.704613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b5d73d18-acd2-4c5a-bdf8-e10bc1c0d0d3 req-39499236-d2f1-443e-a401-757fa46466c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d122213-6f22-4fc2-937c-7d2b457b40b7", "tag": "8f320f4f-e246-404b-b866-19ba0a54faa4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:48.746995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b5d73d18-acd2-4c5a-bdf8-e10bc1c0d0d3 req-39499236-d2f1-443e-a401-757fa46466c4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.747617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b5d73d18-acd2-4c5a-bdf8-e10bc1c0d0d3 req-39499236-d2f1-443e-a401-757fa46466c4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.781437 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b5d73d18-acd2-4c5a-bdf8-e10bc1c0d0d3 req-39499236-d2f1-443e-a401-757fa46466c4 service nova] Creating event network-changed:8f320f4f-e246-404b-b866-19ba0a54faa4 for instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 on n-h2-764486-11 Jul 20 04:43:48.797806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b5d73d18-acd2-4c5a-bdf8-e10bc1c0d0d3 req-39499236-d2f1-443e-a401-757fa46466c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103462 Jul 20 04:43:48.798774 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3453/4578] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:48.804240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:48.805185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:48.813224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.813904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:48.814848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:48.815743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.157129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.176704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.180780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.182537 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1822461d-9c37-4a02-bc68-6785afdfb941 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2754 microversion: 2.42 time: 0.383031 Jul 20 04:43:49.183319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3454/4579] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:48 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2754 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:49.201929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:49.203665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:49.223166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.223992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.225628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.226276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.845918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:49.853953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba6dc602-f090-400a-b586-d825a1348ab6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1512 microversion: 2.1 time: 0.669381 Jul 20 04:43:49.854554 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3455/4580] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:49 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1512 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:49.868232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-unplugged", "status": "completed", "tag": "a3d8da46-0316-4823-9384-cf6668ebebab"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-unplugged", "status": "completed", "tag": "4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-unplugged", "status": "completed", "tag": "ab96e253-e462-44ed-b5d9-1f77c8750bc9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:49.892793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.893249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.906595 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] Creating event network-vif-unplugged:a3d8da46-0316-4823-9384-cf6668ebebab for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:49.907101 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] Creating event network-vif-unplugged:4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:49.907837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] Creating event network-vif-unplugged:ab96e253-e462-44ed-b5d9-1f77c8750bc9 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:49.913851 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-643f4c4b-5836-44a7-a0c8-235efe8d04c5 req-8d6af5be-6d3b-492e-b55f-4a883a919aaf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.058040 Jul 20 04:43:49.914529 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3456/4581] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:49.921203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:49.921988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:49.928889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.929450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:49.930303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:49.931100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.165321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.184679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2af85b75-889c-41ad-a2a7-ab6f25545157 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.266958 Jul 20 04:43:50.188405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3457/4582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:49 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:50.204515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.205654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.225477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.227097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.228642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.229449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.631852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.641924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.643448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:50.651580 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75513239-f099-4913-bba5-dc29dea37392 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2708 microversion: 2.42 time: 0.445649 Jul 20 04:43:50.652848 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3458/4583] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2708 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:50.661563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-787ce910-dd32-42c4-8d00-5177c09d236a req-a1c156fb-bb81-4936-8683-23882541acd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-deleted", "tag": "ab96e253-e462-44ed-b5d9-1f77c8750bc9"}, {"server_uuid": "fb7bc54b-ce29-486c-9a00-1a1c15160146", "name": "network-vif-deleted", "tag": "15b40b14-0262-4a2a-b3cd-1ff34087f791"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:50.695214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-787ce910-dd32-42c4-8d00-5177c09d236a req-a1c156fb-bb81-4936-8683-23882541acd1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.695663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-787ce910-dd32-42c4-8d00-5177c09d236a req-a1c156fb-bb81-4936-8683-23882541acd1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.742375 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-787ce910-dd32-42c4-8d00-5177c09d236a req-a1c156fb-bb81-4936-8683-23882541acd1 service nova] Creating event network-vif-deleted:ab96e253-e462-44ed-b5d9-1f77c8750bc9 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:50.749225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-787ce910-dd32-42c4-8d00-5177c09d236a req-a1c156fb-bb81-4936-8683-23882541acd1 service nova] Creating event network-vif-deleted:15b40b14-0262-4a2a-b3cd-1ff34087f791 for instance fb7bc54b-ce29-486c-9a00-1a1c15160146 on n-h1-764486-11 Jul 20 04:43:50.777600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-787ce910-dd32-42c4-8d00-5177c09d236a req-a1c156fb-bb81-4936-8683-23882541acd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.121241 Jul 20 04:43:50.788134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3459/4584] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:50.871502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:50.873562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:50.887368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.896134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:50.897034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:50.897495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.008888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.009344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.011966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lazy-loading 'fault' on Instance uuid fb7bc54b-ce29-486c-9a00-1a1c15160146 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:43:51.197226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:51.217283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2957c279-3c48-4eb7-add7-7cb9e60720c7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 200 len: 1307 microversion: 2.1 time: 0.348132 Jul 20 04:43:51.220014 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3460/4585] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:50 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:51.244019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.248590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:51.272977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.274251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.276247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.276977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.648181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:51.659680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c91baa96-92d4-4f3b-8da7-31c87884a32c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.438001 Jul 20 04:43:51.663607 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3461/4586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:51.695801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:51.696678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:51.698962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:51.708628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.709286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.710216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:51.710887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:51.761519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=18 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:52.092058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.105706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.107617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.109726 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4245ecb1-1e57-47e2-8e2a-08c0b97991b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2550 microversion: 2.42 time: 0.418943 Jul 20 04:43:52.124437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3462/4587] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:51 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2550 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:52.236827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.237619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.246033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.247274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.249970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.250796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.363703 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 HTTP/1.1 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fb7bc54b-ce29-486c-9a00-1a1c15160146'} Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:52.368296 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:43:52.375737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:52.378464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:52.383426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f563edc8-edc6-4e31-9308-861ba17188d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 404 len: 111 microversion: 2.1 time: 0.149256 Jul 20 04:43:52.386072 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3463/4588] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:52 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:43:52.397435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.402433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.420792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.423338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.425302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.425942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.935957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:52.948135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95a12307-2cb4-4c3b-98a7-7dcbf8aed7ff tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.555878 Jul 20 04:43:52.966757 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3464/4589] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:52 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:52.984550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:52.985516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:52.992177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.992985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:52.993988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:52.994634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.449979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.468178 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2904ac7d-8cad-406e-9968-7a9ef4cfa161 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.499862 Jul 20 04:43:53.470164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3465/4590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:52 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:53.475372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.476150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:53.485710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.486162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.486943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.487519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:53.492829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:43:53.665886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.678972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.681181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:53.682764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0b376ea-0446-459b-848c-842c4933e711 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2504 microversion: 2.42 time: 0.211447 Jul 20 04:43:53.697807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3466/4591] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:53.704508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05135356-4034-4830-a8d6-9ef8e90dd248 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05135356-4034-4830-a8d6-9ef8e90dd248 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 163 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": 12345, "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 12345 Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:43:53.707907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 04:43:53.711172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:53.715176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05135356-4034-4830-a8d6-9ef8e90dd248 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:53.720612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05135356-4034-4830-a8d6-9ef8e90dd248 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017196 Jul 20 04:43:53.722354 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3467/4592] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:53 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:43:53.974978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Calling method '.version_select at 0x7f838b80e8b0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:53.976190 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:43:53.976190 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:43:53.978663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:53.980008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.005935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.006774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.021605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.022444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.031197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b007989-82ea-46fb-a91e-3d8e098401cc tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1755716623-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.307351 Jul 20 04:43:54.032741 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3468/4593] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:43:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:54.039667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:54.040611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:54.048660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.049860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.050856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.051547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.537020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:54.550891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d65f897-268c-4905-b483-d57770831073 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.516737 Jul 20 04:43:54.552018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3469/4594] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:54 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:54.568468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e74e8708-6210-4288-b494-d1d3e19f5314 req-f3ae437b-bf4b-4954-b71f-fd21e975c1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-deleted", "tag": "4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:54.602480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e74e8708-6210-4288-b494-d1d3e19f5314 req-f3ae437b-bf4b-4954-b71f-fd21e975c1a3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.602982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e74e8708-6210-4288-b494-d1d3e19f5314 req-f3ae437b-bf4b-4954-b71f-fd21e975c1a3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.639449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e74e8708-6210-4288-b494-d1d3e19f5314 req-f3ae437b-bf4b-4954-b71f-fd21e975c1a3 service nova] Creating event network-vif-deleted:4b1d4a97-d3d6-4d7b-bdc0-86d8a12a6150 for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:54.651579 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e74e8708-6210-4288-b494-d1d3e19f5314 req-f3ae437b-bf4b-4954-b71f-fd21e975c1a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098860 Jul 20 04:43:54.660996 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3470/4595] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:54.680837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3cfa645d-8dfc-490a-be57-8fb7850635e1 req-b35b8afa-5fb6-455c-8784-36484f775ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d122213-6f22-4fc2-937c-7d2b457b40b7", "name": "network-vif-plugged", "status": "completed", "tag": "8f320f4f-e246-404b-b866-19ba0a54faa4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:54.710178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3cfa645d-8dfc-490a-be57-8fb7850635e1 req-b35b8afa-5fb6-455c-8784-36484f775ff8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.711174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3cfa645d-8dfc-490a-be57-8fb7850635e1 req-b35b8afa-5fb6-455c-8784-36484f775ff8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.761310 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3cfa645d-8dfc-490a-be57-8fb7850635e1 req-b35b8afa-5fb6-455c-8784-36484f775ff8 service nova] Creating event network-vif-plugged:8f320f4f-e246-404b-b866-19ba0a54faa4 for instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 on n-h2-764486-11 Jul 20 04:43:54.774932 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3cfa645d-8dfc-490a-be57-8fb7850635e1 req-b35b8afa-5fb6-455c-8784-36484f775ff8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108573 Jul 20 04:43:54.784910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3471/4596] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:54.791710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:54.792999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:54.824133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.832215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:54.833792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:54.834259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.072690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.081076 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7869bc1-3294-4f16-827a-536cebe5db7a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.294363 Jul 20 04:43:55.084518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3472/4597] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:54 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:55.090801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:55.091456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:55.114068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.114528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.115327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.116084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.565518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:55.581337 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f20ac3f3-2c9f-496d-baeb-09083772cf4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.495681 Jul 20 04:43:55.592397 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3473/4598] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:55 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:55.597983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:55.599419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:55.607776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.609324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.610306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:55.613946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:55.988686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.002755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.005455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.007038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06a1ebcd-a048-4e4a-b15f-5652bce635f2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 2166 microversion: 2.42 time: 0.413350 Jul 20 04:43:56.007836 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3474/4599] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:55 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 2166 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:56.101442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:56.102065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:56.122187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.123285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.126645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.127107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.351116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:56.362273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aea0ff19-909d-41e2-9d32-2bc70d730440 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1366 microversion: 2.1 time: 0.265062 Jul 20 04:43:56.366155 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3475/4600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:56 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:56.699627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d5d18b07-7636-4766-abb7-67249d3a76c9 req-fe7d31f9-c67a-414a-8102-cd997b27cd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-deleted", "tag": "a3d8da46-0316-4823-9384-cf6668ebebab"}, {"server_uuid": "7f5399d9-daca-4051-b0eb-aa79995262f3", "name": "network-vif-deleted", "tag": "75a5af4e-82a6-4b12-957a-046b8af7dc3d"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:56.712810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d5d18b07-7636-4766-abb7-67249d3a76c9 req-fe7d31f9-c67a-414a-8102-cd997b27cd39 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:56.717004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d5d18b07-7636-4766-abb7-67249d3a76c9 req-fe7d31f9-c67a-414a-8102-cd997b27cd39 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:56.746931 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d5d18b07-7636-4766-abb7-67249d3a76c9 req-fe7d31f9-c67a-414a-8102-cd997b27cd39 service nova] Creating event network-vif-deleted:a3d8da46-0316-4823-9384-cf6668ebebab for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:56.747782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d5d18b07-7636-4766-abb7-67249d3a76c9 req-fe7d31f9-c67a-414a-8102-cd997b27cd39 service nova] Creating event network-vif-deleted:75a5af4e-82a6-4b12-957a-046b8af7dc3d for instance 7f5399d9-daca-4051-b0eb-aa79995262f3 on n-h2-764486-11 Jul 20 04:43:56.759945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d5d18b07-7636-4766-abb7-67249d3a76c9 req-fe7d31f9-c67a-414a-8102-cd997b27cd39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064359 Jul 20 04:43:56.763874 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3476/4601] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:43:57.032218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.033291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.047476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.048874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.050090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.056055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.275309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.300088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.303241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.307874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99b4d76a-a3c3-4603-b8ad-a8d5a004a9ce tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.281733 Jul 20 04:43:57.308887 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3477/4602] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:43:57.383587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.384486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.396164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.399133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.400068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.401529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.819602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:57.831725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28f13d3e-faa6-4608-8f1f-5c5d7ebe44e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1555 microversion: 2.1 time: 0.452525 Jul 20 04:43:57.845723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3478/4603] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1555 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:43:57.851186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:57.852552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:57.863490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.864111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.866078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:57.866899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:57.999317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e1fe64f1-c0b5-479c-8f35-7f708d555b16 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151979 Jul 20 04:43:58.000019 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3479/4604] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:43:57 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:43:58.330149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:58.331007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:58.347590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.348129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.349403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.349854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.547296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.583621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.596010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:58.602109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ec588f7-586e-424b-b533-8ed520b387b5 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.278843 Jul 20 04:43:58.606214 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3480/4605] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:43:58 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:43:58.648544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2b92a4-8b71-4040-aa60-4a632e189c42 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-777157621", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:43:58.815948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7c2b92a4-8b71-4040-aa60-4a632e189c42 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Block Device 9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f is not bootable. Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2b92a4-8b71-4040-aa60-4a632e189c42 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 357 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-777157621", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: exception: Block Device 9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f is not bootable. Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-777157621', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f'}], 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f is not bootable. Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:58.830151 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f is not bootable. Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f is not bootable. Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2b92a4-8b71-4040-aa60-4a632e189c42 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Block Device 9fe54176-eccd-4cfa-aab2-4bcbd6d5ae5f is not bootable. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:43:58.833603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c2b92a4-8b71-4040-aa60-4a632e189c42 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.189109 Jul 20 04:43:58.835941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3481/4606] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:43:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:43:58.842438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:58.843057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:58.855014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.855601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:58.856722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:58.857414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.519724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:43:59.531092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23bb9927-539a-44c0-a508-5dca12d1726d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.693921 Jul 20 04:43:59.532030 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3482/4607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:58 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:43:59.551541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:43:59.552550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:43:59.570843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.571455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:43:59.572426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:43:59.573010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.085584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:00.098821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-537ba2bb-63e7-4cf0-b975-79c580ba0d35 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.553118 Jul 20 04:44:00.114321 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3483/4608] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:43:59 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:00.128981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:00.137478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.156310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.156786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.157580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.158017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.340933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:00.351983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:00.353805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:00.355837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4220912-c246-4b1e-9ba1-b5b087e731c3 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.234162 Jul 20 04:44:00.368392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3484/4609] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:00 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:00.374741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:00.379403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:00.398571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.399601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.400636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:00.401250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:00.484461 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f1cda32-c918-4844-bee1-02949831a17b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action" status: 200 len: 24565 microversion: 2.1 time: 0.114353 Jul 20 04:44:00.486773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3485/4610] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:00 2022] POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action => generated 24565 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:44:01.069208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fe71b3e3-8b80-4273-aef5-40953a27507e req-a084d61b-fc95-4b67-8167-b5c315185774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d122213-6f22-4fc2-937c-7d2b457b40b7", "tag": "8f320f4f-e246-404b-b866-19ba0a54faa4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:01.088489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fe71b3e3-8b80-4273-aef5-40953a27507e req-a084d61b-fc95-4b67-8167-b5c315185774 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.089253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fe71b3e3-8b80-4273-aef5-40953a27507e req-a084d61b-fc95-4b67-8167-b5c315185774 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.117804 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fe71b3e3-8b80-4273-aef5-40953a27507e req-a084d61b-fc95-4b67-8167-b5c315185774 service nova] Creating event network-changed:8f320f4f-e246-404b-b866-19ba0a54faa4 for instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 on n-h2-764486-11 Jul 20 04:44:01.132499 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fe71b3e3-8b80-4273-aef5-40953a27507e req-a084d61b-fc95-4b67-8167-b5c315185774 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067537 Jul 20 04:44:01.133430 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3486/4611] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:01.376464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:01.377179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:01.400620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.401003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.401794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:01.402247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:01.656772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.673075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.674902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:01.689836 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b946762-d8a5-4e2b-b842-40bea6935a4e tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.318422 Jul 20 04:44:01.691775 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3487/4612] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:01 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 04:44:02.714326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:02.714953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:02.726753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.727216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.728011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:02.728485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:02.745663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:02.933962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.965542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.978852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:02.979888 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c50553ba-0044-40d8-80dd-83cf6615fadb tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.272256 Jul 20 04:44:02.980489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3488/4613] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:02 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:02.999001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cafb7168-524d-4f81-b2b2-af7a3bb1092a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1785354254", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "015a4084-97ff-4146-83ba-116b77f93e6a", "destination_type": "local"}, {"source_type": "volume", "uuid": "02081da0-8d77-4fd4-995c-e8fc9803c3d7", "destination_type": "invalid"}], "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cafb7168-524d-4f81-b2b2-af7a3bb1092a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 495 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1785354254", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "015a4084-97ff-4146-83ba-116b77f93e6a", "destination_type": "local"}, {"source_type": "volume", "uuid": "02081da0-8d77-4fd4-995c-e8fc9803c3d7", "destination_type": "invalid"}], "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1785354254', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '015a4084-97ff-4146-83ba-116b77f93e6a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '02081da0-8d77-4fd4-995c-e8fc9803c3d7', 'destination_type': 'invalid'}], 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:03.002511 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 04:44:03.005541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.013793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cafb7168-524d-4f81-b2b2-af7a3bb1092a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:03.014998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cafb7168-524d-4f81-b2b2-af7a3bb1092a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020303 Jul 20 04:44:03.015840 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3489/4614] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:03.024032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:03.029826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:03.037984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.039724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.041065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.041714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.310754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.321346 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6111573b-43d9-4ea6-94e5-3d22fd042676 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.301032 Jul 20 04:44:03.324254 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3490/4615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:03 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:03.341572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:03.342459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:03.356046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.360854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.362612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.364853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.657848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:03.672525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29194b66-0a56-4a07-ab1c-403cc6310740 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.336783 Jul 20 04:44:03.673956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3491/4616] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:03 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:03.766338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ad2ec79-521c-4ee0-9d13-d20701201a9a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2015814929", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ad2ec79-521c-4ee0-9d13-d20701201a9a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 492 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2015814929", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2015814929', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 20 04:44:03.769510 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:03.772100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ad2ec79-521c-4ee0-9d13-d20701201a9a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:03.778988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ad2ec79-521c-4ee0-9d13-d20701201a9a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010109 Jul 20 04:44:03.778988 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3492/4617] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:03 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:03.796854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:03.797577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:03.818730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.819193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:03.820003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:03.820466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.304259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.318197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3128e08e-b50d-4d91-ac23-05802cc37f62 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.538758 Jul 20 04:44:04.318897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3493/4618] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:03 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:04.327238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.327983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.353773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.354460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.355327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.355843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.566260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.607203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.617468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:04.622800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0bbc0af-ff19-46e7-b4a1-97867db89939 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.301688 Jul 20 04:44:04.637923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3494/4619] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:04.665642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:04.671539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:04.697083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:04.700067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.701386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:04.702481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:04.703247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.326554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.334755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f09a5bd1-a366-464b-8357-831e152b0b0b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.695013 Jul 20 04:44:05.335364 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3495/4620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:04 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:05.556320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd08b4e4-b531-4e9f-8b1d-f5c627246a63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd08b4e4-b531-4e9f-8b1d-f5c627246a63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 416 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:05.558888 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:05.562908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd08b4e4-b531-4e9f-8b1d-f5c627246a63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:05.565175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd08b4e4-b531-4e9f-8b1d-f5c627246a63 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012839 Jul 20 04:44:05.565791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3496/4621] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:05 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:44:05.581637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:05.582286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:05.589536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.589986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.591031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.591623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.888595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:05.901885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d3da266e-01f0-444b-a472-00b95e561fd8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.322889 Jul 20 04:44:05.903386 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3497/4622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:05 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:05.911519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:05.913284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:05.922821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.923704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:05.925412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:05.926687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.054107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.066164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.072537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.074626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e49cc46-c177-472e-825f-b7e05de01b53 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.169012 Jul 20 04:44:06.077839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3498/4623] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:05 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:06.094866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:06.095487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:06.120336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.122890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.123628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.125106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.919627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:06.930213 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b848ff7d-062d-4056-adc9-cec692d53622 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.845147 Jul 20 04:44:06.944397 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3499/4624] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:06 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:06.944397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:06.944397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:06.960661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.961343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:06.964260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:06.964913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.630176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e444919f-cf0b-4529-92ba-d09dac829dc2 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1836 microversion: 2.1 time: 0.697033 Jul 20 04:44:07.633213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3500/4625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:06 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1836 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:07.649830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.650484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.660972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.661693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.662773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.663555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.776900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.789695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.791720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:07.793297 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1faba71f-216d-4b04-bc70-af559055e5bd tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.157743 Jul 20 04:44:07.794939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3501/4626] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:07.801777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8c85792-6d1a-4284-8ca9-05d2efc6f9bc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-925937740", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": -1, "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:07.814890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a8c85792-6d1a-4284-8ca9-05d2efc6f9bc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Flavor -1 could not be found. Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8c85792-6d1a-4284-8ca9-05d2efc6f9bc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 205 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-925937740", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": -1, "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: exception: Flavor -1 could not be found. Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-925937740', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': -1, 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:07.823075 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:07.827061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8c85792-6d1a-4284-8ca9-05d2efc6f9bc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:07.828364 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a8c85792-6d1a-4284-8ca9-05d2efc6f9bc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.031532 Jul 20 04:44:07.832022 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3502/4627] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:07 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:44:07.835513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:07.836342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:07.845187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.845877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:07.846877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:07.847536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.122795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.132392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff4e3f4a-cd9d-4eb8-b5c3-74dd81bc25f8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1683 microversion: 2.1 time: 0.301380 Jul 20 04:44:08.148791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3503/4628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:07 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1683 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:08.161925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.162740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.170155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.170925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.171904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.172615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.433374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:08.443485 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4479dcce-777d-4db4-b68a-5753db623be3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.288081 Jul 20 04:44:08.456459 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3504/4629] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:08.461271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:08.462273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.494874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.496946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.500909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.502850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.656566 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9936c432-f6c6-433a-aa56-d62d6ede8d94 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action" status: 200 len: 32633 microversion: 2.1 time: 0.204201 Jul 20 04:44:08.657246 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3505/4630] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:08 2022] POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action => generated 32633 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:44:08.665394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:08.669719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:08.687312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.688424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:08.689432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:08.690184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.042433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.059095 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a35ee380-f654-443c-bde7-90f80d619220 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.400207 Jul 20 04:44:09.068442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3506/4631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:08 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:09.073004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:09.073395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.081542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.082172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.083149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.083868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.227992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.239227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.241035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.242444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-437a27df-1c79-482f-9b21-6187a5235880 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.181855 Jul 20 04:44:09.243699 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3507/4632] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:09 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:09.249612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:09.250699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:09.257875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.258802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.260459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:09.261071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:09.380397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd8a18a4d40864ce3829a281033e67052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993dbb35794c42d8889e6ed1ebde0025', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:09.382009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: b239ce17-0567-427c-9c40-992207481c84] flavor_id is None. Assuming migration. {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:44:09.382620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: b239ce17-0567-427c-9c40-992207481c84] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:44:09.925042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:10.120546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc6a6fb1-51ae-41d0-b3b5-54a811ee8735 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action" status: 202 len: 0 microversion: 2.1 time: 0.874134 Jul 20 04:44:10.122531 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3508/4633] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:09 2022] POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:10.130286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cd7951b-f9fd-4eb9-afa4-deef29e6c76f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1158487520", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cd7951b-f9fd-4eb9-afa4-deef29e6c76f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 173 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1158487520", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1158487520', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi -1 Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:10.133960 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 04:44:10.137137 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:10.140887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cd7951b-f9fd-4eb9-afa4-deef29e6c76f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:10.142526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cd7951b-f9fd-4eb9-afa4-deef29e6c76f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018510 Jul 20 04:44:10.143349 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3509/4634] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:10 2022] POST /compute/v2.1/servers => generated 145 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:10.168483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:10.172796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:10.193959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.202236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.206223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.206807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.595090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:10.609842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8286f75d-f971-4d1b-8045-93d97bb6605d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1692 microversion: 2.1 time: 0.458854 Jul 20 04:44:10.610768 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3510/4635] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:10 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1692 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:10.615580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:10.616195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:10.633602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.634056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:10.634849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:10.635282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.151941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.162625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-944a90f8-9bbd-4d82-994b-4a6903ccfd12 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.550650 Jul 20 04:44:11.166650 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3511/4636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:10 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:11.186929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.190100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.206349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.206349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.206915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.212626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.316937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.329301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.332311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.333694 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11b8f86b-8164-458c-a561-60f3e70fe40a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.165084 Jul 20 04:44:11.334407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3512/4637] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:11.339417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.340111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.346444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.347291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.348446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.349106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.609516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:11.617960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b747969-1e06-41a2-9afb-b773e13a1ac0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.282179 Jul 20 04:44:11.624941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3513/4638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:11.641799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:11.642590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:11.655258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.658762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:11.659931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:11.665434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.185718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.196159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8efce73-3925-43c0-b126-65a31132120b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1692 microversion: 2.1 time: 0.558108 Jul 20 04:44:12.196783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3514/4639] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:11 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1692 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:12.205828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b713b9d-e232-47bd-84f7-58bc5bfee754 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-562992579", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:12.215278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9b713b9d-e232-47bd-84f7-58bc5bfee754 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b713b9d-e232-47bd-84f7-58bc5bfee754 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 215 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-562992579", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-562992579', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:12.219611 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b713b9d-e232-47bd-84f7-58bc5bfee754 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b713b9d-e232-47bd-84f7-58bc5bfee754 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019634 Jul 20 04:44:12.224020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3515/4640] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:12 2022] POST /compute/v2.1/servers => generated 123 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:12.235397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.236050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.251602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.253547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.255253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.256469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.534086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.542731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccb52f26-1bc1-441a-bca3-7112e192f492 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.311268 Jul 20 04:44:12.543906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3516/4641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:12.549432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.550379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.557469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.558269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.560425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.573024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.688800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.703969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.705888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.708278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d205062a-855f-4f5f-93d9-05b9c791063d tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.163053 Jul 20 04:44:12.709537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3517/4642] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:12.715896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:12.717020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:12.725948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.727101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.728329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:12.729132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:12.982931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:12.991798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab580e5e-c53c-4b3c-9376-0bcef80782d5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.279959 Jul 20 04:44:12.992574 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3518/4643] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:12 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:13.220777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:13.221850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:13.248199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.250381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.255853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:13.256329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:13.581735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:13.597616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eca3415b-5370-41f2-81ef-9ac130bd1f60 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1692 microversion: 2.1 time: 0.382294 Jul 20 04:44:13.601313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3519/4644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:13 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1692 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:13.615756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-852fd7f9-026f-465e-90d2-3f926cae4723 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1011626707", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-key-1706758182", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:13.724268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-852fd7f9-026f-465e-90d2-3f926cae4723 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] validate_networks() for [('57ffe73c-ee73-4565-99e6-bb491d6105d3', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:44:14.160961 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-852fd7f9-026f-465e-90d2-3f926cae4723 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Invalid key_name provided. Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-852fd7f9-026f-465e-90d2-3f926cae4723 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 247 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1011626707", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-key-1706758182", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid key_name provided. Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1011626707', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'key_name': 'tempest-key-1706758182', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1706758182 not found for user bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:14.163917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:14.167847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-852fd7f9-026f-465e-90d2-3f926cae4723 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid key_name provided. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:14.171740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-852fd7f9-026f-465e-90d2-3f926cae4723 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.567069 Jul 20 04:44:14.173556 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3520/4645] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:13 2022] POST /compute/v2.1/servers => generated 70 bytes in 571 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 04:44:14.184941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.191541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.206540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.207376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.208394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.209042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.357385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:14.367976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:14.386473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:14.395682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c89b0816-7f89-48d9-bdae-b8f987f1fdb1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.220490 Jul 20 04:44:14.397501 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3521/4646] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:14.416150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.417022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.444788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.445822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.446827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.447272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.791298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:14.800696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73ac9d55-7959-4504-ad43-2c6a817c2f91 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.393051 Jul 20 04:44:14.815720 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3522/4647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:14.830191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:14.830808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:14.848066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.849050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:14.850020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:14.850627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.196730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.206509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a5cf29a-ac49-4206-b482-50bc66244638 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.388697 Jul 20 04:44:15.216950 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3523/4648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:14 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:15.224314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:15.225035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:15.231471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.232001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.232911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.233410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.441820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:15.455716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d918a35c-7f66-4c97-baf9-f2b7c73d9334 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.236135 Jul 20 04:44:15.460533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3524/4649] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:15 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:15.955709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Calling method '.version_select at 0x7f838ae515e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:15.956634 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:44:15.956634 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:44:15.957789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.958240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.974817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.975278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.989260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:15.989720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:15.996061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63a44840-732d-47c6-9024-45112b77e7a0 tempest-PortsAdminExtendedAttrsTestJSON-1239901609 tempest-PortsAdminExtendedAttrsTestJSON-1239901609-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.534321 Jul 20 04:44:15.996759 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3525/4650] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 04:44:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:16.020326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.020965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.028136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.029241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.030212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.030885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.120196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.133682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.135404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.138666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4062937-89d5-4675-a790-aa959065c321 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.140611 Jul 20 04:44:16.139519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3526/4651] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:15 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:16.157303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-392b0d6e-8810-4da8-b8a2-845fad6ade38 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1020902190", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:16.364644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.security_group_api [None req-392b0d6e-8810-4da8-b8a2-845fad6ade38 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Neutron security group does_not_exist not found {{(pid=123724) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 20 04:44:16.365254 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-392b0d6e-8810-4da8-b8a2-845fad6ade38 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-392b0d6e-8810-4da8-b8a2-845fad6ade38 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 258 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1020902190", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1020902190', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 20 04:44:16.379388 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:16.383693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-392b0d6e-8810-4da8-b8a2-845fad6ade38 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:16.388846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-392b0d6e-8810-4da8-b8a2-845fad6ade38 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.230831 Jul 20 04:44:16.388846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3527/4652] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:16 2022] POST /compute/v2.1/servers => generated 106 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:16.389822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.390447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.403985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.404485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.405281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.405849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.410252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:16.695444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:16.707400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7b16632-7f68-430e-a438-ffef8eb4b31f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.323376 Jul 20 04:44:16.719494 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3528/4653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:16.728510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:16.729979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:16.782258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.783094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:16.784473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:16.785267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.092036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.105051 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-869cd0bb-a92f-484a-8d10-ea8da5742618 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.382764 Jul 20 04:44:17.109207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3529/4654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:16 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:17.131737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.132764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.141202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.141824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.142869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.144220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.431683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.455791 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de346fd8-573c-4cb3-b454-741a9f343086 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.317543 Jul 20 04:44:17.467135 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3530/4655] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:17.472436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.477378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.498448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.499662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.500786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.501820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.606162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.618544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.622696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3248cf992334800aa9a235250b800d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf31942fc7040c29667c26fa198521a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.625349 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f33e9974-2e8f-4309-b322-70f13cc56fa2 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 200 len: 1603 microversion: 2.42 time: 0.156819 Jul 20 04:44:17.626573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3531/4656] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 1603 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 04:44:17.633188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1d17cbd-671e-4562-ad3b-4a3754dc76cf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.633987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1d17cbd-671e-4562-ad3b-4a3754dc76cf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 2f78d32e-e275-454b-825e-3c47ea00e6ba] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.644475 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c1d17cbd-671e-4562-ad3b-4a3754dc76cf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 2f78d32e-e275-454b-825e-3c47ea00e6ba could not be found. Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1d17cbd-671e-4562-ad3b-4a3754dc76cf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/2f78d32e-e275-454b-825e-3c47ea00e6ba HTTP/1.1 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2f78d32e-e275-454b-825e-3c47ea00e6ba could not be found. Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2f78d32e-e275-454b-825e-3c47ea00e6ba'} Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f78d32e-e275-454b-825e-3c47ea00e6ba could not be found. Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f78d32e-e275-454b-825e-3c47ea00e6ba could not be found. Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:17.645254 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f78d32e-e275-454b-825e-3c47ea00e6ba could not be found. Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:17.650008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1d17cbd-671e-4562-ad3b-4a3754dc76cf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 2f78d32e-e275-454b-825e-3c47ea00e6ba could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:17.652850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1d17cbd-671e-4562-ad3b-4a3754dc76cf tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f78d32e-e275-454b-825e-3c47ea00e6ba" status: 404 len: 111 microversion: 2.1 time: 0.024582 Jul 20 04:44:17.653689 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3532/4657] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:17 2022] DELETE /compute/v2.1/servers/2f78d32e-e275-454b-825e-3c47ea00e6ba => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:17.662709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.663739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.675545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.676158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.677072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.677773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.929819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:17.939731 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6b3b492-e099-4955-b3bf-12ec07a041b1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.281559 Jul 20 04:44:17.940688 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3533/4658] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:17.945465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:17.946075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:17.958060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.958528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:17.959600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:17.960047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.252290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.270244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-065a1cfe-be72-48bd-98d3-149d413c36df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.328439 Jul 20 04:44:18.276403 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3534/4659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:17 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:18.283802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.284830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.298548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.299626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.300721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.301417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.513262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.524211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-786403a3-c2b3-405f-9ec6-ed18c75be2c9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.245474 Jul 20 04:44:18.526001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3535/4660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:18.548217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d005b5-e589-4a68-abf5-63ef4877b268 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.550050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9d005b5-e589-4a68-abf5-63ef4877b268 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Failed to fetch instance by id 9223372036854775808 {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:44:18.553112 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c9d005b5-e589-4a68-abf5-63ef4877b268 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d005b5-e589-4a68-abf5-63ef4877b268 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9223372036854775808 could not be found. Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9223372036854775808'} Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.557433 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:18.564525 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:18.564525 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:18.564525 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:18.564525 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 20 04:44:18.564525 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.564525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d005b5-e589-4a68-abf5-63ef4877b268 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:18.566403 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9d005b5-e589-4a68-abf5-63ef4877b268 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.028667 Jul 20 04:44:18.568937 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3536/4661] 10.222.0.49 () {58 vars in 1187 bytes} [Wed Jul 20 04:44:18 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:44:18.580779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.581620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.590471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.592775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.594184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.595056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.845269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:18.857220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a05d51d4-26e7-4488-a909-9e316c9b4601 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.283174 Jul 20 04:44:18.858571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3537/4662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:18.864273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.865106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.879418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.880558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.881939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.883085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.909056 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] HTTP exception thrown: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Request method failure captured: Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 HTTP/1.1 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14aYjHt5tT2PUBTmRbhW4n-FZmd7RO0KnZTt24wevdcEdNWrTkQCdlZH5dkh999GBlbqq5f-Tmw8TNTrNXzf3fay_ktkxgFSywLo23nDAdam_HfE6iyY_6gvQYQ2Hw_GKMN4MmQV8NDrGJ26mpEqptOEL6PMAU93NzTiZt6Inee9oHM Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cbf31942fc7040c29667c26fa198521a Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbf31942fc7040c29667c26fa198521a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cbf31942fc7040c29667c26fa198521a Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TaggedBootDevicesTest_v242-86190082-project Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b3248cf992334800aa9a235250b800d1 Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TaggedBootDevicesTest_v242-86190082-project Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7f5399d9-daca-4051-b0eb-aa79995262f3'} Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.911737 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:18.916238 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:18.918724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Returning 404 to user: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:18.920089 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba856fd6-f6ca-44c8-98c2-6ad7e2823256 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 404 len: 111 microversion: 2.42 time: 0.060145 Jul 20 04:44:18.921215 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3538/4663] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:18.928537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:18.929991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:18.937696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.938312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:18.939808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:18.940256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.121266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.134425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53c74f7b-0725-4ae5-ae74-fb1ad388fd65 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.210701 Jul 20 04:44:19.135858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3539/4664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:18 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:19.142412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fbb95523-2379-462b-9ce2-ae1fe193e03a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '.version_select at 0x7f838a614a60>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.164093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fbb95523-2379-462b-9ce2-ae1fe193e03a tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444967246" status: 204 len: 0 microversion: 2.42 time: 0.026125 Jul 20 04:44:19.164875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3540/4665] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jul 20 04:44:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444967246 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 04:44:19.171133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89c8e088-c04b-48ac-9cac-ea68899b4d47 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.171865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89c8e088-c04b-48ac-9cac-ea68899b4d47 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Failed to fetch instance by id -1 {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 04:44:19.172583 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-89c8e088-c04b-48ac-9cac-ea68899b4d47 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance -1 could not be found. Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89c8e088-c04b-48ac-9cac-ea68899b4d47 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance -1 could not be found. Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '-1'} Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:19.174421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89c8e088-c04b-48ac-9cac-ea68899b4d47 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance -1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89c8e088-c04b-48ac-9cac-ea68899b4d47 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009924 Jul 20 04:44:19.177875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3541/4666] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:44:19 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:44:19.189782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.190389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:19.197920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.198387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.199238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.199694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.512941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.526877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccc2317e-e158-4d9b-b8dc-abc888dd9eb4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.343704 Jul 20 04:44:19.530097 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3542/4667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:19.542338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.554015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:19.577564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.584916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.585764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.586201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.897432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:19.906128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-870cbdf4-ccd2-4cb9-a48b-9a5a3910a655 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.374116 Jul 20 04:44:19.907040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3543/4668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:19.916624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:19.917346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:19.924637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.925163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:19.926105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:19.926540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.064714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.073111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92389a68-4350-4e12-8fdb-f36f2d9300f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.165061 Jul 20 04:44:20.073696 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3544/4669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:19 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:20.091200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0950d41-fa66-44c5-86ff-8ad99d1e7371 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:20.091744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0950d41-fa66-44c5-86ff-8ad99d1e7371 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 67c349fd-c31c-4248-b04d-687a10feec41] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.097502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a0950d41-fa66-44c5-86ff-8ad99d1e7371 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 67c349fd-c31c-4248-b04d-687a10feec41 could not be found. Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0950d41-fa66-44c5-86ff-8ad99d1e7371 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/67c349fd-c31c-4248-b04d-687a10feec41/action HTTP/1.1 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 19 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: {"forceDelete": {}} Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 67c349fd-c31c-4248-b04d-687a10feec41 could not be found. Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '67c349fd-c31c-4248-b04d-687a10feec41', 'body': {'forceDelete': {}}} Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c349fd-c31c-4248-b04d-687a10feec41 could not be found. Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c349fd-c31c-4248-b04d-687a10feec41 could not be found. Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:20.105051 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c349fd-c31c-4248-b04d-687a10feec41 could not be found. Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0950d41-fa66-44c5-86ff-8ad99d1e7371 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 67c349fd-c31c-4248-b04d-687a10feec41 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0950d41-fa66-44c5-86ff-8ad99d1e7371 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/67c349fd-c31c-4248-b04d-687a10feec41/action" status: 404 len: 111 microversion: 2.1 time: 0.020318 Jul 20 04:44:20.109142 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3545/4670] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:20 2022] POST /compute/v2.1/servers/67c349fd-c31c-4248-b04d-687a10feec41/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:44:20.115231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.115821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.118737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:20.123714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.124166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.124958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.125391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.256824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.265350 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-703ef176-15ae-4c5e-a996-5b90c1d1e1ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.153776 Jul 20 04:44:20.265736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3546/4671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:20.282971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.283919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.290022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.290474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.291343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.291788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.479772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.488298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08c34a67-38ee-4452-8412-86e7ee48889e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.209069 Jul 20 04:44:20.489647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3547/4672] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:20.516160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d743db1f-ea26-48b7-ae01-e80de1f5b2ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:20.523193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d743db1f-ea26-48b7-ae01-e80de1f5b2ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: f39b5329-a7c5-41ac-8efd-55a0589ce489] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.532526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d743db1f-ea26-48b7-ae01-e80de1f5b2ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance f39b5329-a7c5-41ac-8efd-55a0589ce489 could not be found. Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d743db1f-ea26-48b7-ae01-e80de1f5b2ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/f39b5329-a7c5-41ac-8efd-55a0589ce489/action HTTP/1.1 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 39 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: {"os-getConsoleOutput": {"length": 10}} Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f39b5329-a7c5-41ac-8efd-55a0589ce489 could not be found. Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f39b5329-a7c5-41ac-8efd-55a0589ce489', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39b5329-a7c5-41ac-8efd-55a0589ce489 could not be found. Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39b5329-a7c5-41ac-8efd-55a0589ce489 could not be found. Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.545574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:20.549261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:20.549261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:20.549261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:20.549261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:20.549261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39b5329-a7c5-41ac-8efd-55a0589ce489 could not be found. Jul 20 04:44:20.549261 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:20.552948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d743db1f-ea26-48b7-ae01-e80de1f5b2ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance f39b5329-a7c5-41ac-8efd-55a0589ce489 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:20.554192 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d743db1f-ea26-48b7-ae01-e80de1f5b2ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/f39b5329-a7c5-41ac-8efd-55a0589ce489/action" status: 404 len: 111 microversion: 2.1 time: 0.051161 Jul 20 04:44:20.559078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3548/4673] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:20 2022] POST /compute/v2.1/servers/f39b5329-a7c5-41ac-8efd-55a0589ce489/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:20.565452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.566298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.589983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.590768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.591749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.592756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.905911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:20.916381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ec027b0-5c65-4c5f-bf7e-d973cc99bdeb tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.355659 Jul 20 04:44:20.932792 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3549/4674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:20.939160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:20.940134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:20.947616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.948417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:20.949617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:20.950451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.197021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.215808 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e19ccbe3-1929-4949-bd57-9fd2b4bb8718 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.280634 Jul 20 04:44:21.217392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3550/4675] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:20 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:21.224905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:21.226928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.234460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.235139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.236284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.237164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.265897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:21.896403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:21.904684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc072ad5-0d51-406e-91e2-e7464974204e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.685117 Jul 20 04:44:21.905231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3551/4676] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:21 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:21.922040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3b964b8-e42a-48cd-b915-6649b9681aef tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:21.928780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3b964b8-e42a-48cd-b915-6649b9681aef tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 019766b5-61c2-4870-99d0-200aaefc9018] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.940084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c3b964b8-e42a-48cd-b915-6649b9681aef tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 019766b5-61c2-4870-99d0-200aaefc9018 could not be found. Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3b964b8-e42a-48cd-b915-6649b9681aef tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/019766b5-61c2-4870-99d0-200aaefc9018 HTTP/1.1 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 019766b5-61c2-4870-99d0-200aaefc9018 could not be found. Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '019766b5-61c2-4870-99d0-200aaefc9018'} Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019766b5-61c2-4870-99d0-200aaefc9018 could not be found. Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019766b5-61c2-4870-99d0-200aaefc9018 could not be found. Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:21.941559 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:21.945196 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:21.945196 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:21.945196 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:21.945196 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019766b5-61c2-4870-99d0-200aaefc9018 could not be found. Jul 20 04:44:21.945196 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:21.945196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3b964b8-e42a-48cd-b915-6649b9681aef tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 019766b5-61c2-4870-99d0-200aaefc9018 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:21.945886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3b964b8-e42a-48cd-b915-6649b9681aef tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/019766b5-61c2-4870-99d0-200aaefc9018" status: 404 len: 111 microversion: 2.1 time: 0.025523 Jul 20 04:44:21.948711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3552/4677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:21 2022] GET /compute/v2.1/servers/019766b5-61c2-4870-99d0-200aaefc9018 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:44:21.957192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:21.963214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:21.978683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.979436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:21.980989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:21.981644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.172302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.181730 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7168982a-c025-45be-8441-13e11be5c1c6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.228279 Jul 20 04:44:22.182485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3553/4678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:21 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:22.214178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:22.215663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:22.233284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.234294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.236786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.238201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.433859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.450286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8bc572ba-dd5e-4f31-9450-2f1bf3cc7f5c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.254525 Jul 20 04:44:22.451622 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3554/4679] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:22 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:22.459455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:22.460169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:22.483391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.485266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.487638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.488821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.916892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:22.926857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e38c182-794a-4a99-9b98-25d464c3c872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.473435 Jul 20 04:44:22.931402 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3555/4680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:22 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:22.944854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74559c99-b3b9-4532-a0e8-b9c33759e10f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1894633204", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74559c99-b3b9-4532-a0e8-b9c33759e10f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 238 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1894633204", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1894633204', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:22.947853 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 04:44:22.951826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:22.958165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74559c99-b3b9-4532-a0e8-b9c33759e10f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:22.959039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74559c99-b3b9-4532-a0e8-b9c33759e10f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026385 Jul 20 04:44:22.962542 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3556/4681] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:22.971629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:22.972251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:22.981414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.993583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:22.994568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:22.995036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.277193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:23.287584 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b10911f-5c52-433e-b67a-3c57c2df0b2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.319873 Jul 20 04:44:23.292581 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3557/4682] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:22 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:23.309586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:23.310197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:23.317661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.318109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.323249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.323714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.631183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:23.676493 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be7dbc77-76aa-408e-a99a-52e5ccfc0c1f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.371220 Jul 20 04:44:23.678791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3558/4683] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:23 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:23.936667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af30e7b5-7d07-4487-b724-0b30cdf0d6a1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1268126151", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af30e7b5-7d07-4487-b724-0b30cdf0d6a1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 235 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1268126151", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1268126151', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:23.946112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 04:44:23.950907 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:23.953433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-af30e7b5-7d07-4487-b724-0b30cdf0d6a1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:23.954460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-af30e7b5-7d07-4487-b724-0b30cdf0d6a1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.022897 Jul 20 04:44:23.955589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3559/4684] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:44:23.965945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:23.969170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:23.977518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.978259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:23.979303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:23.979965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.252057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.263926 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b25071f-34f0-4177-bc11-2a56513e4fac tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.307050 Jul 20 04:44:24.264559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3560/4685] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:23 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:24.298484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:24.299806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:24.309759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.310707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.311753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.312329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.539047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.551420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a38a7160-7ae7-4321-95d2-b395b80f3819 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.260331 Jul 20 04:44:24.551973 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3561/4686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:24 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:24.576582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:24.579606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:24.614409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.614859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.615638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.616086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.878966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:24.892030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-40bf8774-1bd1-412e-813d-505e110e6f31 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.326259 Jul 20 04:44:24.892824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3562/4687] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:24 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:24.909231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-612c408a-5d73-4bfe-b89b-3af7bc01f6a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:24.910318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-612c408a-5d73-4bfe-b89b-3af7bc01f6a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: deac1564-67a4-4121-91e1-5a5c9d6f90e8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:24.918270 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-612c408a-5d73-4bfe-b89b-3af7bc01f6a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance deac1564-67a4-4121-91e1-5a5c9d6f90e8 could not be found. Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-612c408a-5d73-4bfe-b89b-3af7bc01f6a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/deac1564-67a4-4121-91e1-5a5c9d6f90e8/action HTTP/1.1 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 13 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: {"pause": {}} Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance deac1564-67a4-4121-91e1-5a5c9d6f90e8 could not be found. Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'deac1564-67a4-4121-91e1-5a5c9d6f90e8', 'body': {'pause': {}}} Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deac1564-67a4-4121-91e1-5a5c9d6f90e8 could not be found. Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deac1564-67a4-4121-91e1-5a5c9d6f90e8 could not be found. Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:24.936801 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deac1564-67a4-4121-91e1-5a5c9d6f90e8 could not be found. Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-612c408a-5d73-4bfe-b89b-3af7bc01f6a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance deac1564-67a4-4121-91e1-5a5c9d6f90e8 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-612c408a-5d73-4bfe-b89b-3af7bc01f6a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/deac1564-67a4-4121-91e1-5a5c9d6f90e8/action" status: 404 len: 111 microversion: 2.1 time: 0.035483 Jul 20 04:44:24.942725 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3563/4688] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:24 2022] POST /compute/v2.1/servers/deac1564-67a4-4121-91e1-5a5c9d6f90e8/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:44:24.950080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:24.950769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:24.976121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.978177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:24.979872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:24.980954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.262266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.278864 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52313049-f4b1-4ac9-869e-e2109781dc85 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.332410 Jul 20 04:44:25.280019 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3564/4689] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:24 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:25.298113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.299295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.321105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.321628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.322766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.323284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.554031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.562946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b425bcc-9d9a-4039-9535-ee5a04a3e2c9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.281628 Jul 20 04:44:25.564206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3565/4690] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:25.569646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:25.570536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.577809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.579520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.580561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.582202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.831553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:25.843651 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30725cf2-ea77-467d-ac76-00a2c5fa13df tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.277069 Jul 20 04:44:25.846374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3566/4691] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:25 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:25.860126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:25.860704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:25.872999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.874230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:25.893389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:25.894338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.021534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa08c468-6087-495f-ab46-5b4d00a8940c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 202 len: 0 microversion: 2.1 time: 0.164909 Jul 20 04:44:26.022781 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3567/4692] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:25 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:26.060658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:26.062227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:26.073862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.074827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.075631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.076072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.276034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.292960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7bf7753a-76b0-49a5-9b18-315d6c41f5e3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1511 microversion: 2.1 time: 0.245459 Jul 20 04:44:26.303996 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3568/4693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:26 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:26.309531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:26.309968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:26.321304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.321760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.322876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.323381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.343501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] HTTP exception thrown: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Request method failure captured: Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 HTTP/1.1 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14aYjHt5tT2PUBTmRbhW4n-FZmd7RO0KnZTt24wevdcEdNWrTkQCdlZH5dkh999GBlbqq5f-Tmw8TNTrNXzf3fay_ktkxgFSywLo23nDAdam_HfE6iyY_6gvQYQ2Hw_GKMN4MmQV8NDrGJ26mpEqptOEL6PMAU93NzTiZt6Inee9oHM Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cbf31942fc7040c29667c26fa198521a Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbf31942fc7040c29667c26fa198521a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cbf31942fc7040c29667c26fa198521a Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TaggedBootDevicesTest_v242-86190082-project Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b3248cf992334800aa9a235250b800d1 Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TaggedBootDevicesTest_v242-86190082-project Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7f5399d9-daca-4051-b0eb-aa79995262f3'} Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:26.345065 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Returning 404 to user: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:26.348751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-853e1899-b301-4c7b-a4c8-0374726ccfb4 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 404 len: 111 microversion: 2.42 time: 0.041951 Jul 20 04:44:26.350555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3569/4694] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jul 20 04:44:26 2022] DELETE /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:26.356671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:26.357297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] [instance: 7f5399d9-daca-4051-b0eb-aa79995262f3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:26.363773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.364225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.365210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.365653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.380663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] HTTP exception thrown: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Request method failure captured: Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 HTTP/1.1 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14aYjHt5tT2PUBTmRbhW4n-FZmd7RO0KnZTt24wevdcEdNWrTkQCdlZH5dkh999GBlbqq5f-Tmw8TNTrNXzf3fay_ktkxgFSywLo23nDAdam_HfE6iyY_6gvQYQ2Hw_GKMN4MmQV8NDrGJ26mpEqptOEL6PMAU93NzTiZt6Inee9oHM Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cbf31942fc7040c29667c26fa198521a Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cbf31942fc7040c29667c26fa198521a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cbf31942fc7040c29667c26fa198521a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cbf31942fc7040c29667c26fa198521a Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-86190082 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TaggedBootDevicesTest_v242-86190082-project Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: b3248cf992334800aa9a235250b800d1 Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TaggedBootDevicesTest_v242-86190082-project Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7f5399d9-daca-4051-b0eb-aa79995262f3'} Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.382226 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] Returning 404 to user: Instance 7f5399d9-daca-4051-b0eb-aa79995262f3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97107c11-ee5d-44fc-ae65-550c3d0faec1 tempest-TaggedBootDevicesTest_v242-86190082 tempest-TaggedBootDevicesTest_v242-86190082-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3" status: 404 len: 111 microversion: 2.42 time: 0.031815 Jul 20 04:44:26.387055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3570/4695] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jul 20 04:44:26 2022] GET /compute/v2.1/servers/7f5399d9-daca-4051-b0eb-aa79995262f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:26.581894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:26.582620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:26.589956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.590417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.591973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:26.592454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:26.879812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:26.892050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5978b929-aed3-4f7d-add1-4134ff0ccd82 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1697 microversion: 2.1 time: 0.314631 Jul 20 04:44:26.893466 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3571/4696] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:26 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1697 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:27.312023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:27.313425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:27.324158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.327252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.329297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.331794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.379589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:27.733003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:27.748000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-607b78ee-2fd6-4849-8477-3370d9f4e311 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1491 microversion: 2.1 time: 0.440200 Jul 20 04:44:27.752180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3572/4697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:27 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1491 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:27.780205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:27.783972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:27.813619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.816047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.821091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.821091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.910170 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'pause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state paused Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 13 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: {"pause": {}} Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'pause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state paused Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'pause': {}}} Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state paused. Cannot pause while the instance is in this state. Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state paused Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:27.911751 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state paused Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'pause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state paused {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:27.915641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd01ef57-375b-485d-accb-c132fbd05ee7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 143 microversion: 2.1 time: 0.139223 Jul 20 04:44:27.918565 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3573/4698] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:27 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 143 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:44:27.925144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:27.940295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:27.958273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.958799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:27.959630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:27.960075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.303315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:28.313323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc1550f7-9648-4b3c-95c4-12d7a5b82ec9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1696 microversion: 2.1 time: 0.393659 Jul 20 04:44:28.318598 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3574/4699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:27 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1696 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:28.324577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:28.325328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:28.335424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.336059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.340258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.340985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.560254 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e48a616-b7b3-4e62-98d4-8a6f83c567ea tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 202 len: 0 microversion: 2.1 time: 0.237580 Jul 20 04:44:28.562150 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3575/4700] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:28 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:28.576270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7e595b9b-d1cd-4905-8705-ea54902171aa req-0b788a96-db5b-4a11-83e6-45726ad0c065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "name": "network-vif-unplugged", "status": "completed", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:28.598138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7e595b9b-d1cd-4905-8705-ea54902171aa req-0b788a96-db5b-4a11-83e6-45726ad0c065 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.600683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7e595b9b-d1cd-4905-8705-ea54902171aa req-0b788a96-db5b-4a11-83e6-45726ad0c065 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.633511 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7e595b9b-d1cd-4905-8705-ea54902171aa req-0b788a96-db5b-4a11-83e6-45726ad0c065 service nova] Creating event network-vif-unplugged:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h1-764486-11 Jul 20 04:44:28.663395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-7e595b9b-d1cd-4905-8705-ea54902171aa req-0b788a96-db5b-4a11-83e6-45726ad0c065 service nova] Instance b239ce17-0567-427c-9c40-992207481c84 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:44:28.680862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7e595b9b-d1cd-4905-8705-ea54902171aa req-0b788a96-db5b-4a11-83e6-45726ad0c065 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113540 Jul 20 04:44:28.681741 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3576/4701] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:28.708411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:28.709411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:28.731275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.732613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:28.733536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:28.735438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.117317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.130978 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c3ef7da-5088-4cc8-9d07-8c420d1046d6 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1498 microversion: 2.1 time: 0.447731 Jul 20 04:44:29.136036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3577/4702] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:28 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1498 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:29.340882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:29.341692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:29.359092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.361197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.363999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:29.365547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:29.656521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:29.667233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c9e65ac-143f-435d-897e-5daf3257d04a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1696 microversion: 2.1 time: 0.331954 Jul 20 04:44:29.669456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3578/4703] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:29 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1696 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:30.154294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.155136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.166327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.169063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.172661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.173116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.440628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.457584 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79310216-07a2-4829-815e-4f6a1eb79d25 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.308473 Jul 20 04:44:30.461677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3579/4704] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:30.487056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.487677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.503117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.509329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.509329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.509329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.716385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:30.741510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-825179e5-427a-47c9-993b-aeee6a3f4374 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.259945 Jul 20 04:44:30.744644 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3580/4705] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:30.771193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:30.772068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:30.779493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.780195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:30.781320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:30.781908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.017597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:31.033134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-262c5d91-31e3-44e6-bd4d-5578f3a53361 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1694 microversion: 2.1 time: 0.285458 Jul 20 04:44:31.036682 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3581/4706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:30 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1694 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.045101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:31.046081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.066079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.068709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.070407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.072255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.108082 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146/action HTTP/1.1 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 28 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: {"reboot": {"type": "SOFT"}} Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fb7bc54b-ce29-486c-9a00-1a1c15160146', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:31.114933 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96dc71dd-c268-4f9e-88b4-59056c5f722b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146/action" status: 404 len: 111 microversion: 2.1 time: 0.078749 Jul 20 04:44:31.119100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3582/4707] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:31 2022] POST /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:31.127421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b7b68ce7-b048-45a8-aa23-83bd691caa44 req-ffcb0f97-5bdf-4653-a5ef-3700a0441df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:31.149421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b7b68ce7-b048-45a8-aa23-83bd691caa44 req-ffcb0f97-5bdf-4653-a5ef-3700a0441df7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.150158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b7b68ce7-b048-45a8-aa23-83bd691caa44 req-ffcb0f97-5bdf-4653-a5ef-3700a0441df7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.164947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b7b68ce7-b048-45a8-aa23-83bd691caa44 req-ffcb0f97-5bdf-4653-a5ef-3700a0441df7 service nova] Creating event network-changed:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h1-764486-11 Jul 20 04:44:31.174835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-b7b68ce7-b048-45a8-aa23-83bd691caa44 req-ffcb0f97-5bdf-4653-a5ef-3700a0441df7 service nova] Instance b239ce17-0567-427c-9c40-992207481c84 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:44:31.188194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b7b68ce7-b048-45a8-aa23-83bd691caa44 req-ffcb0f97-5bdf-4653-a5ef-3700a0441df7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069983 Jul 20 04:44:31.189639 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3583/4708] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:31.195995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.197389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.206473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.207447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.208556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.209259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.399330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:31.410118 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ba301b3-9259-4ea1-9b0e-fcb95f3945d9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.218961 Jul 20 04:44:31.410734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3584/4709] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:31 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.428856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.429756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.440992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.441553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.444960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.445414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.677582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:31.688459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc749fff-ece9-47e0-bb90-5226050cc69a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.263462 Jul 20 04:44:31.689898 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3585/4710] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:31 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:31.705457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb14f429-5a4a-497e-afbb-bf2a55bf208f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:31.710391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb14f429-5a4a-497e-afbb-bf2a55bf208f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 8e2ae211-0788-4e43-989e-ac0de9a6e1f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.724256 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-eb14f429-5a4a-497e-afbb-bf2a55bf208f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 8e2ae211-0788-4e43-989e-ac0de9a6e1f5 could not be found. Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb14f429-5a4a-497e-afbb-bf2a55bf208f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/8e2ae211-0788-4e43-989e-ac0de9a6e1f5/action HTTP/1.1 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 28 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: {"reboot": {"type": "SOFT"}} Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 8e2ae211-0788-4e43-989e-ac0de9a6e1f5 could not be found. Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '8e2ae211-0788-4e43-989e-ac0de9a6e1f5', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2ae211-0788-4e43-989e-ac0de9a6e1f5 could not be found. Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2ae211-0788-4e43-989e-ac0de9a6e1f5 could not be found. Jul 20 04:44:31.732721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2ae211-0788-4e43-989e-ac0de9a6e1f5 could not be found. Jul 20 04:44:31.737320 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:31.739521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb14f429-5a4a-497e-afbb-bf2a55bf208f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 8e2ae211-0788-4e43-989e-ac0de9a6e1f5 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:31.741488 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb14f429-5a4a-497e-afbb-bf2a55bf208f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/8e2ae211-0788-4e43-989e-ac0de9a6e1f5/action" status: 404 len: 111 microversion: 2.1 time: 0.040176 Jul 20 04:44:31.744701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3586/4711] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:31 2022] POST /compute/v2.1/servers/8e2ae211-0788-4e43-989e-ac0de9a6e1f5/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:31.755144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:31.756959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:31.785815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.786276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:31.787079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:31.787837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.319526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.330021 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-255eb194-8c6f-493f-8174-b49665d48729 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.580719 Jul 20 04:44:32.333444 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3587/4712] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:31 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:32.340705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.343538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.353122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.353960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.355052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.359349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.862550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:32.874166 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a4f855e-dc6c-4f84-9158-dff9cf8a14f7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1694 microversion: 2.1 time: 0.539137 Jul 20 04:44:32.886490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3588/4713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:32 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1694 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:32.897101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:32.900288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:32.915527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.916311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:32.919381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:32.920189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.315862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.325974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b27295f-ec87-44a6-972f-79e1d30a011b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.437951 Jul 20 04:44:33.330478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3589/4714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:32 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:33.346582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:33.348337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.364626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.366106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.368253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.368959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.406881 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146/action HTTP/1.1 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 65 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fb7bc54b-ce29-486c-9a00-1a1c15160146', 'body': {'rebuild': {'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a'}}} Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:44:33.410201 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:44:33.414579 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:33.419888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:33.421628 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1411f82c-e371-4c5d-95a8-f8ccaea44be4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146/action" status: 404 len: 111 microversion: 2.1 time: 0.080357 Jul 20 04:44:33.422777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3590/4715] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:33 2022] POST /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:44:33.430693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.431572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.439746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.440499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.441517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.442173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.465018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:33.819481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:33.827249 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c9984e3-d13b-448f-8ce8-f44115dd2210 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.400194 Jul 20 04:44:33.836777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3591/4716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:33.845596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:33.846205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:33.862388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.862846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:33.863633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:33.864267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.160750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.171636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d104c851-fb3a-4e9b-8c18-daf261d93a29 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.329809 Jul 20 04:44:34.172626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3592/4717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:33 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:34.177584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:34.178205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.186232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.187266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.188080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.188838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.860384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:34.868424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20fd37a3-17cc-489f-acdc-cd4d3ad916af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1691 microversion: 2.1 time: 0.694399 Jul 20 04:44:34.870686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3593/4718] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:34 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1691 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:34.891273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cc375f3-12a4-4537-b34a-eaa8ff10d099 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:34.894817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3cc375f3-12a4-4537-b34a-eaa8ff10d099 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.909891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3cc375f3-12a4-4537-b34a-eaa8ff10d099 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e could not be found. Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cc375f3-12a4-4537-b34a-eaa8ff10d099 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/4e10d8e2-4658-4fed-8e29-cc30de4cfd1e/action HTTP/1.1 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 65 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e could not be found. Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4e10d8e2-4658-4fed-8e29-cc30de4cfd1e', 'body': {'rebuild': {'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a'}}} Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e could not be found. Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 04:44:34.912519 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e could not be found. Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e could not be found. Jul 20 04:44:34.916837 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:34.919865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cc375f3-12a4-4537-b34a-eaa8ff10d099 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 4e10d8e2-4658-4fed-8e29-cc30de4cfd1e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:34.921858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3cc375f3-12a4-4537-b34a-eaa8ff10d099 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/4e10d8e2-4658-4fed-8e29-cc30de4cfd1e/action" status: 404 len: 111 microversion: 2.1 time: 0.043142 Jul 20 04:44:34.922709 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3594/4719] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:34 2022] POST /compute/v2.1/servers/4e10d8e2-4658-4fed-8e29-cc30de4cfd1e/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:34.951934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:34.954952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:34.981459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.981925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:34.990493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:34.991167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.070068 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b46ffa4-26fc-4713-8d83-4a8f32f9b17d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/ips" status: 200 len: 149 microversion: 2.1 time: 0.127869 Jul 20 04:44:35.076342 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3595/4720] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:44:34 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/ips => generated 149 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:35.087549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:35.088088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.106526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.106980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.107766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.108202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.252846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db01383b-aa91-4401-b6bf-aea56ae21525 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action" status: 204 len: 0 microversion: 2.1 time: 0.180926 Jul 20 04:44:35.253512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3596/4721] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:35 2022] POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:35.258955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.268183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.277811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.278522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.279319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.280313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.461599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.470086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee0d3e05-517b-4074-87de-150062f3eb64 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.215172 Jul 20 04:44:35.470667 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3597/4722] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:35.486108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:35.488761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.496928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:35.507963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.508789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.511554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.514526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.690453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Invalid volume: volume 2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 is already attached to instances: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/os-volume_attachments HTTP/1.1 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 74 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: {"volumeAttachment": {"volumeId": "2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2"}} Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid volume: volume 2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 is already attached to instances: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '2d122213-6f22-4fc2-937c-7d2b457b40b7', 'body': {'volumeAttachment': {'volumeId': '2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2'}}} Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 is already attached to instances: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:35.692512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 is already attached to instances: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 is already attached to instances: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 400 to user: Invalid volume: volume 2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 is already attached to instances: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28cdb295-c377-4b7b-af19-0b765022ae31 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221819 Jul 20 04:44:35.696568 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3598/4723] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:44:35 2022] POST /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:44:35.706934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.707545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:35.723802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.724251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.728765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:35.729255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:35.967501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:35.977724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1731539-de9f-463c-8921-154960ed3d64 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1691 microversion: 2.1 time: 0.282130 Jul 20 04:44:35.985092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3599/4724] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1691 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:35.990116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:35.990743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.009155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.009827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.011332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.012229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.293321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:36.316993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f284f596-c389-43cf-b096-954257b421a4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.329636 Jul 20 04:44:36.320576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3600/4725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:35 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:36.338568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.340101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.366758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.367272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.368094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.368564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.443110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:36.642715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61b3a16b-512c-49f9-a2b5-f122eb4b7efc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 204 len: 0 microversion: 2.1 time: 0.318898 Jul 20 04:44:36.646412 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3601/4726] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:36 2022] DELETE /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:44:36.660676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf57a5be-2aee-4621-bd08-ae2627073a96 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:36.661609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf57a5be-2aee-4621-bd08-ae2627073a96 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.680269 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cf57a5be-2aee-4621-bd08-ae2627073a96 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446 could not be found. Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf57a5be-2aee-4621-bd08-ae2627073a96 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446/action HTTP/1.1 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: {"restore": {}} Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446 could not be found. Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446', 'body': {'restore': {}}} Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446 could not be found. Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446 could not be found. Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:36.687006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:36.690658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:36.690658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:36.690658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446 could not be found. Jul 20 04:44:36.690658 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:36.690658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf57a5be-2aee-4621-bd08-ae2627073a96 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:36.690964 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf57a5be-2aee-4621-bd08-ae2627073a96 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446/action" status: 404 len: 111 microversion: 2.1 time: 0.039439 Jul 20 04:44:36.692661 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3602/4727] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:36 2022] POST /compute/v2.1/servers/cc83f8b2-b36c-42c5-9a1b-7d59c5b7f446/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:36.699301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.700372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.708980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.709814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.710825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.711628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.907344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:36.919871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-870ab7e2-cbf1-49f1-9b4c-1cfb007c6999 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1680 microversion: 2.1 time: 0.224569 Jul 20 04:44:36.923998 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3603/4728] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:36.934892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:36.935694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:36.951129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.951620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:36.952547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:36.952985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.199156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.207746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8000689b-04e3-4704-9b0e-524645e8a3a3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.280268 Jul 20 04:44:37.208409 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3604/4729] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:36 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:37.228264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c660e481-b3b6-43f7-bf1c-60e1bc4113ee req-d6973ffe-5a3b-40ce-b771-d3d56208ff95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "name": "network-vif-plugged", "status": "completed", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:37.237506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c660e481-b3b6-43f7-bf1c-60e1bc4113ee req-d6973ffe-5a3b-40ce-b771-d3d56208ff95 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.237956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c660e481-b3b6-43f7-bf1c-60e1bc4113ee req-d6973ffe-5a3b-40ce-b771-d3d56208ff95 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.253158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c660e481-b3b6-43f7-bf1c-60e1bc4113ee req-d6973ffe-5a3b-40ce-b771-d3d56208ff95 service nova] Creating event network-vif-plugged:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h1-764486-11 Jul 20 04:44:37.259653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-c660e481-b3b6-43f7-bf1c-60e1bc4113ee req-d6973ffe-5a3b-40ce-b771-d3d56208ff95 service nova] Instance b239ce17-0567-427c-9c40-992207481c84 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:44:37.272473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c660e481-b3b6-43f7-bf1c-60e1bc4113ee req-d6973ffe-5a3b-40ce-b771-d3d56208ff95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047975 Jul 20 04:44:37.273299 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3605/4730] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:37.288430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:37.289138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.307346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.308066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.309157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.309326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.535157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.544514 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dcfd7f5d-8130-42ca-8b2c-f575e84de3ed tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1691 microversion: 2.1 time: 0.269510 Jul 20 04:44:37.554939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3606/4731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:37 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:37.561002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:37.561803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.568420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.569009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.569905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.570450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.857912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:37.867409 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35072b09-211f-4442-837e-2c32033bf782 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.310906 Jul 20 04:44:37.868020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3607/4732] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:37 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:37.900755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:37.901908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:37.913690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.914331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.915267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:37.915898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:37.928672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:37.978935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'restore' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: {"restore": {}} Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'restore' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'restore': {}}} Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state active. Cannot restore while the instance is in this state. Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:37.984134 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:37.988721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:37.988721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:37.988721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:37.988721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:37.988721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:37.990823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'restore' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:37.992789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d025366-e178-4632-8872-dc59b4fdc94c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 145 microversion: 2.1 time: 0.112038 Jul 20 04:44:37.994116 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3608/4733] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:37 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 145 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:44:38.007856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.012798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.021055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.023933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.024952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.025529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.374110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:38.387114 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-964b034e-564a-4e27-8c98-c58519572069 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1680 microversion: 2.1 time: 0.386906 Jul 20 04:44:38.389723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3609/4734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:37 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1680 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:38.396928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.402327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.418885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.419522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.420542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.421149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.843324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:38.852272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4701e66a-b005-478b-8225-75752defe3da tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.461081 Jul 20 04:44:38.852906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3610/4735] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:38 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:38.860796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:38.875302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:38.897743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.898225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:38.899047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:38.899485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.214216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.235414 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb591781-13fe-492c-a08e-08ddec48b18a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1683 microversion: 2.1 time: 0.378756 Jul 20 04:44:39.244867 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3611/4736] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:38 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1683 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:39.256716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:39.257471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:39.294470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.295116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.296062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.308392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.613868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.624758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd4a9a91-3193-419d-8db2-b19cfb8caed3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.377897 Jul 20 04:44:39.626351 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3612/4737] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:39 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:39.631511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:39.632402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:39.642158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.642949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.644198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:39.644889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:39.948065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:39.958292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32e55207-9520-43f3-aa4a-a4e94d0a5355 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1680 microversion: 2.1 time: 0.330551 Jul 20 04:44:39.958882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3613/4738] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:39 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1680 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:39.973539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08a0a3a2-0cf4-48c6-b9fb-69b0fcbdcb4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:39.974328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08a0a3a2-0cf4-48c6-b9fb-69b0fcbdcb4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 78c65ac4-2e74-4520-9d0a-208aacce8b08] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:39.984691 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-08a0a3a2-0cf4-48c6-b9fb-69b0fcbdcb4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 78c65ac4-2e74-4520-9d0a-208aacce8b08 could not be found. Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08a0a3a2-0cf4-48c6-b9fb-69b0fcbdcb4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/78c65ac4-2e74-4520-9d0a-208aacce8b08/action HTTP/1.1 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 14 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: {"resume": {}} Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 78c65ac4-2e74-4520-9d0a-208aacce8b08 could not be found. Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '78c65ac4-2e74-4520-9d0a-208aacce8b08', 'body': {'resume': {}}} Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c65ac4-2e74-4520-9d0a-208aacce8b08 could not be found. Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c65ac4-2e74-4520-9d0a-208aacce8b08 could not be found. Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:39.993017 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:39.996567 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:39.996567 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:39.996567 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c65ac4-2e74-4520-9d0a-208aacce8b08 could not be found. Jul 20 04:44:39.996567 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:40.005455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08a0a3a2-0cf4-48c6-b9fb-69b0fcbdcb4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 78c65ac4-2e74-4520-9d0a-208aacce8b08 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:40.006598 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08a0a3a2-0cf4-48c6-b9fb-69b0fcbdcb4c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/78c65ac4-2e74-4520-9d0a-208aacce8b08/action" status: 404 len: 111 microversion: 2.1 time: 0.046645 Jul 20 04:44:40.009877 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3614/4739] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:39 2022] POST /compute/v2.1/servers/78c65ac4-2e74-4520-9d0a-208aacce8b08/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:40.020598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:40.021484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:40.044133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.045416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.046931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.047559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.447721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:40.458652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68f0a84a-971c-4e5f-bd80-d7a5e901b1ba tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.446385 Jul 20 04:44:40.460928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3615/4740] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:40 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:40.483545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:40.484941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:40.495161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.495824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.497181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.497778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.869858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:40.906661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4eb59f91-9ff4-4511-9e3b-53c4d4c30c4b tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.428513 Jul 20 04:44:40.908243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3616/4741] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:40 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:40.917872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-30a42a5c-ae5a-4362-83e8-47546d80e7ea req-0a7c2230-1b26-4511-ae6e-e757c41abb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d122213-6f22-4fc2-937c-7d2b457b40b7", "name": "network-vif-deleted", "tag": "8f320f4f-e246-404b-b866-19ba0a54faa4"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:40.943632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-30a42a5c-ae5a-4362-83e8-47546d80e7ea req-0a7c2230-1b26-4511-ae6e-e757c41abb16 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:40.944535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-30a42a5c-ae5a-4362-83e8-47546d80e7ea req-0a7c2230-1b26-4511-ae6e-e757c41abb16 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:40.976376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-30a42a5c-ae5a-4362-83e8-47546d80e7ea req-0a7c2230-1b26-4511-ae6e-e757c41abb16 service nova] Creating event network-vif-deleted:8f320f4f-e246-404b-b866-19ba0a54faa4 for instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 on n-h2-764486-11 Jul 20 04:44:40.992657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-30a42a5c-ae5a-4362-83e8-47546d80e7ea req-0a7c2230-1b26-4511-ae6e-e757c41abb16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082470 Jul 20 04:44:40.994005 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3617/4742] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:41.001540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:41.002340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:41.009872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.010332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.011327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.011828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.063448 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'resume' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 14 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: {"resume": {}} Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'resume' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'resume': {}}} Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state active. Cannot resume while the instance is in this state. Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:41.065775 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'resume' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:41.069795 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d5c375b-6199-451a-a0c7-1c9223b9d820 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 144 microversion: 2.1 time: 0.071847 Jul 20 04:44:41.071299 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3618/4743] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:40 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 144 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:44:41.078002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:41.079129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:41.087685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.088142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.089734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.090179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.129985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.130442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.131409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lazy-loading 'fault' on Instance uuid 2d122213-6f22-4fc2-937c-7d2b457b40b7 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:41.198497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:41.209742 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8abdb41c-84cd-470b-b17f-047a8734a878 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 200 len: 1330 microversion: 2.1 time: 0.137307 Jul 20 04:44:41.212555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3619/4744] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:41 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:41.217335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:41.218517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:41.232551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.233075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.249218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.252884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.578960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:41.589828 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4468913e-863c-4e19-9d63-d3de34364972 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.376915 Jul 20 04:44:41.591008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3620/4745] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:41 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:41.611305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:41.612431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:41.621028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.621628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.622947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:41.624168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:41.835129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:41.844293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11486fd9-d3c1-4967-90bd-f781e10b9fd5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.237810 Jul 20 04:44:41.844905 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3621/4746] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:41 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:42.030040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-419ba4a9-3820-4c53-a7a1-13bf7b9c9af5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-419ba4a9-3820-4c53-a7a1-13bf7b9c9af5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 160 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "57ffe73c-ee73-4565-99e6-bb491d6105d3"}]}} Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'server': {'name': '', 'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a', 'flavorRef': '452', 'networks': [{'uuid': '57ffe73c-ee73-4565-99e6-bb491d6105d3'}]}}} Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '' Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:44:42.032686 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-419ba4a9-3820-4c53-a7a1-13bf7b9c9af5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-419ba4a9-3820-4c53-a7a1-13bf7b9c9af5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008000 Jul 20 04:44:42.037961 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3622/4747] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:44:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:44:42.046603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:42.047230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:42.055839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.056285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.072313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.072831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.693141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:42.722396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74d327dd-5902-41ee-8e74-10b910b27292 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.678062 Jul 20 04:44:42.725064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3623/4748] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:42 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:42.741335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:42.750840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:42.764327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.764835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.784013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.784825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.819061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 HTTP/1.1 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2d122213-6f22-4fc2-937c-7d2b457b40b7'} Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:42.821495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b817751-509e-4a06-ac1a-8b067de189e2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 404 len: 111 microversion: 2.1 time: 0.095464 Jul 20 04:44:42.826037 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3624/4749] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:42 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:42.834640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:42.835158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:42.852214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.853990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:42.855202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:42.856013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.089109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:43.099723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b7079e3-6526-4038-99dc-87707f3c36f2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.273441 Jul 20 04:44:43.101296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3625/4750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:42 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:43.106353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-964530f7-4984-436a-a7b7-83549ade1cb4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '.version_select at 0x7f838a2003a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:43.141341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-964530f7-4984-436a-a7b7-83549ade1cb4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910217400" status: 202 len: 0 microversion: 2.1 time: 0.037998 Jul 20 04:44:43.143305 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3626/4751] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:44:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910217400 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:43.167291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dd31d2b-1283-4f4e-a8ae-2b7927c1a27e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:43.169064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3dd31d2b-1283-4f4e-a8ae-2b7927c1a27e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: d65083fc-aa78-43b8-b5ca-34bdddecac12] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:43.184837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3dd31d2b-1283-4f4e-a8ae-2b7927c1a27e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance d65083fc-aa78-43b8-b5ca-34bdddecac12 could not be found. Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dd31d2b-1283-4f4e-a8ae-2b7927c1a27e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/d65083fc-aa78-43b8-b5ca-34bdddecac12/action HTTP/1.1 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 14 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: {"shelve": {}} Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d65083fc-aa78-43b8-b5ca-34bdddecac12 could not be found. Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd65083fc-aa78-43b8-b5ca-34bdddecac12', 'body': {'shelve': {}}} Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65083fc-aa78-43b8-b5ca-34bdddecac12 could not be found. Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65083fc-aa78-43b8-b5ca-34bdddecac12 could not be found. Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:44:43.193112 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:44:43.196883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:44:43.196883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:44:43.196883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65083fc-aa78-43b8-b5ca-34bdddecac12 could not be found. Jul 20 04:44:43.196883 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:44:43.199745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dd31d2b-1283-4f4e-a8ae-2b7927c1a27e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance d65083fc-aa78-43b8-b5ca-34bdddecac12 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:44:43.200919 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3dd31d2b-1283-4f4e-a8ae-2b7927c1a27e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/d65083fc-aa78-43b8-b5ca-34bdddecac12/action" status: 404 len: 111 microversion: 2.1 time: 0.056357 Jul 20 04:44:43.202093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3627/4752] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:43 2022] POST /compute/v2.1/servers/d65083fc-aa78-43b8-b5ca-34bdddecac12/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:44:43.211974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:43.213606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:43.230771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.233255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.234318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.236341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.491722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:43.505042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19d16c1c-d1a9-4e2b-9007-3f3d5a7f8bb1 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.297761 Jul 20 04:44:43.508289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3628/4753] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:43 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:43.530743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:43.531931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:43.554520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.555189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:43.556075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:43.558424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.149444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:44.165230 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-601a7b82-f580-4f4f-ab92-8bbae041c34e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.639438 Jul 20 04:44:44.166086 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3629/4754] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:43 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:44.187689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:44:44.187689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:44.200678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.212854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.213840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.214299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.230204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:44.256984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lazy-loading 'flavor' on Instance uuid c1748ffb-8279-402a-b67a-6fc77c5a022b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:44.819659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-979c58c3-b53c-44d7-8dee-bdc86645eaa4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 202 len: 0 microversion: 2.1 time: 0.637382 Jul 20 04:44:44.824062 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3630/4755] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:44:44 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:44:44.836809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:44.840678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:44.862358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.863600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:44.866397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:44.867903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.282628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:45.293812 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2bb07f8-c240-4cfc-af64-0731562af93e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.468244 Jul 20 04:44:45.300609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3631/4756] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:44 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:45.388030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:45.389472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:45.405481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.407179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.408146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.410492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.623788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lazy-loading 'services' on Instance uuid 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:44:45.814788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-227c3e13-daab-44b1-a13d-43fc7f11a9a9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments/2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2" status: 202 len: 0 microversion: 2.1 time: 0.440441 Jul 20 04:44:45.816141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3632/4757] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:44:45 2022] DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments/2fc3b4fe-e9b3-4d4d-b7b2-c230ec5973f2 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:44:45.826671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:45.834080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:45.849034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.859373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.865959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:45.867096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:45.945196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfd4473c-5523-4026-bccb-f89e2c0f03e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124223 Jul 20 04:44:45.946922 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3633/4758] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:45 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:46.311447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:46.312224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:46.322319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.325272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.326164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:46.326612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:46.967958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:46.976180 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50c77d98-64fb-4282-9e85-d8667c697f79 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.668915 Jul 20 04:44:46.981342 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3634/4759] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:46 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:46.986467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:47.001686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:47.008811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.009541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.010580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:47.011234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:47.092972 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89ca6427-a167-4dc9-b786-489ffdea31ae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110210 Jul 20 04:44:47.098746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3635/4760] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:46 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:47.998002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:47.999557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:48.015639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.016622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.017666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.018548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.603049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:48.619636 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e9d35d1-f127-4149-bfee-09b3f585b07c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.625317 Jul 20 04:44:48.629313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3636/4761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:47 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:48.629313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:48.631632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:48.649416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.649988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.650941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:48.651503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:48.711109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7309c92c-4e96-48a1-8843-7fe8c3cd48a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084727 Jul 20 04:44:48.720969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3637/4762] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:48 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:49.642906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:49.645191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:49.665131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.671870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:49.673193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:49.673919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.174289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:50.184838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-196b2da2-5c2f-4cfb-90e2-89a45459e096 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.551927 Jul 20 04:44:50.188524 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3638/4763] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:49 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:50.193566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:50.194712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:50.209127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.209358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.210195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:50.210579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:50.311787 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4973a14a-fcae-4502-9b28-a7fc27193204 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122053 Jul 20 04:44:50.320898 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3639/4764] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:50 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:51.202613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:51.203233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:51.221066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.222695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.225900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.226557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.511356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:51.520626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb4da717-0f51-4293-b722-39dd8cdef808 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.322489 Jul 20 04:44:51.523129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3640/4765] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:51 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:51.536035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:51.543953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:51.558375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.558915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.559761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:51.560428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:51.650451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c69c2d5c-1ca7-4d9e-b74e-0406068ec71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116102 Jul 20 04:44:51.653178 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3641/4766] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:51 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:52.543909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.545361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.553565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.554276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.555255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.556119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.850120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:52.862378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe92df90-ecce-43e5-b8bc-2a80edafd6dc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.323167 Jul 20 04:44:52.865486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3642/4767] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:52 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:52.877125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:52.879967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:52.896658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.897117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.912393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:52.912393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:52.973038 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8af6e86c-8fd9-45e4-a39c-491c135ff582 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105168 Jul 20 04:44:52.974389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3643/4768] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:52 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:53.881336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:53.883262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:53.898949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:53.904458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.906401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.908657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:53.909347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:53.950435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:44:54.692740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:54.704805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5be1b165-ad11-4cfd-a346-41d118a2de54 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.827748 Jul 20 04:44:54.718654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3644/4769] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:53 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:44:54.730587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:54.731795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:54.746368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:54.746950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.748709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:54.752230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:54.815420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e0c46f5-a761-481b-b5ea-de2438aec7a2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095375 Jul 20 04:44:54.820602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3645/4770] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:54 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:55.725038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:55.725663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:55.746353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.747185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:55.748297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:55.748975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.185043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:56.193344 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ecd401da-8dca-49e7-8fec-7dfb30a5f126 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.474055 Jul 20 04:44:56.194156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3646/4771] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:55 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:56.219579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:56.220582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:56.227148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.227676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.228558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:56.229084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:56.297212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-683bb2e3-eb11-4157-9cd2-627b70f5b03f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092874 Jul 20 04:44:56.309056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3647/4772] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:56 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:44:57.211175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.213051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.223284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.224195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.225225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.225883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.511772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:57.524377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-290ba453-edfe-4398-bbf9-7d79218bbfa8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.317808 Jul 20 04:44:57.524902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3648/4773] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:57.543495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.544476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.561980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.562441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.564382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.564846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.601183 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-571c1ba5-900b-4a2c-9583-55df3b90f27b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066608 Jul 20 04:44:57.607652 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3649/4774] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:44:57.677786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.678892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.693695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.694231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.697586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.697586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.757130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:44:57.896943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7502389a-6afc-45d4-b1de-1ec388db96a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 204 len: 0 microversion: 2.1 time: 0.224371 Jul 20 04:44:57.900805 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3650/4775] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:44:57 2022] DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:44:57.910724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:57.911853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:57.920035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.920673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:57.921586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:57.922090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.342774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.357249 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-62060f7c-b4d5-4fcd-9f06-58a8e3163dd4 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1679 microversion: 2.1 time: 0.453429 Jul 20 04:44:58.358225 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3651/4776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:57 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1679 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:58.540755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:58.541415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:58.558944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.560673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.561637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:58.562314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:58.774170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:58.785681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4919f8a7-a81a-4a23-a26c-a097023c3030 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.248975 Jul 20 04:44:58.786275 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3652/4777] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:58 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:59.383999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.386689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.398797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.399928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.402033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.403673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.770573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:44:59.784921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2902d9ac-e0a5-480b-9da6-2aeb69d92e99 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1679 microversion: 2.1 time: 0.410589 Jul 20 04:44:59.789340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3653/4778] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1679 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:44:59.804368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:44:59.805347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:44:59.824385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.825020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:44:59.828754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:44:59.831448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.163569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:00.174600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d25f6e7b-a244-45ae-92a7-078c31e58199 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.374836 Jul 20 04:45:00.175190 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3654/4779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:44:59 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:00.803190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:00.804659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:00.821091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.822310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:00.825010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:00.827164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.173733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:01.189281 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83baaac5-83a6-4891-b969-10407bcc6209 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 200 len: 1612 microversion: 2.1 time: 0.389831 Jul 20 04:45:01.195612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3655/4780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:00 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 1612 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:01.203079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-44c6ab0a-dee2-4ba2-9515-1d90c8e7f741 req-ed1ae23a-ee7b-47ca-9dcb-4b6349305498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eac1974-1ab0-4cd6-8509-9a82ca7855d3", "name": "network-vif-deleted", "tag": "79853aae-7bce-42a9-ad25-ae6e64357507"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:01.233288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-44c6ab0a-dee2-4ba2-9515-1d90c8e7f741 req-ed1ae23a-ee7b-47ca-9dcb-4b6349305498 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.233970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-44c6ab0a-dee2-4ba2-9515-1d90c8e7f741 req-ed1ae23a-ee7b-47ca-9dcb-4b6349305498 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.268956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-44c6ab0a-dee2-4ba2-9515-1d90c8e7f741 req-ed1ae23a-ee7b-47ca-9dcb-4b6349305498 service nova] Creating event network-vif-deleted:79853aae-7bce-42a9-ad25-ae6e64357507 for instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 on n-h2-764486-11 Jul 20 04:45:01.283620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-44c6ab0a-dee2-4ba2-9515-1d90c8e7f741 req-ed1ae23a-ee7b-47ca-9dcb-4b6349305498 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085360 Jul 20 04:45:01.285720 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3656/4781] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:01.295534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:01.299498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:01.317685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.318983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.321299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:01.322913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:01.659444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:01.668043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11e001c2-d21b-40bc-900f-08f3616a9627 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1533 microversion: 2.1 time: 0.380168 Jul 20 04:45:01.681085 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3657/4782] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:01 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1533 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:02.215477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:02.216259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:02.224778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.225576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.226673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.227317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.247405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 HTTP/1.1 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1eac1974-1ab0-4cd6-8509-9a82ca7855d3'} Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:02.274020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:45:02.278249 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:02.286453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:02.294615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d05efe36-bd02-4eaf-8fdf-845b375a1434 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 404 len: 111 microversion: 2.1 time: 0.076921 Jul 20 04:45:02.296594 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3658/4783] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:02 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:45:02.305141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a554e6a-a3ce-4750-b0cc-7ad15f21f8e8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '.version_select at 0x7f838a09c9d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:02.345138 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a554e6a-a3ce-4750-b0cc-7ad15f21f8e8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142117627" status: 202 len: 0 microversion: 2.1 time: 0.043846 Jul 20 04:45:02.349219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3659/4784] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:45:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142117627 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:45:02.691270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:02.692108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:02.736723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.736820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:02.737538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:02.737974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.303785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:03.314954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4889631f-9921-4f0f-a067-a5d13f8d9f51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.629608 Jul 20 04:45:03.323257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3660/4785] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:02 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:03.529263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:03.530206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:03.538435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.538884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.539671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:03.540120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:03.664590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22483097-a916-447f-8284-d170f9e9e17d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action" status: 200 len: 24581 microversion: 2.1 time: 0.138755 Jul 20 04:45:03.666227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3661/4786] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:45:03 2022] POST /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84/action => generated 24581 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:45:04.343208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:04.344754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:04.369368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.369806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.371106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:04.371755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:04.380145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:04.691089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:04.700274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65603575-0b7a-477f-8f25-097530c65eb9 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.370615 Jul 20 04:45:04.715452 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3662/4787] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:04 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:04.736187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e1deecc-4bf5-4bc2-9cf4-517f41e8f728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: .version_select at 0x7f838a0ae310>, body: {"keypair": {"name": "tempest-keypair-1534126522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9EvkxehQbtGl1whtXz6ENyd1wyfOGdAnpWF5EAo8Q3lQhbnxK6rmDt2H9+4db7soaiahngyvlSH+RnUJvRigE4rZeKJYDKvC0ZJyMfsmSDltKYYnAM4nMgJ6BeoZZmfA=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:04.811188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8e1deecc-4bf5-4bc2-9cf4-517f41e8f728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:04.817209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8e1deecc-4bf5-4bc2-9cf4-517f41e8f728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:04.861851 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e1deecc-4bf5-4bc2-9cf4-517f41e8f728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145099 Jul 20 04:45:04.863493 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3663/4788] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:45:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:05.727996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:05.729389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:05.746207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.750479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:05.757810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:05.758530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:06.155811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:06.192718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef52b4fc-0a30-4121-8239-a6081df364cd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.470398 Jul 20 04:45:06.194816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3664/4789] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:05 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:07.122777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ed98782e-6044-4fc2-896e-d97155df6d83 req-63f22b5b-56d8-4184-a222-66ac8d46a51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1748ffb-8279-402a-b67a-6fc77c5a022b", "name": "network-vif-plugged", "status": "completed", "tag": "00205810-62ce-4d7b-8b27-1bc9b842bc1f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:07.144655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed98782e-6044-4fc2-896e-d97155df6d83 req-63f22b5b-56d8-4184-a222-66ac8d46a51b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.148133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed98782e-6044-4fc2-896e-d97155df6d83 req-63f22b5b-56d8-4184-a222-66ac8d46a51b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.186736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ed98782e-6044-4fc2-896e-d97155df6d83 req-63f22b5b-56d8-4184-a222-66ac8d46a51b service nova] Creating event network-vif-plugged:00205810-62ce-4d7b-8b27-1bc9b842bc1f for instance c1748ffb-8279-402a-b67a-6fc77c5a022b on n-h1-764486-11 Jul 20 04:45:07.230411 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ed98782e-6044-4fc2-896e-d97155df6d83 req-63f22b5b-56d8-4184-a222-66ac8d46a51b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115198 Jul 20 04:45:07.231230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3665/4790] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:07.249804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:07.255840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:07.270106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.271168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.274186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:07.276716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:07.806563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:07.839772 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0896ec4-72c6-406c-b3b6-28abb79ffb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.584298 Jul 20 04:45:07.841631 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3666/4791] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:07 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:08.861642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:08.862285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:08.879843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.880293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:08.881112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:08.896829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:09.364140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:09.376792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf5a2ef7-aa89-45f3-abbd-ae86b98ea505 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.522420 Jul 20 04:45:09.395204 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3667/4792] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:08 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:09.513623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1560783124", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2e3bd6f-916b-4434-a9b5-9f9d528c43af"}], "security_groups": [{"name": "tempest-securitygroup--231351970"}], "key_name": "tempest-keypair-1534126522", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:09.738211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] validate_networks() for [('d2e3bd6f-916b-4434-a9b5-9f9d528c43af', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:10.801173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:10.801850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:10.802066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:10.802483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:10.802900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:10.835767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:10.836708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:10.839614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:10.840128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:10.870240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:10.879120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:10.898075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:10.903184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:10.995329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d04f0df7-b1a0-41ae-b953-eef58b761f35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.486144 Jul 20 04:45:10.997533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3668/4793] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:45:11.007378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:11.023416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:11.067411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.068566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.069443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.076791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.374005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b388a86d-0f6d-4da1-9750-6472fb32db71 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1836 microversion: 2.1 time: 0.371011 Jul 20 04:45:11.375709 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3669/4794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:10 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1836 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:11.386630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:11.387582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:11.397874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.398687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:11.400335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:11.401191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.292256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.329656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a356ce6-fa5e-4b63-89f3-74d652631c8d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.934399 Jul 20 04:45:12.346472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3670/4795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:11 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:12.352919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:12.371334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:12.397953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:12.401806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.402794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:12.403119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:12.889358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:12.902930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9690a4a6-c207-43ba-ac00-74fbad3a148d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1238 microversion: 2.1 time: 0.555112 Jul 20 04:45:12.905282 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3671/4796] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:12 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1238 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:13.355504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:13.361579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:13.404240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.422883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:13.440186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:13.440679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.713191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:14.729092 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23e046be-ba7c-45fe-a64d-6d27977dc986 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 1.376657 Jul 20 04:45:14.745291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3672/4797] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:13 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:14.751191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:14.776995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:14.791408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.791870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:14.792881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:14.793507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.124830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:15.141351 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec5e5f00-9e28-4452-b080-e2a1b5908e84 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1300 microversion: 2.1 time: 0.394626 Jul 20 04:45:15.147483 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3673/4798] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:14 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1300 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:15.759573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:15.760241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:15.773998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.775286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:15.776327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:15.776928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.351240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.367253 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-837ea106-8ef1-4d2a-a4e7-f2884e6fbced tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.623840 Jul 20 04:45:16.369417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3674/4799] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:15 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:16.374762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:16.375569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:16.384302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.385039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.385978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.388003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.538005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:16.562631 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2285e307-4c84-4da4-a65e-ba27f4ca429e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1300 microversion: 2.1 time: 0.188664 Jul 20 04:45:16.567161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3675/4800] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:16 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1300 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:16.592641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:16.593658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:16.659877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.660752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.668031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:16.672330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:16.716804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:45:16.941485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:16.999531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b694090-54d0-407a-b4a6-e70fa69dcfcf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 204 len: 0 microversion: 2.1 time: 0.427355 Jul 20 04:45:17.006380 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3676/4801] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:45:16 2022] DELETE /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:45:17.035109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b0c87432-0292-43fb-a1b7-6228576f6f93 req-df80657d-3530-40d4-87f2-304c1c89126b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:17.076839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b0c87432-0292-43fb-a1b7-6228576f6f93 req-df80657d-3530-40d4-87f2-304c1c89126b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.078518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b0c87432-0292-43fb-a1b7-6228576f6f93 req-df80657d-3530-40d4-87f2-304c1c89126b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.125115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b0c87432-0292-43fb-a1b7-6228576f6f93 req-df80657d-3530-40d4-87f2-304c1c89126b service nova] Creating event network-changed:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h1-764486-11 Jul 20 04:45:17.137423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b0c87432-0292-43fb-a1b7-6228576f6f93 req-df80657d-3530-40d4-87f2-304c1c89126b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126954 Jul 20 04:45:17.141119 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3677/4802] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:17.153622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:17.155914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:17.176670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.177277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.178180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:17.178780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:17.602078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:17.618808 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-037b0f76-ec30-4bfe-9266-4983cd18ba6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 200 len: 1689 microversion: 2.1 time: 0.476333 Jul 20 04:45:17.620243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3678/4803] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:17 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 1689 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:18.132697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-737503097", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "8609322c-33fa-4a71-aff4-36a6d228dae9"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:18.294605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] validate_networks() for [('8609322c-33fa-4a71-aff4-36a6d228dae9', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:45:20.857630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:20.892010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:21.415541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:45:21.416240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:45:21.416905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:45:21.417488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:45:21.418056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:45:21.439859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.440873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.449201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.451016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.541894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Getting quotas for project ffaf89672a904bf892f8461e0f608632. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:21.583734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Getting quotas for user 07348b5389df408ab8c19d9d744fcc86 and project ffaf89672a904bf892f8461e0f608632. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:21.690757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:45:21.704721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:45:21.845685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8745a29a-3c91-49c6-8d96-bf6541303852 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.223959 Jul 20 04:45:21.872791 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3679/4804] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:45:21.888414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:21.903918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:21.962747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.963653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:21.967406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:21.973404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:22.651363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:22.654322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:22.688661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2808d07f-5ea7-4a03-850b-83402dc65c51 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.807206 Jul 20 04:45:22.696793 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3680/4805] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:21 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:22.710126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:22.713486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:22.746968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:22.748534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:22.749684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:22.751408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.419232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:23.434701 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f85249f-270d-4625-bfee-c6771a3ca664 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1367 microversion: 2.1 time: 0.736087 Jul 20 04:45:23.437949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3681/4806] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:22 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1367 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:23.451140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:23.455325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: b239ce17-0567-427c-9c40-992207481c84] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:23.471523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.472487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.473549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.477651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.540205 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] HTTP exception thrown: Instance b239ce17-0567-427c-9c40-992207481c84 could not be found. Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Request method failure captured: Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 HTTP/1.1 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fI2Uh8hfePvQFFsiRzC6qxuFXUX_Nvp02KeELtffh0P8y4-57vVIl5ikMVI-at6ye2zsDygciR3mr85j9TebUbVoKnux68Noznm8g9bGnPl-bwhixs6BGDl1W9jBTLbJP9ahHfTb9KKjPO29WpKos-QPKy1_8lT0lgjQI0SEO7CV0 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d198cfbd38c74919a0c171774b8af43a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e13752abfe1a4708aaf68736ff893649 Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance b239ce17-0567-427c-9c40-992207481c84 could not be found. Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'b239ce17-0567-427c-9c40-992207481c84'} Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b239ce17-0567-427c-9c40-992207481c84 could not be found. Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b239ce17-0567-427c-9c40-992207481c84 could not be found. Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:23.559429 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b239ce17-0567-427c-9c40-992207481c84 could not be found. Jul 20 04:45:23.563512 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:23.568205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Returning 404 to user: Instance b239ce17-0567-427c-9c40-992207481c84 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:23.574099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f2a818e-6357-4754-b922-b2581331c9dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84" status: 404 len: 111 microversion: 2.1 time: 0.131820 Jul 20 04:45:23.577382 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3682/4807] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:23 2022] GET /compute/v2.1/servers/b239ce17-0567-427c-9c40-992207481c84 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:45:23.599682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-40643b5c-8df3-4b52-b73a-7ac4b4215684 req-3d5a9cac-9898-4f9f-a121-bd1e72043339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b239ce17-0567-427c-9c40-992207481c84", "name": "network-vif-deleted", "tag": "9c447b73-6b85-4705-a43b-e406f0bdbf02"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:23.629261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-40643b5c-8df3-4b52-b73a-7ac4b4215684 req-3d5a9cac-9898-4f9f-a121-bd1e72043339 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.629659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-40643b5c-8df3-4b52-b73a-7ac4b4215684 req-3d5a9cac-9898-4f9f-a121-bd1e72043339 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.676385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-40643b5c-8df3-4b52-b73a-7ac4b4215684 req-3d5a9cac-9898-4f9f-a121-bd1e72043339 service nova] Creating event network-vif-deleted:9c447b73-6b85-4705-a43b-e406f0bdbf02 for instance b239ce17-0567-427c-9c40-992207481c84 on n-h1-764486-11 Jul 20 04:45:23.720188 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-40643b5c-8df3-4b52-b73a-7ac4b4215684 req-3d5a9cac-9898-4f9f-a121-bd1e72043339 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135611 Jul 20 04:45:23.724234 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3683/4808] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:23.735747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:23.744032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:23.763366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.763843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:23.796973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:23.821429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.182181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:24.202339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82f48599-ea9b-4982-bc86-012eb77352a5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1212 microversion: 2.1 time: 0.471697 Jul 20 04:45:24.208866 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3684/4809] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:23 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1212 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:24.230415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d9e7bfd9-070d-4c6c-b659-cba78bdc5fc7 req-3213f897-b156-4861-a9f8-1f4d198341b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598b71bd-ac88-4afb-977e-1faefa094f93", "tag": "748c7726-ba02-48a3-aecc-cb3a6e9fb7ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:24.280080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d9e7bfd9-070d-4c6c-b659-cba78bdc5fc7 req-3213f897-b156-4861-a9f8-1f4d198341b2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.281778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d9e7bfd9-070d-4c6c-b659-cba78bdc5fc7 req-3213f897-b156-4861-a9f8-1f4d198341b2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.346113 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d9e7bfd9-070d-4c6c-b659-cba78bdc5fc7 req-3213f897-b156-4861-a9f8-1f4d198341b2 service nova] Creating event network-changed:748c7726-ba02-48a3-aecc-cb3a6e9fb7ef for instance 598b71bd-ac88-4afb-977e-1faefa094f93 on n-h2-764486-11 Jul 20 04:45:24.378073 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d9e7bfd9-070d-4c6c-b659-cba78bdc5fc7 req-3213f897-b156-4861-a9f8-1f4d198341b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165976 Jul 20 04:45:24.384123 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3685/4810] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:24.418821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:24.427491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:24.470824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.471292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:24.481573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:24.482421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:25.956803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:25.975225 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-499b25b5-4ded-4ba1-9660-86383cf0c71a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 1.583483 Jul 20 04:45:25.976844 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3686/4811] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:24 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:26.015719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:26.021159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:26.041653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.051364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.052889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:26.053867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:26.963948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:26.976774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d1cb245-d5f8-4fb7-8b92-49aef15ad926 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1367 microversion: 2.1 time: 0.997039 Jul 20 04:45:26.983360 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3687/4812] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:25 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1367 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:26.993522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:26.998352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:27.014040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.014882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.016596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.017476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.233981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:27.249618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-659e1a7c-25ae-402e-a8cf-c064556a7938 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1274 microversion: 2.1 time: 0.259693 Jul 20 04:45:27.253444 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3688/4813] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:26 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:27.260605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:27.266637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:27.290893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.297257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:27.305501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:27.306334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.038148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:28.074650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8df24acf-b335-48cb-98ac-59d28253ce8c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.819574 Jul 20 04:45:28.079759 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3689/4814] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:27 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:28.089757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:28.092532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:28.106148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.108584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.110278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.113388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.374626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:28.419386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-286fee06-2744-4dc3-81b7-de82030b07db tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1367 microversion: 2.1 time: 0.338052 Jul 20 04:45:28.423364 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3690/4815] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:28 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:28.429469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:28.431090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:28.470104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.474711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.477712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:28.483045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:28.998278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.024307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-937bddfb-625f-4e58-ab70-821e113ecda3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 0.598495 Jul 20 04:45:29.028936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3691/4816] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:28 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:29.113084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:29.114023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:29.146689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.147150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.151877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.152368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.750380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:29.762835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-738263b5-18ef-4c68-aed6-f4afde1194d0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.659139 Jul 20 04:45:29.765071 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3692/4817] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:29 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:29.773104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:29.774891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:29.787309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.788536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:29.792049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:29.793177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.568435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:30.587114 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b76a6250-0285-44b4-a527-9a98ad3ee41b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1367 microversion: 2.1 time: 0.820347 Jul 20 04:45:30.588088 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3693/4818] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:29 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1367 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:30.601299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:30.602509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:30.621557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.622266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:30.630117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:30.630800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.353958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:31.367693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5da9fdf5-a667-4f47-a977-17cfa864aafc tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 0.777671 Jul 20 04:45:31.384719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3694/4819] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:30 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:31.406404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:31.407043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:31.444087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.449929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.450854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:31.451306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:31.552255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:31.618019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:32.816583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:32.844028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae12289f-6c62-4833-8e4f-ce33805b63ab tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 1.456404 Jul 20 04:45:32.846277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3695/4820] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:31 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:32.862885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c3ef50dc-1244-499d-9e44-892e054a1f55 req-c2b48e0b-0180-4b36-8d0e-f9e27f2a60b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b71bd-ac88-4afb-977e-1faefa094f93", "name": "network-vif-plugged", "status": "completed", "tag": "748c7726-ba02-48a3-aecc-cb3a6e9fb7ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:32.883994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c3ef50dc-1244-499d-9e44-892e054a1f55 req-c2b48e0b-0180-4b36-8d0e-f9e27f2a60b5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.886239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c3ef50dc-1244-499d-9e44-892e054a1f55 req-c2b48e0b-0180-4b36-8d0e-f9e27f2a60b5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.918742 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c3ef50dc-1244-499d-9e44-892e054a1f55 req-c2b48e0b-0180-4b36-8d0e-f9e27f2a60b5 service nova] Creating event network-vif-plugged:748c7726-ba02-48a3-aecc-cb3a6e9fb7ef for instance 598b71bd-ac88-4afb-977e-1faefa094f93 on n-h2-764486-11 Jul 20 04:45:32.936509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c3ef50dc-1244-499d-9e44-892e054a1f55 req-c2b48e0b-0180-4b36-8d0e-f9e27f2a60b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084132 Jul 20 04:45:32.937361 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3696/4821] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:32.954478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:32.955119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:32.976775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.977321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:32.978167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:32.982132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:33.541808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:33.552746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63dd7d2d-ab63-4a92-80a6-9243f71836f1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1367 microversion: 2.1 time: 0.614231 Jul 20 04:45:33.554302 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3697/4822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:32 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1367 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:33.572872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:33.573890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:33.581096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.581811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:33.582774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:33.589104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.155247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:34.168756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae8f6824-4d1c-41f9-9731-a5c39807865d tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 0.613139 Jul 20 04:45:34.171384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3698/4823] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:33 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:34.365930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3c317dc0-a999-4e27-b730-a28876f74672 req-6a59143c-7011-4f4b-bb58-fa6472d58fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad05f276-3c88-46b4-8f33-e7b9b4279c48", "tag": "b82e3438-0a54-4a32-a27b-fda7248f20f8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:34.380406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3c317dc0-a999-4e27-b730-a28876f74672 req-6a59143c-7011-4f4b-bb58-fa6472d58fb4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:34.381300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3c317dc0-a999-4e27-b730-a28876f74672 req-6a59143c-7011-4f4b-bb58-fa6472d58fb4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.395949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3c317dc0-a999-4e27-b730-a28876f74672 req-6a59143c-7011-4f4b-bb58-fa6472d58fb4 service nova] Creating event network-changed:b82e3438-0a54-4a32-a27b-fda7248f20f8 for instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 on n-h1-764486-11 Jul 20 04:45:34.403617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3c317dc0-a999-4e27-b730-a28876f74672 req-6a59143c-7011-4f4b-bb58-fa6472d58fb4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229751 Jul 20 04:45:34.404846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3699/4824] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:34.411190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:34.412478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:34.421258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:34.422154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:34.423208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:34.423864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.799306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:35.802703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:35.821184 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8877c366-e307-4d4d-bc4b-09325a6ac417 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 1.408967 Jul 20 04:45:35.821855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3700/4825] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:34 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:35.838612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:35.839260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:35.868540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.873715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:35.876046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:35.876550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.734973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:36.744408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a656718d-fdd4-40f4-9fe7-c5569f30b995 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1557 microversion: 2.1 time: 0.921449 Jul 20 04:45:36.755111 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3701/4826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:35 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1557 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:36.779320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:36.782222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:36.809097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.813700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:36.814743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:36.815338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:37.134038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:37.142968 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdc93adc-5570-45c0-9306-a722e8eac065 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 0.381102 Jul 20 04:45:37.143761 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3702/4827] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:36 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:37.149376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:37.171331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:37.183779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:37.184865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:37.187306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:37.205294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:37.455967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a745138a-d14b-4a0c-b614-f5f27e2f54b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.310817 Jul 20 04:45:37.456722 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3703/4828] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:45:37 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-interface => generated 285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:37.462073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:37.462898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:37.479772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:37.481390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:37.482383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:37.484159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.073665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:38.085882 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d16dd1f-5e85-4c18-b4b0-c71a3d4d6d2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1528 microversion: 2.1 time: 0.627783 Jul 20 04:45:38.086836 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3704/4829] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:37 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1528 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:38.160599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:38.161566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:38.174033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.175115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:38.176117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:38.177093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.159757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.204756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e701f985-29b1-4d02-991d-3350aeecd06f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 1.047669 Jul 20 04:45:39.216200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3705/4830] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:38 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:39.229453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:39.230941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:39.239851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.241665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.242907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.243575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.574404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:39.583679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef914d1c-ace7-4f4f-8721-de309286b6b8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1510 microversion: 2.1 time: 0.365570 Jul 20 04:45:39.584638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3706/4831] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:39 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:39.600651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5ec6c79f-7a27-43c1-8e26-6c41a12de763 req-2cd78098-902f-41cc-af5c-6798d7657307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad05f276-3c88-46b4-8f33-e7b9b4279c48", "name": "network-vif-plugged", "status": "completed", "tag": "b82e3438-0a54-4a32-a27b-fda7248f20f8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:39.614319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5ec6c79f-7a27-43c1-8e26-6c41a12de763 req-2cd78098-902f-41cc-af5c-6798d7657307 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:39.615046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5ec6c79f-7a27-43c1-8e26-6c41a12de763 req-2cd78098-902f-41cc-af5c-6798d7657307 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:39.635760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5ec6c79f-7a27-43c1-8e26-6c41a12de763 req-2cd78098-902f-41cc-af5c-6798d7657307 service nova] Creating event network-vif-plugged:b82e3438-0a54-4a32-a27b-fda7248f20f8 for instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 on n-h1-764486-11 Jul 20 04:45:39.643803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5ec6c79f-7a27-43c1-8e26-6c41a12de763 req-2cd78098-902f-41cc-af5c-6798d7657307 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047632 Jul 20 04:45:39.647960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3707/4832] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:39.675487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8274ef86-ca1b-41f8-a966-5d782066469d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '.version_select at 0x7f838a0924c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:39.719771 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8274ef86-ca1b-41f8-a966-5d782066469d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-934470033" status: 202 len: 0 microversion: 2.1 time: 0.057907 Jul 20 04:45:39.720812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3708/4833] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 04:45:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-934470033 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:45:39.748407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da6ff65b-ad1d-47be-a70f-2e7df1f4e1c1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: .version_select at 0x7f838a03f550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-928607689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3inVnLYlCOc5TQzFtoeqqLMBLh/tt/fDYlIjbOUMgs+URlkdxrSjCXZ6oPo8MV0Gd3icIofs6w2uakKzEhdBasdnIAzbUFGtisvF97k1gdhXPJBN4zup8GQFtrxKHIBg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:39.775542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-da6ff65b-ad1d-47be-a70f-2e7df1f4e1c1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:45:39.784402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-da6ff65b-ad1d-47be-a70f-2e7df1f4e1c1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:45:39.834473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da6ff65b-ad1d-47be-a70f-2e7df1f4e1c1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.091252 Jul 20 04:45:39.836319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3709/4834] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:45:39 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:40.223777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:40.224784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:40.269472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.272685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.275435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.277609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.753835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:40.769720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3562896d-b809-4890-bd9b-ce79d2f1409f tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 0.550344 Jul 20 04:45:40.770456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3710/4835] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:40 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:40.785103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a4c9438f-d355-4ce3-a6fc-ab4b82b4e088 req-def0a789-7117-4070-b72f-350a48c3ccb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598b71bd-ac88-4afb-977e-1faefa094f93", "tag": "748c7726-ba02-48a3-aecc-cb3a6e9fb7ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:40.813048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:40.816887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a4c9438f-d355-4ce3-a6fc-ab4b82b4e088 req-def0a789-7117-4070-b72f-350a48c3ccb6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.820951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a4c9438f-d355-4ce3-a6fc-ab4b82b4e088 req-def0a789-7117-4070-b72f-350a48c3ccb6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.852758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a4c9438f-d355-4ce3-a6fc-ab4b82b4e088 req-def0a789-7117-4070-b72f-350a48c3ccb6 service nova] Creating event network-changed:748c7726-ba02-48a3-aecc-cb3a6e9fb7ef for instance 598b71bd-ac88-4afb-977e-1faefa094f93 on n-h2-764486-11 Jul 20 04:45:40.863658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a4c9438f-d355-4ce3-a6fc-ab4b82b4e088 req-def0a789-7117-4070-b72f-350a48c3ccb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085654 Jul 20 04:45:40.865674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3711/4836] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:40.889492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:40.890557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:40.904009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.905167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:40.906880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:40.907858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:41.441230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:41.460285 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89809ecf-6262-4cab-9599-3b91b4d62db0 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1510 microversion: 2.1 time: 0.590419 Jul 20 04:45:41.461346 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3712/4837] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:40 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:41.792449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:41.797279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:41.813874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:41.818472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:41.824584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:41.825253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:42.465572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:42.487688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8735f53a-f5c0-44da-8ea9-7231377ea7c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1316 microversion: 2.1 time: 0.704420 Jul 20 04:45:42.508591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3713/4838] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:41 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:42.513810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:42.514442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:42.547193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.547652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:42.556013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:42.556509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.088415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:43.099615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c7a2f11-b1ef-47fb-8e79-99ba901cf94a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1513 microversion: 2.1 time: 0.589504 Jul 20 04:45:43.100223 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3714/4839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:42 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1513 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:43.107355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-75de9e4f-77dd-4fc3-a4e3-78443da4a356 req-9647f16a-6a0f-47d9-9159-4081105162d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1748ffb-8279-402a-b67a-6fc77c5a022b", "name": "network-vif-unplugged", "status": "completed", "tag": "00205810-62ce-4d7b-8b27-1bc9b842bc1f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:43.126917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-75de9e4f-77dd-4fc3-a4e3-78443da4a356 req-9647f16a-6a0f-47d9-9159-4081105162d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.127360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-75de9e4f-77dd-4fc3-a4e3-78443da4a356 req-9647f16a-6a0f-47d9-9159-4081105162d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.175837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_external_events [req-75de9e4f-77dd-4fc3-a4e3-78443da4a356 req-9647f16a-6a0f-47d9-9159-4081105162d4 service nova] Unable to find a host for instance c1748ffb-8279-402a-b67a-6fc77c5a022b. Dropping event network-vif-unplugged {{(pid=123724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 04:45:43.176715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-75de9e4f-77dd-4fc3-a4e3-78443da4a356 req-9647f16a-6a0f-47d9-9159-4081105162d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073051 Jul 20 04:45:43.177336 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3715/4840] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 04:45:43.182346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:43.183312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:43.202435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.203733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.205973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.208410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.683512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:43.700817 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b007a5e-f996-4dde-bb86-b2c7f53eaf08 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1453 microversion: 2.1 time: 0.515850 Jul 20 04:45:43.701754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3716/4841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:43 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1453 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:43.718559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:43.719475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:43.731980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.732728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:43.733741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:43.734369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.453518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:44.483024 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84f69549-4520-4b7e-9107-a61dd317c7f3 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1506 microversion: 2.1 time: 0.779796 Jul 20 04:45:44.483624 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3717/4842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:43 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1506 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:44.500824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:44.501590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:44.510210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.513303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.514298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.514904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.558018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lazy-loading 'flavor' on Instance uuid c1748ffb-8279-402a-b67a-6fc77c5a022b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:45:44.576833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'shelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state shelved_offloaded Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 14 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: {"shelve": {}} Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'shelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state shelved_offloaded Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'shelve': {}}} Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 20 04:45:44.579400 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state shelved_offloaded Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state shelved_offloaded Jul 20 04:45:44.584235 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:44.585794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'shelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state shelved_offloaded {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:44.587781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e94b1f19-1d72-4301-abb5-4a42d1fac9cc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 155 microversion: 2.1 time: 0.102054 Jul 20 04:45:44.588539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3718/4843] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:45:44 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 155 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:45:44.603286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:44.603863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:44.611445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.612127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.613463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.614084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.647372 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbd286d6-4286-48ac-83a3-6a16769451b2 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48/ips" status: 200 len: 110 microversion: 2.1 time: 0.052024 Jul 20 04:45:44.649815 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3719/4844] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:45:44 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48/ips => generated 110 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:44.671708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:44.672479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:44.681866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.682931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.684069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.685223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.888497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65f9afbc-165a-47f5-af8a-4d6a4c41bdb3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 202 len: 0 microversion: 2.1 time: 0.235496 Jul 20 04:45:44.889152 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3720/4845] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:45:44 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:45:44.905950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:44.910370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:44.923731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.924345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:44.925640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:44.926083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.019099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:45.026211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-069e64e8-9b91-4825-96b7-946c50bde2c5 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48/ips" status: 200 len: 110 microversion: 2.1 time: 0.133849 Jul 20 04:45:45.026815 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3721/4846] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:45:44 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48/ips => generated 110 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:45.046855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.049361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.063803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.064259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.069141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.069643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.486258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:45.497504 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b7d7035-0595-4cf9-8c84-216044b77501 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1461 microversion: 2.1 time: 0.469465 Jul 20 04:45:45.498200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3722/4847] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:45 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1461 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:45.521794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.522418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.539833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.544696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.545822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.548857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.622510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-477be650-8dab-4670-8b22-5365bcc7d416 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48/ips/tempest-ServerAddressesTestJSON-2130976976-network" status: 200 len: 95 microversion: 2.1 time: 0.122467 Jul 20 04:45:45.630574 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3723/4848] 10.222.0.49 () {58 vars in 1400 bytes} [Wed Jul 20 04:45:45 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48/ips/tempest-ServerAddressesTestJSON-2130976976-network => generated 95 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:45:45.643438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.649041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.661194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.662082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.663131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.665087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.730446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:45:45.903597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-174e12ce-fcb0-479c-9b25-e4624948a9de tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 204 len: 0 microversion: 2.1 time: 0.267779 Jul 20 04:45:45.904419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3724/4849] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:45:45 2022] DELETE /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:45:45.924146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:45.925030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:45.941705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.942161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:45.942944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:45.943376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.393562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:46.403126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4161c487-b477-4af9-99c8-a0f26ddedf05 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1512 microversion: 2.1 time: 0.492531 Jul 20 04:45:46.403735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3725/4850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:45 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:46.517700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:46.519827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:46.532415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.533675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.534735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:46.535473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:46.798962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:46.813489 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6244028c-954f-4cad-89c9-0fde425f31d8 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1461 microversion: 2.1 time: 0.302526 Jul 20 04:45:46.814091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3726/4851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:46 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1461 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:47.422534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:47.423211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:47.432154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.432984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:47.434081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:47.434940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.048344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07348b5389df408ab8c19d9d744fcc86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf89672a904bf892f8461e0f608632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:48.061590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-089271aa-b71e-46a1-a6bb-1080a60e955c tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 200 len: 1512 microversion: 2.1 time: 0.644380 Jul 20 04:45:48.062231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3727/4852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:47 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 1512 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:48.084537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:48.086278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:48.097146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.097799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.099048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.099714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.397126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:48.406552 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd2f8010-9060-4d83-828c-7186abc7f08e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.342534 Jul 20 04:45:48.412247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3728/4853] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:48 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:48.427647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cde750ef-2fb3-43cf-b459-ac2d29e1bdaf req-51354ba8-312e-49e6-b4d6-e65c9e2f72b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad05f276-3c88-46b4-8f33-e7b9b4279c48", "name": "network-vif-deleted", "tag": "b82e3438-0a54-4a32-a27b-fda7248f20f8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:45:48.458947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cde750ef-2fb3-43cf-b459-ac2d29e1bdaf req-51354ba8-312e-49e6-b4d6-e65c9e2f72b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:48.459252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cde750ef-2fb3-43cf-b459-ac2d29e1bdaf req-51354ba8-312e-49e6-b4d6-e65c9e2f72b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:48.484434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cde750ef-2fb3-43cf-b459-ac2d29e1bdaf req-51354ba8-312e-49e6-b4d6-e65c9e2f72b1 service nova] Creating event network-vif-deleted:b82e3438-0a54-4a32-a27b-fda7248f20f8 for instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 on n-h1-764486-11 Jul 20 04:45:48.490142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cde750ef-2fb3-43cf-b459-ac2d29e1bdaf req-51354ba8-312e-49e6-b4d6-e65c9e2f72b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076083 Jul 20 04:45:48.491023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3729/4854] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:45:49.080726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:49.081489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] [instance: ad05f276-3c88-46b4-8f33-e7b9b4279c48] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:49.096948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.102075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.104845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.106804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.154814 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] HTTP exception thrown: Instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 could not be found. Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Request method failure captured: Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 HTTP/1.1 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14hcNSbU0nBMVjAl2JlS_O_gwzG2eBAngdbPRsArxct7sMba7apCoq3lSFHhJZBJuqv9RYmQRvii9kqT4_BOOj1ScEFILxfiIbaOLcCQdUqLAEkRwY3NGCUQazgH-Vv2hPFFwPdsZ0DT0USnc-AmtzkoFaTm7GI4Go3fZo7jcmWTYxo Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: ffaf89672a904bf892f8461e0f608632 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerAddressesTestJSON-1939267427 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ffaf89672a904bf892f8461e0f608632"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ffaf89672a904bf892f8461e0f608632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ffaf89672a904bf892f8461e0f608632"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ffaf89672a904bf892f8461e0f608632", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerAddressesTestJSON-1939267427 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: ffaf89672a904bf892f8461e0f608632 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1939267427 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerAddressesTestJSON-1939267427-project Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 07348b5389df408ab8c19d9d744fcc86 Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerAddressesTestJSON-1939267427-project Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 could not be found. Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ad05f276-3c88-46b4-8f33-e7b9b4279c48'} Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 could not be found. Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 could not be found. Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:45:49.156783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 could not be found. Jul 20 04:45:49.160698 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:45:49.164769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] Returning 404 to user: Instance ad05f276-3c88-46b4-8f33-e7b9b4279c48 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:45:49.176612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0a7cf28-c6f8-4d31-b4da-71f195d99486 tempest-ServerAddressesTestJSON-1939267427 tempest-ServerAddressesTestJSON-1939267427-project] 10.222.0.49 "GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48" status: 404 len: 111 microversion: 2.1 time: 0.090443 Jul 20 04:45:49.177900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3730/4855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:49 2022] GET /compute/v2.1/servers/ad05f276-3c88-46b4-8f33-e7b9b4279c48 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:45:49.428906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:49.429947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:49.442689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.445632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.447427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:49.454209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:49.796976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:45:50.683107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:50.691965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f4b4681-572d-4a46-bf4d-57e6c6276588 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 1.267317 Jul 20 04:45:50.695490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3731/4856] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:49 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:51.720744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:51.721546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:51.750475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.751304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:51.752326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:51.753041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:52.934228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:52.952160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86160d04-c341-450f-9225-8994f5edc667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 1.237100 Jul 20 04:45:52.957508 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3732/4857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:51 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:45:53.971825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:53.973444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:53.996616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:54.010666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:54.011832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:54.012466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:55.050990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:55.064650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93795331-4fbb-4859-abc8-a0a3afcd8211 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 1.097308 Jul 20 04:45:55.065577 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3733/4858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:53 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:56.083266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:56.084047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:56.123386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.128856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:56.129913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:56.132780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:57.665896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:45:57.687470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f76d781-51d7-4ca0-86db-532e42f760dd tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 1.608892 Jul 20 04:45:57.702997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3734/4859] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:56 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:45:58.706658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:45:58.707486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:45:58.731249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.731663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:45:58.732645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:45:58.737697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:00.267643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:00.286797 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f5152830-b438-434c-9b9e-75933b40004f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 1.581916 Jul 20 04:46:00.290703 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3735/4860] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:45:58 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:00.315097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-368807000", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "882fcfcf-ab1e-488d-a594-36e66386b9c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-928607689", "security_groups": [{"name": "tempest-secgroup-smoke-2115278093"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:00.896293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] validate_networks() for [('882fcfcf-ab1e-488d-a594-36e66386b9c2', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:03.317260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:03.317886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:03.319873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:03.320240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:03.320721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:03.343569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.344489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.345723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.346377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.407766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:03.416005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:03.457872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:03.469703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:03.577624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78c6861d-a182-42d7-80d0-8c2d4beb0a5e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.285261 Jul 20 04:46:03.581112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3736/4861] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:03.588581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:03.593265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:03.609998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.610770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:03.612663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:03.613588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:04.061182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.077930 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bca91219-742f-4382-8553-97cb469f649f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.495384 Jul 20 04:46:04.078504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3737/4862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:03 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:04.093990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd329659-6f44-4a45-960d-d262b0a9e987 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:04.097423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fd329659-6f44-4a45-960d-d262b0a9e987 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:04.434922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fd329659-6f44-4a45-960d-d262b0a9e987 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:04.467487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd329659-6f44-4a45-960d-d262b0a9e987 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1265 microversion: 2.1 time: 0.368480 Jul 20 04:46:04.467487 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3738/4863] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:04 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:05.096376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.097392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:05.149650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.164885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.165842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.166297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.674733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:05.677126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:05.690322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6014ddda-027e-4736-8549-f787b5604909 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.598974 Jul 20 04:46:05.703369 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3739/4864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:05.713867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:05.714878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:05.745503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.748671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.750014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:05.750712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:05.862256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:05.873672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a614542d-1d86-43c7-b1fd-03165b260d1c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1317 microversion: 2.1 time: 0.168268 Jul 20 04:46:05.875156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3740/4865] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:05 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:06.711034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:06.713475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:06.726711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.727171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:06.727963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:06.728543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.034677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.045857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d3fbf82-10f9-49c6-8ad7-30ab8cae98f7 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.342085 Jul 20 04:46:07.056219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3741/4866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:06 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:07.061555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:07.062473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:07.073323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.074201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.075358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:07.075767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:07.254758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:07.264971 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f14fb985-34f4-4f7f-8382-8329a0af595f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1325 microversion: 2.1 time: 0.207098 Jul 20 04:46:07.268947 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3742/4867] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:07 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:08.063440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:08.065137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:08.084225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.087689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.089852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.093545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.814418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:08.838036 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f1e0590-7313-4186-981d-2b44989da393 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.778014 Jul 20 04:46:08.839895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3743/4868] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:08 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:08.856096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:08.857429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:08.865807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.866368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.867311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:08.867884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:08.992665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:09.004868 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9afe1cf-7e6f-48f7-83d2-4703b5c2ba8f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1323 microversion: 2.1 time: 0.162861 Jul 20 04:46:09.006980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3744/4869] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:08 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:09.859794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:09.862023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:09.872851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.874009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:09.875084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:09.875830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.196611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:10.205335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-844c4463-d850-4cef-8605-478bd16ae99d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.351475 Jul 20 04:46:10.205945 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3745/4870] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:09 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:10.215028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:10.221411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:10.233247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.239843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.243359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:10.244099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:10.899389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:10.923047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e081fcf-a1b1-43ca-bc6b-592a7c3055a5 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1391 microversion: 2.1 time: 0.711858 Jul 20 04:46:10.927536 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3746/4871] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:10 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1391 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:11.900546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5a79f661-a009-4e15-8858-9d6d37666f6e req-b174d28b-5054-4d23-9693-596ae1e6ede3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1748ffb-8279-402a-b67a-6fc77c5a022b", "name": "network-vif-plugged", "status": "completed", "tag": "00205810-62ce-4d7b-8b27-1bc9b842bc1f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:11.904320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:11.925417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a79f661-a009-4e15-8858-9d6d37666f6e req-b174d28b-5054-4d23-9693-596ae1e6ede3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:11.939659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a79f661-a009-4e15-8858-9d6d37666f6e req-b174d28b-5054-4d23-9693-596ae1e6ede3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:11.979606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5a79f661-a009-4e15-8858-9d6d37666f6e req-b174d28b-5054-4d23-9693-596ae1e6ede3 service nova] Creating event network-vif-plugged:00205810-62ce-4d7b-8b27-1bc9b842bc1f for instance c1748ffb-8279-402a-b67a-6fc77c5a022b on n-h1-764486-11 Jul 20 04:46:11.999096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5a79f661-a009-4e15-8858-9d6d37666f6e req-b174d28b-5054-4d23-9693-596ae1e6ede3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.821348 Jul 20 04:46:12.000488 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3747/4872] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:12.016341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:12.039915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:12.064108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.071809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.072936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:12.073507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:12.937485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:12.952973 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6cc7600-a9a8-4e0f-9d9b-2b62527f03d2 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.950176 Jul 20 04:46:12.954845 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3748/4873] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:12 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:12.978335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a74cb733-1799-42b7-afd4-f4ec5bf8146b req-1b0eecf0-587e-4219-8ffa-9c438ef4427a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:12.998457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a74cb733-1799-42b7-afd4-f4ec5bf8146b req-1b0eecf0-587e-4219-8ffa-9c438ef4427a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.002500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a74cb733-1799-42b7-afd4-f4ec5bf8146b req-1b0eecf0-587e-4219-8ffa-9c438ef4427a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.031881 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a74cb733-1799-42b7-afd4-f4ec5bf8146b req-1b0eecf0-587e-4219-8ffa-9c438ef4427a service nova] Creating event network-changed:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:46:13.046090 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a74cb733-1799-42b7-afd4-f4ec5bf8146b req-1b0eecf0-587e-4219-8ffa-9c438ef4427a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073294 Jul 20 04:46:13.047775 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3749/4874] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:13.066992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:13.073175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:13.085967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.086424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.092898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.093365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.382221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:13.933651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:13.946480 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-691f8831-411b-4199-8da2-e7491df64c38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1391 microversion: 2.1 time: 0.892841 Jul 20 04:46:13.947966 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3750/4875] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:13 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1391 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:13.969994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:13.972284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:13.984484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.985558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:13.986704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:13.987385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.132272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a35ede65-d93c-4d57-b56a-ab99b2252f49 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/ips" status: 200 len: 148 microversion: 2.1 time: 0.182287 Jul 20 04:46:14.136693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3751/4876] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:46:13 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/ips => generated 148 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:14.164928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.167237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.189261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.190169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.194213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.194921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.441506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:14.642450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:14.660840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d693647-6c24-45bf-bbe3-1ffe56861c2e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1519 microversion: 2.1 time: 0.522268 Jul 20 04:46:14.666964 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3752/4877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:14 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1519 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:14.965188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:14.965802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:14.986664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.987154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:14.987986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:14.988463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.587801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:15.595540 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d77d0df-03ac-4893-867a-14b183498edc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1391 microversion: 2.1 time: 0.634757 Jul 20 04:46:15.596339 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3753/4878] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:14 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1391 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:15.683381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:15.683999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:15.713153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.713574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:15.714364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:15.714803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.166790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:17.194888 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-156150c3-3cf0-468d-adb5-80ec3ccd7016 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 1.509580 Jul 20 04:46:17.198384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3754/4879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:15 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:17.212942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-823765379", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:17.343951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:17.828885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:17.829318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:17.829983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:17.830433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:17.831482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:17.842127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.843204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.844626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:17.845272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:17.876399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Getting quotas for project 082838812f48442c9f4fc87fd2c61a07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:17.882734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Getting quotas for user 1f3d347a64164207bfc3e34a98db5de3 and project 082838812f48442c9f4fc87fd2c61a07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:17.898130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:17.901061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:17.979302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3893c28b-be5b-4969-a79d-ae168607f9d6 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779308 Jul 20 04:46:17.980293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3755/4880] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:17.985946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.010813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.042898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.043935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.045165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.045833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.328223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:18.339366 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad9f57a4-5291-4c95-b2b5-878a06229d30 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1391 microversion: 2.1 time: 0.356412 Jul 20 04:46:18.340178 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3756/4881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:17 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1391 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:18.345974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:18.346838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.361512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.361959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.362771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.363175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.570051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:18.581670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef027dd7-ad16-4525-a9c3-67d432001a28 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.239642 Jul 20 04:46:18.595866 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3757/4882] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:18 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:18.613149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206ba87a-8f59-4f31-8061-a10270611141"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:18.624864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:18.637972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.638863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.640536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:18.643230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:18.819141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:19.174816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-012d4905-bc87-48a6-8976-48532af5e53f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.576850 Jul 20 04:46:19.176232 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3758/4883] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:46:18 2022] POST /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 194 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:19.190209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:19.191050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:19.203980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.212666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.213715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.214227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.422610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3100571f-925e-4cd8-a623-60dba8b94185 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1209 microversion: 2.1 time: 0.259330 Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3759/4884] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:19 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1209 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:19.656160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.584785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:20.600576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aaddf01c-d6b8-4940-9ae6-94399b616061 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 1.151382 Jul 20 04:46:20.616512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3760/4885] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:19 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:20.630358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:20.630998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:20.656064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:20.656563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:20.657352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:20.657789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:21.131044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:21.152559 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0901c8de-eaa6-4703-b6f6-1d2970caf1bf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1391 microversion: 2.1 time: 0.526891 Jul 20 04:46:21.153774 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3761/4886] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:20 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1391 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:21.471566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-862927537", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:21.610387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] validate_networks() for [('7105edda-7f29-49ca-b9e2-2120458e40fc', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:23.183677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:23.184236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:23.184798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:23.185394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:23.186979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:23.211008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.211459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.212279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.212756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.285332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:23.305160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for user 73721f6e36eb487589dcb980b6fdb483 and project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:23.364979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:23.367819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:23.469816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7812f9f8-f58b-4d71-ac42-57653ddc6514 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.314738 Jul 20 04:46:23.472415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3762/4887] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:23.476563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:23.477279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:23.493959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.494417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:23.495377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:23.495702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.264285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:24.275787 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d186be3-ebcf-418a-b9e0-d7921caf5e8a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1313 microversion: 2.1 time: 0.803571 Jul 20 04:46:24.276444 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3763/4888] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:23 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:24.302731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-aa59faba-0fe0-433f-a95b-55e8073bba3f req-b9dbc804-5fb2-4051-92c1-5e17ad573c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "name": "network-vif-plugged", "status": "completed", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:24.338579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-aa59faba-0fe0-433f-a95b-55e8073bba3f req-b9dbc804-5fb2-4051-92c1-5e17ad573c87 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.339108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-aa59faba-0fe0-433f-a95b-55e8073bba3f req-b9dbc804-5fb2-4051-92c1-5e17ad573c87 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.366202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-aa59faba-0fe0-433f-a95b-55e8073bba3f req-b9dbc804-5fb2-4051-92c1-5e17ad573c87 service nova] Creating event network-vif-plugged:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:46:24.385772 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-aa59faba-0fe0-433f-a95b-55e8073bba3f req-b9dbc804-5fb2-4051-92c1-5e17ad573c87 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105387 Jul 20 04:46:24.386813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3764/4889] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:24.407234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa734638-598c-46d4-8cda-9a835f3898c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:24.463445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-aa734638-598c-46d4-8cda-9a835f3898c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 7687babf-c562-4b59-bd6b-fe2b8a7c79d9 has no mapping to a cell. Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa734638-598c-46d4-8cda-9a835f3898c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/7687babf-c562-4b59-bd6b-fe2b8a7c79d9/action HTTP/1.1 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: {"os-stop": {}} Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7687babf-c562-4b59-bd6b-fe2b8a7c79d9 has no mapping to a cell. Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7687babf-c562-4b59-bd6b-fe2b8a7c79d9', 'body': {'os-stop': {}}} Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7687babf-c562-4b59-bd6b-fe2b8a7c79d9 has no mapping to a cell. Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:24.484946 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7687babf-c562-4b59-bd6b-fe2b8a7c79d9 has no mapping to a cell. Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7687babf-c562-4b59-bd6b-fe2b8a7c79d9 has no mapping to a cell. Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:24.490190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa734638-598c-46d4-8cda-9a835f3898c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 7687babf-c562-4b59-bd6b-fe2b8a7c79d9 has no mapping to a cell. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:24.491217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa734638-598c-46d4-8cda-9a835f3898c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/7687babf-c562-4b59-bd6b-fe2b8a7c79d9/action" status: 404 len: 117 microversion: 2.1 time: 0.102123 Jul 20 04:46:24.498211 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3765/4890] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:24 2022] POST /compute/v2.1/servers/7687babf-c562-4b59-bd6b-fe2b8a7c79d9/action => generated 117 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:24.544560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:24.548723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:24.584552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.586460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:24.590027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:24.591899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.146345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.156610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a953aab6-e7e0-48e6-8643-d5389694a79b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1391 microversion: 2.1 time: 0.650985 Jul 20 04:46:25.171092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3766/4891] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:24 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1391 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:25.177744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.178638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.186635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.187583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.188127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.188609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.333961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.343629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eacd4eeb-9a02-48ba-b719-da5dcacd1cb5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1273 microversion: 2.1 time: 0.179541 Jul 20 04:46:25.357467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3767/4892] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:25.370409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9344e658-7868-4576-83e6-6a6347af27ed req-a50d399c-b42d-41d6-afda-5ee205090afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b46041-216c-43f9-a83f-0ae4f42e1dec", "tag": "fdae72f7-70ef-46fc-8905-a1c1298b715a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:25.380707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9344e658-7868-4576-83e6-6a6347af27ed req-a50d399c-b42d-41d6-afda-5ee205090afe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.385281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9344e658-7868-4576-83e6-6a6347af27ed req-a50d399c-b42d-41d6-afda-5ee205090afe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.410388 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9344e658-7868-4576-83e6-6a6347af27ed req-a50d399c-b42d-41d6-afda-5ee205090afe service nova] Creating event network-changed:fdae72f7-70ef-46fc-8905-a1c1298b715a for instance 56b46041-216c-43f9-a83f-0ae4f42e1dec on n-h2-764486-11 Jul 20 04:46:25.422580 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9344e658-7868-4576-83e6-6a6347af27ed req-a50d399c-b42d-41d6-afda-5ee205090afe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050836 Jul 20 04:46:25.424031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3768/4893] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:25.438318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.439214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.465291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.466948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.468020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.468755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.809497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:25.825767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59f1d062-49ca-4a05-b74b-648ab196b221 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.399539 Jul 20 04:46:25.827730 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3769/4894] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:25.833135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:25.834104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:25.842353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.843689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:25.844758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:25.845413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:26.153434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:26.169467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-385a0618-6549-4249-84ad-e5c93373a5e5 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1313 microversion: 2.1 time: 0.339971 Jul 20 04:46:26.173994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3770/4895] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:25 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:26.193550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1462189971", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:26.289267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] validate_networks() for [('7105edda-7f29-49ca-b9e2-2120458e40fc', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:46:27.613075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:46:27.614950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:46:27.615855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:46:27.617675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:46:27.618140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:46:27.632473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.632927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.633928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.634529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.665970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:46:27.680137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for user 73721f6e36eb487589dcb980b6fdb483 and project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:46:27.711534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:46:27.714220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:46:27.854413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0cc126a2-7bbd-43a9-a5fc-1563ad1c84fa tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.679105 Jul 20 04:46:27.855098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3771/4896] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:46:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:46:27.873873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:27.874431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:27.889271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.889933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:27.890941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:27.891561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.413317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.425838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ac6ab34-f2c2-435b-9620-38ae7f1c1a0e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.563757 Jul 20 04:46:28.427560 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3772/4897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:27 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:28.451694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.455709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.464993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.465490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.466275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.466713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.832410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:28.843523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ea59c4d-111e-4210-86a8-ffd17e903aaf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1563 microversion: 2.1 time: 0.397383 Jul 20 04:46:28.845833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3773/4898] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:28 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1563 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:28.865605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:28.866235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:28.890102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.890552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:28.891682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:28.892424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.252502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.262071 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0481666-7491-4728-966f-ee7f7969cce0 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1313 microversion: 2.1 time: 0.403512 Jul 20 04:46:29.277295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3774/4899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:28 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:29.282498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:29.283616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:29.309449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.316682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.320980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.323164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.462146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:29.482005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-583d5744-b2c5-45a2-837e-705a4d9a1975 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1274 microversion: 2.1 time: 0.203635 Jul 20 04:46:29.482616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3775/4900] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:29 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:29.506608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-476410fe-1ed3-480a-a35d-bdbe65e82209 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:29.508230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-476410fe-1ed3-480a-a35d-bdbe65e82209 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 0eeb4182-1ea3-4761-a554-b0b78beebd8e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:29.516237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:29.556380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-476410fe-1ed3-480a-a35d-bdbe65e82209 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 0eeb4182-1ea3-4761-a554-b0b78beebd8e could not be found. Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-476410fe-1ed3-480a-a35d-bdbe65e82209 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/0eeb4182-1ea3-4761-a554-b0b78beebd8e/action HTTP/1.1 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: {"suspend": {}} Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 0eeb4182-1ea3-4761-a554-b0b78beebd8e could not be found. Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0eeb4182-1ea3-4761-a554-b0b78beebd8e', 'body': {'suspend': {}}} Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eeb4182-1ea3-4761-a554-b0b78beebd8e could not be found. Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eeb4182-1ea3-4761-a554-b0b78beebd8e could not be found. Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:29.558943 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:29.562999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:29.562999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:29.562999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eeb4182-1ea3-4761-a554-b0b78beebd8e could not be found. Jul 20 04:46:29.562999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:29.575853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-476410fe-1ed3-480a-a35d-bdbe65e82209 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 0eeb4182-1ea3-4761-a554-b0b78beebd8e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:29.577196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-476410fe-1ed3-480a-a35d-bdbe65e82209 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/0eeb4182-1ea3-4761-a554-b0b78beebd8e/action" status: 404 len: 111 microversion: 2.1 time: 0.089801 Jul 20 04:46:29.577834 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3776/4901] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:29 2022] POST /compute/v2.1/servers/0eeb4182-1ea3-4761-a554-b0b78beebd8e/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:29.592863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:29.597461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:29.627425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.628307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:29.630813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:29.631611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.110659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:30.119234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d69307d6-2184-4878-a5b0-5422756ad794 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1563 microversion: 2.1 time: 0.538911 Jul 20 04:46:30.135909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3777/4902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:29 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1563 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:30.143626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.157314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.165109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.165874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.166947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.167425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.588733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:30.591347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:30.603875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2207346-2fda-44b4-ab16-1726143f707c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.466290 Jul 20 04:46:30.607935 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3778/4903] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:30.653154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-00a72939-1342-4fd4-b1fe-7f1a525710e4 req-cd9f07eb-3a72-4b39-bd79-49a6d29617b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a885fd-892b-41e3-8c37-23617a6e4b26", "tag": "9d29b2fc-75f4-423c-b708-418e0cf6a87a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:30.674709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-00a72939-1342-4fd4-b1fe-7f1a525710e4 req-cd9f07eb-3a72-4b39-bd79-49a6d29617b9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.675161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-00a72939-1342-4fd4-b1fe-7f1a525710e4 req-cd9f07eb-3a72-4b39-bd79-49a6d29617b9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.703074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-00a72939-1342-4fd4-b1fe-7f1a525710e4 req-cd9f07eb-3a72-4b39-bd79-49a6d29617b9 service nova] Creating event network-changed:9d29b2fc-75f4-423c-b708-418e0cf6a87a for instance 14a885fd-892b-41e3-8c37-23617a6e4b26 on n-h1-764486-11 Jul 20 04:46:30.714949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-00a72939-1342-4fd4-b1fe-7f1a525710e4 req-cd9f07eb-3a72-4b39-bd79-49a6d29617b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105623 Jul 20 04:46:30.715572 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3779/4904] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:30.725600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:30.726315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:30.743889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.744545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:30.745355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:30.745822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.045136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.057341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa59f013-5b39-4f0e-810f-104a90e3a53c tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1313 microversion: 2.1 time: 0.339786 Jul 20 04:46:31.057956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3780/4905] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:30 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:31.063521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:31.064492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:31.075739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.076191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.077065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.077661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.151880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.159844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-183841c8-05eb-4b6c-8492-241acf3d7bb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1280 microversion: 2.1 time: 0.100653 Jul 20 04:46:31.160456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3781/4906] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:31 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:31.166738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:31.168212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:31.176810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.177265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.178051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.178486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.352985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.361172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b98a437-4cf1-4839-a283-f972091c9a82 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.198793 Jul 20 04:46:31.362077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3782/4907] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:31 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:31.369016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1c8ea2e6-61d5-4ace-955f-86d409975041 req-1a96db45-4f56-4a1b-a589-2d2a0c5d9b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b46041-216c-43f9-a83f-0ae4f42e1dec", "name": "network-vif-plugged", "status": "completed", "tag": "fdae72f7-70ef-46fc-8905-a1c1298b715a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:31.379360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1c8ea2e6-61d5-4ace-955f-86d409975041 req-1a96db45-4f56-4a1b-a589-2d2a0c5d9b18 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.380203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1c8ea2e6-61d5-4ace-955f-86d409975041 req-1a96db45-4f56-4a1b-a589-2d2a0c5d9b18 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.393108 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1c8ea2e6-61d5-4ace-955f-86d409975041 req-1a96db45-4f56-4a1b-a589-2d2a0c5d9b18 service nova] Creating event network-vif-plugged:fdae72f7-70ef-46fc-8905-a1c1298b715a for instance 56b46041-216c-43f9-a83f-0ae4f42e1dec on n-h2-764486-11 Jul 20 04:46:31.398473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1c8ea2e6-61d5-4ace-955f-86d409975041 req-1a96db45-4f56-4a1b-a589-2d2a0c5d9b18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034755 Jul 20 04:46:31.399421 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3783/4908] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:31.407899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:31.409066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:31.419332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.429855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.430878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.433887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.475508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lazy-loading 'flavor' on Instance uuid c1748ffb-8279-402a-b67a-6fc77c5a022b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:31.579825 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-040423ba-a09e-4ae2-bd5a-ab560150eb7d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 202 len: 0 microversion: 2.1 time: 0.178623 Jul 20 04:46:31.580533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3784/4909] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:31 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:46:31.589120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:31.589827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:31.608428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.609096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.609893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:31.610332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:31.831813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:31.840703 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72c09991-8d85-4094-baf8-820d91a01352 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1514 microversion: 2.1 time: 0.255651 Jul 20 04:46:31.841611 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3785/4910] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:31 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:32.088657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:32.092243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:32.114247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.119721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.120701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.121658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.482185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:32.490179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dae7a374-2ddc-49d1-9218-a7ff2bf23608 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1313 microversion: 2.1 time: 0.418502 Jul 20 04:46:32.491457 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3786/4911] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:32 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:32.496775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:32.497627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:32.504058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.505145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:32.506109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:32.506739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.167224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.203323 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-831548d6-af06-40bc-b54b-e575ea204cc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 0.710518 Jul 20 04:46:33.216586 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3787/4912] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:32 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:33.227465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.228657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.238058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.239081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.240025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.242790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.452760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.461275 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4b7d44e-d60a-4325-aff2-c7d78d5b6d3c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1497 microversion: 2.1 time: 0.239396 Jul 20 04:46:33.462666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3788/4913] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:33 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:33.479033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:33.479582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.486248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.486805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.487474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.488090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.517261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lazy-loading 'flavor' on Instance uuid c1748ffb-8279-402a-b67a-6fc77c5a022b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:33.531373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'suspend' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state suspended Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: {"suspend": {}} Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'suspend' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state suspended Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'suspend': {}}} Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state suspended. Cannot suspend while the instance is in this state. Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 20 04:46:33.533283 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state suspended Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state suspended Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'suspend' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state suspended {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33f1b8bd-158a-4d73-8adf-6829bdfbbfda tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 148 microversion: 2.1 time: 0.060067 Jul 20 04:46:33.542578 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3789/4914] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:33 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 148 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:46:33.544027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:33.544027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.552698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.555098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.563736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.569179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.756282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:33.768716 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d71d148-27ee-45d1-85c3-eba12667ef7e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1463 microversion: 2.1 time: 0.231226 Jul 20 04:46:33.769412 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3790/4915] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:33 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:33.774766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:33.775509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.797958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.798475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.799507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.799982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.891239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-421b3305-67f7-44e2-b60a-718adc934286 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 202 len: 0 microversion: 2.1 time: 0.118168 Jul 20 04:46:33.896548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3791/4916] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:33 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:46:33.925428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0041ce36-7ece-4866-b67d-875c022928fd", "device": "/dev/sdb"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:33.927882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:33.944146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.944578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:33.945373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:33.945810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.360713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:34.373755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2495f09-82cb-4c43-be12-a0d6090f1b5a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "POST /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459886 Jul 20 04:46:34.375095 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3792/4917] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:46:33 2022] POST /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:34.384122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:34.384938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.396253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.396934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.397883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.399067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.790267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:34.799215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ec9f417-0393-4a00-9ffa-572f696c6f57 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1503 microversion: 2.1 time: 0.422727 Jul 20 04:46:34.803580 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3793/4918] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:34 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1503 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:34.816297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c308d68d-8151-43af-94df-f48ee73771ce req-20e65b4d-69c2-44fb-811e-caa0af7ef628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de939a38-1c17-4505-b82d-156b1625f8ed", "tag": "b7944392-a590-4718-9160-70fe53572a1c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:34.855612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c308d68d-8151-43af-94df-f48ee73771ce req-20e65b4d-69c2-44fb-811e-caa0af7ef628 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.856000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c308d68d-8151-43af-94df-f48ee73771ce req-20e65b4d-69c2-44fb-811e-caa0af7ef628 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.883877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c308d68d-8151-43af-94df-f48ee73771ce req-20e65b4d-69c2-44fb-811e-caa0af7ef628 service nova] Creating event network-changed:b7944392-a590-4718-9160-70fe53572a1c for instance de939a38-1c17-4505-b82d-156b1625f8ed on n-h2-764486-11 Jul 20 04:46:34.894709 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c308d68d-8151-43af-94df-f48ee73771ce req-20e65b4d-69c2-44fb-811e-caa0af7ef628 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089488 Jul 20 04:46:34.895914 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3794/4919] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:34.905935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:34.906641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:34.932676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.933369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:34.934216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:34.934765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.362183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:35.386751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6437c12b-319c-4123-ab84-08f2570d71d1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 0.487657 Jul 20 04:46:35.388714 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3795/4920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:34 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:35.831995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:35.833735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:35.873672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:35.874266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:35.878507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:35.879277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.295711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:36.306788 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31f918db-da14-4e6b-97b1-62b6811ea910 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1503 microversion: 2.1 time: 0.490036 Jul 20 04:46:36.307496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3796/4921] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:35 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:36.361358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:36.364949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:36.387558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.392241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.395525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.402159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.759975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:36.771470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-151f51af-69f1-4c00-ba6f-5c4199ebad7d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1563 microversion: 2.1 time: 0.432269 Jul 20 04:46:36.788663 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3797/4922] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:36 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1563 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:36.799998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:36.800687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:36.827181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.830650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:36.831462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:36.840445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.242895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:37.260737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf9ccfe0-f56a-4e89-83da-384a06571d1b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 0.470806 Jul 20 04:46:37.261658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3798/4923] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:36 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:37.267275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206ba87a-8f59-4f31-8061-a10270611141"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:37.268647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:37.288913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.289700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.290670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.291405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.471122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Invalid volume: volume 206ba87a-8f59-4f31-8061-a10270611141 is already attached to instances: 598b71bd-ac88-4afb-977e-1faefa094f93 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments HTTP/1.1 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 74 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: {"volumeAttachment": {"volumeId": "206ba87a-8f59-4f31-8061-a10270611141"}} Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid volume: volume 206ba87a-8f59-4f31-8061-a10270611141 is already attached to instances: 598b71bd-ac88-4afb-977e-1faefa094f93 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '598b71bd-ac88-4afb-977e-1faefa094f93', 'body': {'volumeAttachment': {'volumeId': '206ba87a-8f59-4f31-8061-a10270611141'}}} Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 206ba87a-8f59-4f31-8061-a10270611141 is already attached to instances: 598b71bd-ac88-4afb-977e-1faefa094f93 Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:37.473428 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 206ba87a-8f59-4f31-8061-a10270611141 is already attached to instances: 598b71bd-ac88-4afb-977e-1faefa094f93 Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 206ba87a-8f59-4f31-8061-a10270611141 is already attached to instances: 598b71bd-ac88-4afb-977e-1faefa094f93 Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 400 to user: Invalid volume: volume 206ba87a-8f59-4f31-8061-a10270611141 is already attached to instances: 598b71bd-ac88-4afb-977e-1faefa094f93 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:37.477279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-587183a3-9715-4bde-9870-2864106ea428 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.212085 Jul 20 04:46:37.478310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3799/4924] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:46:37 2022] POST /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 174 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:46:37.486757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-38e86a93-f623-473e-9da5-bf871668798d req-975b1866-6925-43b2-882d-f862acc186f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:37.523945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-38e86a93-f623-473e-9da5-bf871668798d req-975b1866-6925-43b2-882d-f862acc186f2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.524414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-38e86a93-f623-473e-9da5-bf871668798d req-975b1866-6925-43b2-882d-f862acc186f2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.573312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-38e86a93-f623-473e-9da5-bf871668798d req-975b1866-6925-43b2-882d-f862acc186f2 service nova] Creating event network-changed:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:46:37.578557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-38e86a93-f623-473e-9da5-bf871668798d req-975b1866-6925-43b2-882d-f862acc186f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099426 Jul 20 04:46:37.579179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3800/4925] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:37.604157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:37.604820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:37.626367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.626829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.627631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:37.628074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:37.725516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:37.726322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=18 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:38.349989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:38.366424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44b9d0d5-1f5a-4ed3-b059-3d3cea8233d4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.785900 Jul 20 04:46:38.367231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3801/4926] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:37 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:38.373646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.391780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.407208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.407664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.408586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.408934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.668272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lazy-loading 'services' on Instance uuid 598b71bd-ac88-4afb-977e-1faefa094f93 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:38.857284 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b289a6d-78e3-4537-bada-61f7bd1f00f9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments/206ba87a-8f59-4f31-8061-a10270611141" status: 202 len: 0 microversion: 2.1 time: 0.488019 Jul 20 04:46:38.862264 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3802/4927] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:46:38 2022] DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments/206ba87a-8f59-4f31-8061-a10270611141 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:46:38.877696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4646197e-fc58-417c-9753-bd98d671e503 req-8636283a-bdb4-4d4b-929c-65cca5e3d599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a885fd-892b-41e3-8c37-23617a6e4b26", "name": "network-vif-plugged", "status": "completed", "tag": "9d29b2fc-75f4-423c-b708-418e0cf6a87a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:38.895003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4646197e-fc58-417c-9753-bd98d671e503 req-8636283a-bdb4-4d4b-929c-65cca5e3d599 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.896265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4646197e-fc58-417c-9753-bd98d671e503 req-8636283a-bdb4-4d4b-929c-65cca5e3d599 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.927844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4646197e-fc58-417c-9753-bd98d671e503 req-8636283a-bdb4-4d4b-929c-65cca5e3d599 service nova] Creating event network-vif-plugged:9d29b2fc-75f4-423c-b708-418e0cf6a87a for instance 14a885fd-892b-41e3-8c37-23617a6e4b26 on n-h1-764486-11 Jul 20 04:46:38.943707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4646197e-fc58-417c-9753-bd98d671e503 req-8636283a-bdb4-4d4b-929c-65cca5e3d599 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069966 Jul 20 04:46:38.944664 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3803/4928] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:38.954835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:38.961524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:38.972436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.976193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:38.977531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:38.979206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.064073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:40.077817 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4924b077-7116-4235-b4be-9a92dc4d9203 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 1.131647 Jul 20 04:46:40.078418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3804/4929] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:38 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:40.094468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.095086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.107716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.108171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.117060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.117523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.327374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:40.341542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f7af635-0a99-4d36-813f-79052b13f3c5 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.250853 Jul 20 04:46:40.342505 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3805/4930] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:40.349554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.352590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.368405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.369160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.370384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.371134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.427994 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c75445f-d447-4d26-96d1-61b05c5cbebc tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083619 Jul 20 04:46:40.434944 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3806/4931] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:40.440417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-080de9fd-852c-4ddf-b759-bb3c6f3d8acc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:40.441232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-080de9fd-852c-4ddf-b759-bb3c6f3d8acc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.450722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-080de9fd-852c-4ddf-b759-bb3c6f3d8acc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f could not be found. Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-080de9fd-852c-4ddf-b759-bb3c6f3d8acc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f/action HTTP/1.1 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: {"unpause": {}} Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f could not be found. Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f', 'body': {'unpause': {}}} Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f could not be found. Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f could not be found. Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:40.452918 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f could not be found. Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-080de9fd-852c-4ddf-b759-bb3c6f3d8acc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-080de9fd-852c-4ddf-b759-bb3c6f3d8acc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f/action" status: 404 len: 111 microversion: 2.1 time: 0.018793 Jul 20 04:46:40.457221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3807/4932] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:40 2022] POST /compute/v2.1/servers/4ff9f691-c0fe-469d-8a11-a31b8b0e4b5f/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:40.465254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.466205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.493061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.493528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.494331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.494787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.773162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:40.800945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c203090-31ae-4c51-b4d5-ddb35e3523fc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.340354 Jul 20 04:46:40.801551 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3808/4933] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:40.818229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:40.838868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:40.864502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.864964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:40.866218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:40.866218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.109158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.118453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b0d7884-bab2-43c5-88ee-4007659bf92f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.304006 Jul 20 04:46:41.120338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3809/4934] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:40 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:41.128720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.129460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.148066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.148653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.157074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.158642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.326219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.336173 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf15c803-7e6a-4f2f-bd06-613fa6c2e87e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 0.214339 Jul 20 04:46:41.337129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3810/4935] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:41.342228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:41.343057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.350366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.351058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.352023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.352665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.379434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'unpause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 15 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: {"unpause": {}} Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'unpause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'unpause': {}}} Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state active. Cannot unpause while the instance is in this state. Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:41.381353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:41.386574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:41.386574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:41.386574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:41.386574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:41.386574 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.388015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'unpause' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:41.389614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-183b6990-376d-4824-b986-84f5dd8c8e66 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 145 microversion: 2.1 time: 0.051383 Jul 20 04:46:41.390966 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3811/4936] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:41 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:46:41.401521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.402339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.408897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.409558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.411731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.412367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.417163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:41.578779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.593291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc3ff776-593b-4803-884b-a4b19ce52b7c tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.195666 Jul 20 04:46:41.598231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3812/4937] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:41.619087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.624933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.635766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.636535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.637712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.638283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.686915 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17e0fbca-c81b-43b8-b03e-1eaca1e531ec tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087191 Jul 20 04:46:41.688885 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3813/4938] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:41.694678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.695692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.704248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.704749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.705529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.705966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.867539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:41.877553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-025d7cda-55df-4241-864e-a65b20b84151 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.187666 Jul 20 04:46:41.878443 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3814/4939] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:41.894476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e07dd2d-2d47-4c50-8baa-b74e5a683cce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:41.895608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e07dd2d-2d47-4c50-8baa-b74e5a683cce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: f080761d-30a9-42b0-b071-faa1c2a00cad] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.903090 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9e07dd2d-2d47-4c50-8baa-b74e5a683cce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance f080761d-30a9-42b0-b071-faa1c2a00cad could not be found. Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e07dd2d-2d47-4c50-8baa-b74e5a683cce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/f080761d-30a9-42b0-b071-faa1c2a00cad/action HTTP/1.1 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 18 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: {"unshelve": null} Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f080761d-30a9-42b0-b071-faa1c2a00cad could not be found. Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f080761d-30a9-42b0-b071-faa1c2a00cad', 'body': {'unshelve': None}} Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f080761d-30a9-42b0-b071-faa1c2a00cad could not be found. Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f080761d-30a9-42b0-b071-faa1c2a00cad could not be found. Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.904850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f080761d-30a9-42b0-b071-faa1c2a00cad could not be found. Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e07dd2d-2d47-4c50-8baa-b74e5a683cce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance f080761d-30a9-42b0-b071-faa1c2a00cad could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e07dd2d-2d47-4c50-8baa-b74e5a683cce tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/f080761d-30a9-42b0-b071-faa1c2a00cad/action" status: 404 len: 111 microversion: 2.1 time: 0.017896 Jul 20 04:46:41.911118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3815/4940] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:41 2022] POST /compute/v2.1/servers/f080761d-30a9-42b0-b071-faa1c2a00cad/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:46:41.917888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:41.920101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:41.930530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.930984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:41.931825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:41.932216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.079948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.088136 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1609164d-ff72-4d52-8871-6ba05da88667 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.174123 Jul 20 04:46:42.088946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3816/4941] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:41 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:42.106139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.106763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.113991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.114667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.115204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.115633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.282688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.294656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13f19d78-945d-4eaa-aed2-7338e217715e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.188737 Jul 20 04:46:42.295534 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3817/4942] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:42.319314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:42.320333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.326864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.327664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.328715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.329358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.372271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Cannot 'unshelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action HTTP/1.1 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 18 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: {"unshelve": null} Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'unshelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'unshelve': None}} Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b in vm_state active. Cannot unshelve while the instance is in this state. Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:46:42.374165 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active Jul 20 04:46:42.377830 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:42.380579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 409 to user: Cannot 'unshelve' instance c1748ffb-8279-402a-b67a-6fc77c5a022b while it is in vm_state active {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:42.381675 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1599b2fa-984e-42c8-9ae5-0977d7f9b608 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action" status: 409 len: 146 microversion: 2.1 time: 0.073879 Jul 20 04:46:42.382871 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3818/4943] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:42 2022] POST /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b/action => generated 146 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:46:42.388097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.389193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.396498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.397089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.398018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.398626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.553461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.562238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a891aaf-a428-4854-ba77-6880043e9192 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 0.178012 Jul 20 04:46:42.563189 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3819/4944] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:42.579307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.580285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.587770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.588588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.589774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.602077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.844149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:42.858042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33651328-d7c6-488e-9d5d-6a128fe3610a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.283880 Jul 20 04:46:42.859726 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3820/4945] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:42.866103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.868534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.875212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.875943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.878450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.879746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.924820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d3789464-eea9-409d-91a9-8dd956568a42 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063570 Jul 20 04:46:42.927156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3821/4946] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:42.933183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:42.934295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:42.941763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.942349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:42.943245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:42.943776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.131973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.142681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ad8bae6-5c54-493d-95cb-a4a11a9a099a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.214337 Jul 20 04:46:43.143877 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3822/4947] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:42 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:43.150217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-024e8a04-8d2f-476a-a996-9871d86c3c2e req-5430e228-b15b-4085-aaad-774d7fadc8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de939a38-1c17-4505-b82d-156b1625f8ed", "name": "network-vif-plugged", "status": "completed", "tag": "b7944392-a590-4718-9160-70fe53572a1c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:43.159749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-024e8a04-8d2f-476a-a996-9871d86c3c2e req-5430e228-b15b-4085-aaad-774d7fadc8a5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.160909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-024e8a04-8d2f-476a-a996-9871d86c3c2e req-5430e228-b15b-4085-aaad-774d7fadc8a5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.178721 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-024e8a04-8d2f-476a-a996-9871d86c3c2e req-5430e228-b15b-4085-aaad-774d7fadc8a5 service nova] Creating event network-vif-plugged:b7944392-a590-4718-9160-70fe53572a1c for instance de939a38-1c17-4505-b82d-156b1625f8ed on n-h2-764486-11 Jul 20 04:46:43.186450 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-024e8a04-8d2f-476a-a996-9871d86c3c2e req-5430e228-b15b-4085-aaad-774d7fadc8a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040295 Jul 20 04:46:43.188201 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3823/4948] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:43.197558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-480b8965-dea1-4543-b1cd-13accda276f3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-839131893_updated"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:43.198929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-480b8965-dea1-4543-b1cd-13accda276f3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: 66f876a8-33c9-46c8-a6dd-7f58553b9ee9] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.204829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-480b8965-dea1-4543-b1cd-13accda276f3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance 66f876a8-33c9-46c8-a6dd-7f58553b9ee9 could not be found. Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-480b8965-dea1-4543-b1cd-13accda276f3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/servers/66f876a8-33c9-46c8-a6dd-7f58553b9ee9 HTTP/1.1 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 80 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-839131893_updated"}} Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 66f876a8-33c9-46c8-a6dd-7f58553b9ee9 could not be found. Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '66f876a8-33c9-46c8-a6dd-7f58553b9ee9', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-839131893_updated'}}} Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f876a8-33c9-46c8-a6dd-7f58553b9ee9 could not be found. Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 04:46:43.207669 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f876a8-33c9-46c8-a6dd-7f58553b9ee9 could not be found. Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f876a8-33c9-46c8-a6dd-7f58553b9ee9 could not be found. Jul 20 04:46:43.211561 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.214317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-480b8965-dea1-4543-b1cd-13accda276f3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance 66f876a8-33c9-46c8-a6dd-7f58553b9ee9 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:43.217952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-480b8965-dea1-4543-b1cd-13accda276f3 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "PUT /compute/v2.1/servers/66f876a8-33c9-46c8-a6dd-7f58553b9ee9" status: 404 len: 111 microversion: 2.1 time: 0.025463 Jul 20 04:46:43.218871 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3824/4949] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:46:43 2022] PUT /compute/v2.1/servers/66f876a8-33c9-46c8-a6dd-7f58553b9ee9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:43.229087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.229794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.245869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.248159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.249385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.250462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.490618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.498783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b80b82b4-0d21-48e0-a505-e40e3d2e759e tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.274345 Jul 20 04:46:43.499690 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3825/4950] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:43.516171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.516813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.518782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:43.524957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.525628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.526547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.527144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.664468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.672274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fb02f1e-5e6f-4cce-b030-77578aef511d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.159912 Jul 20 04:46:43.673096 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3826/4951] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:43.689384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.690460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.696078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.696599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.697887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.697887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.835448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:43.843373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce20baa1-7b55-4124-9285-5252f6971f35 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1322 microversion: 2.1 time: 0.157851 Jul 20 04:46:43.844160 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3827/4952] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:43.858941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9557b0a-1fae-49c1-aa57-e57d0758e431 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9557b0a-1fae-49c1-aa57-e57d0758e431 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b HTTP/1.1 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 280 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.861393 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9557b0a-1fae-49c1-aa57-e57d0758e431 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9557b0a-1fae-49c1-aa57-e57d0758e431 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "PUT /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 400 len: 619 microversion: 2.1 time: 0.008701 Jul 20 04:46:43.864912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3828/4953] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Jul 20 04:46:43 2022] PUT /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:46:43.871448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:43.872714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:43.879929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.880415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:43.881193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:43.881631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.028247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:44.038272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-634c3652-df57-4347-bcf3-9e7a86a8b58a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.169860 Jul 20 04:46:44.050027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3829/4954] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:43 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:44.050027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.050027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.056149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.056694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.057416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.057853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.091921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df1364fa-203d-4e33-a0f0-d5efb38dba9d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050900 Jul 20 04:46:44.095800 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3830/4955] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:44.097784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.098400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.105765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.106227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.107014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.107512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.263114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:44.271622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12f39e3c-11d3-4540-8560-a68773087329 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.177737 Jul 20 04:46:44.272413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3831/4956] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.302660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7654c5c9-2ee3-41dd-a2ee-d6eada2b8d2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7654c5c9-2ee3-41dd-a2ee-d6eada2b8d2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: request: PUT /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b HTTP/1.1 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 24 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: {"server": {"name": ""}} Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b', 'body': {'server': {'name': ''}}} Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '' Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:46:44.305453 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7654c5c9-2ee3-41dd-a2ee-d6eada2b8d2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7654c5c9-2ee3-41dd-a2ee-d6eada2b8d2f tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "PUT /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 400 len: 108 microversion: 2.1 time: 0.009904 Jul 20 04:46:44.315489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3832/4957] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 04:46:44 2022] PUT /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:46:44.319291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.319794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.329343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.329879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.330756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.331297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.496768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:44.499398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:44.508194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc75cee2-2acc-4f8d-97bf-cf7ba5fad360 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1506 microversion: 2.1 time: 0.196012 Jul 20 04:46:44.520446 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3833/4958] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:44.860992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:44.861774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:44.868849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.871655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:44.874599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:44.881072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.132823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:45.141319 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2fc29a4b-90ab-40a6-8d9a-52db4cf9d74d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1516 microversion: 2.1 time: 0.284318 Jul 20 04:46:45.142077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3834/4959] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:44 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1516 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:45.147617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.148814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:45.155774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.156335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.157128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.158145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.194054 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-887a5469-aa7f-4021-8696-3ea79e84d728 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050553 Jul 20 04:46:45.195002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3835/4960] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:45.200924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:45.202250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:45.208829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.209498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.210509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.211177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.249182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lazy-loading 'flavor' on Instance uuid de939a38-1c17-4505-b82d-156b1625f8ed {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:46:45.369065 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-690c9f06-e7b0-4d5c-864d-943c2b8da26a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action" status: 200 len: 32 microversion: 2.1 time: 0.172379 Jul 20 04:46:45.370363 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3836/4961] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:45 2022] POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:46:45.388080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:45.389133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:45.401940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.402406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.403271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:45.404958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:45.670676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:45.682664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1821442e-222e-4f1f-9ff8-bd4b8f6bf228 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.307124 Jul 20 04:46:45.685363 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3837/4962] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:45 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:46.218170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:46.219141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:46.246480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.247098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.247924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.248442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.290132 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80c0dafe-0feb-4f6c-858d-83bd01176151 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086514 Jul 20 04:46:46.296298 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3838/4963] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:46 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:46.703126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:46.703746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:46.716378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.717096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.718685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:46.719440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:46.965848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:46.974423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdc0c0fe-62f9-4dfe-988b-7439ddd4e0de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.275371 Jul 20 04:46:46.984639 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3839/4964] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:46 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:47.305594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:47.306519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:47.324135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.324488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.325275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:47.325713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:47.385666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7345fe3-627b-428c-9b6a-601a8e70e6ba tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084026 Jul 20 04:46:47.386593 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3840/4965] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:47 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:47.992471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:47.993239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.001684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.005132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.009906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.010426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.359147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:48.373394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ca71d17-7af0-4519-9c81-d298009b8c4f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.385897 Jul 20 04:46:48.383688 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3841/4966] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:47 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:48.410722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:48.411923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:48.419704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.420699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.421593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:48.422118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:48.481420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78bbe593-947d-475c-8ee5-32aaaca9d0b0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066559 Jul 20 04:46:48.481420 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3842/4967] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:48 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:49.392132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:49.392792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:49.405428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.408825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.411390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.413043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.881236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:49.893146 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0fa49563-8138-4ef2-a28b-3948a3cc4ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.505835 Jul 20 04:46:49.905516 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3843/4968] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:49 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:49.905516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:49.905516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:49.916071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.916847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.919066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:49.919839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:49.959613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20abdc55-e29b-4390-896d-b73606b7cb71 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063465 Jul 20 04:46:49.961104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3844/4969] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:49 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:50.918736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:50.919734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:50.967148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.972800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:50.975016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:50.982182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.452080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:51.461106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de28c5bb-ad05-42f4-88de-167b386b8f5a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.551419 Jul 20 04:46:51.479373 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3845/4970] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:50 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:51.485339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:51.486300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:51.506423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.509386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.510421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:51.512012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:51.598768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d013714-58ee-483f-9481-997b9880dd95 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117402 Jul 20 04:46:51.603893 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3846/4971] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:51 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:52.310383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:52.312072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:52.329487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.330071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.330882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.331215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.367898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 HTTP/1.1 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fb7bc54b-ce29-486c-9a00-1a1c15160146'} Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:52.372158 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.376123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:52.379607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-914afc9c-6b52-4c5c-b053-77019df013c4 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 404 len: 111 microversion: 2.1 time: 0.072890 Jul 20 04:46:52.381413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3847/4972] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:52 2022] DELETE /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:46:52.393235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:52.394501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: fb7bc54b-ce29-486c-9a00-1a1c15160146] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:52.415600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.416066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.416994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.417340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.469460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 HTTP/1.1 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'fb7bc54b-ce29-486c-9a00-1a1c15160146'} Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:52.471317 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. Jul 20 04:46:52.477744 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:52.479305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance fb7bc54b-ce29-486c-9a00-1a1c15160146 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:52.480382 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f566ae9-471b-454c-9099-2ed839dff11a tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146" status: 404 len: 111 microversion: 2.1 time: 0.096225 Jul 20 04:46:52.481609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3848/4973] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:52 2022] GET /compute/v2.1/servers/fb7bc54b-ce29-486c-9a00-1a1c15160146 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:52.487099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:52.488060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:52.497537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.498292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:52.499496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:52.500568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.017022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:53.020022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:53.032817 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-435a3177-418b-4b0b-8d11-b2ba56193168 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.549771 Jul 20 04:46:53.033332 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3849/4974] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:52 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:53.060788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.067160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.093783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.094234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.104894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.106412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.283545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:53.708712 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38632b3d-6a13-469f-96ea-cb468a39ac03 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 204 len: 0 microversion: 2.1 time: 0.669289 Jul 20 04:46:53.709883 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3850/4975] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:53 2022] DELETE /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:53.723779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.728589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.773091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.773399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.774217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.774658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.890944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c6e2d2f-28a3-479e-a2b6-aa8a55fe9e35 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176061 Jul 20 04:46:53.896910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3851/4976] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:53 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:53.909427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:53.910063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:53.932380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.932380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:53.932380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:53.932380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.252802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:54.262367 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41ee3817-2b05-4488-bfb3-9506cdd99207 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.357720 Jul 20 04:46:54.274538 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3852/4977] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:53 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:54.287130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.287745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.307823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.313502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.315076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.316515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.693153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:54.710789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abced02f-63af-4c6b-90e4-d1c9df98cdad tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.434842 Jul 20 04:46:54.720087 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3853/4978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:54.915594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:54.916811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:54.930397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.932343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:54.937303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:54.947323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.042458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd72c52f-afee-4f85-8e45-54bb820d693d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139190 Jul 20 04:46:55.048636 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3854/4979] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:54 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:46:55.291852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:55.293055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:55.318914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.319366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.320222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.332370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.659919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:55.671850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28ec0d57-cb62-4161-9788-b2386e605583 tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1512 microversion: 2.1 time: 0.388121 Jul 20 04:46:55.672528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3855/4980] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:55 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:55.729386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:55.730753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:55.740486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.741174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.742419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:55.743026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:55.963957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:55.976836 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c509229-4dce-42c1-bc6e-afb4e00372d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.251249 Jul 20 04:46:55.978600 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3856/4981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:55 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:56.060158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.063354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.085478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.088108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.089343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.091133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.204610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-050a8732-b742-4602-8975-0161e436f4b1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151337 Jul 20 04:46:56.210389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3857/4982] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:56.692675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:56.693711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:56.709816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.713792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.715005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:56.715605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:56.979371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd3b5ee6cd244d7e80a42c0ce5f0b153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2928abc9397241a3951cf0cd55b66d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:56.988676 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15c98c78-623e-4ae9-bf61-9e6adec4eb0d tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 200 len: 1470 microversion: 2.1 time: 0.302639 Jul 20 04:46:56.994453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3858/4983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:56 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:46:57.000408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-95afd64a-bb53-4f31-be56-048c9f73c0a3 req-f86152c0-7aaf-40ba-b9f4-a443e276eaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1748ffb-8279-402a-b67a-6fc77c5a022b", "name": "network-vif-deleted", "tag": "00205810-62ce-4d7b-8b27-1bc9b842bc1f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:57.042112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-95afd64a-bb53-4f31-be56-048c9f73c0a3 req-f86152c0-7aaf-40ba-b9f4-a443e276eaa5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.043167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-95afd64a-bb53-4f31-be56-048c9f73c0a3 req-f86152c0-7aaf-40ba-b9f4-a443e276eaa5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.081595 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-95afd64a-bb53-4f31-be56-048c9f73c0a3 req-f86152c0-7aaf-40ba-b9f4-a443e276eaa5 service nova] Creating event network-vif-deleted:00205810-62ce-4d7b-8b27-1bc9b842bc1f for instance c1748ffb-8279-402a-b67a-6fc77c5a022b on n-h1-764486-11 Jul 20 04:46:57.087275 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-95afd64a-bb53-4f31-be56-048c9f73c0a3 req-f86152c0-7aaf-40ba-b9f4-a443e276eaa5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091247 Jul 20 04:46:57.087902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3859/4984] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:46:57.100126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:57.102860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:57.117413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.118139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.119310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.119914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.437852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:57.454080 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d81b5d10-156a-4bde-a87d-54f79843bb60 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.362138 Jul 20 04:46:57.454723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3860/4985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:57 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:57.459780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:57.467536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:57.482756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.483233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.484098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.484795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.552848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae540d7c-aeb6-4df4-b029-6bca273851a1 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096926 Jul 20 04:46:57.553529 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3861/4986] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:46:57 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:46:57.639575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:57.640087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:57.646520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.647226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.648025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.648502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.678399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:46:57.838508 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e8a43f1-703b-4d2c-8a07-319362846e86 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 204 len: 0 microversion: 2.1 time: 0.202370 Jul 20 04:46:57.843347 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3862/4987] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:46:57 2022] DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:46:57.858328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:57.859613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:57.877058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.882340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:57.883508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:57.884928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.305047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:58.307893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:46:58.321705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1905d0a1-70eb-416a-adc5-1660f08b05a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1680 microversion: 2.1 time: 0.476840 Jul 20 04:46:58.325819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3863/4988] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:57 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1680 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:58.338982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.339524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] [instance: c1748ffb-8279-402a-b67a-6fc77c5a022b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.359064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.359586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.360387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.360827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.384696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] HTTP exception thrown: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b could not be found. Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Request method failure captured: Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b HTTP/1.1 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fZRoCjtx5i2oBOQIz-h9yaM12VKmEg0NaxmzpJhPiAq73r4PYAH_Vsi5w2r_XckXTbmZdIE9yGTSqymqWKJcPU3rlbDxtt3c1AiuJpOgf4jxfSNHfeihwfwyjObPeuZyUANLanc_-p6bwyoubjbGD_vFMmZI2PLL2TP27yWKd2S6M Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2928abc9397241a3951cf0cd55b66d35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2928abc9397241a3951cf0cd55b66d35", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 2928abc9397241a3951cf0cd55b66d35 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1808617015 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: bd3b5ee6cd244d7e80a42c0ce5f0b153 Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1808617015-project Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b could not be found. Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c1748ffb-8279-402a-b67a-6fc77c5a022b'} Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b could not be found. Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b could not be found. Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:46:58.386541 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b could not be found. Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] Returning 404 to user: Instance c1748ffb-8279-402a-b67a-6fc77c5a022b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:46:58.390376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab09fc2e-d924-422f-897e-cd8ee9c07bbc tempest-ServersNegativeTestJSON-1808617015 tempest-ServersNegativeTestJSON-1808617015-project] 10.222.0.49 "GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b" status: 404 len: 111 microversion: 2.1 time: 0.064293 Jul 20 04:46:58.413323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3864/4989] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:58 2022] GET /compute/v2.1/servers/c1748ffb-8279-402a-b67a-6fc77c5a022b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:46:58.421758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:46:58.433601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.457517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.458054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.458876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.459325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.543816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be71e092-2adc-474e-948e-2c1ae24a06d3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action" status: 200 len: 24581 microversion: 2.1 time: 0.129171 Jul 20 04:46:58.553589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3865/4990] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:46:58 2022] POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action => generated 24581 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:46:58.561932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:58.568561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:58.621610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.622865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.624971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:58.626095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:58.895968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:58.912190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9eed0fc0-c906-400e-8193-ed310c6c7421 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.352189 Jul 20 04:46:58.913528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3866/4991] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:58 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:59.341545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:59.342450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:59.361284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.361737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.362584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.363023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.843837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:46:59.891824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e64e7224-2f04-4bf3-880e-151e88ce3525 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1680 microversion: 2.1 time: 0.553661 Jul 20 04:46:59.892962 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3867/4992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:59 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:46:59.941451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:46:59.943282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:46:59.953665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.955890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:46:59.958526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:46:59.959568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:00.194087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:00.202197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f858b4b5-6fb7-4726-b58d-977e88327c48 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.267018 Jul 20 04:47:00.203056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3868/4993] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:46:59 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:00.918191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:00.918946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:00.945801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:00.954381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:00.959010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:00.960722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.293847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:01.306934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-542f12cf-72a9-49d3-b60f-381db7f0db67 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1680 microversion: 2.1 time: 0.395829 Jul 20 04:47:01.307947 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3869/4994] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:00 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1680 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:01.315340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:01.319800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:01.347254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.348097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.349141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:01.355895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:01.849170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:01.857875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2b78495-491a-426b-bb1f-aaddde366eb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.548619 Jul 20 04:47:01.871642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3870/4995] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:01 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:02.327933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:02.329481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:02.367403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.367662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.368493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.374078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.757998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:02.779773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c795500-10e3-4921-8e7e-c739baccf17a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1613 microversion: 2.1 time: 0.451655 Jul 20 04:47:02.783794 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3871/4996] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:02 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1613 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:02.907529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:02.910920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:02.926029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:02.943265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.944104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:02.947590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:02.948300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.316977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:03.328160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b23bec2d-5615-466a-8a5c-84d377103ef7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.443085 Jul 20 04:47:03.332496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3872/4997] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:02 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:03.803065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:03.804189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:03.830826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.837536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:03.844513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:03.851448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.051904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:04.099736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-773ec695-7255-484c-9514-b49896358bb7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1613 microversion: 2.1 time: 0.297280 Jul 20 04:47:04.103418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3873/4998] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:03 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1613 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:04.345934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:04.348162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:04.359244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:04.360014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.365505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:04.366249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.831400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:04.845850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-192c226c-760d-4f0d-bda0-76b3c7576994 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.500346 Jul 20 04:47:04.849950 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3874/4999] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:04 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:04.865211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dda4dcb1-c9e9-4a5c-8a7c-34e2c8dc13c9 req-b1861080-5384-4722-8dd7-5fde5204549b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b71bd-ac88-4afb-977e-1faefa094f93", "name": "network-vif-deleted", "tag": "748c7726-ba02-48a3-aecc-cb3a6e9fb7ef"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:04.890913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dda4dcb1-c9e9-4a5c-8a7c-34e2c8dc13c9 req-b1861080-5384-4722-8dd7-5fde5204549b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:04.891842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dda4dcb1-c9e9-4a5c-8a7c-34e2c8dc13c9 req-b1861080-5384-4722-8dd7-5fde5204549b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:04.925732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dda4dcb1-c9e9-4a5c-8a7c-34e2c8dc13c9 req-b1861080-5384-4722-8dd7-5fde5204549b service nova] Creating event network-vif-deleted:748c7726-ba02-48a3-aecc-cb3a6e9fb7ef for instance 598b71bd-ac88-4afb-977e-1faefa094f93 on n-h2-764486-11 Jul 20 04:47:04.939496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dda4dcb1-c9e9-4a5c-8a7c-34e2c8dc13c9 req-b1861080-5384-4722-8dd7-5fde5204549b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087804 Jul 20 04:47:04.940875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3875/5000] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:05.126825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:05.128455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:05.165040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.176283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.180108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.185514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.339944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.340562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.342788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lazy-loading 'fault' on Instance uuid 598b71bd-ac88-4afb-977e-1faefa094f93 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:05.943395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:05.954648 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53b92dd4-3e42-43ad-b561-ee9a8681aa5a tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 200 len: 1332 microversion: 2.1 time: 0.833227 Jul 20 04:47:05.965911 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3876/5001] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:05 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 1332 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:05.974205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:05.977283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:05.994154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.997349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:05.998398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:05.999883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:06.336502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:06.347445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-713ed6b0-29aa-4899-989f-e9689c316dce tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.380101 Jul 20 04:47:06.348044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3877/5002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:05 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:06.973884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:06.974523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:07.005166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.005634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.006707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.007325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.040681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 HTTP/1.1 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '598b71bd-ac88-4afb-977e-1faefa094f93'} Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:07.042635 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73663548-c364-4bf8-8f7d-f02b0b3d06c0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 404 len: 111 microversion: 2.1 time: 0.074935 Jul 20 04:47:07.047715 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3878/5003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:06 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:07.066626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0b20c47-8375-4295-9a37-3d4e9b36a855 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '.version_select at 0x7f838a051d30>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:07.118348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0b20c47-8375-4295-9a37-3d4e9b36a855 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534126522" status: 202 len: 0 microversion: 2.1 time: 0.056998 Jul 20 04:47:07.118939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3879/5004] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:47:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534126522 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:07.365933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:07.366619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:07.378869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.379622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.381627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:07.383684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:07.982794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:07.994501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-deac2b12-f9b6-4c41-9af7-b349b301996b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.633607 Jul 20 04:47:07.995563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3880/5005] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:07 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:09.016280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:09.016280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:09.024839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.025301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.026110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.026558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.329222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:09.351955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ff558fe-ae09-4ed0-986a-40af3b618081 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.343947 Jul 20 04:47:09.353355 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3881/5006] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:09 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:09.710581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:09.712276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:09.723452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.729296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:09.730593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:09.731278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.029714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa3186ff-45f9-45e6-916d-109692d5c535 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1835 microversion: 2.1 time: 0.328126 Jul 20 04:47:10.036255 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3882/5007] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:09 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1835 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:10.041308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29b715b0-e46d-4eb7-ae9b-4df012880985 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: .version_select at 0x7f8389f813a0>, body: {"keypair": {"name": "tempest-keypair-1584471877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1mv5n6EDUJ8ULt5GHvLz0C8MbOxIoPrhy8rWb8YJpXnb6wuEvsrFddrWd00QuUrD3R7lwNKaa9QPaTh0/cCJU2D1Kwus7QH9PWFuD/v01oDRYFteglkY+EjgPfwcIT5Q=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:10.083519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-29b715b0-e46d-4eb7-ae9b-4df012880985 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:10.092171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-29b715b0-e46d-4eb7-ae9b-4df012880985 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:10.144261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29b715b0-e46d-4eb7-ae9b-4df012880985 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106627 Jul 20 04:47:10.145745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3883/5008] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:47:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:10.157775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:10.159709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.179869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.181773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.185207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.187423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.234876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:10.465969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.492310 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9d1b81e-5795-4a1c-bff8-a26f8dcf7b7a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1682 microversion: 2.1 time: 0.328295 Jul 20 04:47:10.493248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3884/5009] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:10 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1682 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:10.506730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:10.507341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:10.529689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.531637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.533009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:10.534007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:10.985190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:10.996676 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5fda98a-7716-4c0d-8df0-055c89b6dd58 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.502265 Jul 20 04:47:11.001237 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3885/5010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:10 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:11.012482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:11.013861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.023127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.023972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.025870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.026934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.102279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-703300c2-939d-42fb-8b3c-e4378973c719 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action" status: 200 len: 32637 microversion: 2.1 time: 0.097888 Jul 20 04:47:11.103606 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3886/5011] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:11 2022] POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action => generated 32637 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:47:11.253967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:11.254954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.263090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.271167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.272539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.274679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.318593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd8a18a4d40864ce3829a281033e67052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993dbb35794c42d8889e6ed1ebde0025', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:11.319230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] flavor_id is None. Assuming migration. {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 04:47:11.319774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 04:47:11.505339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3d5594e-b657-4e39-9a81-e659c4429457 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.256368 Jul 20 04:47:11.509803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3887/5012] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:11 2022] POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:11.520337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:11.521119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:11.545780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.549621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.551382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:11.553585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:11.997797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.010795 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbfde3ce-7b09-413a-be8b-74b60e570260 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1691 microversion: 2.1 time: 0.497467 Jul 20 04:47:12.020448 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3888/5013] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:11 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1691 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:12.029907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:12.033301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:12.054151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.063827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.069534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:12.069991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:12.498867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:12.532468 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c779f30-0d3d-43e4-9ec8-106bf8b38e80 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.516479 Jul 20 04:47:12.538269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3889/5014] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:12 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:13.038270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:13.043765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:13.072734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.073208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:13.077289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.079768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:13.692868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:13.722455 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0081afc2-843a-4bce-9a38-f36ecafce892 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1691 microversion: 2.1 time: 0.693867 Jul 20 04:47:13.724685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3890/5015] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:13 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1691 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:13.750700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:13.753757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:13.780037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.782297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:13.788992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:13.791225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:14.201793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:14.263036 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1a577d5-b5bb-4bc1-ac7d-ded74328eec1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.535563 Jul 20 04:47:14.273144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3891/5016] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:13 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:14.298719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1550146486", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2e3bd6f-916b-4434-a9b5-9f9d528c43af"}], "security_groups": [{"name": "tempest-securitygroup--1206818920"}], "key_name": "tempest-keypair-1584471877", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:14.541108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] validate_networks() for [('d2e3bd6f-916b-4434-a9b5-9f9d528c43af', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:47:15.290086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:47:15.290781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:47:15.290985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:47:15.291579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:47:15.292458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:47:15.303320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.303775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.304631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.305075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.328001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:15.335603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Getting quotas for user dfdec296862948fc8e2b3c266a47b20f and project 3c4d65f2a08545209d516d67b288bb97. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:15.351616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:47:15.354174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:47:15.440751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91ea8b3d-67af-429b-bef8-52bce158a0a7 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.162398 Jul 20 04:47:15.446221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3892/5017] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:47:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:47:15.449195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:15.449821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:15.463993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.465778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:15.466990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:15.467951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:16.781744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:16.799159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76685da5-6848-4b3b-8c04-9c05f5d4824f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1691 microversion: 2.1 time: 1.355203 Jul 20 04:47:16.816606 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3893/5018] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:15 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1691 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:16.822082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:16.834164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:16.853483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:16.853945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:16.861683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:16.862167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.308971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:17.321055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-559ae289-c48f-4764-afc5-e63be0d05de9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.503012 Jul 20 04:47:17.332835 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3894/5019] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:16 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:17.348794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.354496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.372156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.373774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.375765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.377854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.466715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:17.476887 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32203a0d-2dda-4ec7-acd6-7f8270cf3ecd tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1302 microversion: 2.1 time: 0.142690 Jul 20 04:47:17.477492 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3895/5020] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1302 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:17.821325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:17.821978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:17.837438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.837912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:17.838754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:17.839208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.260813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:18.278862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08fb557c-c3a9-457b-b82a-3ab8f06173cf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.456587 Jul 20 04:47:18.281171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3896/5021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:17 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:18.338367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:18.339320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:18.365855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.369301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.370246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.371125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.571329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:18.606272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35967535-e301-4a5d-a198-2e2384595eda tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1522 microversion: 2.1 time: 0.272564 Jul 20 04:47:18.608001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3897/5022] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:18 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:18.614776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:18.615815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:18.623696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.624715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.625709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:18.626364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:18.746708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:18.786677 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cc98a41-7bbb-4edd-95f1-64aaa6fe19ce tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1300 microversion: 2.1 time: 0.151890 Jul 20 04:47:18.786677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3898/5023] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:18 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:19.303843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.306711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.325918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.326411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.327239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.327651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.582581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:19.595278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a580794-02a5-4630-ade8-7b3227179586 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.297593 Jul 20 04:47:19.596783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3899/5024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:19.624922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.625633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.638894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.639535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.640538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.641154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.659418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:19.904780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:19.915885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2d43ec9-1693-4e9f-8bad-707f1fe817c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1502 microversion: 2.1 time: 0.294749 Jul 20 04:47:19.929659 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3900/5025] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1502 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:19.938069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:19.941461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:19.956819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.957557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:19.958830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:19.959487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.168297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:20.179116 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff129353-34a3-4920-995d-b9f3d2f460d9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.247565 Jul 20 04:47:20.185067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3901/5026] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:19 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:20.191005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.191924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.199116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.199790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.200802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.201454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.365042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:20.374011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03258cb4-2702-4a85-ae83-13f759aafefd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1514 microversion: 2.1 time: 0.187453 Jul 20 04:47:20.375046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3902/5027] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:20.394482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a56fe7f-512b-49cb-b40a-7aa54f347e7b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:20.395888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a56fe7f-512b-49cb-b40a-7aa54f347e7b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: c5bd6023-1b14-4b4b-8c43-9ae172c3e50c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.401516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5a56fe7f-512b-49cb-b40a-7aa54f347e7b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Instance c5bd6023-1b14-4b4b-8c43-9ae172c3e50c could not be found. Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a56fe7f-512b-49cb-b40a-7aa54f347e7b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/c5bd6023-1b14-4b4b-8c43-9ae172c3e50c/action HTTP/1.1 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 14 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: {"rescue": {}} Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c5bd6023-1b14-4b4b-8c43-9ae172c3e50c could not be found. Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c5bd6023-1b14-4b4b-8c43-9ae172c3e50c', 'body': {'rescue': {}}} Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bd6023-1b14-4b4b-8c43-9ae172c3e50c could not be found. Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bd6023-1b14-4b4b-8c43-9ae172c3e50c could not be found. Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.425326 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bd6023-1b14-4b4b-8c43-9ae172c3e50c could not be found. Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a56fe7f-512b-49cb-b40a-7aa54f347e7b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 404 to user: Instance c5bd6023-1b14-4b4b-8c43-9ae172c3e50c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a56fe7f-512b-49cb-b40a-7aa54f347e7b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/c5bd6023-1b14-4b4b-8c43-9ae172c3e50c/action" status: 404 len: 111 microversion: 2.1 time: 0.041454 Jul 20 04:47:20.435989 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3903/5028] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:20 2022] POST /compute/v2.1/servers/c5bd6023-1b14-4b4b-8c43-9ae172c3e50c/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:47:20.440980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:20.442067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.452229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.453499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.455513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.456133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.559746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8efc9895-3294-4c3f-97c7-581dc136366e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action" status: 202 len: 0 microversion: 2.1 time: 0.124747 Jul 20 04:47:20.560918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3904/5029] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:20 2022] POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:47:20.569584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.570354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.579660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.580792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.581669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.582443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.813869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:20.836479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93e1b244-85dd-4808-8575-eb189ea4ae24 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1519 microversion: 2.1 time: 0.271468 Jul 20 04:47:20.838828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3905/5030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:20.869480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:20.871570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:20.891259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:20.897882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.901276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:20.902739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:20.903198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.280711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.290263 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91879e50-9580-46f7-bc44-c6aab2b05d42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.450177 Jul 20 04:47:21.301678 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3906/5031] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:20 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:21.306134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:21.312600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:21.328791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.329714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.330798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.330991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.537507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:21.547482 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1943b3e-d34f-4ad8-b5f7-8daf88b12376 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.253266 Jul 20 04:47:21.560832 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3907/5032] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:21 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:21.659687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-65d0ac54-864c-49c8-b0ad-706aca637ec8 req-ad068ea0-1c6f-46a6-ab76-042c4667d1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1", "tag": "be5bba43-3340-463b-b914-a6d249ef7788"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:21.675425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65d0ac54-864c-49c8-b0ad-706aca637ec8 req-ad068ea0-1c6f-46a6-ab76-042c4667d1a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.675880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65d0ac54-864c-49c8-b0ad-706aca637ec8 req-ad068ea0-1c6f-46a6-ab76-042c4667d1a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.707312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-65d0ac54-864c-49c8-b0ad-706aca637ec8 req-ad068ea0-1c6f-46a6-ab76-042c4667d1a0 service nova] Creating event network-changed:be5bba43-3340-463b-b914-a6d249ef7788 for instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 on n-h1-764486-11 Jul 20 04:47:21.714465 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-65d0ac54-864c-49c8-b0ad-706aca637ec8 req-ad068ea0-1c6f-46a6-ab76-042c4667d1a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059110 Jul 20 04:47:21.715089 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3908/5033] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:21.854619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:21.855338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:21.868698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.869150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:21.869950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:21.870444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.154702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.165656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c024a5a-31cf-42a6-b733-c48b6d1e4393 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1499 microversion: 2.1 time: 0.315167 Jul 20 04:47:22.166249 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3909/5034] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:21 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1499 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:22.185938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:22.187144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.210286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.216483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.218274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.219499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.269036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lazy-loading 'flavor' on Instance uuid 14a885fd-892b-41e3-8c37-23617a6e4b26 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:22.290890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Cannot 'rescue' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state paused Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action HTTP/1.1 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 14 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: {"rescue": {}} Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'rescue' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state paused Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '14a885fd-892b-41e3-8c37-23617a6e4b26', 'body': {'rescue': {}}} Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 in vm_state paused. Cannot rescue while the instance is in this state. Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state paused Jul 20 04:47:22.293624 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state paused Jul 20 04:47:22.298023 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:22.300490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 409 to user: Cannot 'rescue' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state paused {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:22.301699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-209142a0-fc0c-419c-a757-eb4bef5406b6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action" status: 409 len: 144 microversion: 2.1 time: 0.119984 Jul 20 04:47:22.306900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3910/5035] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:22 2022] POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action => generated 144 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:47:22.313690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.315228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.325393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.327772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.329110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.329571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.559102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:22.584222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6deef972-eeba-402e-bbf1-d8155b628731 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.275777 Jul 20 04:47:22.585013 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3911/5036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:22.601788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:22.602825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.613977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.615082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.616546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.618192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.760045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1781594a-f4bd-4c29-8c4b-a80663c404d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action" status: 202 len: 0 microversion: 2.1 time: 0.172776 Jul 20 04:47:22.760747 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3912/5037] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:22 2022] POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:22.774670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:22.775451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:22.789547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.790006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:22.792478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:22.792956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.034880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.051445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce91a683-05e1-4965-99b7-f49e4edd88b2 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.289293 Jul 20 04:47:23.058613 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3913/5038] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:22 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:23.070494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.071145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.080782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.081234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.082034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.082479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.291052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.323680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23767be5-6273-49d8-8039-db3fbe2515a3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1506 microversion: 2.1 time: 0.263635 Jul 20 04:47:23.325929 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3914/5039] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:23.601094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:23.601787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:23.615309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.615918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.616757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:23.618794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:23.870642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:23.880670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da067a1e-e903-4881-873f-958ad0fa1e38 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.283457 Jul 20 04:47:23.881563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3915/5040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:23 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:24.076166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:24.076874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:24.084847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.085811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.087093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.087700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.935731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:24.948846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:24.948846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-915edb6b-991c-4783-aa00-2bdaca7d11f8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.876252 Jul 20 04:47:24.958815 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3916/5041] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:24 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:24.966657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:24.967788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:24.987152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.988068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:24.989569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:24.990381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.274793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:25.286588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3bc4ee47-9153-44fd-8169-eefb2cb166c7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1514 microversion: 2.1 time: 0.326210 Jul 20 04:47:25.287196 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3917/5042] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:24 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:25.297181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.303791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:25.313633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.314871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.315837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:25.316492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:25.317210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:25.354997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:25.701096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:25.723021 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ffa7ed9-4cae-4edd-8316-1205ce9e0821 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.434538 Jul 20 04:47:25.723881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3918/5043] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:25.979220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:25.982366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.012606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.013088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.013912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.014434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.394594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:26.405158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a56dd5b2-bc2c-4609-986f-42233e6c5d1c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.444283 Jul 20 04:47:26.405896 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3919/5044] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:25 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:26.741386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:26.742015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:26.754104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.756176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:26.762715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:26.763345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.259933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.278049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5de30e19-343f-4926-82e1-2b2ce9ae21e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.537943 Jul 20 04:47:27.280858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3920/5045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:26 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:27.424096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:27.424832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:27.437463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.437927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.438866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:27.439784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:27.747810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:27.759585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7ab25380-37e6-4db8-8c8b-afc8a234689b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.341617 Jul 20 04:47:27.761606 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3921/5046] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:27 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:27.987029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a3e606c1-c679-47e2-8b7b-9f902b3bdc86 req-3bd4d72d-88f3-4dbf-a462-123ffcdafeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1", "name": "network-vif-plugged", "status": "completed", "tag": "be5bba43-3340-463b-b914-a6d249ef7788"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:28.008590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a3e606c1-c679-47e2-8b7b-9f902b3bdc86 req-3bd4d72d-88f3-4dbf-a462-123ffcdafeb5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.008590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a3e606c1-c679-47e2-8b7b-9f902b3bdc86 req-3bd4d72d-88f3-4dbf-a462-123ffcdafeb5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.047007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a3e606c1-c679-47e2-8b7b-9f902b3bdc86 req-3bd4d72d-88f3-4dbf-a462-123ffcdafeb5 service nova] Creating event network-vif-plugged:be5bba43-3340-463b-b914-a6d249ef7788 for instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 on n-h1-764486-11 Jul 20 04:47:28.077420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a3e606c1-c679-47e2-8b7b-9f902b3bdc86 req-3bd4d72d-88f3-4dbf-a462-123ffcdafeb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078794 Jul 20 04:47:28.080490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3922/5047] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:28.139110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:28.141293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.157375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.158392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.159216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.159656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.196874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lazy-loading 'flavor' on Instance uuid 14a885fd-892b-41e3-8c37-23617a6e4b26 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:47:28.321638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ada0356-34c0-4dcb-abd9-5f4179eb5229 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action" status: 200 len: 32 microversion: 2.1 time: 0.186888 Jul 20 04:47:28.322726 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3923/5048] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:28 2022] POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:47:28.334246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:28.335208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.348385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.356861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.368088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.371904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.888079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:28.901461 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc19fb2b-3e71-406b-996d-92ca8e3cc549 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.577390 Jul 20 04:47:28.906828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3924/5049] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:28 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:28.923798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:28.926339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:28.940920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.942419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:28.946568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:28.947288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.190772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:29.207223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-898b8868-28fe-4377-8bdd-b5b9c7bb0c18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.295583 Jul 20 04:47:29.208548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3925/5050] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:28 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:29.214912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:29.215771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:29.224337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.225172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.226812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.227484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.834907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:29.850165 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94acfc21-1eda-4e62-b3ae-907e7e831ac0 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1368 microversion: 2.1 time: 0.634578 Jul 20 04:47:29.852864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3926/5051] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:29 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1368 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:29.929518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:29.932221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:29.957853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.959036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:29.963251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:29.965478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.306853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:30.316678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa7919ab-9ecb-4606-b86d-ccb093234f31 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.394513 Jul 20 04:47:30.317828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3927/5052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:29 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:30.323132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.324090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:30.333095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.333817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.334620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.346573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.724085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:30.754292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9717e07-b702-42f0-9d4b-8797fec13021 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.435150 Jul 20 04:47:30.761219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3928/5053] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:30.879175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:30.880008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:30.895716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.897188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:30.898667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:30.899174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.185783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:31.208618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73c78c1b-f95f-4e9c-ac18-e75370ba2dfe tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1558 microversion: 2.1 time: 0.338166 Jul 20 04:47:31.210001 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3929/5054] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:30 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1558 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:31.240699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.241684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:31.260697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.261502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.262570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.263224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.511271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8b3a55c-cf12-4d75-89e3-326c14a38d73 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.288254 Jul 20 04:47:31.518896 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3930/5055] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:31.525496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:31.526394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:31.535673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.536597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.537824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:31.538762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:31.963217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:31.977257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3af38ff5-6ae5-442a-9cbf-4d1ce0151501 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 0.455349 Jul 20 04:47:31.978860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3931/5056] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:32.001983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.002966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:32.022088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.023218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.024249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:32.027187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:32.089459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:32.355895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:32.375506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b555aa64-96c2-42d2-a0ed-b59f746276f8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.384822 Jul 20 04:47:32.380242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3932/5057] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:31 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:32.995077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:32.995743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:33.007637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.011024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:33.012010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:33.012910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.111851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:34.156149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bcc79eb1-4cef-49ec-a485-f79f4052cf93 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1696 microversion: 2.1 time: 1.162579 Jul 20 04:47:34.160044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3933/5058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:32 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1696 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:34.166490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:34.173847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:34.196925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:34.197897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.200770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:34.201887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:34.671787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:34.686186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-143df7b6-0440-4df3-8b14-3e49d87351b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.524321 Jul 20 04:47:34.690326 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3934/5059] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:34 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:35.903936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bba042c1-4e24-42ec-aa77-d3e93e98ad4f req-94cfbf33-3380-480b-b1f0-872e0e25455c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1", "tag": "be5bba43-3340-463b-b914-a6d249ef7788"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:35.942567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bba042c1-4e24-42ec-aa77-d3e93e98ad4f req-94cfbf33-3380-480b-b1f0-872e0e25455c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:35.943652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bba042c1-4e24-42ec-aa77-d3e93e98ad4f req-94cfbf33-3380-480b-b1f0-872e0e25455c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.015473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bba042c1-4e24-42ec-aa77-d3e93e98ad4f req-94cfbf33-3380-480b-b1f0-872e0e25455c service nova] Creating event network-changed:be5bba43-3340-463b-b914-a6d249ef7788 for instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 on n-h1-764486-11 Jul 20 04:47:36.035125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bba042c1-4e24-42ec-aa77-d3e93e98ad4f req-94cfbf33-3380-480b-b1f0-872e0e25455c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.928484 Jul 20 04:47:36.038738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3935/5060] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:36.056466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-858b3c40-2b1b-4c9c-a696-e15771a36e3e req-59ddd203-c2de-4c98-af81-4e37f931e81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "name": "network-vif-unplugged", "status": "completed", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:36.070997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-858b3c40-2b1b-4c9c-a696-e15771a36e3e req-59ddd203-c2de-4c98-af81-4e37f931e81a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.072074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-858b3c40-2b1b-4c9c-a696-e15771a36e3e req-59ddd203-c2de-4c98-af81-4e37f931e81a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.111732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-858b3c40-2b1b-4c9c-a696-e15771a36e3e req-59ddd203-c2de-4c98-af81-4e37f931e81a service nova] Creating event network-vif-unplugged:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h2-764486-11 Jul 20 04:47:36.121900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-858b3c40-2b1b-4c9c-a696-e15771a36e3e req-59ddd203-c2de-4c98-af81-4e37f931e81a service nova] Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:47:36.153848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-858b3c40-2b1b-4c9c-a696-e15771a36e3e req-59ddd203-c2de-4c98-af81-4e37f931e81a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113392 Jul 20 04:47:36.154940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3936/5061] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:36.171643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.172568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.181728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.182505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.183509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.184122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.755417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:36.773157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0cd23933-ac27-42d2-a8bf-50f6d33e94df tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1695 microversion: 2.1 time: 0.606642 Jul 20 04:47:36.773157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3937/5062] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1695 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:36.795640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:36.798268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:36.832309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.832811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:36.833630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:36.834079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.521902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:37.538858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6997ad10-dc5c-4e74-986a-6f69170b2e21 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.764361 Jul 20 04:47:37.539511 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3938/5063] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:36 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:37.791969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:37.793844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:37.826130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.829023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:37.839650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:37.840048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.091717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.102052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e59655ba-35ec-4862-aafc-fb31b8234475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1695 microversion: 2.1 time: 0.320317 Jul 20 04:47:38.103292 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3939/5064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:37 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1695 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:38.245603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e038fb5a-2f85-4b73-a769-608d74c106d2 req-b0f40c62-4a87-4315-aa84-dd960dbe0929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:38.255249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e038fb5a-2f85-4b73-a769-608d74c106d2 req-b0f40c62-4a87-4315-aa84-dd960dbe0929 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.255933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e038fb5a-2f85-4b73-a769-608d74c106d2 req-b0f40c62-4a87-4315-aa84-dd960dbe0929 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.269606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e038fb5a-2f85-4b73-a769-608d74c106d2 req-b0f40c62-4a87-4315-aa84-dd960dbe0929 service nova] Creating event network-changed:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h2-764486-11 Jul 20 04:47:38.314898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-e038fb5a-2f85-4b73-a769-608d74c106d2 req-b0f40c62-4a87-4315-aa84-dd960dbe0929 service nova] Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:47:38.327128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e038fb5a-2f85-4b73-a769-608d74c106d2 req-b0f40c62-4a87-4315-aa84-dd960dbe0929 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085279 Jul 20 04:47:38.327916 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3940/5065] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:38.557752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:38.558703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:38.572876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.580336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.589668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:38.590417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:38.921907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:38.937097 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ae11816-00b5-452f-8b0a-10d471fce178 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.384209 Jul 20 04:47:38.938942 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3941/5066] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:38 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:39.130557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.132020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.153939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.159305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.168298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.171561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.413893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:39.422567 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8064d68-44f3-45aa-b0d1-c569b971b486 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1695 microversion: 2.1 time: 0.302503 Jul 20 04:47:39.423185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3942/5067] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1695 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:39.956128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:39.957085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:39.979708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.987581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:39.988427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:39.989461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.757733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:40.766902 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-183668d6-459f-46aa-b178-e5a776612b8a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.814643 Jul 20 04:47:40.778089 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3943/5068] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:39 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:40.781091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:40.781561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:40.794896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.795271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:40.796170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:40.796586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.254889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:41.265181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2dc49c18-d766-4bbb-8542-945f97646f0d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1693 microversion: 2.1 time: 0.495502 Jul 20 04:47:41.267296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3944/5069] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:40 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1693 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:41.785240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:41.785863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:41.810065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.810545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:41.811408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:41.811849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.070407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:42.080565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d59b897a-d3a2-40d3-b69f-42aaa49df4b4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.300173 Jul 20 04:47:42.082588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3945/5070] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:41 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:42.286305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:42.287676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.302173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.302629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.303427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.303864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.574695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:42.586227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1baaa304-15a7-4d17-a52a-6db24b77db21 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1690 microversion: 2.1 time: 0.304078 Jul 20 04:47:42.587842 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3946/5071] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:42 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1690 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:42.604188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:42.605068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.625639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.626296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.627317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.627919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.831718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3c068bf-4978-416c-91d8-e8241b9a5c03 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action" status: 202 len: 0 microversion: 2.1 time: 0.230720 Jul 20 04:47:42.836228 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3947/5072] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:42 2022] POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:42.845090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:42.845769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:42.855684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.856441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.857969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:42.858906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:42.946459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:43.270673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:43.282424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2230cf3-7eb3-4649-ac75-44f954631830 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.442044 Jul 20 04:47:43.283824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3948/5073] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:42 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:43.289314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.290666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.300835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.306990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.307558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.310581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.586590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:43.597408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-90691af1-8a3d-4698-af8d-49797fc7bbf9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1500 microversion: 2.1 time: 0.311935 Jul 20 04:47:43.609179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3949/5074] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1500 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:43.617031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0378052f-e6b2-40a7-b774-2baa14976ad5"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:43.619673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.628176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.629979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.631049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.632478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.708592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Cannot 'attach_volume' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state rescued Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/os-volume_attachments HTTP/1.1 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 74 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: {"volumeAttachment": {"volumeId": "0378052f-e6b2-40a7-b774-2baa14976ad5"}} Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'attach_volume' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state rescued Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '14a885fd-892b-41e3-8c37-23617a6e4b26', 'body': {'volumeAttachment': {'volumeId': '0378052f-e6b2-40a7-b774-2baa14976ad5'}}} Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 04:47:43.710833 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state rescued Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state rescued Jul 20 04:47:43.716204 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:47:43.720445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 409 to user: Cannot 'attach_volume' instance 14a885fd-892b-41e3-8c37-23617a6e4b26 while it is in vm_state rescued {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:47:43.721842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d61058a3-40a7-4d17-bb86-4883c2b4c9b7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.110183 Jul 20 04:47:43.728772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3950/5075] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:47:43 2022] POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/os-volume_attachments => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:47:43.753222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:43.753849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:43.765735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.766250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.767071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:43.767525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:43.964290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f9ef865-280d-41bb-a86c-280bfff94bff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action" status: 202 len: 0 microversion: 2.1 time: 0.233116 Jul 20 04:47:43.969184 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3951/5076] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:47:43 2022] POST /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:47:43.993755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:43.994643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.006507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.010172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.014218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.024469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.542720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:44.554615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e1aa3216-1ba3-41d2-a1ef-484d6be5a465 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1508 microversion: 2.1 time: 0.575115 Jul 20 04:47:44.556293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3952/5077] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:43 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1508 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:44.571786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:44.572694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:44.587248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.587865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:44.588790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:44.589496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.110833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.137222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e1f4694-45a6-4ad1-80a4-afcfa08fe571 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.576535 Jul 20 04:47:45.144975 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3953/5078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:44 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:45.577087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:45.578360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:45.585296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:45.596249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.601297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.602504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:45.605078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:45.860373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:45.869906 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e218ab99-bf37-4ac4-9329-d8583e87c8b3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1508 microversion: 2.1 time: 0.299544 Jul 20 04:47:45.898519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3954/5079] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:45 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:46.101355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d05f68fb-a49d-4776-ba5b-ee3eb317bd87 req-28ba218a-fdde-4c6a-a297-c76ce9479da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "name": "network-vif-plugged", "status": "completed", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:46.145187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d05f68fb-a49d-4776-ba5b-ee3eb317bd87 req-28ba218a-fdde-4c6a-a297-c76ce9479da8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.145711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d05f68fb-a49d-4776-ba5b-ee3eb317bd87 req-28ba218a-fdde-4c6a-a297-c76ce9479da8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.167876 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d05f68fb-a49d-4776-ba5b-ee3eb317bd87 req-28ba218a-fdde-4c6a-a297-c76ce9479da8 service nova] Creating event network-vif-plugged:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h2-764486-11 Jul 20 04:47:46.177489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-d05f68fb-a49d-4776-ba5b-ee3eb317bd87 req-28ba218a-fdde-4c6a-a297-c76ce9479da8 service nova] Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:47:46.194208 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d05f68fb-a49d-4776-ba5b-ee3eb317bd87 req-28ba218a-fdde-4c6a-a297-c76ce9479da8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095235 Jul 20 04:47:46.196956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3955/5080] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:46.204535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.210580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.243657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.244282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.245150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.246993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.604111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:46.614402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-debfc8ea-969a-457d-bc15-209a5b531cd0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.416131 Jul 20 04:47:46.615439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3956/5081] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:46.899873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:46.900526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:46.939286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.953126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:46.954333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:46.956900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.460336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:47.472873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e45c79b6-9dce-440a-b9a0-943257966a18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1508 microversion: 2.1 time: 0.582372 Jul 20 04:47:47.483243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3957/5082] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:46 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1508 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:47.632220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:47.633050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:47.641496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.641975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:47.642767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:47.651134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.065672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:48.085203 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f181368-4257-4cf8-8545-a984d21ed463 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.446451 Jul 20 04:47:48.088804 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3958/5083] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:47 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:48.492344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:48.492978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:48.507191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.508020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.520997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:48.522014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:48.961604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:48.977020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5aa90c11-1726-4578-838e-a6c2a233bdb4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1514 microversion: 2.1 time: 0.488840 Jul 20 04:47:48.977940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3959/5084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:48 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1514 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:49.102810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:49.103429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:49.122459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.123174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.124117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:49.124769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:49.516887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:49.526122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4005bc78-2668-4c04-960b-fb18567d1c96 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.426676 Jul 20 04:47:49.538896 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3960/5085] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:49 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:51.322933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:51.338563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:51.422943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.453537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:51.474476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:51.481758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.340578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:52.359942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18978a32-5ca6-461d-84f6-5c2ce3cb060f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 1.814707 Jul 20 04:47:52.361821 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3961/5086] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:50 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:52.375873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4f09e378-e741-4f52-8b1d-3b9b2a06ca26 req-25a3af66-c482-4e8a-b473-bc03a4013828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "name": "network-vif-unplugged", "status": "completed", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:52.395602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f09e378-e741-4f52-8b1d-3b9b2a06ca26 req-25a3af66-c482-4e8a-b473-bc03a4013828 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:52.398055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4f09e378-e741-4f52-8b1d-3b9b2a06ca26 req-25a3af66-c482-4e8a-b473-bc03a4013828 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:52.453896 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4f09e378-e741-4f52-8b1d-3b9b2a06ca26 req-25a3af66-c482-4e8a-b473-bc03a4013828 service nova] Creating event network-vif-unplugged:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:47:52.466680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-4f09e378-e741-4f52-8b1d-3b9b2a06ca26 req-25a3af66-c482-4e8a-b473-bc03a4013828 service nova] Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:47:52.504754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4f09e378-e741-4f52-8b1d-3b9b2a06ca26 req-25a3af66-c482-4e8a-b473-bc03a4013828 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140945 Jul 20 04:47:52.522471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3962/5087] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:53.074721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78fed81e-19c1-4381-aa1b-8868175d77c6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'create', calling method: .version_select at 0x7f838aecf5e0>, body: {"keypair": {"name": "tempest-keypair-1635629475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWch0rzX5wzxcPI/0Z+MxhEJJv1Nz/VykgXdBawXx6dKhnMI2BbganZrWm62ib15oWvDQreHfjd1cIsnTK/gG3CPf/TVNBpBqc0dxrvz+xA3dxJPvMej2vWfti9xIuuOw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:53.115485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-78fed81e-19c1-4381-aa1b-8868175d77c6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:47:53.121548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-78fed81e-19c1-4381-aa1b-8868175d77c6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for user 73721f6e36eb487589dcb980b6fdb483 and project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:47:53.197148 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78fed81e-19c1-4381-aa1b-8868175d77c6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129629 Jul 20 04:47:53.206870 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3963/5088] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:47:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:47:53.388666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:53.389785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:53.411261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.412153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:53.413851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:53.416988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:54.386068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:54.398064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37a420ea-e3e4-4c32-8f39-20ae618421da tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 1.023259 Jul 20 04:47:54.398696 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3964/5089] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:53 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:55.209019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5f0442ff-4c4a-4d6e-b1e3-60918466e0c4 req-3ce9aa56-0f80-4a11-9c91-c66f1f8a935a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:47:55.229032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f0442ff-4c4a-4d6e-b1e3-60918466e0c4 req-3ce9aa56-0f80-4a11-9c91-c66f1f8a935a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.229674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5f0442ff-4c4a-4d6e-b1e3-60918466e0c4 req-3ce9aa56-0f80-4a11-9c91-c66f1f8a935a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.273068 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5f0442ff-4c4a-4d6e-b1e3-60918466e0c4 req-3ce9aa56-0f80-4a11-9c91-c66f1f8a935a service nova] Creating event network-changed:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:47:55.295335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-5f0442ff-4c4a-4d6e-b1e3-60918466e0c4 req-3ce9aa56-0f80-4a11-9c91-c66f1f8a935a service nova] Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 04:47:55.316181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5f0442ff-4c4a-4d6e-b1e3-60918466e0c4 req-3ce9aa56-0f80-4a11-9c91-c66f1f8a935a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116341 Jul 20 04:47:55.317469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3965/5090] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:47:55.423423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:55.425057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:55.524950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.525412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.535452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:55.536019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:55.575683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:47:56.316518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:56.326761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e9813af-0c9c-4e43-a8c0-d758307c1ebc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.912852 Jul 20 04:47:56.333042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3966/5091] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:55 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:47:57.347678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:57.348296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:57.367361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.368091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:57.369081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:57.370224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:58.237873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:47:58.253686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78c57ec4-bb1e-4829-b3c3-2b0bf0449e3a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 0.909652 Jul 20 04:47:58.255751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3967/5092] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:57 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:47:59.277456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:47:59.286522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:47:59.300709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.301435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:47:59.302636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:47:59.303310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:00.284290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:00.301656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-336ee02c-73c9-4c44-9009-f1245606668f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1689 microversion: 2.1 time: 1.033862 Jul 20 04:48:00.302873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3968/5093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:47:59 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1689 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:00.468273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-499056008", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7105edda-7f29-49ca-b9e2-2120458e40fc"}], "security_groups": [{"name": "tempest-securitygroup--1670888384"}], "key_name": "tempest-keypair-1635629475", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:01.282132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] validate_networks() for [('7105edda-7f29-49ca-b9e2-2120458e40fc', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:48:02.597569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:48:02.598829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:48:02.599537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:48:02.600121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:48:02.600765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:48:02.631220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.631959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.633155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.633772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.659489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:02.667223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Getting quotas for user 73721f6e36eb487589dcb980b6fdb483 and project c4967ab029fe43318dcfe66a43c49cc7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:02.686645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:48:02.689983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:48:02.797805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c6bb471-ed9d-4701-83c5-85ac1958f03f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.334821 Jul 20 04:48:02.798969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3969/5094] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:48:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:48:02.804127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:02.805026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:02.818969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.822395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:02.823778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:02.824529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.793068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:03.818380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56d757ed-dbe2-465f-a67f-8dbf4edd3cab tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1682 microversion: 2.1 time: 1.018163 Jul 20 04:48:03.818985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3970/5095] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:02 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1682 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:03.833890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:03.840488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:03.860825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.863027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:03.866861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:03.867329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.123137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:04.137228 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d519bfa-e70d-4b6c-b075-0e9fb1c64644 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1249 microversion: 2.1 time: 0.307524 Jul 20 04:48:04.145132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3971/5096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:03 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1249 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:04.462381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-53509a52-c1d3-4482-8d05-e116f47a9b10 req-5e71dd4a-d072-466c-a78d-330ddec2cc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "name": "network-vif-plugged", "status": "completed", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:04.479597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-53509a52-c1d3-4482-8d05-e116f47a9b10 req-5e71dd4a-d072-466c-a78d-330ddec2cc56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:04.480512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-53509a52-c1d3-4482-8d05-e116f47a9b10 req-5e71dd4a-d072-466c-a78d-330ddec2cc56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:04.507683 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-53509a52-c1d3-4482-8d05-e116f47a9b10 req-5e71dd4a-d072-466c-a78d-330ddec2cc56 service nova] Creating event network-vif-plugged:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:48:04.524173 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-53509a52-c1d3-4482-8d05-e116f47a9b10 req-5e71dd4a-d072-466c-a78d-330ddec2cc56 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065918 Jul 20 04:48:04.527213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3972/5097] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:05.156107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:05.156830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:05.173831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.175081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.187905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:05.212182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:05.559071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:05.568160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c75632eb-231e-4471-9989-167a613f916c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1303 microversion: 2.1 time: 0.417477 Jul 20 04:48:05.569337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3973/5098] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:05 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1303 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:06.586255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:06.587693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:06.610823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.611546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:06.616782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:06.619342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:07.085965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:07.100538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0a5efe1-d7e0-429a-ad5b-ccbf20e5d07f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.518023 Jul 20 04:48:07.115382 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3974/5099] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:06 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:08.125126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:08.126843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:08.136627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.137391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.140512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.141923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.752707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:08.773954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f939290b-261d-4daa-b59a-5c06a1f23603 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.654724 Jul 20 04:48:08.785465 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3975/5100] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:08 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:08.792148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ee11b7d6-3f24-4de1-a7a8-59b859666850 req-bb7dbfdf-a707-4a22-a9ba-f482f853c4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ff2e60-9699-4e9f-8048-ca7da01d4d0d", "tag": "2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:08.804145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ee11b7d6-3f24-4de1-a7a8-59b859666850 req-bb7dbfdf-a707-4a22-a9ba-f482f853c4bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:08.804819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ee11b7d6-3f24-4de1-a7a8-59b859666850 req-bb7dbfdf-a707-4a22-a9ba-f482f853c4bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:08.820398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ee11b7d6-3f24-4de1-a7a8-59b859666850 req-bb7dbfdf-a707-4a22-a9ba-f482f853c4bc service nova] Creating event network-changed:2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e for instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d on n-h2-764486-11 Jul 20 04:48:08.827149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ee11b7d6-3f24-4de1-a7a8-59b859666850 req-bb7dbfdf-a707-4a22-a9ba-f482f853c4bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039543 Jul 20 04:48:08.828800 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3976/5101] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:09.794907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:09.797396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:09.806343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.807089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:09.808021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:09.808701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.144395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:10.154895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2846d044-5c9c-491e-b22d-85578c960e32 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.366821 Jul 20 04:48:10.171847 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3977/5102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:09 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:10.477944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:10.479022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:10.509603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.510217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.511151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:10.511614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:10.645513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-774a91de-2c4e-4e06-90b6-b8b1dd232124 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/ips" status: 200 len: 150 microversion: 2.1 time: 0.171399 Jul 20 04:48:10.651460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3978/5103] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:48:10 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/ips => generated 150 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:11.181917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:11.190013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:11.219902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.288281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.069s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.292614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:11.297872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:11.822356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:11.849002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3660783f-3878-4c23-b729-5fab4c07f5b1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.675035 Jul 20 04:48:11.851044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3979/5104] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:11 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:12.875728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:12.876529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:12.895388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:12.901163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:12.907687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.913208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:12.915795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:12.918057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:13.416627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:13.443372 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bdf70346-3623-4e8a-ac0b-a03e79a5cd01 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.574474 Jul 20 04:48:13.454931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3980/5105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:12 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:14.464724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:14.465502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.526677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.527898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.529591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.531824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.892504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:14.911464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a01442a-847c-4dab-b933-75a7deae4d16 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.449481 Jul 20 04:48:14.916106 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3981/5106] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:14 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:14.934363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6321cb04-1818-4fc0-ae6d-c555b0e0871e"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:14.938442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:14.960240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.961011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:14.962008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:14.962617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.474104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f4089d4-2530-42ec-9e8a-eb1791e429fa tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "POST /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544565 Jul 20 04:48:15.475106 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3982/5107] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:48:14 2022] POST /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:15.934287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:15.935172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:15.938069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:15.967188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.975809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:15.981714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:15.983891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.326354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:16.334834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53eebec8-c414-4d5d-8a68-731ee5156071 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.404703 Jul 20 04:48:16.344805 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3983/5108] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:15 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:16.409383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-81971218-b900-409a-817e-c0d2399d0f1d req-16397962-915c-4614-aa07-8dec192ca565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ff2e60-9699-4e9f-8048-ca7da01d4d0d", "name": "network-vif-plugged", "status": "completed", "tag": "2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:16.429064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-81971218-b900-409a-817e-c0d2399d0f1d req-16397962-915c-4614-aa07-8dec192ca565 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:16.441007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-81971218-b900-409a-817e-c0d2399d0f1d req-16397962-915c-4614-aa07-8dec192ca565 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:16.477222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:16.480418 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-81971218-b900-409a-817e-c0d2399d0f1d req-16397962-915c-4614-aa07-8dec192ca565 service nova] Creating event network-vif-plugged:2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e for instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d on n-h2-764486-11 Jul 20 04:48:16.500290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-81971218-b900-409a-817e-c0d2399d0f1d req-16397962-915c-4614-aa07-8dec192ca565 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095396 Jul 20 04:48:16.501322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3984/5109] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:17.380825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:17.381866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:17.404437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.405094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.406053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:17.406618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:17.733787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:17.755993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-427a75b0-d205-4896-8ebc-b75158ca6f93 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1371 microversion: 2.1 time: 0.384951 Jul 20 04:48:17.761411 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3985/5110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:17 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:18.779154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:18.781570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:18.802111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.803290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:18.804385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:18.806205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.107451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:19.117507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88b85eae-f520-49ab-b6a7-d3edb9b99387 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1564 microversion: 2.1 time: 0.343473 Jul 20 04:48:19.118673 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3986/5111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:18 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1564 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:19.144426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:19.148694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:19.168324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.168873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.169721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:19.170168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:19.873037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-110d02e2-3207-49ee-ac3c-d9a8c2774a77 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.737259 Jul 20 04:48:19.880076 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3987/5112] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:48:19 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-interface => generated 284 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:22.413714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-568e5bfb-bfda-46a4-919a-4057c84d9ae9 req-0a2c4a89-35f2-44df-82d6-489ca95ae74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ff2e60-9699-4e9f-8048-ca7da01d4d0d", "tag": "2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:22.421524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-568e5bfb-bfda-46a4-919a-4057c84d9ae9 req-0a2c4a89-35f2-44df-82d6-489ca95ae74d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:22.421984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-568e5bfb-bfda-46a4-919a-4057c84d9ae9 req-0a2c4a89-35f2-44df-82d6-489ca95ae74d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:22.467471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-568e5bfb-bfda-46a4-919a-4057c84d9ae9 req-0a2c4a89-35f2-44df-82d6-489ca95ae74d service nova] Creating event network-changed:2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e for instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d on n-h2-764486-11 Jul 20 04:48:22.478630 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-568e5bfb-bfda-46a4-919a-4057c84d9ae9 req-0a2c4a89-35f2-44df-82d6-489ca95ae74d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075397 Jul 20 04:48:22.479607 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3988/5113] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:28.352239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:28.353489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:28.384913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.385376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.393900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:28.394558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:28.477558 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee11bf3b-78e3-44c9-b78e-5611e0f61a9d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action" status: 200 len: 63192 microversion: 2.1 time: 0.134141 Jul 20 04:48:28.485949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3989/5114] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:48:28 2022] POST /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c/action => generated 63192 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:48:35.191536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.193492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.227107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.228025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.230969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.235336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.725413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6e7301e-01b3-4f5e-9205-aa109da03b4f tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1835 microversion: 2.1 time: 0.940997 Jul 20 04:48:35.727297 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3990/5115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:34 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1835 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:35.765774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:35.766405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:35.793838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.794970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:35.796843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:35.797517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.042842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lazy-loading 'services' on Instance uuid 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:36.251662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef3d3fc3-380c-4f56-a336-c4801e2ed079 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments/6321cb04-1818-4fc0-ae6d-c555b0e0871e" status: 202 len: 0 microversion: 2.1 time: 0.522822 Jul 20 04:48:36.255720 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3991/5116] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:48:35 2022] DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments/6321cb04-1818-4fc0-ae6d-c555b0e0871e => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:36.297753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:36.305748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:36.320611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:36.321590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.322819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:36.323908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:36.401340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa51c984-d4f9-4d3f-a8a9-f2890f5b3f46 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137955 Jul 20 04:48:36.403895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3992/5117] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:36 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:37.415009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:37.415964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:37.430728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.430728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.432624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.433097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.533606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61399d7d-22b5-4f75-92bb-c3a12f7c299f tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122858 Jul 20 04:48:37.540447 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3993/5118] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:37 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:37.595123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:37.595628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:37.603172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.603630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.619806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:37.620809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:37.822142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lazy-loading 'services' on Instance uuid 56b46041-216c-43f9-a83f-0ae4f42e1dec {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:37.958898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe49c12a-b1bb-40d0-ba97-f90cd55d665a tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec/os-volume_attachments/0041ce36-7ece-4866-b67d-875c022928fd" status: 202 len: 0 microversion: 2.1 time: 0.367455 Jul 20 04:48:37.959512 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3994/5119] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:48:37 2022] DELETE /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec/os-volume_attachments/0041ce36-7ece-4866-b67d-875c022928fd => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:48:38.552646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:38.556017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:38.579466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.580101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.582588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:38.585015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:38.682473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e07823c-a529-4549-b4f6-8f052b312e65 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139263 Jul 20 04:48:38.683820 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3995/5120] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:38 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:39.324705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:39.325213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:39.335040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.335508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.336306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.344907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.401843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:39.568947 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f44350a2-f0a9-4452-b84e-7ef4928f51cb tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 204 len: 0 microversion: 2.1 time: 0.247673 Jul 20 04:48:39.571067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3996/5121] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:39 2022] DELETE /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:48:39.578678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-76d814d0-beca-4d57-8771-4b81867851a1 req-004bcb8f-5d94-4cec-a379-647e7647b146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:39.589030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76d814d0-beca-4d57-8771-4b81867851a1 req-004bcb8f-5d94-4cec-a379-647e7647b146 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.589731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-76d814d0-beca-4d57-8771-4b81867851a1 req-004bcb8f-5d94-4cec-a379-647e7647b146 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.605513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-76d814d0-beca-4d57-8771-4b81867851a1 req-004bcb8f-5d94-4cec-a379-647e7647b146 service nova] Creating event network-changed:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:48:39.611895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-76d814d0-beca-4d57-8771-4b81867851a1 req-004bcb8f-5d94-4cec-a379-647e7647b146 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038717 Jul 20 04:48:39.614279 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3997/5122] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:39.620120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:39.621160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:39.628605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.629540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:39.630517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:39.631377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:40.057408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:40.067767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58489d7e-4603-48b4-bda5-704d31a6db3f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1688 microversion: 2.1 time: 0.451995 Jul 20 04:48:40.068391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3998/5123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:39 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1688 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:40.079480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:40.080679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:40.104415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:40.104916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:40.105718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:40.107408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:40.188803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5866acc-07a8-4ebd-acfe-cb16c3e4c71e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115262 Jul 20 04:48:40.189427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 3999/5124] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:40 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:41.088072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:41.088866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:41.105975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.107385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.116325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.118193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.177530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:41.581124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:41.593376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-718fdad8-b2d2-4abc-a863-98ff080e2602 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1688 microversion: 2.1 time: 0.511196 Jul 20 04:48:41.602850 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4000/5125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:41 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1688 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:41.611961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:41.613204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:41.634964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.635440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.638929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:41.639414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:41.720522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23481ff0-11d6-4b21-af21-af89724bcf25 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116399 Jul 20 04:48:41.721125 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4001/5126] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:41 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:42.611655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:42.613235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:42.626444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.631227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.632331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.634203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.761068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:42.776237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2543a5c2-6683-4bdd-99c9-9f5ebfce65a6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 200 len: 1501 microversion: 2.1 time: 0.169144 Jul 20 04:48:42.777328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4002/5127] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:42 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:42.782234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:42.783462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:42.794790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.797060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.800055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.801577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.848503 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b36b8c84-a8e9-4cf7-abd8-8ed0eb157f74 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069660 Jul 20 04:48:42.849608 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4003/5128] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:42 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:42.894121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-398c3e0d-d5d2-41bf-9e4e-7874bcd4c10b req-c851d004-dd37-4d96-a6b7-3183bf09ee01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1e040d-7920-4b61-a3a4-29c2942e4d9c", "name": "network-vif-deleted", "tag": "81def010-5530-4820-8e61-437643567eb8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:42.905702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-398c3e0d-d5d2-41bf-9e4e-7874bcd4c10b req-c851d004-dd37-4d96-a6b7-3183bf09ee01 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:42.906471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-398c3e0d-d5d2-41bf-9e4e-7874bcd4c10b req-c851d004-dd37-4d96-a6b7-3183bf09ee01 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:42.932289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-398c3e0d-d5d2-41bf-9e4e-7874bcd4c10b req-c851d004-dd37-4d96-a6b7-3183bf09ee01 service nova] Creating event network-vif-deleted:81def010-5530-4820-8e61-437643567eb8 for instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c on n-h1-764486-11 Jul 20 04:48:42.942051 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-398c3e0d-d5d2-41bf-9e4e-7874bcd4c10b req-c851d004-dd37-4d96-a6b7-3183bf09ee01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052545 Jul 20 04:48:42.943393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4004/5129] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:43.799046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:43.799771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 6d1e040d-7920-4b61-a3a4-29c2942e4d9c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:43.811875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.813344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.814853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.816173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.842618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] HTTP exception thrown: Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c could not be found. Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Request method failure captured: Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c HTTP/1.1 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fI2Uh8hfePvQFFsiRzC6qxuFXUX_Nvp02KeELtffh0P8y4-57vVIl5ikMVI-at6ye2zsDygciR3mr85j9TebUbVoKnux68Noznm8g9bGnPl-bwhixs6BGDl1W9jBTLbJP9ahHfTb9KKjPO29WpKos-QPKy1_8lT0lgjQI0SEO7CV0 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d198cfbd38c74919a0c171774b8af43a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e13752abfe1a4708aaf68736ff893649 Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c could not be found. Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '6d1e040d-7920-4b61-a3a4-29c2942e4d9c'} Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c could not be found. Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c could not be found. Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:43.845276 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c could not be found. Jul 20 04:48:43.850130 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:43.852057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Returning 404 to user: Instance 6d1e040d-7920-4b61-a3a4-29c2942e4d9c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:43.853137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6960657e-4135-47e3-98e5-42eff0d2cf32 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c" status: 404 len: 111 microversion: 2.1 time: 0.062343 Jul 20 04:48:43.854193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4005/5130] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:43 2022] GET /compute/v2.1/servers/6d1e040d-7920-4b61-a3a4-29c2942e4d9c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:43.864596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:43.865775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:43.875416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.876152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.877171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:43.881624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:43.935180 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dadb8f0a-2bc0-4686-9778-ffb16f6fa68b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075028 Jul 20 04:48:43.935980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4006/5131] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:48:43 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 04:48:44.954783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:44.955432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:44.975468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.976918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:44.978000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:44.978452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.027703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:45.251352 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7af2b201-c532-4b40-8b98-208a822da854 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 204 len: 0 microversion: 2.1 time: 0.301430 Jul 20 04:48:45.252936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4007/5132] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:44 2022] DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:48:45.266515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:45.267468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:45.278282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:45.278990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.281538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:45.282518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:45.777817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:45.812288 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49d1a709-a81d-4d0c-a932-c0bcc311030e tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1683 microversion: 2.1 time: 0.554838 Jul 20 04:48:45.816745 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4008/5133] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:45 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1683 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:46.835271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:46.836022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:46.839870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:46.877370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.877945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:46.879169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:46.879899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:47.383325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:47.401940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd2f92db-e0f5-4f79-89af-682cb598a80d tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1683 microversion: 2.1 time: 0.572068 Jul 20 04:48:47.406700 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4009/5134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:46 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1683 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:48.425529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:48.427006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:48.445197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.447374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.449686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:48.450268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:48.622315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:48.634885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8347d745-8a82-4128-a6db-54dcfed21eae tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1615 microversion: 2.1 time: 0.212361 Jul 20 04:48:48.638173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4010/5135] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:48 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1615 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:49.703253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:49.719919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:49.815800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.815800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:49.816738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:49.817188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.078555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfdec296862948fc8e2b3c266a47b20f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d65f2a08545209d516d67b288bb97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:50.097588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97a7ee53-1a03-48be-ae0a-b98b38d793da tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 200 len: 1327 microversion: 2.1 time: 0.443131 Jul 20 04:48:50.098199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4011/5136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:49 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 1327 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:50.111525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2dc9bb9b-dcea-4afa-a313-46fddc4c089a req-389780d8-51af-418b-9ef4-ae1a788b3d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1", "name": "network-vif-deleted", "tag": "be5bba43-3340-463b-b914-a6d249ef7788"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:50.135557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2dc9bb9b-dcea-4afa-a313-46fddc4c089a req-389780d8-51af-418b-9ef4-ae1a788b3d4b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:50.136021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2dc9bb9b-dcea-4afa-a313-46fddc4c089a req-389780d8-51af-418b-9ef4-ae1a788b3d4b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:50.162531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2dc9bb9b-dcea-4afa-a313-46fddc4c089a req-389780d8-51af-418b-9ef4-ae1a788b3d4b service nova] Creating event network-vif-deleted:be5bba43-3340-463b-b914-a6d249ef7788 for instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 on n-h1-764486-11 Jul 20 04:48:50.168590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2dc9bb9b-dcea-4afa-a313-46fddc4c089a req-389780d8-51af-418b-9ef4-ae1a788b3d4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068658 Jul 20 04:48:50.170163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4012/5137] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:48:51.115587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:51.116301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:51.126286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.126741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.127546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:51.128001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:51.188381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 HTTP/1.1 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1'} Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:48:51.190127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21533e50-4dc6-43a2-8ae6-464f7b83a8b8 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 404 len: 111 microversion: 2.1 time: 0.081183 Jul 20 04:48:51.195692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4013/5138] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:51 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:48:51.203771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50fd7f64-f95e-4599-936e-3c61e89fb6e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '.version_select at 0x7f838a98d670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:51.249795 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50fd7f64-f95e-4599-936e-3c61e89fb6e9 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584471877" status: 202 len: 0 microversion: 2.1 time: 0.053093 Jul 20 04:48:51.252331 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4014/5139] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584471877 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:51.374098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccf29ef4-7c27-4080-a872-0031ace44a6a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '.version_select at 0x7f8398142790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:51.425635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccf29ef4-7c27-4080-a872-0031ace44a6a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-928607689" status: 202 len: 0 microversion: 2.1 time: 0.056267 Jul 20 04:48:51.426596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4015/5140] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 04:48:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-928607689 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:48:51.471147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fddfdf1-ca84-41e3-a1ad-64e4a0594059 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: .version_select at 0x7f838a0ba310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-917123172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEz1Vs2TiaPMwdSeW3Kbo31RnF3yzKu9vR2zbRuYolAaExsjeo3O0HxzjJw8JsLWTyBrEZa0t+RF2sC1jeT71R1pJt5xVaMtPFGy+aob9/UFNz1vfMS3FWg8reZGica2Q=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:51.519837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7fddfdf1-ca84-41e3-a1ad-64e4a0594059 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:48:51.535292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7fddfdf1-ca84-41e3-a1ad-64e4a0594059 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:48:51.599547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fddfdf1-ca84-41e3-a1ad-64e4a0594059 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.132388 Jul 20 04:48:51.600508 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4016/5141] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:48:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:52.639496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.640239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:52.648094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.648776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.649773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.650334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.735467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:48:52.951311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81baa58b-f23c-4a34-bb56-e7c29659de65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "DELETE /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 204 len: 0 microversion: 2.1 time: 0.322972 Jul 20 04:48:52.955126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4017/5142] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:48:52 2022] DELETE /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:48:52.967861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:52.969029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:52.979415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.980432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:52.985728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:52.986515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:53.552197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:53.565401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-045b864d-1113-4a60-b3c4-d550becc0d65 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1469 microversion: 2.1 time: 0.603639 Jul 20 04:48:53.566019 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4018/5143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:52 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:54.586355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:54.586880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:54.604872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.605663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.607166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:54.607597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:54.704114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:48:56.221161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:56.246014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccc6b8de-2876-4af2-ad60-a62975b07120 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1469 microversion: 2.1 time: 1.666297 Jul 20 04:48:56.255226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4019/5144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:54 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1469 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:57.270278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:57.271670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:57.300553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.301004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:57.318324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:57.319215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.038785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:58.050537 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d59facaf-4eb4-4ec3-b12c-6775fc5f847e tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1469 microversion: 2.1 time: 0.784786 Jul 20 04:48:58.055469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4020/5145] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:57 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1469 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:48:58.582490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e0679393-a3f6-4273-a88c-9fe15e7235aa req-b97d8c77-c0eb-4367-8c6d-52b3418b436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b46041-216c-43f9-a83f-0ae4f42e1dec", "name": "network-vif-deleted", "tag": "fdae72f7-70ef-46fc-8905-a1c1298b715a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:58.603532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e0679393-a3f6-4273-a88c-9fe15e7235aa req-b97d8c77-c0eb-4367-8c6d-52b3418b436a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:58.610532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e0679393-a3f6-4273-a88c-9fe15e7235aa req-b97d8c77-c0eb-4367-8c6d-52b3418b436a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:58.638954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e0679393-a3f6-4273-a88c-9fe15e7235aa req-b97d8c77-c0eb-4367-8c6d-52b3418b436a service nova] Creating event network-vif-deleted:fdae72f7-70ef-46fc-8905-a1c1298b715a for instance 56b46041-216c-43f9-a83f-0ae4f42e1dec on n-h2-764486-11 Jul 20 04:48:58.662616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e0679393-a3f6-4273-a88c-9fe15e7235aa req-b97d8c77-c0eb-4367-8c6d-52b3418b436a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081985 Jul 20 04:48:58.665850 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4021/5146] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:48:59.076761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:48:59.077353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.098892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.099403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.110110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.118688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.298785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.301637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.305682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lazy-loading 'fault' on Instance uuid 56b46041-216c-43f9-a83f-0ae4f42e1dec {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:48:59.483583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d347a64164207bfc3e34a98db5de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082838812f48442c9f4fc87fd2c61a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:48:59.508137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-629fa604-e88e-4670-9860-3244edc13760 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 200 len: 1303 microversion: 2.1 time: 0.439762 Jul 20 04:48:59.513451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4022/5147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:48:59 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 1303 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:48:59.542666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "369afa0a-7cc4-4b9a-a708-c6637ee9d02e"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:48:59.559853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:48:59.618979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.623225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:48:59.624164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:48:59.626730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.424384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-780d958d-6354-40f3-ba60-2474266000ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905099 Jul 20 04:49:00.426466 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4023/5148] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 04:48:59 2022] POST /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:00.530915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:00.531628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] [instance: 56b46041-216c-43f9-a83f-0ae4f42e1dec] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:00.553990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.554483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.555326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:00.560017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:00.614722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] HTTP exception thrown: Instance 56b46041-216c-43f9-a83f-0ae4f42e1dec could not be found. Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Request method failure captured: Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec HTTP/1.1 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14iUroSuxx7OxQBQHjflMgTV1J1ggaBjJDDV1sana8PpBd3_OocT5gf82dJvq8FzV-EMurCRd81VACUf5WKDorHen1NrhhYv9cTRDP7cGDXYQvmEUKbADYktA54zOhiDjVn8vGdixBzKAesg3MbwgOBsXOko-1y9G0P1mLpsCnJ5XgI Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 082838812f48442c9f4fc87fd2c61a07 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesBackupsTest-62810063 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/082838812f48442c9f4fc87fd2c61a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/082838812f48442c9f4fc87fd2c61a07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/082838812f48442c9f4fc87fd2c61a07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_082838812f48442c9f4fc87fd2c61a07", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesBackupsTest-62810063 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 082838812f48442c9f4fc87fd2c61a07 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesBackupsTest-62810063 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesBackupsTest-62810063-project Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 1f3d347a64164207bfc3e34a98db5de3 Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesBackupsTest-62810063-project Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 56b46041-216c-43f9-a83f-0ae4f42e1dec could not be found. Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '56b46041-216c-43f9-a83f-0ae4f42e1dec'} Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b46041-216c-43f9-a83f-0ae4f42e1dec could not be found. Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b46041-216c-43f9-a83f-0ae4f42e1dec could not be found. Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.620917 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b46041-216c-43f9-a83f-0ae4f42e1dec could not be found. Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:00.625487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] Returning 404 to user: Instance 56b46041-216c-43f9-a83f-0ae4f42e1dec could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:00.633529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81a8bfb0-f702-44dd-93f6-49f0aca95c37 tempest-VolumesBackupsTest-62810063 tempest-VolumesBackupsTest-62810063-project] 10.222.0.49 "GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec" status: 404 len: 111 microversion: 2.1 time: 0.098577 Jul 20 04:49:00.637615 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4024/5149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:00 2022] GET /compute/v2.1/servers/56b46041-216c-43f9-a83f-0ae4f42e1dec => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:02.710557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:02.712674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:02.721311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:02.762854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.773705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.781324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.785007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.851354 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 HTTP/1.1 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1'} Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:02.855893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.859870 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.881860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:02.882802 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c42bfcc4-3416-43e7-a361-43d05b1334bb tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 404 len: 111 microversion: 2.1 time: 0.179043 Jul 20 04:49:02.883891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4025/5150] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:02 2022] DELETE /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:02.892090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:02.897318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:02.914469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.914926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.915726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:02.916165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:02.971178 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 HTTP/1.1 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1'} Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:02.972909 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c2a2d1a-6cd9-4da4-a7f3-ce38511d807c tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1" status: 404 len: 111 microversion: 2.1 time: 0.086454 Jul 20 04:49:02.977008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4026/5151] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:02 2022] GET /compute/v2.1/servers/75fbdcd7-eaf9-4ca2-9c5e-a2e7046c04f1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:49:15.489561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1452172990", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "a9390dab-cc79-42f1-bef8-c49911b1a34a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-917123172", "security_groups": [{"name": "tempest-secgroup-smoke-1870140332"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:15.516518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:15.520865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:15.820218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] validate_networks() for [('a9390dab-cc79-42f1-bef8-c49911b1a34a', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:49:16.835327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:49:16.835873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:49:16.836224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:49:16.836676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:49:16.837101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:49:16.858384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:16.858856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.872215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:16.872723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:16.930810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:49:16.945465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:49:16.974107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:49:16.984744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:49:17.101541 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c752d1bc-3849-4c33-bd29-98b1bf979f07 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.617075 Jul 20 04:49:17.105585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4027/5152] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:49:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:49:17.115942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-425c61f4-d06b-47e1-89fe-017b24064dc0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.116978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-425c61f4-d06b-47e1-89fe-017b24064dc0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.291508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-425c61f4-d06b-47e1-89fe-017b24064dc0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:17.308991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-425c61f4-d06b-47e1-89fe-017b24064dc0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1266 microversion: 2.1 time: 0.193424 Jul 20 04:49:17.314267 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4028/5153] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:17 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:17.328644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.334056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.357573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.358105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.358960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.359423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.411914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 HTTP/1.1 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '598b71bd-ac88-4afb-977e-1faefa094f93'} Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:17.417856 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:17.428702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6015eb57-da0b-4da7-8334-6bb8afae0a07 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 404 len: 111 microversion: 2.1 time: 0.106378 Jul 20 04:49:17.431384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4029/5154] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:17 2022] DELETE /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:17.440276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.440985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 598b71bd-ac88-4afb-977e-1faefa094f93] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.482117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.482619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.485808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.491113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.536735 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 HTTP/1.1 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '598b71bd-ac88-4afb-977e-1faefa094f93'} Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.543821 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. Jul 20 04:49:17.549810 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.553626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 598b71bd-ac88-4afb-977e-1faefa094f93 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:17.556711 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97b5930a-a296-4f04-a0a9-c15464473d50 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93" status: 404 len: 111 microversion: 2.1 time: 0.124067 Jul 20 04:49:17.563217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4030/5155] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:17 2022] GET /compute/v2.1/servers/598b71bd-ac88-4afb-977e-1faefa094f93 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:17.574807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.579309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.606802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.609548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.612687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.616368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.680455 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 HTTP/1.1 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2d122213-6f22-4fc2-937c-7d2b457b40b7'} Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:17.691880 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.697127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:17.700180 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5f33f2e-4a7a-4b7f-a404-326d473b9f14 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 404 len: 111 microversion: 2.1 time: 0.127894 Jul 20 04:49:17.706240 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4031/5156] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:17 2022] DELETE /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:17.721149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:17.721798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 2d122213-6f22-4fc2-937c-7d2b457b40b7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:17.755778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.756263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.758970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:17.760733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:17.801853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 HTTP/1.1 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2d122213-6f22-4fc2-937c-7d2b457b40b7'} Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:17.805496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 2d122213-6f22-4fc2-937c-7d2b457b40b7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d52d3024-0ae0-42e4-9a0c-264e7b4cc92b tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7" status: 404 len: 111 microversion: 2.1 time: 0.099665 Jul 20 04:49:17.811006 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4032/5157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:17 2022] GET /compute/v2.1/servers/2d122213-6f22-4fc2-937c-7d2b457b40b7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:18.331124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:18.333747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:18.360626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.362065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.366883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:18.368593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:18.543242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:18.574001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6cd53387-49ff-421a-a455-f04dac50416c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1270 microversion: 2.1 time: 0.251443 Jul 20 04:49:18.579211 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4033/5158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:18 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:19.622866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:19.642395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:19.678208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:19.680731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:19.689892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:19.691607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:19.973723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:20.032064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c11d5b6-79f8-4570-86c3-7312f35cbd85 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1324 microversion: 2.1 time: 0.438613 Jul 20 04:49:20.047117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4034/5159] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:19 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:21.063011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:21.064002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:21.077966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.078505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.079334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:21.089246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:21.331396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:21.359892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28c523a1-30f1-4d1d-8c79-a202a681d74f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1324 microversion: 2.1 time: 0.302147 Jul 20 04:49:21.360969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4035/5160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:21 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:22.389048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:22.390070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:22.425266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.426337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.428198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:22.428923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:22.648097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:22.658546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-134a0e9a-203c-4d4c-89e1-f74dfff096c6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1324 microversion: 2.1 time: 0.276348 Jul 20 04:49:22.659415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4036/5161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:22 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:23.180866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:23.182698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:23.222136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.222669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.224001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.237135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.300227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lazy-loading 'flavor' on Instance uuid 97ff2e60-9699-4e9f-8048-ca7da01d4d0d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:49:23.587028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e99c882-9fef-46a3-8908-1f96075ee364 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/action" status: 200 len: 32 microversion: 2.1 time: 0.413262 Jul 20 04:49:23.591240 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4037/5162] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:49:23 2022] POST /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/action => generated 32 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:49:23.626678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:23.628644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:23.648777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.650021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:23.653433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:23.654465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.225906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:24.261555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-847ed01b-5dbd-4396-acda-7af324a50e5c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.654137 Jul 20 04:49:24.280807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4038/5163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:23 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:24.290015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:24.292022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:24.303956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:24.305160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.307000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:24.308660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:24.727182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:24.742259 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22634eaf-e8a3-4392-aa45-54c2f3c51020 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.459780 Jul 20 04:49:24.753375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4039/5164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:24 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:24.997724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:24.998360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.011454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.011934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.024720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.025428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.052111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 HTTP/1.1 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1eac1974-1ab0-4cd6-8509-9a82ca7855d3'} Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:25.053927 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:25.058495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb95d7fd-17f7-450e-aa27-3f4743301edf tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 404 len: 111 microversion: 2.1 time: 0.062686 Jul 20 04:49:25.059573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4040/5165] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:49:24 2022] DELETE /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:25.064461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:25.079583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] [instance: 1eac1974-1ab0-4cd6-8509-9a82ca7855d3] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.087914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.094796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.095963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.096626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.128998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] HTTP exception thrown: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Request method failure captured: Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 HTTP/1.1 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14eg7Rgep2pbjxDMgtFYT-e22FLGemFv_g2cqx8cWIwEYYpJvgWY3IiM-_h-KzYygIBf-_bn26w9RFpI4zx6g7NfGorWjGw51qKx7iX4_fzqDcNqjvdWfUIvnaWhOenTPC5r_fnDb1TOKifAqfgnmHT4YbIwTaK_djj8ynclmBjJjJI Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d65f2a08545209d516d67b288bb97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d65f2a08545209d516d67b288bb97", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d65f2a08545209d516d67b288bb97 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-855360636 Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: dfdec296862948fc8e2b3c266a47b20f Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-AttachVolumeNegativeTest-855360636-project Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1eac1974-1ab0-4cd6-8509-9a82ca7855d3'} Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:49:25.138565 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. Jul 20 04:49:25.143417 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:49:25.144867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] Returning 404 to user: Instance 1eac1974-1ab0-4cd6-8509-9a82ca7855d3 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:49:25.157699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd808e18-53fc-4a9a-a9e4-cd48c2588813 tempest-AttachVolumeNegativeTest-855360636 tempest-AttachVolumeNegativeTest-855360636-project] 10.222.0.49 "GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3" status: 404 len: 111 microversion: 2.1 time: 0.097263 Jul 20 04:49:25.158980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4041/5166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:25 2022] GET /compute/v2.1/servers/1eac1974-1ab0-4cd6-8509-9a82ca7855d3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:49:25.292470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:25.304500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.316724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.320920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.322592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.326804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.731997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:25.748238 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbf5552c-8c88-480e-9eca-e30751109a30 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.463039 Jul 20 04:49:25.750991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4042/5167] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:25 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:25.784322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:25.793691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:25.813806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.814281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:25.815236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:25.815690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.236897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:26.261807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75e21c63-9102-4074-ba10-4b9acd70ac6f tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.504383 Jul 20 04:49:26.263932 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4043/5168] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:25 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:26.776856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:26.783295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:26.812150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.814626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.815806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:26.819019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:26.913706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.304026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:27.375868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:27.413233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48240388-c814-4988-9ee9-68447338a62d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.646511 Jul 20 04:49:27.413865 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4044/5169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:26 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:27.422982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:27.423610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:27.445745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.455640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:27.457198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:27.458050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.595061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:28.612694 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d3cda95e-ec98-4c2e-a529-5d868d089ab4 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 1.197423 Jul 20 04:49:28.620772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4045/5170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:27 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:28.632255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:28.633462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:28.646467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:28.651200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:28.652872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:28.654151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.358322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:29.401674 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a6ef4f2-46ba-41b5-b2a0-745db3f0c4a8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.774772 Jul 20 04:49:29.408972 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4046/5171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:28 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:29.456778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-42ef37d6-41c0-4da7-96ec-c1d2cb809850 req-c6c1133c-68a2-4343-a04c-bb06738477d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:29.502908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-42ef37d6-41c0-4da7-96ec-c1d2cb809850 req-c6c1133c-68a2-4343-a04c-bb06738477d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.503576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-42ef37d6-41c0-4da7-96ec-c1d2cb809850 req-c6c1133c-68a2-4343-a04c-bb06738477d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.530808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:29.573221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-42ef37d6-41c0-4da7-96ec-c1d2cb809850 req-c6c1133c-68a2-4343-a04c-bb06738477d3 service nova] Creating event network-changed:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h1-764486-11 Jul 20 04:49:29.601045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-42ef37d6-41c0-4da7-96ec-c1d2cb809850 req-c6c1133c-68a2-4343-a04c-bb06738477d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188495 Jul 20 04:49:29.603197 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4047/5172] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:29.646984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:29.654239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:29.677018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.691725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:29.693332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:29.696019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.456530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:30.469402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d4bca1c-a73d-4c97-b017-7b9a5f4e7210 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.835446 Jul 20 04:49:30.469880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4048/5173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:29 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:30.481821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:30.482443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:30.491728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.493354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.495469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:30.496176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:30.762935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:30.783383 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d30bbc3-290b-4fac-b081-cb1b07ff7f64 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.312381 Jul 20 04:49:30.796388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4049/5174] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:30 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:31.487993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:31.489343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:31.506493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.508506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.513815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:31.514729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:31.984749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:31.994942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8c8be72-9b4f-4ba7-9068-5e9e542a1228 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.512240 Jul 20 04:49:31.997374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4050/5175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:31 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:32.007086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:32.007709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:32.026476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:32.026920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.027718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:32.028156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:32.520800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:32.529711 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a035a71c-374a-4f7b-9f99-b39ab49782c8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.530478 Jul 20 04:49:32.540773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4051/5176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:31 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:33.013835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:33.014538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:33.036030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.036935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.038094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.038437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.539157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:33.549471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-939346b9-7c94-49a6-bd6f-6db15f114af0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.541289 Jul 20 04:49:33.554764 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4052/5177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:33 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:33.562217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:33.569981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:33.578643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.581250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.582356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:33.586055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:33.927096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:33.937806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebb53b33-52e1-4e02-8800-be69afe4510e tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.379373 Jul 20 04:49:33.942963 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4053/5178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:33 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:34.574409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:34.575361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:34.595511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:34.596336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:34.597739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:34.602155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:35.001438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:35.038316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5109dbe-2e47-4500-a11f-b79ffdb5fc3b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.468871 Jul 20 04:49:35.046009 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4054/5179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:34 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:35.067126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-132a3f01-8d40-448b-8074-79f985a708f5 req-0d8590e9-ae58-4819-9a93-1e74ad047959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "name": "network-vif-plugged", "status": "completed", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:35.091585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-132a3f01-8d40-448b-8074-79f985a708f5 req-0d8590e9-ae58-4819-9a93-1e74ad047959 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:35.093062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-132a3f01-8d40-448b-8074-79f985a708f5 req-0d8590e9-ae58-4819-9a93-1e74ad047959 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:35.108949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-132a3f01-8d40-448b-8074-79f985a708f5 req-0d8590e9-ae58-4819-9a93-1e74ad047959 service nova] Creating event network-vif-plugged:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h1-764486-11 Jul 20 04:49:35.117593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-132a3f01-8d40-448b-8074-79f985a708f5 req-0d8590e9-ae58-4819-9a93-1e74ad047959 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067378 Jul 20 04:49:35.120122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4055/5180] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:35.147017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:35.149726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:35.177768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:35.178485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:35.179102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:35.179553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:35.642310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:35.658776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef6d4a7f-2c83-4222-96e6-7b064a8d30d3 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.537101 Jul 20 04:49:35.661132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4056/5181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:35 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:36.069870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:36.070809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:36.096245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:36.097458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:36.099991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:36.103347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:36.412962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:36.428037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86188f37-d1b1-4557-a209-f62d048acda0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.363848 Jul 20 04:49:36.430579 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4057/5182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:36 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:36.693292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:36.693949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:36.701656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:36.702355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:36.703469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:36.703976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:36.976921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:37.000593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa716015-d175-436a-bfe7-848cfb85d1a0 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.313034 Jul 20 04:49:37.002493 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4058/5183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:36 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:37.453450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:37.454403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:37.467446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:37.468371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:37.469733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:37.470273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:37.787456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:37.803196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab9a5324-14b6-4c39-9d95-e9ab67974475 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1392 microversion: 2.1 time: 0.355566 Jul 20 04:49:37.808483 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4059/5184] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:37 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:38.024426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:38.026343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:38.047403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:38.048672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:38.053220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:38.054851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:38.406662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:38.433741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41e28019-3708-4e37-a1bc-66c157a7b7ef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.418110 Jul 20 04:49:38.444389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4060/5185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:38 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:38.829831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:38.831158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:38.850742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:38.851426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:38.852941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:38.854205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:39.140480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:39.149851 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8f66374-f65d-44d2-9304-da218e46ec6d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1564 microversion: 2.1 time: 0.325059 Jul 20 04:49:39.162967 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4061/5186] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:38 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1564 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:39.169205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:39.170119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:39.180260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:39.181244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:39.184277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:39.184951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:39.424006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:39.479424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d567e75-4e59-4882-92bc-4e62f10c1c0c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1564 microversion: 2.1 time: 0.314400 Jul 20 04:49:39.486200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4062/5187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:39 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1564 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:39.503657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:39.504923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:39.521826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:39.522979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:39.524772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:39.526444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:39.922883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:39.950229 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-96577d40-6d7c-4f06-951f-3190f28d8954 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.455140 Jul 20 04:49:39.954212 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4063/5188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:39 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:40.980870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:40.983413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:41.030197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:41.031155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:41.034281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:41.036307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:41.779556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:41.822858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed7eb402-0e54-40f5-b89d-d2915ab85ba9 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.854153 Jul 20 04:49:41.825928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4064/5189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:40 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:42.846774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:42.847878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:42.868613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:42.871856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:42.873822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:42.875825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:42.956321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:43.985419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:44.009165 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04fb4e82-cab8-48be-a96c-d0350727c3eb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 1.167444 Jul 20 04:49:44.014172 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4065/5190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:42 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:44.031490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:44.035486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:44.054445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.055146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:44.056775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.058337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:44.613576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:44.634807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae277bbd-97aa-48f6-a0c8-476b0a9bcc35 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1564 microversion: 2.1 time: 0.618945 Jul 20 04:49:44.636616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4066/5191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:44 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1564 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:44.687472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5a9b0715-e689-4bc6-9de4-1963b690217b req-bfe8ea1b-56ee-4f85-8bed-22c69855df22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:49:44.715802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:49:44.720666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a9b0715-e689-4bc6-9de4-1963b690217b req-bfe8ea1b-56ee-4f85-8bed-22c69855df22 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:44.722165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a9b0715-e689-4bc6-9de4-1963b690217b req-bfe8ea1b-56ee-4f85-8bed-22c69855df22 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:44.764686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5a9b0715-e689-4bc6-9de4-1963b690217b req-bfe8ea1b-56ee-4f85-8bed-22c69855df22 service nova] Creating event network-changed:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h1-764486-11 Jul 20 04:49:44.778330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5a9b0715-e689-4bc6-9de4-1963b690217b req-bfe8ea1b-56ee-4f85-8bed-22c69855df22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112638 Jul 20 04:49:44.808746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4067/5192] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:49:45.045796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:45.049554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:45.068242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:45.068843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:45.070931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:45.074631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:45.460418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:45.472302 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e74ae7a-1b32-447f-bb0d-aa0b0fc7dcff tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.444303 Jul 20 04:49:45.484902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4068/5193] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:45 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:46.509331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:46.516123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:46.535575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:46.544829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:46.547589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:46.548305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:46.847407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:46.875392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0db614f1-dd5b-4ab0-b1ad-f6d6d604277f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.373033 Jul 20 04:49:46.876718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4069/5194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:46 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:47.916030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:47.917212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:47.936666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:47.937390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:47.938354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:47.938956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:48.278087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:48.289084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3337a369-2d81-443c-98b8-0492d46cc01f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.387642 Jul 20 04:49:48.290282 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4070/5195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:47 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:49.313345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:49.315428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:49.353701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:49.354704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:49.355979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:49.357230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:49.624319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:49.639150 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c6ade0b-2d2e-42fc-92c1-2e770793607d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.331184 Jul 20 04:49:49.652803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4071/5196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:49 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:50.660278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:50.668268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:50.684282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:50.690607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:50.695072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:50.698451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:51.121979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:51.158267 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc6542cd-b838-4518-9d62-3539695b930d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.501620 Jul 20 04:49:51.166717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4072/5197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:50 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:52.189968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:52.192057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:52.220589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:52.221457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:52.222603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:52.223372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:52.536939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:52.552555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce213f7f-269f-47e4-a1e6-1cde123f46c4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.372858 Jul 20 04:49:52.562288 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4073/5198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:52 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:53.575478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:53.577250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:53.601777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.617994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:53.620959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:53.622340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:54.105096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:54.136664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b40adc5-d01d-4c63-929c-aece866a82d4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.565404 Jul 20 04:49:54.149868 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4074/5199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:53 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:55.161046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:55.162402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:55.172793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:55.173577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:55.174579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:55.175364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:55.436790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:55.474461 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-366a6be8-f4c3-4859-b33a-d35b6aa3ecf7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.320230 Jul 20 04:49:55.490952 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4075/5200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:55 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:56.503153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:56.505323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:56.533803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.534588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:56.536071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:56.541924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:57.124799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:57.194343 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53dc6289-08b2-42a0-a5a0-eb8a7fd2fbd4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.699421 Jul 20 04:49:57.213839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4076/5201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:56 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:49:58.228639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:58.229796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:58.244346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.245030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.245962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:58.246511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:58.638414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:49:58.672620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3475bff2-c6b6-4614-abd7-8566c13cba71 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.445166 Jul 20 04:49:58.683083 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4077/5202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:58 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:49:59.705967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:49:59.708133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:49:59.727053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.728158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.729818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:49:59.730906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:49:59.994720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:00.014551 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25c12915-26ac-4cd4-ada3-e462d1601339 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.313366 Jul 20 04:50:00.029046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4078/5203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:49:59 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:01.044701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:01.045357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:01.071222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.077419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.080823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:01.083179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:01.418005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:01.433927 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b6225df-4872-4100-89de-0c04f0b8b40b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.394117 Jul 20 04:50:01.443901 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4079/5204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:01 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:02.454164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:02.455912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:02.484149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.485109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.488623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:02.491802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:02.885320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:02.899749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e7aec459-b912-4163-81bf-cc9df9f1cb6d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.451497 Jul 20 04:50:02.900930 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4080/5205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:02 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:03.919347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:03.921244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:03.936627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.939269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:03.943806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:03.947077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.239944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:04.252120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4859d38d-5bc3-44ba-b02a-285ca9acc74f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.337947 Jul 20 04:50:04.253991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4081/5206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:03 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:04.495363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:04.497127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:04.508378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.511354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.513114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:04.514782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:04.567940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:04.618546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27ecd52b-2d2a-417d-a052-3b3902cda8af tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action" status: 200 len: 24565 microversion: 2.1 time: 0.125902 Jul 20 04:50:04.619234 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4082/5207] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:50:04 2022] POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action => generated 24565 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:50:05.274332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:05.275201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:05.298810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.300230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.302050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:05.304284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:05.599745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:05.617087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1c2eec1-0588-4b0f-a3a9-1a0183592920 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.349434 Jul 20 04:50:05.619046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4083/5208] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:05 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:06.646826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:06.647654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:06.690320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.691086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:06.691597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:06.692039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:07.146290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:07.156137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72c116d3-d33e-4e5c-bc64-3526bbded2d6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.517405 Jul 20 04:50:07.173391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4084/5209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:06 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:08.181636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:08.182459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:08.201179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.202238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:08.203998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:08.205094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:08.498724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:08.524196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a4bd3e5-f3e0-447a-bcea-768c30934322 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.345768 Jul 20 04:50:08.525114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4085/5210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:08 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:09.551516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:09.552253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:09.574825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.575290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.576110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:09.576584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:09.939993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:09.949808 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-203672cc-c1f1-44e5-955b-4a707ada263a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1735 microversion: 2.1 time: 0.403661 Jul 20 04:50:09.951981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4086/5211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:09 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:10.981515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:10.983592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:10.992043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.992971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:10.993966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:10.994586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.329865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:11.340949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9f1a5d0-aad9-4597-8591-f4123553279f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1715 microversion: 2.1 time: 0.372739 Jul 20 04:50:11.344588 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4087/5212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:10 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1715 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:11.762841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:11.764193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:11.776418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.777426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:11.780137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:11.781151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.164462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Cannot 'detach_volume' instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d while it is in vm_state rescued Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments/369afa0a-7cc4-4b9a-a708-c6637ee9d02e HTTP/1.1 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'detach_volume' instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d while it is in vm_state rescued Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '97ff2e60-9699-4e9f-8048-ca7da01d4d0d', 'id': '369afa0a-7cc4-4b9a-a708-c6637ee9d02e'} Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d while it is in vm_state rescued Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:12.167421 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:12.173355 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:12.173355 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:12.173355 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:12.173355 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:12.173355 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d while it is in vm_state rescued Jul 20 04:50:12.173355 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:12.188055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 409 to user: Cannot 'detach_volume' instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d while it is in vm_state rescued {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:12.189221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87d5f801-74f2-46fb-bae3-5ba4ad4ce75b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments/369afa0a-7cc4-4b9a-a708-c6637ee9d02e" status: 409 len: 152 microversion: 2.1 time: 0.436478 Jul 20 04:50:12.201612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4088/5213] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:50:11 2022] DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments/369afa0a-7cc4-4b9a-a708-c6637ee9d02e => generated 152 bytes in 450 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 04:50:12.229043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:12.233564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:12.275558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.282138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.292848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.297484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.566385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0756c81-fcea-4880-8c71-c5f85b0d48ee tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/action" status: 202 len: 0 microversion: 2.1 time: 0.357325 Jul 20 04:50:12.574067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4089/5214] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:50:12 2022] POST /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:12.600217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:12.602462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:12.620626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.621441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:12.622806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:12.623572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:13.052158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:13.073513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1deca72b-945e-4973-bdc4-184030f33128 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1723 microversion: 2.1 time: 0.492883 Jul 20 04:50:13.077327 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4090/5215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:12 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:14.098522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:14.101230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:14.122496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:14.124282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.126345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:14.127225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:14.533502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:14.564266 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2067bf2b-5876-4691-a6f6-bafd4a1af5de tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1723 microversion: 2.1 time: 0.471529 Jul 20 04:50:14.578287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4091/5216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:14 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:15.588005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:15.588702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:15.608743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=49 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:15.615581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.617421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:15.619361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:15.620082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.001445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:16.024078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83e4a369-6009-47c0-aa19-b040102f0d15 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1723 microversion: 2.1 time: 0.438373 Jul 20 04:50:16.025108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4092/5217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:15 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:16.052769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:16.059410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:16.083907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.085942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.087334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.092493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.376507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:16.388111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-573e9855-534e-483b-bb43-faa26e5b1872 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1682 microversion: 2.1 time: 0.360480 Jul 20 04:50:16.388955 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4093/5218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:16 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:16.535518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:16.537849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:16.555903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.558016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.560542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.563743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.669031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c8d862c-1df1-48f8-a86d-6426e4314402 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action" status: 200 len: 32635 microversion: 2.1 time: 0.139170 Jul 20 04:50:16.671310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4094/5219] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:50:16 2022] POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action => generated 32635 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:50:16.894776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:16.895534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:16.914423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.914873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:16.924740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:16.925471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.229103 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4955312d-52bf-4644-a96c-2417292633bf tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1835 microversion: 2.1 time: 0.339725 Jul 20 04:50:17.229720 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4095/5220] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:16 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1835 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:17.234876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:17.259263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:17.286232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:17.289414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.290427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:17.303138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.674546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:17.692517 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf77305b-2bf8-43f1-a16d-fd7c04b45bef tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1729 microversion: 2.1 time: 0.461082 Jul 20 04:50:17.696186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4096/5221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:17 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1729 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:17.712119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:17.713773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:17.739000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:17.741280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.753308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:17.758376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:17.797974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lazy-loading 'flavor' on Instance uuid befdf846-1f54-46c3-bebe-11c487d52587 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:17.822392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Going to try to live migrate instance to another host {{(pid=123724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 04:50:17.920705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:22.315669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b5e6c47-22f0-4a7a-8e01-124f6ab90618 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action" status: 202 len: 0 microversion: 2.1 time: 4.618008 Jul 20 04:50:22.316330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4097/5222] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:50:17 2022] POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action => generated 0 bytes in 4619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:22.343592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:22.348295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:22.389782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:22.392235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:22.393827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:22.394617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:22.840274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04747530-cae8-4c60-9d4e-fbec57ea94cb tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.515588 Jul 20 04:50:22.841801 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4098/5223] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 04:50:22 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-interface => generated 284 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:22.864855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:22.873367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:22.893551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:22.894689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:22.907723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:22.909194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:23.344731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:23.373700 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84d16e75-f772-47d5-bef7-6722a8e84390 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.529862 Jul 20 04:50:23.391559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4099/5224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:22 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:24.406755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:24.407825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:24.448746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:24.449388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:24.450640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:24.451360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:25.136453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:25.152472 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21e55d58-5ce5-4716-9b17-57b21d005b8a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.747631 Jul 20 04:50:25.154030 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4100/5225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:24 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:26.189676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:26.195111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:26.251524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.252685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.254354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:26.260605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:26.746400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:26.763326 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c316386b-ee04-4c6a-a1a7-7ac7ca75bcbf tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.581760 Jul 20 04:50:26.780604 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4101/5226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:26 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:27.143939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fe961d4f-d662-436c-b2f5-fb478ef6fe0e req-a4a329c9-de71-49f5-a29c-efaacaaaccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ff2e60-9699-4e9f-8048-ca7da01d4d0d", "tag": "2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:27.178001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fe961d4f-d662-436c-b2f5-fb478ef6fe0e req-a4a329c9-de71-49f5-a29c-efaacaaaccd2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.186781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fe961d4f-d662-436c-b2f5-fb478ef6fe0e req-a4a329c9-de71-49f5-a29c-efaacaaaccd2 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.255257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fe961d4f-d662-436c-b2f5-fb478ef6fe0e req-a4a329c9-de71-49f5-a29c-efaacaaaccd2 service nova] Creating event network-changed:2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e for instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d on n-h2-764486-11 Jul 20 04:50:27.294293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fe961d4f-d662-436c-b2f5-fb478ef6fe0e req-a4a329c9-de71-49f5-a29c-efaacaaaccd2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157446 Jul 20 04:50:27.296282 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4102/5227] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:27.798185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:27.800919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:27.836443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.837874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:27.839785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:27.845987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:28.355786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:28.368691 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9bfac3be-4a71-4e0f-98ec-2826976e5e98 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.580113 Jul 20 04:50:28.373685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4103/5228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:27 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:29.395690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-072bbc41-7970-45d4-9011-48ef52b37d6d req-3ee9e6c0-dc56-445c-b1ce-60b158578777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ff2e60-9699-4e9f-8048-ca7da01d4d0d", "tag": "2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e"}, {"server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "name": "network-vif-unplugged", "status": "completed", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:29.433728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-072bbc41-7970-45d4-9011-48ef52b37d6d req-3ee9e6c0-dc56-445c-b1ce-60b158578777 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.436806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-072bbc41-7970-45d4-9011-48ef52b37d6d req-3ee9e6c0-dc56-445c-b1ce-60b158578777 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.472783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-072bbc41-7970-45d4-9011-48ef52b37d6d req-3ee9e6c0-dc56-445c-b1ce-60b158578777 service nova] Creating event network-changed:2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e for instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d on n-h2-764486-11 Jul 20 04:50:29.473937 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-072bbc41-7970-45d4-9011-48ef52b37d6d req-3ee9e6c0-dc56-445c-b1ce-60b158578777 service nova] Creating event network-vif-unplugged:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h1-764486-11 Jul 20 04:50:29.510143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-072bbc41-7970-45d4-9011-48ef52b37d6d req-3ee9e6c0-dc56-445c-b1ce-60b158578777 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.120641 Jul 20 04:50:29.525760 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4104/5229] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:29.572394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:29.574042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:29.619622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.620426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:29.638005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:29.638921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:30.019134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:30.030382 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9afed7e1-11e8-4ab5-8de1-e39837fac934 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.501818 Jul 20 04:50:30.031548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4105/5230] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:29 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:31.062414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:31.062980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:31.080021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.080545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:31.081405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.081913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:31.644176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:31.679586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-299f60b2-9a4b-4ab6-b8fb-a7c560c8d5dc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.621325 Jul 20 04:50:31.692418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4106/5231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:31 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:31.722214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8c850331-84ab-4183-acba-ac2c406dbf08 req-4fb8ce74-0e8e-4d2b-84db-86ed185616ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:31.776660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8c850331-84ab-4183-acba-ac2c406dbf08 req-4fb8ce74-0e8e-4d2b-84db-86ed185616ee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:31.777547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8c850331-84ab-4183-acba-ac2c406dbf08 req-4fb8ce74-0e8e-4d2b-84db-86ed185616ee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:31.813078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8c850331-84ab-4183-acba-ac2c406dbf08 req-4fb8ce74-0e8e-4d2b-84db-86ed185616ee service nova] Creating event network-changed:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h1-764486-11 Jul 20 04:50:31.832523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8c850331-84ab-4183-acba-ac2c406dbf08 req-4fb8ce74-0e8e-4d2b-84db-86ed185616ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115371 Jul 20 04:50:31.841668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4107/5232] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:32.702600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:32.703405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:32.732017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:32.732017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:32.732017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:32.732017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:33.092999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:33.102312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78c1d3d4-33d8-4133-b4ec-ee2d974737ee tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.404158 Jul 20 04:50:33.104585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4108/5233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:32 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:34.126139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:34.126764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:34.153448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:34.155264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:34.158674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:34.160931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:34.452137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:34.465939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b32dfa67-a9ad-422e-8354-4bfcd9c4cdcd tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.345280 Jul 20 04:50:34.469457 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4109/5234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:34 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:35.488156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:35.488914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:35.510379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:35.511302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:35.513920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:35.514436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:35.794255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:35.804412 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-50757f16-6c18-4ac5-90a1-eab454f63b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.320883 Jul 20 04:50:35.805039 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4110/5235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:35 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:37.126494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3f8eaa42-bc7a-4062-9ded-059be7d25bf9 req-ff4fc8ce-b94d-46e8-b2aa-d3f53b5e0c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "name": "network-vif-unplugged", "status": "completed", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:37.149264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3f8eaa42-bc7a-4062-9ded-059be7d25bf9 req-ff4fc8ce-b94d-46e8-b2aa-d3f53b5e0c6f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.150979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3f8eaa42-bc7a-4062-9ded-059be7d25bf9 req-ff4fc8ce-b94d-46e8-b2aa-d3f53b5e0c6f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:37.190529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3f8eaa42-bc7a-4062-9ded-059be7d25bf9 req-ff4fc8ce-b94d-46e8-b2aa-d3f53b5e0c6f service nova] Creating event network-vif-unplugged:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h1-764486-11 Jul 20 04:50:37.207863 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3f8eaa42-bc7a-4062-9ded-059be7d25bf9 req-ff4fc8ce-b94d-46e8-b2aa-d3f53b5e0c6f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.878390 Jul 20 04:50:37.212743 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4111/5236] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:37.235387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:37.238660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:37.260428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.261549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:37.265081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:37.266995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:37.853676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:37.879186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6003b6a-4e14-4841-b4ee-f2a35a0fcee3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.652153 Jul 20 04:50:37.883404 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4112/5237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:37 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:38.899690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:38.901148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:38.914980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:38.921639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:38.922800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:38.923432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:39.247422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:39.260607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-deffae3b-c2fb-4e1f-a226-e699e29229f2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1692 microversion: 2.1 time: 0.364683 Jul 20 04:50:39.262164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4113/5238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:38 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1692 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:40.278601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:40.286328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:40.309026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:40.317110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:40.318414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:40.319031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:40.676007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:40.687611 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37e233f2-5017-43be-93b1-f5846949acf6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1682 microversion: 2.1 time: 0.412951 Jul 20 04:50:40.688785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4114/5239] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:40 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1682 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:40.708260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:40.710542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:40.725347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:40.726697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:40.731818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:40.732713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:41.097753 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44b0b3f4-57b7-462e-b7ce-7ef806499558 tempest-TestNetworkAdvancedServerOps-987287981 tempest-TestNetworkAdvancedServerOps-987287981-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1835 microversion: 2.1 time: 0.394658 Jul 20 04:50:41.116566 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4115/5240] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:40 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1835 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:41.128333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:41.129399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:41.137866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:41.138605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:41.139898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:41.140599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:41.972262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:41.979092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:42.006397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94a65f2a-8674-43b0-923f-b1fb9c153ab3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1682 microversion: 2.1 time: 0.876708 Jul 20 04:50:42.009982 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4116/5241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:41 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1682 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:50:42.897935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:42.899045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:42.920368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:42.921177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:42.921998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:42.922539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:43.113542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1298ce91-746d-43ab-b8e4-cbab088b4ad7 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action" status: 200 len: 38604 microversion: 2.1 time: 0.213760 Jul 20 04:50:43.127609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4117/5242] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:50:42 2022] POST /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587/action => generated 38604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:50:46.482171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:46.482171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:46.484968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=54 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:50:46.505182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.532229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.533615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.534076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.646860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:50:46.866226 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b4d0413-a7e0-45d6-8dfe-ed65491cb88a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 204 len: 0 microversion: 2.1 time: 0.388617 Jul 20 04:50:46.866831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4118/5243] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:50:46 2022] DELETE /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:50:46.873193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5054254f-abc4-471e-8a25-82ef4979fcd8 req-3b685f57-12b8-4e62-9189-133c20de54ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:46.913476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5054254f-abc4-471e-8a25-82ef4979fcd8 req-3b685f57-12b8-4e62-9189-133c20de54ee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:46.913832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5054254f-abc4-471e-8a25-82ef4979fcd8 req-3b685f57-12b8-4e62-9189-133c20de54ee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:46.954903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5054254f-abc4-471e-8a25-82ef4979fcd8 req-3b685f57-12b8-4e62-9189-133c20de54ee service nova] Creating event network-changed:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h2-764486-11 Jul 20 04:50:46.961956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5054254f-abc4-471e-8a25-82ef4979fcd8 req-3b685f57-12b8-4e62-9189-133c20de54ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093615 Jul 20 04:50:46.962572 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4119/5244] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:46.978433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:46.979668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:47.000380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:47.003151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:47.005172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:47.011079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:47.669994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:47.686437 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-979d9a0e-56e4-4e48-8b7d-d10189c7a159 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1688 microversion: 2.1 time: 0.718499 Jul 20 04:50:47.688879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4120/5245] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:46 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1688 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:48.708919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:48.709672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:48.718880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:48.721992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:48.724986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:48.727097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:50.350671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:50:50.391306 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a036778-21dc-4eff-a8d3-490c7e7bb746 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 200 len: 1688 microversion: 2.1 time: 1.680921 Jul 20 04:50:50.408778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4121/5246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:48 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 1688 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:50:50.429471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-243315ca-263d-4423-9279-60e51af4d1f8 req-2acc9284-88b9-4431-98d5-955376728ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befdf846-1f54-46c3-bebe-11c487d52587", "name": "network-vif-deleted", "tag": "cd820a1a-a807-453a-b5ad-c9bb856e17d7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:50:50.464953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-243315ca-263d-4423-9279-60e51af4d1f8 req-2acc9284-88b9-4431-98d5-955376728ed1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:50.465728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-243315ca-263d-4423-9279-60e51af4d1f8 req-2acc9284-88b9-4431-98d5-955376728ed1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:50.493765 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-243315ca-263d-4423-9279-60e51af4d1f8 req-2acc9284-88b9-4431-98d5-955376728ed1 service nova] Creating event network-vif-deleted:cd820a1a-a807-453a-b5ad-c9bb856e17d7 for instance befdf846-1f54-46c3-bebe-11c487d52587 on n-h2-764486-11 Jul 20 04:50:50.513159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-243315ca-263d-4423-9279-60e51af4d1f8 req-2acc9284-88b9-4431-98d5-955376728ed1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099592 Jul 20 04:50:50.514190 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4122/5247] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:51.415462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:51.416228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: befdf846-1f54-46c3-bebe-11c487d52587] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:51.435401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:51.435871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:51.439650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:51.440333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:51.485622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] HTTP exception thrown: Instance befdf846-1f54-46c3-bebe-11c487d52587 could not be found. Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Request method failure captured: Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 HTTP/1.1 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fI2Uh8hfePvQFFsiRzC6qxuFXUX_Nvp02KeELtffh0P8y4-57vVIl5ikMVI-at6ye2zsDygciR3mr85j9TebUbVoKnux68Noznm8g9bGnPl-bwhixs6BGDl1W9jBTLbJP9ahHfTb9KKjPO29WpKos-QPKy1_8lT0lgjQI0SEO7CV0 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d198cfbd38c74919a0c171774b8af43a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e13752abfe1a4708aaf68736ff893649 Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance befdf846-1f54-46c3-bebe-11c487d52587 could not be found. Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'befdf846-1f54-46c3-bebe-11c487d52587'} Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance befdf846-1f54-46c3-bebe-11c487d52587 could not be found. Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance befdf846-1f54-46c3-bebe-11c487d52587 could not be found. Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:51.488419 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance befdf846-1f54-46c3-bebe-11c487d52587 could not be found. Jul 20 04:50:51.494416 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:50:51.496428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Returning 404 to user: Instance befdf846-1f54-46c3-bebe-11c487d52587 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:50:51.498933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f13fe504-d4c7-4214-8406-5bf6d5783910 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587" status: 404 len: 111 microversion: 2.1 time: 0.092266 Jul 20 04:50:51.507011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4123/5248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:50:51 2022] GET /compute/v2.1/servers/befdf846-1f54-46c3-bebe-11c487d52587 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:50:54.619996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:54.621618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:54.632170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:54.633096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:54.634147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:54.634941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:54.842170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lazy-loading 'services' on Instance uuid 97ff2e60-9699-4e9f-8048-ca7da01d4d0d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:50:55.058871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edfca3ab-2e6b-44cd-bebd-b4c09dbbc46b tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments/369afa0a-7cc4-4b9a-a708-c6637ee9d02e" status: 202 len: 0 microversion: 2.1 time: 0.440610 Jul 20 04:50:55.060857 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4124/5249] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 04:50:54 2022] DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments/369afa0a-7cc4-4b9a-a708-c6637ee9d02e => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:50:55.080095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:55.084270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:55.124828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:55.126462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:55.127857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:55.128578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:55.243765 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd13a415-6784-4835-befa-c3e388267db5 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178981 Jul 20 04:50:55.251004 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4125/5250] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:55 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:50:56.264047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:56.265399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:56.273020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.274034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.275505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:56.276204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:56.397130 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8df4675-81fe-4202-802b-d0d7ee948f14 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136262 Jul 20 04:50:56.398210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4126/5251] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:56 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:57.410753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:57.412529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:57.437140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.439153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.441345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:57.444603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:57.575925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2469f5a-23f0-40d3-9c03-8e0f5dd471c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169680 Jul 20 04:50:57.582241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4127/5252] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:57 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:58.593902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:58.595612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:58.632295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:58.637973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:58.639698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:58.640378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:58.725971 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e162f2b-9294-4376-902a-21e6a4d62f2d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137480 Jul 20 04:50:58.738294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4128/5253] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:58 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:50:59.748707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:50:59.751692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:50:59.778037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.780264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.783985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:50:59.784767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:50:59.852759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11f5ae2e-f705-4523-b71c-d34b610a14da tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110002 Jul 20 04:50:59.854371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4129/5254] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:50:59 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:00.864935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:00.865888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:00.882408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.884541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.888216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:00.894916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:00.995151 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-428c0aca-b334-43e1-9ad8-48727ef4e624 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134209 Jul 20 04:51:00.996096 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4130/5255] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:00 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:02.010044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:02.011006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:02.037925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:02.038619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:02.053844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:02.055682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:02.172657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce494a04-ef1b-4e51-8adc-e10f1cfcab4c tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166582 Jul 20 04:51:02.174742 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4131/5256] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:02 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:03.184319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:03.185335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:03.204833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.205371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.206674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:03.207440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:03.341305 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91097dd9-65b6-4299-9bab-6f310c211cfd tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161091 Jul 20 04:51:03.348071 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4132/5257] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:03 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:04.359500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:04.365732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:04.374555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.396503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.397688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:04.400891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:04.470054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:04.518622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e0b0c54-5bc9-44fc-9658-c3b7b0627608 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162465 Jul 20 04:51:04.524539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4133/5258] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:04 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:05.533115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:05.534053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:05.589654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.590035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:05.590832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:05.602365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:05.767810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed5bcbb9-e2a2-4289-9d7d-b2faa042dc18 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240683 Jul 20 04:51:05.770146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4134/5259] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:05 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:05.829652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2c44b70-0e8e-49e0-8cc9-4638a7491e37 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '.version_select at 0x7f838ba29e50>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:05.926017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2c44b70-0e8e-49e0-8cc9-4638a7491e37 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-917123172" status: 202 len: 0 microversion: 2.1 time: 0.154615 Jul 20 04:51:05.926689 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4135/5260] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 04:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-917123172 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:51:05.956078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-723addd6-829b-40a6-ac60-c38152d1f7e9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: .version_select at 0x7f838b00a820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-437737943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHszyxt8VKkGMFwruELUSNhrr7zCgdJwYDfLhD8kONFIfcBuo97lLBlF+URdj3fgzQVAyBQubqdUdcZrSGmMV8cWFdLmYMyn38aGDnbuy5UeBVnGIVr16uBT4r8GWx3AQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:06.016591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-723addd6-829b-40a6-ac60-c38152d1f7e9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:06.047003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-723addd6-829b-40a6-ac60-c38152d1f7e9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:06.116670 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-723addd6-829b-40a6-ac60-c38152d1f7e9 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.164600 Jul 20 04:51:06.118068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4136/5261] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:51:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:06.781024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:06.782845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:06.807817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:06.808397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:06.809223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:06.809668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:06.863237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e829aba-514a-4cc4-88f1-8814cb5e9182 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084404 Jul 20 04:51:06.866391 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4137/5262] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:06 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:08.235378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a043d20-47a1-43a8-aa7a-5d39ee2bfb3f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:08.239109 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:51:08.239109 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:51:08.240695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a043d20-47a1-43a8-aa7a-5d39ee2bfb3f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.243116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a043d20-47a1-43a8-aa7a-5d39ee2bfb3f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.249380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a043d20-47a1-43a8-aa7a-5d39ee2bfb3f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.249848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a043d20-47a1-43a8-aa7a-5d39ee2bfb3f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.317936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a043d20-47a1-43a8-aa7a-5d39ee2bfb3f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.708047 Jul 20 04:51:08.318550 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4138/5263] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Jul 20 04:51:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:08.351211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:08.352169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:08.370853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.371540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.372643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:08.373635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:08.447276 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70526b81-b8ae-4337-93dd-26d2e3d47b0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097996 Jul 20 04:51:08.453064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4139/5264] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:08 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:08.577464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1609226580", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "availability_zone": "nova:n-h1-764486-11", "networks": [{"uuid": "c86ff06c-e871-4e2d-9a55-52f4d7f4b76b"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:08.816456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] validate_networks() for [('c86ff06c-e871-4e2d-9a55-52f4d7f4b76b', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:10.520246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:10.521078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:10.521669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:10.522190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:10.522724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:10.548745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.549532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.550563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.551658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.596863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Getting quotas for project cc0635c4f52f4dc88e4a6b2bde2f3bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:10.616137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Getting quotas for user 31fdece8f20b44808345c191eded91df and project cc0635c4f52f4dc88e4a6b2bde2f3bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:10.655470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:10.661851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:10.791988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f19d5373-2d7a-4790-bd13-31e812dae84f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218337 Jul 20 04:51:10.800153 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4140/5265] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:51:10.805840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:10.807277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:10.837100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.837873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.841218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:10.841909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:10.884774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5f5e3bb1-7a71-4781-8d7e-b54e19240908 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083056 Jul 20 04:51:10.885751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4141/5266] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 04:51:10 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 04:51:10.905334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c33296f8-f5c5-45a8-bcc2-9bbac1f2ab66 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:10.907563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c33296f8-f5c5-45a8-bcc2-9bbac1f2ab66 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:11.248565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c33296f8-f5c5-45a8-bcc2-9bbac1f2ab66 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1329 microversion: 2.1 time: 0.361368 Jul 20 04:51:11.249169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4142/5267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:10 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1329 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:11.284917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:11.285864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:11.318337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.318792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.319589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.320207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.423563 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Cannot 'reboot' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action HTTP/1.1 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 28 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: {"reboot": {"type": "HARD"}} Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'reboot' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de939a38-1c17-4505-b82d-156b1625f8ed', 'body': {'reboot': {'type': 'HARD'}}} Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance de939a38-1c17-4505-b82d-156b1625f8ed in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:51:11.425648 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.432004 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.446872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 409 to user: Cannot 'reboot' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:11.448033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe7cf805-8916-47d6-8a3b-b21e45449e92 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action" status: 409 len: 145 microversion: 2.1 time: 0.174442 Jul 20 04:51:11.451766 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4143/5268] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:51:11 2022] POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action => generated 145 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:51:11.458157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:11.474044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:11.487880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.505253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.506573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.507519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.673181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Cannot 'rebuild' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action HTTP/1.1 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 65 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: exception: Cannot 'rebuild' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de939a38-1c17-4505-b82d-156b1625f8ed', 'body': {'rebuild': {'imageRef': '015a4084-97ff-4146-83ba-116b77f93e6a'}}} Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance de939a38-1c17-4505-b82d-156b1625f8ed in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:51:11.675177 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:11.682954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 409 to user: Cannot 'rebuild' instance de939a38-1c17-4505-b82d-156b1625f8ed while it is in vm_state rescued {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:11.697372 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd316b92-c930-4a13-9af2-12ce797582ca tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action" status: 409 len: 146 microversion: 2.1 time: 0.242526 Jul 20 04:51:11.697994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4144/5269] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:51:11 2022] POST /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed/action => generated 146 bytes in 244 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:51:11.721372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:11.721936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:11.760949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.767722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.773544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:11.775300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:11.946473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:12.225002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c984bea5-9d11-43cf-ab16-b48d0ac77e0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 204 len: 0 microversion: 2.1 time: 0.517101 Jul 20 04:51:12.227990 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4145/5270] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:11 2022] DELETE /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:51:12.256619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:12.258238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:12.269317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:12.300090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:12.309571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:12.315046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:12.315354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.031984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:13.057118 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-805a5e10-4957-4563-a22f-8488d49a2d73 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1689 microversion: 2.1 time: 0.821778 Jul 20 04:51:13.070816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4146/5271] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:12 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1689 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:13.077964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:13.078589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:13.125688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.127658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:13.128550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:13.129598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.576023 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47126335-c142-4205-8224-ce9725ec6677 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1338 microversion: 2.1 time: 1.495128 Jul 20 04:51:14.583177 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4147/5272] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:13 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1338 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:14.597049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:14.598473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:14.635889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.636547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:14.639844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:14.640109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.221966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:15.236028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0af12b5-0057-4fba-b937-891d2864660a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1689 microversion: 2.1 time: 0.651385 Jul 20 04:51:15.236715 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4148/5273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:14 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1689 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:15.621099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:15.621099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:15.638893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.639412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.640250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:15.640723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:15.973683 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b272d095-f2f7-4396-b2f2-dfb4931bb7ab tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1424 microversion: 2.1 time: 0.378216 Jul 20 04:51:15.974293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4149/5274] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:15 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1424 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:16.255544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:16.256185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:16.270327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:16.270789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:16.271614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:16.272060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:16.775914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:16.789278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-010e6872-c077-4bda-8aff-7f6eacdfb0c2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1689 microversion: 2.1 time: 0.538547 Jul 20 04:51:16.819826 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4150/5275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:16 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1689 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:16.995317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:16.996788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:17.017066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.022868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:17.028978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.030568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:17.719958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d00d6eb-f0e3-45c8-b19a-ded0330ad414 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 0.730951 Jul 20 04:51:17.723427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4151/5276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:16 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:17.808842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:17.810202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:17.828197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.829258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:17.835331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:17.844198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:18.504786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:18.513420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ac3641c-b76a-4deb-a077-c5d608862f41 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1689 microversion: 2.1 time: 0.709152 Jul 20 04:51:18.517596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4152/5277] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:17 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1689 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:18.754019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:18.754675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:18.774487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:18.774943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:18.775732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:18.776172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:18.856524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:19.301684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d389ff0a-240b-4337-bc96-cc7bbe3c832d tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 0.560339 Jul 20 04:51:19.307960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4153/5278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:18 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:19.537304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:19.539786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:19.562811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:19.566083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:19.574883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:19.576192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:20.200201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:20.216449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9435565-73f7-4046-b2fc-df8ffe62ffea tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1621 microversion: 2.1 time: 0.682274 Jul 20 04:51:20.218703 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4154/5279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:19 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1621 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:20.332980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:20.336608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:20.380861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:20.383748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:20.388949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:20.390624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:20.571981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:20.822845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e1eb903-6f67-4df9-ac11-8e3fe14972b3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 0.496012 Jul 20 04:51:20.835427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4155/5280] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:20 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:20.848917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3740ea81-8d03-42eb-93c3-0babc4499d23 req-eb11ac99-ba0e-4638-8b64-8f56afd2d2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88af9fa4-f2ca-4caf-a4ca-0ad247f648c7", "tag": "ce390585-c68a-49cd-9202-8ebc652c2dee"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:20.870502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3740ea81-8d03-42eb-93c3-0babc4499d23 req-eb11ac99-ba0e-4638-8b64-8f56afd2d2de service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:20.871339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3740ea81-8d03-42eb-93c3-0babc4499d23 req-eb11ac99-ba0e-4638-8b64-8f56afd2d2de service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:20.891495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3740ea81-8d03-42eb-93c3-0babc4499d23 req-eb11ac99-ba0e-4638-8b64-8f56afd2d2de service nova] Creating event network-changed:ce390585-c68a-49cd-9202-8ebc652c2dee for instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 on n-h1-764486-11 Jul 20 04:51:20.907928 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3740ea81-8d03-42eb-93c3-0babc4499d23 req-eb11ac99-ba0e-4638-8b64-8f56afd2d2de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070765 Jul 20 04:51:20.911243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4156/5281] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:21.248757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:21.591766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:21.593398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:21.616194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:21.616937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:21.617938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:21.618558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:21.869712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:21.880308 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60bc63af-ddfa-44f5-b692-9330baf58fb2 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 200 len: 1621 microversion: 2.1 time: 0.650545 Jul 20 04:51:21.884014 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4157/5282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:21 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 1621 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:21.905235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:21.906155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:21.919107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:21.922822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:21.923673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:21.924119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:22.593410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc5e7360-aa41-41d2-b4d2-6b5301f0fe2b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 0.707610 Jul 20 04:51:22.594922 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4158/5283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:21 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:22.926368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:22.927284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 97ff2e60-9699-4e9f-8048-ca7da01d4d0d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:22.990538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:22.991780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:22.998754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:23.000640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:23.065524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d could not be found. Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d HTTP/1.1 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d could not be found. Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '97ff2e60-9699-4e9f-8048-ca7da01d4d0d'} Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d could not be found. Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d could not be found. Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:23.084172 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d could not be found. Jul 20 04:51:23.089939 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:23.091710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 404 to user: Instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:23.093948 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ace180fd-9dff-41f1-8c57-d978ee1d2dc6 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d" status: 404 len: 111 microversion: 2.1 time: 0.194955 Jul 20 04:51:23.102545 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4159/5284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:22 2022] GET /compute/v2.1/servers/97ff2e60-9699-4e9f-8048-ca7da01d4d0d => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:51:23.108108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fc02e014-a7ea-49fc-82e6-ecdb3042d687 req-62a5062e-f5b1-41db-9f7e-f597ceb3bd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ff2e60-9699-4e9f-8048-ca7da01d4d0d", "name": "network-vif-deleted", "tag": "2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:23.140858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fc02e014-a7ea-49fc-82e6-ecdb3042d687 req-62a5062e-f5b1-41db-9f7e-f597ceb3bd67 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:23.153184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fc02e014-a7ea-49fc-82e6-ecdb3042d687 req-62a5062e-f5b1-41db-9f7e-f597ceb3bd67 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:23.189728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fc02e014-a7ea-49fc-82e6-ecdb3042d687 req-62a5062e-f5b1-41db-9f7e-f597ceb3bd67 service nova] Creating event network-vif-deleted:2aa5dbb0-7b57-45f8-9550-d6f5508b0e2e for instance 97ff2e60-9699-4e9f-8048-ca7da01d4d0d on n-h2-764486-11 Jul 20 04:51:23.204800 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fc02e014-a7ea-49fc-82e6-ecdb3042d687 req-62a5062e-f5b1-41db-9f7e-f597ceb3bd67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099895 Jul 20 04:51:23.206295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4160/5285] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:23.213092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c29cc0b6-c6d0-48c6-b98f-008977a71ff4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '.version_select at 0x7f839cda44c0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:23.240464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c29cc0b6-c6d0-48c6-b98f-008977a71ff4 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1635629475" status: 202 len: 0 microversion: 2.1 time: 0.032517 Jul 20 04:51:23.242226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4161/5286] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 04:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1635629475 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:51:23.611470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:23.616962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:23.635717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:23.639516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:23.643958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:23.645225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:25.402884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-831c030f-15a8-4c4f-818e-484fc680627f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 1.795252 Jul 20 04:51:25.407135 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4162/5287] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:23 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:26.293557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1264597785", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "eca798b3-a66c-4e54-9b7d-7c31e67b7129"}], "key_name": "tempest-TestNetworkAdvancedServerOps-437737943", "security_groups": [{"name": "tempest-secgroup-smoke-1885282439"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:26.475042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] validate_networks() for [('eca798b3-a66c-4e54-9b7d-7c31e67b7129', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:27.702169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:27.702836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:27.703056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:27.703687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:27.704284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:27.776746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:27.777484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:27.783115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:27.783594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:27.850884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:27.887503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Getting quotas for user e13752abfe1a4708aaf68736ff893649 and project d198cfbd38c74919a0c171774b8af43a. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:27.945890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:27.948310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:28.144917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b45273f-f1d9-4973-b526-8d0ba40b8e3c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.857635 Jul 20 04:51:28.161303 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4163/5288] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:51:28.171607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:28.189643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:28.217457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.217740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:28.218533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:28.218987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:28.896429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a4c4016-5006-4fd1-85be-fe7fc29db6d4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 0.725548 Jul 20 04:51:28.897123 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4164/5289] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:28 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:28.928376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66eca118-28c7-4a38-8584-9b4cd7811ab2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:28.929021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66eca118-28c7-4a38-8584-9b4cd7811ab2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:29.158364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66eca118-28c7-4a38-8584-9b4cd7811ab2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:29.167708 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66eca118-28c7-4a38-8584-9b4cd7811ab2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1266 microversion: 2.1 time: 0.256532 Jul 20 04:51:29.168334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4165/5290] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:28 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:29.913696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:29.915068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:29.952170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:29.952786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:29.953642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:29.954092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:30.920998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49a00907-4102-4db5-bf0b-c1c4add09238 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 1.010739 Jul 20 04:51:30.927040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4166/5291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:29 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:30.939061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:30.958057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:31.013597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.014460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.015830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.025714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.542528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:31.626652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-927c6f10-5270-4695-ba16-7457f7e8cf4d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1336 microversion: 2.1 time: 0.694571 Jul 20 04:51:31.629286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4167/5292] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:30 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1336 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:31.834973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bf08c425-6ca0-4262-99d9-e77adac8b025 req-b211f445-a884-4756-adee-6f6e4f4a0f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88af9fa4-f2ca-4caf-a4ca-0ad247f648c7", "name": "network-vif-plugged", "status": "completed", "tag": "ce390585-c68a-49cd-9202-8ebc652c2dee"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:31.853896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf08c425-6ca0-4262-99d9-e77adac8b025 req-b211f445-a884-4756-adee-6f6e4f4a0f8f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.855091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf08c425-6ca0-4262-99d9-e77adac8b025 req-b211f445-a884-4756-adee-6f6e4f4a0f8f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.886245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bf08c425-6ca0-4262-99d9-e77adac8b025 req-b211f445-a884-4756-adee-6f6e4f4a0f8f service nova] Creating event network-vif-plugged:ce390585-c68a-49cd-9202-8ebc652c2dee for instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 on n-h1-764486-11 Jul 20 04:51:31.898756 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bf08c425-6ca0-4262-99d9-e77adac8b025 req-b211f445-a884-4756-adee-6f6e4f4a0f8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262917 Jul 20 04:51:31.899855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4168/5293] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:31.944979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:31.946567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:31.959643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.963188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:31.965513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:31.970736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:33.021778 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5069bd7-efa1-4d41-9051-27fe089c2b54 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1466 microversion: 2.1 time: 1.085555 Jul 20 04:51:33.040928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4169/5294] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:31 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1466 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:33.050856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:33.052243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:33.068021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:33.070106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:33.075997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:33.076800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:33.923391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:33.950524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06dd9810-984a-4a46-a4a3-dc0be47833fc tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1392 microversion: 2.1 time: 0.900005 Jul 20 04:51:33.954025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4170/5295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:33 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1392 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:34.041343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:34.043036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:34.054566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.063623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:34.063623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.063623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:34.472993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-781139a9-0f69-49ae-a104-4d1194fbb901 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1650 microversion: 2.1 time: 0.435163 Jul 20 04:51:34.477783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4171/5296] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:34 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1650 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:34.504996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:34.506033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:34.519650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.525182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:34.528308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:34.529687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.015042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-301ed02e-03ed-4d4b-8398-f7f00736dae4 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1650 microversion: 2.1 time: 0.514226 Jul 20 04:51:35.023956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4172/5297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:34 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1650 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:35.032860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:35.036161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:35.050488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:35.051176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.054141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:35.055463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.603268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:35.613605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48ca55d3-4d46-4c1a-aeb3-9ba0727537d1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1392 microversion: 2.1 time: 0.588293 Jul 20 04:51:35.627295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4173/5298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:35 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1392 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:35.636560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:35.637190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:35.657868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:35.658329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:35.659656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:35.660107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:36.138953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2c014ff-aef1-467e-bb3b-9398f5c4ecce tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1650 microversion: 2.1 time: 0.510345 Jul 20 04:51:36.153773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4174/5299] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:35 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1650 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:36.174475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-461efde7-0d87-4b88-a073-14361f395a07 req-95dd3d11-67fb-49c3-81a9-b145f2f01074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:36.185305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-461efde7-0d87-4b88-a073-14361f395a07 req-95dd3d11-67fb-49c3-81a9-b145f2f01074 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:36.186010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-461efde7-0d87-4b88-a073-14361f395a07 req-95dd3d11-67fb-49c3-81a9-b145f2f01074 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:36.212016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-461efde7-0d87-4b88-a073-14361f395a07 req-95dd3d11-67fb-49c3-81a9-b145f2f01074 service nova] Creating event network-changed:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:51:36.228389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-461efde7-0d87-4b88-a073-14361f395a07 req-95dd3d11-67fb-49c3-81a9-b145f2f01074 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073150 Jul 20 04:51:36.233563 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4175/5300] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:36.263220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-981734347", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "availability_zone": "nova:n-h2-764486-11", "networks": [{"uuid": "c86ff06c-e871-4e2d-9a55-52f4d7f4b76b"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:36.380045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] validate_networks() for [('c86ff06c-e871-4e2d-9a55-52f4d7f4b76b', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:51:37.829475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:37.946324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:51:37.946751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:51:37.947223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:51:37.947936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:51:37.948363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:51:37.971718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:37.978165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:37.981496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:37.981961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:38.005717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:38.032283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Getting quotas for project cc0635c4f52f4dc88e4a6b2bde2f3bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:51:38.049472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Getting quotas for user 31fdece8f20b44808345c191eded91df and project cc0635c4f52f4dc88e4a6b2bde2f3bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:51:38.077307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:51:38.089187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:51:38.203198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab0597ec-7b0b-4a4f-a65d-a102afec3bbd tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944673 Jul 20 04:51:38.209257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4176/5301] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:51:38.223825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:38.228849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:38.247067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:38.248071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:38.249136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:38.252580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:40.163222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:40.173846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82e9a5e5-e818-4637-9c99-d51dd5ef6e36 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1392 microversion: 2.1 time: 1.960684 Jul 20 04:51:40.181102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4177/5302] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:38 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1392 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:40.189661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:40.190833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:40.204967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:40.239223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:40.239223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:40.239223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:40.239223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:40.415940 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6a29e8e-e6db-4e63-900d-6a984262a459 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1417 microversion: 2.1 time: 0.233647 Jul 20 04:51:40.419729 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4178/5303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:40 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1417 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:41.192641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:41.195330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:41.204298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:41.205079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:41.206852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:41.207553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.020027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:42.037585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c060bfac-ded1-4213-a869-fed593fa3849 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1392 microversion: 2.1 time: 0.850423 Jul 20 04:51:42.039028 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4179/5304] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:41 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1392 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:42.045611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:42.046845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:42.074663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.075447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.077810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.078438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.614761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82ec479d-d2c2-4145-992c-cb9a5e3f3413 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.573717 Jul 20 04:51:42.621170 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4180/5305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:42 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:42.644565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b26f76b6-6d4a-4635-8a96-3b274bc7fe2f req-b359cc21-3d5c-4983-b872-40b573bfeef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "name": "network-vif-plugged", "status": "completed", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:42.664239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b26f76b6-6d4a-4635-8a96-3b274bc7fe2f req-b359cc21-3d5c-4983-b872-40b573bfeef5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.665203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b26f76b6-6d4a-4635-8a96-3b274bc7fe2f req-b359cc21-3d5c-4983-b872-40b573bfeef5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.679284 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b26f76b6-6d4a-4635-8a96-3b274bc7fe2f req-b359cc21-3d5c-4983-b872-40b573bfeef5 service nova] Creating event network-vif-plugged:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:51:42.695376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b26f76b6-6d4a-4635-8a96-3b274bc7fe2f req-b359cc21-3d5c-4983-b872-40b573bfeef5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059742 Jul 20 04:51:42.696965 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4181/5306] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:42.849442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:42.850310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:42.863835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.864609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.865585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:42.868976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:42.916298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:43.089028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc9b047f-15fe-4966-aabf-caa1ce0ac104 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 204 len: 0 microversion: 2.1 time: 0.243178 Jul 20 04:51:43.091260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4182/5307] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:42 2022] DELETE /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:51:43.104614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:43.108764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:43.156412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:43.157319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:43.158416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:43.160555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:43.753946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:43.763016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a7009dd0-2736-4222-83b4-43c4266c49b1 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1392 microversion: 2.1 time: 0.665161 Jul 20 04:51:43.767147 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4183/5308] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:43 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1392 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:43.777088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:43.789235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:43.809926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:43.833978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:43.836188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:43.839100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:44.229174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:44.244175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc5c29c8-b940-4e7e-95ea-868249c3c653 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1508 microversion: 2.1 time: 0.474952 Jul 20 04:51:44.269400 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4184/5309] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:43 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:44.269400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b0edcd71-51c9-4ba3-8fc0-a526ffe29d4e req-69c5ec93-6dbd-4efb-b5a0-8a52842b23d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1", "tag": "4a5685ff-5602-4ae4-8924-4372461e752b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:44.318242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b0edcd71-51c9-4ba3-8fc0-a526ffe29d4e req-69c5ec93-6dbd-4efb-b5a0-8a52842b23d6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:44.318902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b0edcd71-51c9-4ba3-8fc0-a526ffe29d4e req-69c5ec93-6dbd-4efb-b5a0-8a52842b23d6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:44.375050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b0edcd71-51c9-4ba3-8fc0-a526ffe29d4e req-69c5ec93-6dbd-4efb-b5a0-8a52842b23d6 service nova] Creating event network-changed:4a5685ff-5602-4ae4-8924-4372461e752b for instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 on n-h2-764486-11 Jul 20 04:51:44.395747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b0edcd71-51c9-4ba3-8fc0-a526ffe29d4e req-69c5ec93-6dbd-4efb-b5a0-8a52842b23d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146298 Jul 20 04:51:44.400481 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4185/5310] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:44.478064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:44.490614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:44.522128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:44.527025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:44.528231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:44.528977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:44.871176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5be0e27c-5d49-494f-af89-a5317c8de71b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.426550 Jul 20 04:51:44.873318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4186/5311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:44 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:44.880459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:44.881682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:44.891073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:44.892079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:44.893373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:44.894334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.181265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:45.200842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a0f6f8c-d1e5-4ec7-b764-4aa8f1c68c2b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1392 microversion: 2.1 time: 0.323519 Jul 20 04:51:45.201885 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4187/5312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:44 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:45.287443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:45.288460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:45.304212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.304869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.305684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.306127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.553538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:45.562472 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd4895bf-4239-444f-9e85-34225c85146d tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1508 microversion: 2.1 time: 0.280147 Jul 20 04:51:45.565499 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4188/5313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:45 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:45.890318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:45.891841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:45.901347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.902217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:45.903631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:45.904342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.110343 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc478adf-46c1-45ef-a898-2babbcc7fce6 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.223744 Jul 20 04:51:46.122812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4189/5314] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:45 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:46.219053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:46.220655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:46.230813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.231364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.232396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.232934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.450244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:46.463091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1be7c480-06c6-455f-ad8a-6aa20a9e2608 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1564 microversion: 2.1 time: 0.247342 Jul 20 04:51:46.464278 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4190/5315] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:46 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:46.481919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:46.482606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:46.492769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.493252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.495330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.495750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.695509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:46.705784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63c02119-28d3-45fb-b203-bbbb5418b643 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1564 microversion: 2.1 time: 0.228241 Jul 20 04:51:46.706927 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4191/5316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:46 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:46.712849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:46.728521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:46.740326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.740963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:46.744468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:46.744468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:47.041412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:47.052515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2db2aba9-d324-4341-b59b-c37ceba66ea8 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1508 microversion: 2.1 time: 0.344163 Jul 20 04:51:47.057073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4192/5317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:46 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:47.132495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:47.133403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:47.147034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:47.150103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:47.151276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:47.151912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:47.163288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:47.559858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b43ceb76-1f3d-42f7-a726-b092406c773e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.433715 Jul 20 04:51:47.561336 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4193/5318] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:47 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:47.589472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-64bcc315-704f-490d-a0b5-88a32fd26748 req-c88d4209-0d5f-4eae-8ba1-bf130141ba20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de939a38-1c17-4505-b82d-156b1625f8ed", "name": "network-vif-deleted", "tag": "b7944392-a590-4718-9160-70fe53572a1c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:47.604898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-64bcc315-704f-490d-a0b5-88a32fd26748 req-c88d4209-0d5f-4eae-8ba1-bf130141ba20 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:47.605359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-64bcc315-704f-490d-a0b5-88a32fd26748 req-c88d4209-0d5f-4eae-8ba1-bf130141ba20 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:47.640895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-64bcc315-704f-490d-a0b5-88a32fd26748 req-c88d4209-0d5f-4eae-8ba1-bf130141ba20 service nova] Creating event network-vif-deleted:b7944392-a590-4718-9160-70fe53572a1c for instance de939a38-1c17-4505-b82d-156b1625f8ed on n-h2-764486-11 Jul 20 04:51:47.657215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-64bcc315-704f-490d-a0b5-88a32fd26748 req-c88d4209-0d5f-4eae-8ba1-bf130141ba20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069765 Jul 20 04:51:47.665735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4194/5319] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:51:48.074134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:48.074973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:48.077179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:48.078577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:48.093418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:48.105997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:48.107950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:48.113925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:48.320463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:48.338034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ead71444-d7ee-4acf-8061-00a5ccacca7a tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 200 len: 1466 microversion: 2.1 time: 0.268878 Jul 20 04:51:48.343956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4195/5320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:48 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 1466 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:48.582826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:48.584500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:48.615212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:48.616018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:48.619440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:48.622174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.165873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60adb02f-125c-4fe0-9eb3-8ddecf20af5b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.590488 Jul 20 04:51:49.178585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4196/5321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:48 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:49.361939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:49.363156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: de939a38-1c17-4505-b82d-156b1625f8ed] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:49.386403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.387374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.388499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.389186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.433204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Instance de939a38-1c17-4505-b82d-156b1625f8ed could not be found. Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed HTTP/1.1 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance de939a38-1c17-4505-b82d-156b1625f8ed could not be found. Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de939a38-1c17-4505-b82d-156b1625f8ed'} Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de939a38-1c17-4505-b82d-156b1625f8ed could not be found. Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de939a38-1c17-4505-b82d-156b1625f8ed could not be found. Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:49.435633 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de939a38-1c17-4505-b82d-156b1625f8ed could not be found. Jul 20 04:51:49.441531 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:49.452953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 404 to user: Instance de939a38-1c17-4505-b82d-156b1625f8ed could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:49.453630 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a1b70cd-9850-47da-a583-7e4b860afb69 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed" status: 404 len: 111 microversion: 2.1 time: 0.096122 Jul 20 04:51:49.454560 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4197/5322] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:49 2022] GET /compute/v2.1/servers/de939a38-1c17-4505-b82d-156b1625f8ed => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:51:49.465058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:49.465504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:49.479074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.479540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.484726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.485244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.544209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:49.787314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9128320e-b020-4b50-b591-5a29c97388e1 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 204 len: 0 microversion: 2.1 time: 0.325438 Jul 20 04:51:49.793948 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4198/5323] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:49 2022] DELETE /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:51:49.808858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:49.809747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:49.821065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.821890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:49.822962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:49.824005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.813372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:50.839180 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8656105d-65f7-4adf-99aa-4ccf0ff51faf tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 1.043646 Jul 20 04:51:50.840413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4199/5324] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:49 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:50.846536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:50.847551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:50.854824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.855666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:50.856714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:50.857439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.301152 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-982f388a-e52b-49d2-a02d-3f81483323c2 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.459366 Jul 20 04:51:51.302628 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4200/5325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:50 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:51.307629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:51.308540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:51.342114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.346493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.349080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.353514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.649277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:51.661622 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b001a81f-872f-4da7-ab68-4f18fc9eea20 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1564 microversion: 2.1 time: 0.357417 Jul 20 04:51:51.663471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4201/5326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:51 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1564 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:51.677491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d43b75a5-14f5-4158-a8c9-784b830b8c4e req-b046bcda-0cac-4f9b-a675-f75f919ce41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:51.697091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d43b75a5-14f5-4158-a8c9-784b830b8c4e req-b046bcda-0cac-4f9b-a675-f75f919ce41a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.699229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d43b75a5-14f5-4158-a8c9-784b830b8c4e req-b046bcda-0cac-4f9b-a675-f75f919ce41a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.728943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d43b75a5-14f5-4158-a8c9-784b830b8c4e req-b046bcda-0cac-4f9b-a675-f75f919ce41a service nova] Creating event network-changed:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:51:51.786317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d43b75a5-14f5-4158-a8c9-784b830b8c4e req-b046bcda-0cac-4f9b-a675-f75f919ce41a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099454 Jul 20 04:51:51.789537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4202/5327] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:51.859758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:51.862851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:51.879317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.887316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:51.888616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:51.889242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.201361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:52.211884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3399735-a56e-4db0-badd-a3ec17f5fdc7 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.357423 Jul 20 04:51:52.216893 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4203/5328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:51 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:52.319996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:52.320963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:52.327493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.329232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.330803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:52.331375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:52.623037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d50b6c7-cf42-4f5b-b003-638639942605 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.308698 Jul 20 04:51:52.628407 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4204/5329] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:52 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:53.235482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:53.239148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:53.302639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.303324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.304172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.304791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.649620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:53.658646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71b3853f-0cfc-4b54-b730-dbe35ad02f0f tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1520 microversion: 2.1 time: 0.427785 Jul 20 04:51:53.662556 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4205/5330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:53 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:53.667598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-059cb0a8-14d1-4c77-b2ed-7c10b78322ff req-1d0bcd5c-3fb0-4f19-96d7-3690cca7c0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1", "name": "network-vif-plugged", "status": "completed", "tag": "4a5685ff-5602-4ae4-8924-4372461e752b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:53.695702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-059cb0a8-14d1-4c77-b2ed-7c10b78322ff req-1d0bcd5c-3fb0-4f19-96d7-3690cca7c0ea service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.696413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-059cb0a8-14d1-4c77-b2ed-7c10b78322ff req-1d0bcd5c-3fb0-4f19-96d7-3690cca7c0ea service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.730626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-059cb0a8-14d1-4c77-b2ed-7c10b78322ff req-1d0bcd5c-3fb0-4f19-96d7-3690cca7c0ea service nova] Creating event network-vif-plugged:4a5685ff-5602-4ae4-8924-4372461e752b for instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 on n-h2-764486-11 Jul 20 04:51:53.739705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-059cb0a8-14d1-4c77-b2ed-7c10b78322ff req-1d0bcd5c-3fb0-4f19-96d7-3690cca7c0ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075569 Jul 20 04:51:53.745641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4206/5331] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:53.768429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:53.772066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:53.789755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.790375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.791496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:53.793241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:53.968438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c8d9706-6282-415a-a9b5-e10bf0f1b07e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.219884 Jul 20 04:51:53.978106 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4207/5332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:53 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:54.610590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0d8e843b-84d5-49ae-a26b-91474df0dcc3 req-f899b9a0-0c11-4b67-ba05-cbf1781a6c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a885fd-892b-41e3-8c37-23617a6e4b26", "name": "network-vif-deleted", "tag": "9d29b2fc-75f4-423c-b708-418e0cf6a87a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:51:54.629116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0d8e843b-84d5-49ae-a26b-91474df0dcc3 req-f899b9a0-0c11-4b67-ba05-cbf1781a6c52 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.631203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0d8e843b-84d5-49ae-a26b-91474df0dcc3 req-f899b9a0-0c11-4b67-ba05-cbf1781a6c52 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.653006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0d8e843b-84d5-49ae-a26b-91474df0dcc3 req-f899b9a0-0c11-4b67-ba05-cbf1781a6c52 service nova] Creating event network-vif-deleted:9d29b2fc-75f4-423c-b708-418e0cf6a87a for instance 14a885fd-892b-41e3-8c37-23617a6e4b26 on n-h1-764486-11 Jul 20 04:51:54.660283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0d8e843b-84d5-49ae-a26b-91474df0dcc3 req-f899b9a0-0c11-4b67-ba05-cbf1781a6c52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055286 Jul 20 04:51:54.662043 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4208/5333] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:51:54.676172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:54.679446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:54.693499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.697364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.698595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:54.699653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:54.894138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73721f6e36eb487589dcb980b6fdb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4967ab029fe43318dcfe66a43c49cc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:51:54.904704 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75c022e8-fe6d-406e-84d9-26a2c5029916 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 200 len: 1306 microversion: 2.1 time: 0.233028 Jul 20 04:51:54.905237 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4209/5334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:54 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:54.989892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:54.990437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:55.004842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.006445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.007413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.007866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.333549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b69e384-24b9-4b82-b26c-a78dda228702 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1465 microversion: 2.1 time: 0.350786 Jul 20 04:51:55.337971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4210/5335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:54 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:55.923053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:55.923715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] [instance: 14a885fd-892b-41e3-8c37-23617a6e4b26] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:55.931925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.933229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.934402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:55.935013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:55.967407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] HTTP exception thrown: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 could not be found. Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Request method failure captured: Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 HTTP/1.1 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14ibSPITWhRbil31WGW-QtLdBsEmTOSHw39wyu8Ul5vEy1LZW_2BE5a8BHXk5tVpDOUEwSzcIoXIblHFUxoY0HEdCM1b-qYa24s4FHprel6RkGgy6LvZ3lMabkm3WLfe2Bwby4DThSBaiakHR89FUjUL1hq4QxutZJ0dqahbQFFFYFM Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c4967ab029fe43318dcfe66a43c49cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c4967ab029fe43318dcfe66a43c49cc7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c4967ab029fe43318dcfe66a43c49cc7 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1947057012 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 73721f6e36eb487589dcb980b6fdb483 Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1947057012-project Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 could not be found. Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '14a885fd-892b-41e3-8c37-23617a6e4b26'} Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 could not be found. Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 could not be found. Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.969293 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 could not be found. Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] Returning 404 to user: Instance 14a885fd-892b-41e3-8c37-23617a6e4b26 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c7dab9ca-4e29-4580-9907-47ab3e4b2298 tempest-ServerRescueNegativeTestJSON-1947057012 tempest-ServerRescueNegativeTestJSON-1947057012-project] 10.222.0.49 "GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26" status: 404 len: 111 microversion: 2.1 time: 0.053414 Jul 20 04:51:55.974507 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4211/5336] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:55 2022] GET /compute/v2.1/servers/14a885fd-892b-41e3-8c37-23617a6e4b26 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:51:56.355003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:56.359865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:56.395789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:56.396254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:56.418525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:56.420532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:56.447267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:51:56.890049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0bd96b1-771f-4f4c-855b-149b58feea5e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1649 microversion: 2.1 time: 0.540419 Jul 20 04:51:56.893015 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4212/5337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:56 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1649 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:56.906803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:56.907761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:56.920098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:56.920591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:56.921386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:56.921830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.216200 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30fb46d4-0ecb-43d3-b7ac-2cb0e6a0443b tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1649 microversion: 2.1 time: 0.313252 Jul 20 04:51:57.220446 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4213/5338] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:56 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1649 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:51:57.238301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:57.239034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:57.252837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.257954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.259523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.260575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.695714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-226fd7bf-a9a9-474f-b707-ac59cce900f3 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1649 microversion: 2.1 time: 0.461858 Jul 20 04:51:57.697313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4214/5339] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:57 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1649 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:57.713878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:57.714696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:57.724540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.727147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.727976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:57.728556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:57.790345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:51:58.046127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-039e9dcf-d026-4802-8098-ca8b3ca25b73 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 204 len: 0 microversion: 2.1 time: 0.335699 Jul 20 04:51:58.048609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4215/5340] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:51:57 2022] DELETE /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:51:58.059428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:58.060583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:58.071665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:58.072737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:58.077683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:58.078802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:58.413846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22748de1-78d5-472f-a183-8841f8a7ba5f tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1655 microversion: 2.1 time: 0.359952 Jul 20 04:51:58.432735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4216/5341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:58 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1655 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:51:59.448774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:51:59.449884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:51:59.476264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.479627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.480549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:51:59.480998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:51:59.949001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aebd1382-23be-474d-b329-38ef109f14b1 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1655 microversion: 2.1 time: 0.512318 Jul 20 04:51:59.960958 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4217/5342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:51:59 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1655 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:00.998622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:00.999339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:01.050734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.055695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.061167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:01.061649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:01.900213 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eec3e6e7-4df0-4b60-8b68-62e08246605c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1655 microversion: 2.1 time: 0.918945 Jul 20 04:52:01.909858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4218/5343] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:00 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1655 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:02.094482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8f00f4a1-7b2f-4d5e-aeff-f1b459b2eb16 req-1e029739-c1a3-4263-8c7a-ae39b08ef676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1", "name": "network-vif-deleted", "tag": "4a5685ff-5602-4ae4-8924-4372461e752b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:02.132648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:02.226254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8f00f4a1-7b2f-4d5e-aeff-f1b459b2eb16 req-1e029739-c1a3-4263-8c7a-ae39b08ef676 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.227111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8f00f4a1-7b2f-4d5e-aeff-f1b459b2eb16 req-1e029739-c1a3-4263-8c7a-ae39b08ef676 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.401298 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8f00f4a1-7b2f-4d5e-aeff-f1b459b2eb16 req-1e029739-c1a3-4263-8c7a-ae39b08ef676 service nova] Creating event network-vif-deleted:4a5685ff-5602-4ae4-8924-4372461e752b for instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 on n-h2-764486-11 Jul 20 04:52:02.470375 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8f00f4a1-7b2f-4d5e-aeff-f1b459b2eb16 req-1e029739-c1a3-4263-8c7a-ae39b08ef676 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372996 Jul 20 04:52:02.482513 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4219/5344] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:02.935891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:02.938099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:02.955670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.956142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:02.961919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:02.962353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:03.115234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:03.117985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:03.119012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lazy-loading 'fault' on Instance uuid 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:03.491667 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aced7bd8-2c5b-4a62-8fa1-ca18cf9635a9 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 200 len: 1455 microversion: 2.1 time: 0.559778 Jul 20 04:52:03.501374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4220/5345] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:02 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 1455 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:04.529480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:04.530502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:04.544167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.549052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.550385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.551012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.572530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] HTTP exception thrown: Instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 could not be found. Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Request method failure captured: Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 HTTP/1.1 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14m7ecih6fSioWVKhDAagWoG3Had7kx805D5n2oTOcZ5vZS6XpJotayGXuSjNnFtnuw7J22b1ACvjeTQCBkcfjy8k0JNW-7XDX-lxhKpyeKz4Zf3-d3i4U6wh2wyPTuWp9nnS45u-1Jh0L4YOLmXbY0iC5TIXkKkuJrUG444temAJvM Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cc0635c4f52f4dc88e4a6b2bde2f3bb8 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestServerMultinode-1886965523 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc0635c4f52f4dc88e4a6b2bde2f3bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc0635c4f52f4dc88e4a6b2bde2f3bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc0635c4f52f4dc88e4a6b2bde2f3bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc0635c4f52f4dc88e4a6b2bde2f3bb8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestServerMultinode-1886965523 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cc0635c4f52f4dc88e4a6b2bde2f3bb8 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestServerMultinode-1886965523 Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestServerMultinode-1886965523-project-admin Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 31fdece8f20b44808345c191eded91df Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestServerMultinode-1886965523-project-admin Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 could not be found. Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1'} Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 could not be found. Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 could not be found. Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:04.575660 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 could not be found. Jul 20 04:52:04.582281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:04.584991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Returning 404 to user: Instance 83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:04.586149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6c3612e-d3c2-4d90-9726-760e0fb61c8c tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1" status: 404 len: 111 microversion: 2.1 time: 0.060421 Jul 20 04:52:04.587288 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4221/5346] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:04 2022] GET /compute/v2.1/servers/83fb7f6f-0ba8-43ca-9ad8-183e8af25fc1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:04.596154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:04.596996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:04.604617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.605288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.606449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.607916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.649703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:52:04.929696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ee6cb78-2aaf-498d-8958-b545675f77a0 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 204 len: 0 microversion: 2.1 time: 0.337888 Jul 20 04:52:04.931102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4222/5347] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:52:04 2022] DELETE /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:52:04.946546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:04.947259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:04.967839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.968298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:04.969123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:04.972870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:05.325807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1fd2f7a4-bb94-456e-9ef6-5835a8b951ad tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1656 microversion: 2.1 time: 0.387220 Jul 20 04:52:05.336059 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4223/5348] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:04 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1656 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:06.345926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:06.346970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:06.374998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.375453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.376818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:06.386388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:06.871087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c2c1b43-3886-4144-886f-4cee1a473282 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1656 microversion: 2.1 time: 0.531594 Jul 20 04:52:06.885167 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4224/5349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:06 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1656 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:07.781039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f05e12b7-98f1-4e8b-94ed-af39a381da1e req-887f3570-2532-4c0b-b840-780f976ab7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88af9fa4-f2ca-4caf-a4ca-0ad247f648c7", "name": "network-vif-deleted", "tag": "ce390585-c68a-49cd-9202-8ebc652c2dee"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:07.795510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f05e12b7-98f1-4e8b-94ed-af39a381da1e req-887f3570-2532-4c0b-b840-780f976ab7dd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.796273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f05e12b7-98f1-4e8b-94ed-af39a381da1e req-887f3570-2532-4c0b-b840-780f976ab7dd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.811723 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f05e12b7-98f1-4e8b-94ed-af39a381da1e req-887f3570-2532-4c0b-b840-780f976ab7dd service nova] Creating event network-vif-deleted:ce390585-c68a-49cd-9202-8ebc652c2dee for instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 on n-h1-764486-11 Jul 20 04:52:07.817714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f05e12b7-98f1-4e8b-94ed-af39a381da1e req-887f3570-2532-4c0b-b840-780f976ab7dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041404 Jul 20 04:52:07.822718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4225/5350] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:52:07.896794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:07.897994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:07.923573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.929389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:07.951514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:07.955540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:08.066812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:08.070928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:08.072728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lazy-loading 'fault' on Instance uuid 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:52:08.175549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:08.184053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0726e978-b829-40c6-a70b-2be0fe12d27e tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 200 len: 1456 microversion: 2.1 time: 0.293182 Jul 20 04:52:08.186799 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4226/5351] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:07 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 1456 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:09.203748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.205115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] [instance: 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:09.227156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.228677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.232474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:09.233171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:09.291595 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] HTTP exception thrown: Instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 could not be found. Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Request method failure captured: Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 HTTP/1.1 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14m7ecih6fSioWVKhDAagWoG3Had7kx805D5n2oTOcZ5vZS6XpJotayGXuSjNnFtnuw7J22b1ACvjeTQCBkcfjy8k0JNW-7XDX-lxhKpyeKz4Zf3-d3i4U6wh2wyPTuWp9nnS45u-1Jh0L4YOLmXbY0iC5TIXkKkuJrUG444temAJvM Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: cc0635c4f52f4dc88e4a6b2bde2f3bb8 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestServerMultinode-1886965523 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cc0635c4f52f4dc88e4a6b2bde2f3bb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc0635c4f52f4dc88e4a6b2bde2f3bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cc0635c4f52f4dc88e4a6b2bde2f3bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cc0635c4f52f4dc88e4a6b2bde2f3bb8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestServerMultinode-1886965523 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: cc0635c4f52f4dc88e4a6b2bde2f3bb8 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestServerMultinode-1886965523 Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestServerMultinode-1886965523-project-admin Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 31fdece8f20b44808345c191eded91df Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestServerMultinode-1886965523-project-admin Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 could not be found. Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '88af9fa4-f2ca-4caf-a4ca-0ad247f648c7'} Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 could not be found. Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 could not be found. Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:09.294288 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 could not be found. Jul 20 04:52:09.299573 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:09.302569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Returning 404 to user: Instance 88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:09.306025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7" status: 404 len: 111 microversion: 2.1 time: 0.106307 Jul 20 04:52:09.307788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4227/5352] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/v2.1/servers/88af9fa4-f2ca-4caf-a4ca-0ad247f648c7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:09.879633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:09.880649 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d615eac7-dd63-4b05-921c-48169581d363 tempest-TestServerMultinode-1886965523 tempest-TestServerMultinode-1886965523-project-admin] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001338 Jul 20 04:52:09.887115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4228/5353] 10.222.0.49 () {56 vars in 885 bytes} [Wed Jul 20 04:52:09 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 04:52:12.251368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:12.252576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:12.264374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.271084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.291550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:12.292552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:12.431074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67db7013-b2b3-4d1a-93ac-b670e4569e53 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604/action" status: 200 len: 24563 microversion: 2.1 time: 0.183473 Jul 20 04:52:12.437748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4229/5354] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:52:12 2022] POST /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604/action => generated 24563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:52:13.866202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd651654-25cf-4079-82f2-97591ce926ba tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Action: 'create', calling method: .version_select at 0x7f838a94f5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1937789764", "metadata": {"Type": "work"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd651654-25cf-4079-82f2-97591ce926ba tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Request method failure captured: Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 122 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14n95PZfhT0Z9MDbXCV2Fmgqs6qknkM-sqeiOmfGjO9hg0Lv2hNJDGK7yeZF4FABuDyUEmhddfsNi0aC6erTiuBSViKqr4acn0ycb55vX7hUr1R3htAqFKZMdQE4F27NQWK-nlVNvnmPP6koEWdrxmMEFEgW0-TVRjsFCMkROtcOxO8 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ec19de45dd74b0c9b416d62b8030a28", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8c01cf9b48e441ad9d208f9b8f55aab3 Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1937789764", "metadata": {"Type": "work"}}} Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1937789764', 'metadata': {'Type': 'work'}}}} Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:52:13.871949 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 04:52:13.879195 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.890596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fd651654-25cf-4079-82f2-97591ce926ba tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:13.893550 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fd651654-25cf-4079-82f2-97591ce926ba tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.518813 Jul 20 04:52:13.894693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4230/5355] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jul 20 04:52:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 521 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 04:52:13.908471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6539a742-0733-40ac-91c8-ca0dd1271866 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Action: 'create', calling method: .version_select at 0x7f838a9d2790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-829956802", "metadata": {"Type": "work"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6539a742-0733-40ac-91c8-ca0dd1271866 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Request method failure captured: Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 119 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14n95PZfhT0Z9MDbXCV2Fmgqs6qknkM-sqeiOmfGjO9hg0Lv2hNJDGK7yeZF4FABuDyUEmhddfsNi0aC6erTiuBSViKqr4acn0ycb55vX7hUr1R3htAqFKZMdQE4F27NQWK-nlVNvnmPP6koEWdrxmMEFEgW0-TVRjsFCMkROtcOxO8 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ec19de45dd74b0c9b416d62b8030a28", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8c01cf9b48e441ad9d208f9b8f55aab3 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-829956802", "metadata": {"Type": "work"}}} Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-829956802', 'metadata': {'Type': 'work'}}}} Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '0' Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:52:13.916596 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 04:52:13.923115 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.929404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6539a742-0733-40ac-91c8-ca0dd1271866 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:13.932713 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6539a742-0733-40ac-91c8-ca0dd1271866 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032168 Jul 20 04:52:13.940837 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4231/5356] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jul 20 04:52:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:52:13.953486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5434612-9774-49c7-834c-b1aeab00e283 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Action: 'create', calling method: .version_select at 0x7f838b0780d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-228180994", "metadata": {"Type": "work"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5434612-9774-49c7-834c-b1aeab00e283 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Request method failure captured: Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 118 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14n95PZfhT0Z9MDbXCV2Fmgqs6qknkM-sqeiOmfGjO9hg0Lv2hNJDGK7yeZF4FABuDyUEmhddfsNi0aC6erTiuBSViKqr4acn0ycb55vX7hUr1R3htAqFKZMdQE4F27NQWK-nlVNvnmPP6koEWdrxmMEFEgW0-TVRjsFCMkROtcOxO8 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ec19de45dd74b0c9b416d62b8030a28", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8c01cf9b48e441ad9d208f9b8f55aab3 Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-228180994", "metadata": {"Type": "work"}}} Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-228180994', 'metadata': {'Type': 'work'}}}} Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '' Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 04:52:13.965832 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 04:52:13.971855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:13.977741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5434612-9774-49c7-834c-b1aeab00e283 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:13.979080 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5434612-9774-49c7-834c-b1aeab00e283 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036843 Jul 20 04:52:13.979913 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4232/5357] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jul 20 04:52:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 04:52:14.000328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b87f646-da7c-40f7-a101-d43e6d12032b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Calling method '.version_select at 0x7f838a9d21f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.069518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-9b87f646-da7c-40f7-a101-d43e6d12032b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] HTTP exception thrown: Volume tempest-invalid-1197601554 could not be found. Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b87f646-da7c-40f7-a101-d43e6d12032b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Request method failure captured: Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1197601554 HTTP/1.1 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14n95PZfhT0Z9MDbXCV2Fmgqs6qknkM-sqeiOmfGjO9hg0Lv2hNJDGK7yeZF4FABuDyUEmhddfsNi0aC6erTiuBSViKqr4acn0ycb55vX7hUr1R3htAqFKZMdQE4F27NQWK-nlVNvnmPP6koEWdrxmMEFEgW0-TVRjsFCMkROtcOxO8 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ec19de45dd74b0c9b416d62b8030a28", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8c01cf9b48e441ad9d208f9b8f55aab3 Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume tempest-invalid-1197601554 could not be found. Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'tempest-invalid-1197601554'} Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1197601554 could not be found. (HTTP 404) (Request-ID: req-e9c5de47-55a4-496d-80bc-01d28261fe0c) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:52:14.084248 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1197601554 could not be found. Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1197601554 could not be found. Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1197601554 could not be found. Jul 20 04:52:14.093838 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.102673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b87f646-da7c-40f7-a101-d43e6d12032b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Returning 404 to user: Volume tempest-invalid-1197601554 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:14.107464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b87f646-da7c-40f7-a101-d43e6d12032b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1197601554" status: 404 len: 99 microversion: 2.1 time: 0.121178 Jul 20 04:52:14.108241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4233/5358] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jul 20 04:52:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1197601554 => generated 99 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 04:52:14.149960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6d4b150-ef19-418e-99a1-8341c58a283e tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020463 Jul 20 04:52:14.156853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4234/5359] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jul 20 04:52:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:52:14.163190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6378859d-a4ae-4b48-a851-f902e36d6bf2 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005028 Jul 20 04:52:14.163882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4235/5360] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 04:52:14.191728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b169d469-b265-42f9-957d-c7d6380b1b4b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Calling method '.version_select at 0x7f838aa115e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.303329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b169d469-b265-42f9-957d-c7d6380b1b4b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] HTTP exception thrown: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b169d469-b265-42f9-957d-c7d6380b1b4b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Request method failure captured: Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/os-volumes/0113bbd0-7712-4838-a926-3ce3c1c40281 HTTP/1.1 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14n95PZfhT0Z9MDbXCV2Fmgqs6qknkM-sqeiOmfGjO9hg0Lv2hNJDGK7yeZF4FABuDyUEmhddfsNi0aC6erTiuBSViKqr4acn0ycb55vX7hUr1R3htAqFKZMdQE4F27NQWK-nlVNvnmPP6koEWdrxmMEFEgW0-TVRjsFCMkROtcOxO8 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ec19de45dd74b0c9b416d62b8030a28", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8c01cf9b48e441ad9d208f9b8f55aab3 Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0113bbd0-7712-4838-a926-3ce3c1c40281'} Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. (HTTP 404) (Request-ID: req-370a746d-7450-4440-a40d-abc5a2bd083a) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:52:14.305717 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b169d469-b265-42f9-957d-c7d6380b1b4b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Returning 404 to user: Volume 0113bbd0-7712-4838-a926-3ce3c1c40281 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b169d469-b265-42f9-957d-c7d6380b1b4b tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/0113bbd0-7712-4838-a926-3ce3c1c40281" status: 404 len: 109 microversion: 2.1 time: 0.125883 Jul 20 04:52:14.310967 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4236/5361] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jul 20 04:52:14 2022] DELETE /compute/v2.1/os-volumes/0113bbd0-7712-4838-a926-3ce3c1c40281 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:52:14.324298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51f08b9f-f06f-441e-a46f-05df21f8da91 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Calling method '.version_select at 0x7f838b878d30>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:14.385936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-51f08b9f-f06f-441e-a46f-05df21f8da91 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] HTTP exception thrown: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51f08b9f-f06f-441e-a46f-05df21f8da91 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Request method failure captured: Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/os-volumes/e1ece165-aea3-4a04-b566-402962826c78 HTTP/1.1 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14n95PZfhT0Z9MDbXCV2Fmgqs6qknkM-sqeiOmfGjO9hg0Lv2hNJDGK7yeZF4FABuDyUEmhddfsNi0aC6erTiuBSViKqr4acn0ycb55vX7hUr1R3htAqFKZMdQE4F27NQWK-nlVNvnmPP6koEWdrxmMEFEgW0-TVRjsFCMkROtcOxO8 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0ec19de45dd74b0c9b416d62b8030a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0ec19de45dd74b0c9b416d62b8030a28", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0ec19de45dd74b0c9b416d62b8030a28 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesNegativeTest-655718498 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8c01cf9b48e441ad9d208f9b8f55aab3 Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesNegativeTest-655718498-project Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: method: Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: exception: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e1ece165-aea3-4a04-b566-402962826c78'} Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. (HTTP 404) (Request-ID: req-8b6b3cca-2d74-4b3d-8a51-c18c67175d7f) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 04:52:14.388413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51f08b9f-f06f-441e-a46f-05df21f8da91 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] Returning 404 to user: Volume e1ece165-aea3-4a04-b566-402962826c78 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51f08b9f-f06f-441e-a46f-05df21f8da91 tempest-VolumesNegativeTest-655718498 tempest-VolumesNegativeTest-655718498-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/e1ece165-aea3-4a04-b566-402962826c78" status: 404 len: 109 microversion: 2.1 time: 0.069876 Jul 20 04:52:14.394123 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4237/5362] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jul 20 04:52:14 2022] GET /compute/v2.1/os-volumes/e1ece165-aea3-4a04-b566-402962826c78 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:52:23.397551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:23.400091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:23.411305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:23.414465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:52:23.426465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.427549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.429089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.429828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.618861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:52:23.619317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:52:23.625178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:52:23.625598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:52:23.626024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:52:23.772165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:23.807398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.807749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.808657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.809085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.933171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc3257b7-b9f7-4f85-ba43-6b26e668a9ba tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604/action" status: 202 len: 1138 microversion: 2.1 time: 0.535675 Jul 20 04:52:23.934532 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4238/5363] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:52:23 2022] POST /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604/action => generated 1138 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 04:52:23.951322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:23.952399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:23.970973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.971742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:23.972880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:23.981280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:24.486034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:24.508160 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b87254d4-34cf-4abe-a37b-4503a3e041b0 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.551256 Jul 20 04:52:24.512738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4239/5364] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:23 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:25.540260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:25.542078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:25.578812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:25.601936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:25.604962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:25.612078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:26.412431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:26.423322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b0053a7-64fa-43d4-8dd5-d3018ec9c58e tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.888776 Jul 20 04:52:26.424426 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4240/5365] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:25 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:27.441778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:27.442424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:27.464816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.465569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:27.466189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:27.466827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:27.841994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:27.860335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edbc753d-0674-4cd0-b767-2e52b7a6222b tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.422718 Jul 20 04:52:27.861992 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4241/5366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:27 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:28.887944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:28.888516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:28.910257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:28.910779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:28.911602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:28.912052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:29.494885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:29.509151 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77874012-ed6a-4aca-86dc-1d266729f78a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.634398 Jul 20 04:52:29.510931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4242/5367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:28 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:30.527928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:30.528766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:30.538538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.538997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:30.539783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:30.540225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:31.006157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:31.049330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6525eb9b-c928-4d43-be4d-4ebade6ec36d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.525810 Jul 20 04:52:31.056179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4243/5368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:30 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:32.085182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:32.086622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:32.098716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.102494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.103633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:32.105361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:32.475456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:32.502396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d890200f-68b1-4dbb-81c7-e2e858634c3d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.421585 Jul 20 04:52:32.505258 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4244/5369] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:32 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:33.530086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:33.531146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:33.561160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.564419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:33.567348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:33.570107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:34.165221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:34.178314 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c92d98b2-0926-418f-af55-08baeece5876 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.656845 Jul 20 04:52:34.179218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4245/5370] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:33 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:35.197183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:35.197991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:35.213912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.219550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.223402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:35.225518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:35.772741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:35.787192 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-accd802a-05ef-4525-b1da-e48d6c73a4b2 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.594485 Jul 20 04:52:35.787812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4246/5371] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:35 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:36.807874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:36.810006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:36.832016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.832522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:36.845006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:36.845485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:37.389208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:37.401124 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6334c20c-4c3d-4a1d-b620-df079c396c06 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1692 microversion: 2.1 time: 0.599462 Jul 20 04:52:37.404126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4247/5372] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:36 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1692 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:38.419808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:38.420604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:38.447220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:38.450171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:38.454952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:38.462182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:39.154824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:39.196929 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5ede6d8-5b90-44cd-9a6f-b4d56a6487f6 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1698 microversion: 2.1 time: 0.775045 Jul 20 04:52:39.201272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4248/5373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:38 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1698 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:52:40.220012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:52:40.220840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:52:40.245659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:40.250457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:40.251446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:40.255209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:40.624142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:52:40.632710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e1f6610-1e1c-4c85-8853-07a0cf338273 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1683 microversion: 2.1 time: 0.417324 Jul 20 04:52:40.637026 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4249/5374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:52:40 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1683 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:52:43.180236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f15472ab-ecf1-4a31-8e92-d5dc6de695a6 req-ad70fda6-8e90-4f19-956b-18e324fd8660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "name": "network-vif-unplugged", "status": "completed", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:43.197186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f15472ab-ecf1-4a31-8e92-d5dc6de695a6 req-ad70fda6-8e90-4f19-956b-18e324fd8660 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:43.197644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f15472ab-ecf1-4a31-8e92-d5dc6de695a6 req-ad70fda6-8e90-4f19-956b-18e324fd8660 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:43.260000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f15472ab-ecf1-4a31-8e92-d5dc6de695a6 req-ad70fda6-8e90-4f19-956b-18e324fd8660 service nova] Creating event network-vif-unplugged:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:52:43.282441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f15472ab-ecf1-4a31-8e92-d5dc6de695a6 req-ad70fda6-8e90-4f19-956b-18e324fd8660 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128829 Jul 20 04:52:43.292757 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4250/5375] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:52:48.636767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-96f6fc7f-39f9-4cb4-a502-5bebb63621d5 req-69896e77-4f01-4785-861c-005cc3e721f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "name": "network-vif-plugged", "status": "completed", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:52:48.654990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-96f6fc7f-39f9-4cb4-a502-5bebb63621d5 req-69896e77-4f01-4785-861c-005cc3e721f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:52:48.655442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-96f6fc7f-39f9-4cb4-a502-5bebb63621d5 req-69896e77-4f01-4785-861c-005cc3e721f8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:52:48.744294 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-96f6fc7f-39f9-4cb4-a502-5bebb63621d5 req-69896e77-4f01-4785-861c-005cc3e721f8 service nova] Creating event network-vif-plugged:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:52:48.756610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-96f6fc7f-39f9-4cb4-a502-5bebb63621d5 req-69896e77-4f01-4785-861c-005cc3e721f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124289 Jul 20 04:52:48.774946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4251/5376] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:53:07.970093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=32 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:07.983351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:08.809279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:08.810538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:08.823864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:08.824677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:08.826014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:08.826462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:08.915125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55da536d-762b-4d71-b3d8-27e08fa89b9a tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "POST /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604/action" status: 200 len: 24569 microversion: 2.1 time: 0.965111 Jul 20 04:53:08.916411 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4252/5377] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:53:07 2022] POST /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604/action => generated 24569 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 04:53:08.923945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-25451846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "68d2ff8e-a3a0-428d-b5f2-bb83ddd83601", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:09.107062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:53:10.338256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:53:10.338828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:53:10.339152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:53:10.339564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:53:10.339975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:53:10.357979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:10.360200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:10.361348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:10.362027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:10.445960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:10.469607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:10.597096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:53:10.599787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68d2ff8e-a3a0-428d-b5f2-bb83ddd83601',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:53:10.889727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a4cf934-f406-446e-917a-54b2145d5718 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967587 Jul 20 04:53:10.896323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4253/5378] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:53:10.914036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f25d76a-2b54-40e4-91d1-a4c8f31a90d9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:10.917503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f25d76a-2b54-40e4-91d1-a4c8f31a90d9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:11.091582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f25d76a-2b54-40e4-91d1-a4c8f31a90d9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:11.102637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f25d76a-2b54-40e4-91d1-a4c8f31a90d9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1055 microversion: 2.1 time: 0.205049 Jul 20 04:53:11.119370 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4254/5379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:10 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1055 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:12.123444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14a5950d-33fd-452b-ba85-2bafc5052b5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:12.125646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14a5950d-33fd-452b-ba85-2bafc5052b5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:12.509627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14a5950d-33fd-452b-ba85-2bafc5052b5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:12.526610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14a5950d-33fd-452b-ba85-2bafc5052b5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1055 microversion: 2.1 time: 0.410447 Jul 20 04:53:12.533279 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4255/5380] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:12 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1055 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:13.548779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:13.549566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:13.579736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:13.585316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:13.593267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:13.597399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:14.340812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:14.368252 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec61251b-4720-4d54-959b-d2a70d82e7ba tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1153 microversion: 2.1 time: 0.819776 Jul 20 04:53:14.369068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4256/5381] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:13 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1153 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:15.393041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:15.393713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:15.411015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:15.411471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:15.412266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:15.412731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:15.773511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:15.789212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3cc4141a-e883-4f97-af6a-2dcb74a85160 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1171 microversion: 2.1 time: 0.398494 Jul 20 04:53:15.801401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4257/5382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:15 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1171 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:16.807211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:16.807752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:16.832156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:16.832683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:16.833492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:16.848423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:18.041184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:18.052774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d32dd184-eaed-486e-a2af-ece44ed938b5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 1.249419 Jul 20 04:53:18.064763 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4258/5383] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:16 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:19.070498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:19.072003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:19.086297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:19.087314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:19.089909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:19.091305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:19.544960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:19.561592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-149459b5-a670-4e1e-a337-89ddf2c848ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 0.492911 Jul 20 04:53:19.564971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4259/5384] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:19 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:20.584924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:20.585573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:20.599735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:20.607002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:20.607501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:20.608319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:20.608790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:22.147278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:22.165790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca184754-ae83-4dce-822c-aa2e396dca4f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 1.584332 Jul 20 04:53:22.166340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4260/5385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:20 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:22.641939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:23.023946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bd98dad2-825c-4e6c-8196-7fdfd7a730e8 req-ed021a61-ea0d-4719-bc60-f878b30e1960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb410d1e-6c1d-4e26-a7b3-eab1a00eef63", "tag": "48469a89-68a1-4353-aa0c-25757d11cd71"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:23.051237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bd98dad2-825c-4e6c-8196-7fdfd7a730e8 req-ed021a61-ea0d-4719-bc60-f878b30e1960 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:23.054955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bd98dad2-825c-4e6c-8196-7fdfd7a730e8 req-ed021a61-ea0d-4719-bc60-f878b30e1960 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:23.110216 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bd98dad2-825c-4e6c-8196-7fdfd7a730e8 req-ed021a61-ea0d-4719-bc60-f878b30e1960 service nova] Creating event network-changed:48469a89-68a1-4353-aa0c-25757d11cd71 for instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 on n-h1-764486-11 Jul 20 04:53:23.128588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bd98dad2-825c-4e6c-8196-7fdfd7a730e8 req-ed021a61-ea0d-4719-bc60-f878b30e1960 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.492309 Jul 20 04:53:23.132873 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4261/5386] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:23.188047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:23.188905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:23.216199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:23.217915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:23.218896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:23.222796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:24.113243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:24.133535 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00727a7d-cba0-42d1-8bef-d673031648e8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 0.952567 Jul 20 04:53:24.136689 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4262/5387] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:23 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:25.157054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:25.163257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:25.195279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.195833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:25.198590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:25.199085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.203123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:26.226400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31a0c424-8066-4b7c-ba5a-adb9b294f65c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 1.077168 Jul 20 04:53:26.243954 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4263/5388] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:25 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:26.257159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:26.262828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:26.286895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.287690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.288861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.291746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.366490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:26.580393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68b60449-f90e-41d4-91ff-92cbd50c72e8 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 204 len: 0 microversion: 2.1 time: 0.334415 Jul 20 04:53:26.581379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4264/5389] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:26 2022] DELETE /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:26.591674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6e458866-e426-4bf6-8ccf-b3805f638d63 req-8d50a77e-a51a-4cd1-b39b-c079b34b358d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:26.627719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6e458866-e426-4bf6-8ccf-b3805f638d63 req-8d50a77e-a51a-4cd1-b39b-c079b34b358d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.631446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6e458866-e426-4bf6-8ccf-b3805f638d63 req-8d50a77e-a51a-4cd1-b39b-c079b34b358d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.653525 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6e458866-e426-4bf6-8ccf-b3805f638d63 req-8d50a77e-a51a-4cd1-b39b-c079b34b358d service nova] Creating event network-changed:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:53:26.660615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6e458866-e426-4bf6-8ccf-b3805f638d63 req-8d50a77e-a51a-4cd1-b39b-c079b34b358d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076378 Jul 20 04:53:26.663052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4265/5390] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:26.669333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:26.670244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:26.677980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.679335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:26.680289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:26.681059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:27.373547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:27.387887 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80850968-d191-4e2a-8091-fa72371c837c tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1689 microversion: 2.1 time: 0.723397 Jul 20 04:53:27.389650 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4266/5391] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:26 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1689 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:27.398819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:27.409368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:27.420523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:27.429042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:27.430051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:27.430627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:27.834912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:27.848959 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1ca9c87-0297-41df-a857-6c1e2cc34615 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 0.453820 Jul 20 04:53:27.851883 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4267/5392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:27 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:28.411087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:28.411087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:28.438799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:28.440031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:28.444280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:28.446303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:29.007842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:29.033382 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65275a23-f9ed-4978-8cd1-1490180e4bf3 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1689 microversion: 2.1 time: 0.628577 Jul 20 04:53:29.036208 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4268/5393] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:28 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1689 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:29.060077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:29.073330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:29.094508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:29.099789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:29.104897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:29.112986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:29.425719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:29.441016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2af444d0-92e7-4bfe-a011-d87ec0ebf68d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 0.402792 Jul 20 04:53:29.443850 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4269/5394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:29 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:30.062542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:30.064878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:30.081803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.082550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.083874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.084574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.386365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:30.395891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe86cf6e-84a6-45c3-9552-9a7e15ba7696 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1689 microversion: 2.1 time: 0.346275 Jul 20 04:53:30.412792 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4270/5395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:30 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1689 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:30.469705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:30.470371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:30.487886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.488372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.489198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:30.489638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:30.508559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:30.822660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:30.836274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4bb3e362-db9a-4e9c-8a47-3e076d4b451f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 0.371414 Jul 20 04:53:30.837564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4271/5396] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:30 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:31.268141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c31aecd2-fb5c-4130-bf1b-ef4c6941f0aa req-4270ab33-a53c-4bdc-867a-9bfbe169adcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604", "name": "network-vif-deleted", "tag": "65c84540-5294-4638-88f4-bd4bf0c65da3"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:31.294228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c31aecd2-fb5c-4130-bf1b-ef4c6941f0aa req-4270ab33-a53c-4bdc-867a-9bfbe169adcf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.296567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c31aecd2-fb5c-4130-bf1b-ef4c6941f0aa req-4270ab33-a53c-4bdc-867a-9bfbe169adcf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.335345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c31aecd2-fb5c-4130-bf1b-ef4c6941f0aa req-4270ab33-a53c-4bdc-867a-9bfbe169adcf service nova] Creating event network-vif-deleted:65c84540-5294-4638-88f4-bd4bf0c65da3 for instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 on n-h2-764486-11 Jul 20 04:53:31.351361 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c31aecd2-fb5c-4130-bf1b-ef4c6941f0aa req-4270ab33-a53c-4bdc-867a-9bfbe169adcf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087704 Jul 20 04:53:31.357720 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4272/5397] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:31.418342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:31.419103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:31.442349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.442829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.443649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.444095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.587548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.591714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.592390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lazy-loading 'fault' on Instance uuid 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:53:31.757216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13752abfe1a4708aaf68736ff893649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd198cfbd38c74919a0c171774b8af43a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:31.769186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ef8e89b-b728-4afa-84cb-8a831a65df59 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 200 len: 1356 microversion: 2.1 time: 0.355903 Jul 20 04:53:31.769815 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4273/5398] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:31 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 1356 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:31.857385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:31.858104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:31.884539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.887448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:31.889866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:31.890296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.298923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:32.314992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6208ed52-1882-4d3a-9f68-f4af1749d674 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1213 microversion: 2.1 time: 0.461004 Jul 20 04:53:32.316778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4274/5399] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:31 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1213 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:32.787584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:32.788930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [instance: 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:32.811646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.820188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.821799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:32.828092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:32.882846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] HTTP exception thrown: Instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 could not be found. Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Request method failure captured: Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 HTTP/1.1 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14fI2Uh8hfePvQFFsiRzC6qxuFXUX_Nvp02KeELtffh0P8y4-57vVIl5ikMVI-at6ye2zsDygciR3mr85j9TebUbVoKnux68Noznm8g9bGnPl-bwhixs6BGDl1W9jBTLbJP9ahHfTb9KKjPO29WpKos-QPKy1_8lT0lgjQI0SEO7CV0 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d198cfbd38c74919a0c171774b8af43a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d198cfbd38c74919a0c171774b8af43a", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: d198cfbd38c74919a0c171774b8af43a Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1085871251 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: e13752abfe1a4708aaf68736ff893649 Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1085871251-project Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 could not be found. Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604'} Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 could not be found. Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 could not be found. Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.895546 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 could not be found. Jul 20 04:53:32.899993 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:53:32.906795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Returning 404 to user: Instance 7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:53:32.909804 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6d61397-f9d2-4069-bbe5-76d8f0d9cf42 tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604" status: 404 len: 111 microversion: 2.1 time: 0.125981 Jul 20 04:53:32.912047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4275/5400] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:32 2022] GET /compute/v2.1/servers/7d1ea54c-0fa8-4e7c-8186-9d4e16e3f604 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:53:33.334799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:33.335630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:33.346916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:33.348810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:33.350366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:33.353799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:35.418703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:35.432993 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a7f72a9a-19d3-44e7-bccd-d084579f22bb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 2.102808 Jul 20 04:53:35.445065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4276/5401] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:33 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:36.453677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:36.454297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:36.500850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:36.502695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:36.505932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:36.506635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:37.047029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:37.057834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a45a98b3-3347-4e55-82a9-447b9a56ab71 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 0.611035 Jul 20 04:53:37.059078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4277/5402] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:36 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:38.075699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:38.076324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:38.081712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:38.103081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:38.112000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:38.113378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:38.118037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:39.378667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:39.391913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-970f3670-8093-4413-a583-4bdd9ce480f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 1.320538 Jul 20 04:53:39.404485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4278/5403] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:38 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:40.410402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:40.411027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:40.427420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:40.427871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:40.428682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:40.429123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:41.059992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:41.078856 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c24ffde8-9226-46de-a195-da74d7614fd0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 0.665624 Jul 20 04:53:41.088547 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4279/5404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:40 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:42.108282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:42.108972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:42.121778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:42.127678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:42.128795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:42.136655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:43.233652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:43.250799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b70a017b-5d65-4cc5-8a47-47b59c1184f2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 1.146565 Jul 20 04:53:43.260423 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4280/5405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:42 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:44.015012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d28320ea-8769-4b7d-9a49-1dbda837850d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] Calling method '.version_select at 0x7f838a0c93a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:44.023981 n-d-764486-11 devstack@n-api.service[123724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d28320ea-8769-4b7d-9a49-1dbda837850d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [7bf5ac51-90a9-4ad8-a56a-6f64659177d7] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 04:53:45.033712 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [None req-d28320ea-8769-4b7d-9a49-1dbda837850d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] [7bf5ac51-90a9-4ad8-a56a-6f64659177d7] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39342. Jul 20 04:53:45.084779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d28320ea-8769-4b7d-9a49-1dbda837850d tempest-TestNetworkAdvancedServerOps-1085871251 tempest-TestNetworkAdvancedServerOps-1085871251-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-437737943" status: 202 len: 0 microversion: 2.1 time: 1.075532 Jul 20 04:53:45.095283 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4281/5406] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 04:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-437737943 => generated 0 bytes in 1087 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:53:45.124549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:45.125753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:45.133360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.134383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.136381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:45.138115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:45.359637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:45.371953 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bfc00c9-3660-420b-a8dd-ba8a35ced643 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 0.275129 Jul 20 04:53:45.373990 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4282/5407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:45 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:45.942782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dbe6a1f6-6ef1-4181-8458-43ed7fe1705e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Action: 'create', calling method: .version_select at 0x7f838a22d040>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2125629057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILJrfhjKwU1kbsnfZIJd3qhMc9vDQq9A2f73hpAv9qlxGmOpc9novGOSLb1Q2a8sGzZiGMcFkOmnlfGK6J/tXBPFd1E+jP85FKCvwce4Y8xp82i0tHBx9WIQdRRqkMxCQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:45.993676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-dbe6a1f6-6ef1-4181-8458-43ed7fe1705e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Getting quotas for project c465c18121794c11bfaadef8264a4a61. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:46.007879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-dbe6a1f6-6ef1-4181-8458-43ed7fe1705e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Getting quotas for user 5412dce0e2c545ff86ca4ed2e9d20027 and project c465c18121794c11bfaadef8264a4a61. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:46.085207 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dbe6a1f6-6ef1-4181-8458-43ed7fe1705e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.698669 Jul 20 04:53:46.085870 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4283/5408] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:53:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:46.096928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bba88762-7f22-4460-af13-b4f7626d36cd req-7a56c20b-6eb0-4fa1-b990-4d92dfec50aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb410d1e-6c1d-4e26-a7b3-eab1a00eef63", "name": "network-vif-plugged", "status": "completed", "tag": "48469a89-68a1-4353-aa0c-25757d11cd71"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:46.115910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bba88762-7f22-4460-af13-b4f7626d36cd req-7a56c20b-6eb0-4fa1-b990-4d92dfec50aa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.116411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bba88762-7f22-4460-af13-b4f7626d36cd req-7a56c20b-6eb0-4fa1-b990-4d92dfec50aa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.135955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bba88762-7f22-4460-af13-b4f7626d36cd req-7a56c20b-6eb0-4fa1-b990-4d92dfec50aa service nova] Creating event network-vif-plugged:48469a89-68a1-4353-aa0c-25757d11cd71 for instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 on n-h1-764486-11 Jul 20 04:53:46.154088 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bba88762-7f22-4460-af13-b4f7626d36cd req-7a56c20b-6eb0-4fa1-b990-4d92dfec50aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067028 Jul 20 04:53:46.155067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4284/5409] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:46.391220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:46.392314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:46.405752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.407738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:46.409864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:46.410485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:47.110578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:47.119750 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17cadc27-2406-4e43-bfb8-64c2c5dfc06d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1201 microversion: 2.1 time: 0.733719 Jul 20 04:53:47.126790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4285/5410] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:46 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1201 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:48.144892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.146624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.162799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.163255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.164037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.164843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.427804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:48.436657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7189e6dd-6ddf-40d4-b171-397bf55c0999 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1388 microversion: 2.1 time: 0.297068 Jul 20 04:53:48.452795 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4286/5411] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1388 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:48.460108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.465138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.486406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.486872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.487669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.488111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.668927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:48.680596 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4fbc0def-0907-41d2-a7ac-c5768ece5cc0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1388 microversion: 2.1 time: 0.226563 Jul 20 04:53:48.691986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4287/5412] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1388 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:48.698888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.700001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.713441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.716778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.719488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.721333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.939436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:48.955343 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f25d479-4153-478f-a667-cb32c53c7c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1388 microversion: 2.1 time: 0.260063 Jul 20 04:53:48.956070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4288/5413] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:48 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1388 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:48.972054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:48.972773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:48.982928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.983611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:48.984604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:48.985228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.031623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:53:49.136293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:49.281020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd7df542-a369-445a-9248-f2e4655d55e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 204 len: 0 microversion: 2.1 time: 0.310256 Jul 20 04:53:49.281587 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4289/5414] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:53:48 2022] DELETE /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:53:49.304662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:49.307519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:49.322701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.328766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.329914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:49.330438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:49.648395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:49.669634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e59fed49-8d1c-4116-b4cd-fed05a8a7ce3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1394 microversion: 2.1 time: 0.380367 Jul 20 04:53:49.670386 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4290/5415] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:49 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1394 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:49.683566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-895637875", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2125629057", "security_groups": [{"name": "tempest-secgroup-smoke-410907962"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "fd056f24-4b76-4930-8d3a-f616f707aa01"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:49.899045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] validate_networks() for [('fd056f24-4b76-4930-8d3a-f616f707aa01', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:53:52.692691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Getting quotas for project c465c18121794c11bfaadef8264a4a61. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:52.714627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Getting quotas for user 5412dce0e2c545ff86ca4ed2e9d20027 and project c465c18121794c11bfaadef8264a4a61. Resources: dict_keys(['metadata_items']) {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:52.782710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:53:52.783534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:53:52.784336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:53:52.807671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:53:52.826675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:53:52.846459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.847504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.848582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:52.849208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:52.881158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Getting quotas for project c465c18121794c11bfaadef8264a4a61. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:52.894074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Getting quotas for user 5412dce0e2c545ff86ca4ed2e9d20027 and project c465c18121794c11bfaadef8264a4a61. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:52.931796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:53:52.939092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:53:53.114932 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-789bda29-b225-42ed-8edc-4633dcedb21e tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.439385 Jul 20 04:53:53.116152 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4291/5416] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:53:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:53:53.133923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:53.137838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:53.157128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.158455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.159625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.161636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.338072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:53.350891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49d69e37-c2d4-4864-a1ae-d8cf8c805106 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1186 microversion: 2.1 time: 0.233332 Jul 20 04:53:53.355224 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4292/5417] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:53 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1186 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:53.371802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-16b71ba3-e4bb-4fd7-8107-dec6ed51dc5d req-7d525048-7a23-4e2c-b4d8-12171739423c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb410d1e-6c1d-4e26-a7b3-eab1a00eef63", "name": "network-vif-deleted", "tag": "48469a89-68a1-4353-aa0c-25757d11cd71"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:53.411625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-16b71ba3-e4bb-4fd7-8107-dec6ed51dc5d req-7d525048-7a23-4e2c-b4d8-12171739423c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:53.412905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-16b71ba3-e4bb-4fd7-8107-dec6ed51dc5d req-7d525048-7a23-4e2c-b4d8-12171739423c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:53.442313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-16b71ba3-e4bb-4fd7-8107-dec6ed51dc5d req-7d525048-7a23-4e2c-b4d8-12171739423c service nova] Creating event network-vif-deleted:48469a89-68a1-4353-aa0c-25757d11cd71 for instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 on n-h1-764486-11 Jul 20 04:53:53.462736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-16b71ba3-e4bb-4fd7-8107-dec6ed51dc5d req-7d525048-7a23-4e2c-b4d8-12171739423c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105507 Jul 20 04:53:53.467425 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4293/5418] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:53.485101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d477273a-5baa-4217-8b7f-a897d4fb8d7a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:53.486103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d477273a-5baa-4217-8b7f-a897d4fb8d7a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:53.875556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d477273a-5baa-4217-8b7f-a897d4fb8d7a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:53.883084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d477273a-5baa-4217-8b7f-a897d4fb8d7a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1302 microversion: 2.1 time: 0.412215 Jul 20 04:53:53.886280 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4294/5419] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:53 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1302 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:54.374198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:54.375051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:54.420732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.430449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.437937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:54.444085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:54.802524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:54.817601 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8de2aa9a-762b-4f52-b2ff-5b120e9112ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1186 microversion: 2.1 time: 0.450251 Jul 20 04:53:54.825222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4295/5420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:54 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1186 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:54.903654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6129ad3-8ecc-490a-9aad-1bca8930ee6a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:54.905125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6129ad3-8ecc-490a-9aad-1bca8930ee6a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:55.140579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6129ad3-8ecc-490a-9aad-1bca8930ee6a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:55.163211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6129ad3-8ecc-490a-9aad-1bca8930ee6a tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1302 microversion: 2.1 time: 0.259398 Jul 20 04:53:55.168295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4296/5421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:54 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1302 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:55.783336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-515420804", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "e2d427b8-dee1-4e52-bb1a-c6e6c4274253"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:55.883711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] validate_networks() for [('e2d427b8-dee1-4e52-bb1a-c6e6c4274253', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:53:56.709303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:53:56.710408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:53:56.711047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:53:56.711612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:53:56.712177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:53:56.732982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.733705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.736747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:56.737361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:56.789487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Getting quotas for project 0a024443bdd4415a9e5537d0be6ee0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:56.805583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Getting quotas for user 74cfe671e48f4b70aa3e0a77cdb3b93e and project 0a024443bdd4415a9e5537d0be6ee0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:56.841330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:53:56.843784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:53:56.948396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39d7f511-f96b-4e5f-a779-01ea89c686d0 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596688 Jul 20 04:53:56.949221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4297/5422] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:53:57.702189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d51eb1dc-c142-41a3-9b02-e3240fe26858 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Action: 'create', calling method: .version_select at 0x7f8389f81b80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1040523037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNz1bDipPuyZFcn7NHECKVGKMY98RMdL/qkfOKQjQWx9G/1pEmI+BEXKlKlUwmm745IzTMXTbBHVG2wU+qqlq8km20rm1Omjs7ouyzGVwP+u9zSzZNby7qaY1Erux5E1Tw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:53:57.706945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:53:57.759546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d51eb1dc-c142-41a3-9b02-e3240fe26858 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Getting quotas for project 8d7cbda236d149e7ad47dd14fb2b9830. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:53:57.788055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-d51eb1dc-c142-41a3-9b02-e3240fe26858 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Getting quotas for user 21586a3ec5c8404faa79726006308ab4 and project 8d7cbda236d149e7ad47dd14fb2b9830. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:53:57.856777 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d51eb1dc-c142-41a3-9b02-e3240fe26858 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.906199 Jul 20 04:53:57.857741 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4298/5423] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:53:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:53:57.919943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:57.925350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:57.971432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:57.972828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:57.976721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:57.980524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.161112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:58.176214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66ab0424-c2df-4325-b284-209faca2ae59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1186 microversion: 2.1 time: 0.283999 Jul 20 04:53:58.178103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4299/5424] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:57 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1186 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:58.193591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:58.197488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:58.219812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:58.222692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.223624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:58.224017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.362018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:58.375268 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-029dc00c-a1f1-4865-a539-c03593056ac5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1298 microversion: 2.1 time: 0.193006 Jul 20 04:53:58.376380 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4300/5425] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:58 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:58.381685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:58.382719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:58.395893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:58.396828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.398210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:58.398981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:58.576633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:58.590386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07cd824b-2a2a-4d36-9d66-c2b80372ff3f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1218 microversion: 2.1 time: 0.210634 Jul 20 04:53:58.592941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4301/5426] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:58 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:59.198003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:59.220635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:59.232137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.233176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.234548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.235162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.332648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:59.341981 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-365000ab-0df4-431c-9089-c536ce264cfb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1186 microversion: 2.1 time: 0.151345 Jul 20 04:53:59.343266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4302/5427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:59 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1186 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:53:59.396023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:59.396648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:59.411749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.418961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.420021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.421593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.581553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:59.593909 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d7f26e6-4794-41bd-b955-474b276e729d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1354 microversion: 2.1 time: 0.201092 Jul 20 04:53:59.597790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4303/5428] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:59 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:53:59.610915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:53:59.612461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:53:59.623995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.625637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.626809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:53:59.629740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:53:59.807368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:53:59.817125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a0adf21-47a0-4ffc-8d81-03ca2475d873 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1266 microversion: 2.1 time: 0.210824 Jul 20 04:53:59.827054 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4304/5429] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:53:59 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:00.360061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:00.360827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:00.378141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.379020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.380064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.380712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.626110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:00.637456 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dba2a959-3130-4a82-8109-b2827d296850 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1186 microversion: 2.1 time: 0.281717 Jul 20 04:54:00.641467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4305/5430] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:00 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1186 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:00.652508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:00.656922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:00.671882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.673560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.676191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.678683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.879210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:00.890291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b7fbc10-c395-462c-b028-b2f536ffbcbf tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1360 microversion: 2.1 time: 0.247525 Jul 20 04:54:00.901853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4306/5431] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:00 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:00.915945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:00.917708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:00.925166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.925953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:00.926950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:00.927603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.048330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:01.070501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d981b2cb-12a6-409d-9a54-ce68b875eef5 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1272 microversion: 2.1 time: 0.158757 Jul 20 04:54:01.073260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4307/5432] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:00 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:01.663879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:01.664956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:01.689128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.690099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.691699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.692333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.729138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.729851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.730520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lazy-loading 'fault' on Instance uuid eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:01.807906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:01.816859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb2a54fe-ae8f-420b-b232-aa816c3f1534 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 200 len: 1191 microversion: 2.1 time: 0.159648 Jul 20 04:54:01.818030 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4308/5433] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:01 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 1191 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:01.910050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:01.911248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:01.926509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.927953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:01.929218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:01.931160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:02.099724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:02.113335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebae113b-59ee-4554-bffd-f962933386ad tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1360 microversion: 2.1 time: 0.206900 Jul 20 04:54:02.114672 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4309/5434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:01 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1360 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:02.121714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:02.129354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:02.136579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:02.137038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:02.138843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:02.139540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:02.346278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:02.357041 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-872490b6-f335-400f-b3e0-ec3a0ff882ec tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.239773 Jul 20 04:54:02.357848 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4310/5435] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:02 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:02.836559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:02.837193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: eb410d1e-6c1d-4e26-a7b3-eab1a00eef63] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:02.857723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:02.860158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:02.861320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:02.861781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:02.928772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:02.930935 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 could not be found. Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 HTTP/1.1 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 could not be found. Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'eb410d1e-6c1d-4e26-a7b3-eab1a00eef63'} Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 could not be found. Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 could not be found. Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:02.933405 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 could not be found. Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:02.937182 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9d78c7f-7e96-4446-919f-1069a61712c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63" status: 404 len: 111 microversion: 2.1 time: 0.104226 Jul 20 04:54:02.938925 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4311/5436] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:02 2022] GET /compute/v2.1/servers/eb410d1e-6c1d-4e26-a7b3-eab1a00eef63 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:54:03.131751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:03.132402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:03.147684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:03.148063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:03.152565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:03.155385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:03.437856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:03.449500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edcee8f2-3e15-426f-857d-d55d7e90a757 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.322276 Jul 20 04:54:03.451535 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4312/5437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:03 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:03.456776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:03.458083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:03.477783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:03.478672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:03.479731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:03.480170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:04.044046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:04.063168 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1adca0f3-62ee-4e1f-8afc-3d5c2cd5f7a9 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.610518 Jul 20 04:54:04.067610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4313/5438] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:03 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:04.467086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:04.468182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:04.480327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:04.482260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:04.484637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:04.489613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:06.060676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:06.065710 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8cf0580-1cd5-4cee-89fd-96596abeb4bb tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 1.603245 Jul 20 04:54:06.075647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4314/5439] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:04 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:06.081036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:06.081628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:06.107574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:06.108031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:06.108863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:06.109311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:06.751758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:06.761937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:06.784637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c68a15a1-bf88-4c84-84f4-5d689cc81ce2 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.704523 Jul 20 04:54:06.794017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4315/5440] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:06 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:06.801979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-45d66c40-e0dc-40b8-b2bf-7bb4fad14836 req-2eb38dc4-3082-425e-a7e6-668aebdb4af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b420b5-91f9-47fc-99f9-512a7e4aaa40", "tag": "f16ab84a-3a53-4c92-bffa-ff7e24efdf59"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:06.811602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45d66c40-e0dc-40b8-b2bf-7bb4fad14836 req-2eb38dc4-3082-425e-a7e6-668aebdb4af1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:06.812313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45d66c40-e0dc-40b8-b2bf-7bb4fad14836 req-2eb38dc4-3082-425e-a7e6-668aebdb4af1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:06.848761 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-45d66c40-e0dc-40b8-b2bf-7bb4fad14836 req-2eb38dc4-3082-425e-a7e6-668aebdb4af1 service nova] Creating event network-changed:f16ab84a-3a53-4c92-bffa-ff7e24efdf59 for instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 on n-h2-764486-11 Jul 20 04:54:06.863007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-45d66c40-e0dc-40b8-b2bf-7bb4fad14836 req-2eb38dc4-3082-425e-a7e6-668aebdb4af1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067408 Jul 20 04:54:06.863934 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4316/5441] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:07.092798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:07.094312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:07.105906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:07.108130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:07.114571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:07.115026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:07.741380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:07.757487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dbd695fc-2a9f-41d5-b81e-b3b45608418c tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.669902 Jul 20 04:54:07.768505 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4317/5442] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:07 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:07.803054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:07.803903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:07.817747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=28 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:07.826049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:07.826525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:07.829767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:07.830458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:08.536921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:08.552313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f772643-61d0-4a8a-8ff6-fd24acbd52bc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.754822 Jul 20 04:54:08.552979 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4318/5443] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:07 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:08.773673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:08.774288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:08.792664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:08.793118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:08.793911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:08.794340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:09.520600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:09.536244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e67d3fa-1521-4291-aca6-9bf2c3547f44 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.766464 Jul 20 04:54:09.538371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4319/5444] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:08 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:09.555351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d8954157-676f-4184-b170-c95c1259fb21 req-f8bbda18-e69e-4e34-8218-d24d687289d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ef2ab0-45a5-45df-84d9-6ad638279015", "tag": "314e1fb4-1557-49c7-b090-e63515605cf8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:09.622223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d8954157-676f-4184-b170-c95c1259fb21 req-f8bbda18-e69e-4e34-8218-d24d687289d5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:09.624769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d8954157-676f-4184-b170-c95c1259fb21 req-f8bbda18-e69e-4e34-8218-d24d687289d5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:09.673010 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d8954157-676f-4184-b170-c95c1259fb21 req-f8bbda18-e69e-4e34-8218-d24d687289d5 service nova] Creating event network-changed:314e1fb4-1557-49c7-b090-e63515605cf8 for instance 25ef2ab0-45a5-45df-84d9-6ad638279015 on n-h2-764486-11 Jul 20 04:54:09.692289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d8954157-676f-4184-b170-c95c1259fb21 req-f8bbda18-e69e-4e34-8218-d24d687289d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147353 Jul 20 04:54:09.698813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4320/5445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:09.714034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:09.718260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:09.731819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:09.732269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:09.733109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:09.733527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:11.041394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:11.053938 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-add7264e-5c09-4154-9b99-52e2776c3a29 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 1.353398 Jul 20 04:54:11.069399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4321/5446] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:09 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:11.092167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:11.099967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:11.131326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:11.136035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:11.137376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:11.137905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:11.932158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:11.949293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-57464fae-f531-4c2b-a089-6f6363871b2d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.869768 Jul 20 04:54:11.954477 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4322/5447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:11 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:12.076642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:12.078375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:12.097963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:12.106317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:12.107637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:12.109398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:12.853569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:12.872135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9bc2e85c-11a5-4415-8eea-b32853c691af tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.797278 Jul 20 04:54:12.874089 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4323/5448] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:12 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:12.966007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:12.966633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:12.983965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:12.984501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:12.986954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:12.987416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:14.186629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:14.209006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a9b7068-2e27-4bb2-9a53-430c2d051800 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 1.243883 Jul 20 04:54:14.209662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4324/5449] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:12 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:14.249021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:14.249930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:14.292748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:14.294966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:14.299183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:14.302366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:14.955001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:14.976534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cce13fe6-0bfe-4d45-968a-9c4bb8e9c217 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.759649 Jul 20 04:54:14.977161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4325/5450] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:14 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:14.996884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-332ff916-f509-47e4-aa58-7f8bc8e9f7fb req-ca1e52a1-7adf-4ace-87a6-cb143cf3a3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b420b5-91f9-47fc-99f9-512a7e4aaa40", "name": "network-vif-plugged", "status": "completed", "tag": "f16ab84a-3a53-4c92-bffa-ff7e24efdf59"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:15.026119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-332ff916-f509-47e4-aa58-7f8bc8e9f7fb req-ca1e52a1-7adf-4ace-87a6-cb143cf3a3da service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:15.037143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-332ff916-f509-47e4-aa58-7f8bc8e9f7fb req-ca1e52a1-7adf-4ace-87a6-cb143cf3a3da service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:15.100364 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-332ff916-f509-47e4-aa58-7f8bc8e9f7fb req-ca1e52a1-7adf-4ace-87a6-cb143cf3a3da service nova] Creating event network-vif-plugged:f16ab84a-3a53-4c92-bffa-ff7e24efdf59 for instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 on n-h2-764486-11 Jul 20 04:54:15.123885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-332ff916-f509-47e4-aa58-7f8bc8e9f7fb req-ca1e52a1-7adf-4ace-87a6-cb143cf3a3da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139047 Jul 20 04:54:15.126628 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4326/5451] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:15.228289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:15.231803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:15.244845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:15.245313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:15.246105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:15.246550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:15.646305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:15.657561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-239a72ec-3bcb-4dce-991a-1278cf3368d5 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.434174 Jul 20 04:54:15.659278 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4327/5452] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:15 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:16.000148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:16.000819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:16.030029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:16.033223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:16.035561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:16.036067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:16.429455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:16.445546 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6238e98-f7b3-481a-8ebc-e94ceb0b2c3a tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1314 microversion: 2.1 time: 0.454722 Jul 20 04:54:16.446365 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4328/5453] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:15 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:16.676323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:16.677069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:16.699620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:16.701965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:16.704475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:16.706673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:17.315182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:17.326924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60c2e5a5-edff-4c5e-93b9-4dc086270ca8 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.655510 Jul 20 04:54:17.327515 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4329/5454] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:16 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:17.427968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1174329016-access_point-786769586", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "abb29914-e913-4201-9e48-4d5b2cc0f1af"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1040523037", "security_groups": [{"name": "tempest-secgroup_access--1600350180"}, {"name": "tempest-secgroup_general--627035284"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:17.746396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] validate_networks() for [('abb29914-e913-4201-9e48-4d5b2cc0f1af', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:54:18.615006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:54:18.615725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:54:18.616384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:54:18.617169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:54:18.618675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:54:18.632698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.634008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.635316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:18.636041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:18.740037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Getting quotas for project 8d7cbda236d149e7ad47dd14fb2b9830. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:18.755667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Getting quotas for user 21586a3ec5c8404faa79726006308ab4 and project 8d7cbda236d149e7ad47dd14fb2b9830. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:18.812248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:54:18.815557 n-d-764486-11 devstack@n-api.service[123724]: WARNING nova.utils [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1174329016-access_point-786769586 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1174329016-ac Jul 20 04:54:18.816290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:54:18.950646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-802a0407-075a-4331-be44-c1fedb10b9fd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.520910 Jul 20 04:54:18.955308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4330/5455] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:54:17 2022] POST /compute/v2.1/servers => generated 457 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:54:18.988151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:18.990925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:19.027063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.028524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.030094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.032879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.071565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:19.369080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:19.379434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-443a02c8-1b4b-4377-9537-efd356c1b6dc tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1501 microversion: 2.1 time: 0.420558 Jul 20 04:54:19.382498 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4331/5456] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:18 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:19.405569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:19.406814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:19.422579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.424531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.427949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:19.429795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:19.782125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:19.807593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fef74896-725c-44fb-bdac-aacc44c787bc tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.420121 Jul 20 04:54:19.808250 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4332/5457] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:19 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:19.828310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14bd3448-235d-4205-b09c-3e4d4ff6f82a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:19.831293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14bd3448-235d-4205-b09c-3e4d4ff6f82a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:19.842113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:19.973070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14bd3448-235d-4205-b09c-3e4d4ff6f82a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:19.984741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14bd3448-235d-4205-b09c-3e4d4ff6f82a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1294 microversion: 2.1 time: 0.175159 Jul 20 04:54:19.986472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4333/5458] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:19 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1294 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:19.993959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:19.994959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:20.003321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.004162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.005242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.005891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.410751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:20.438920 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2666fbd3-163b-44ce-9b7b-cb0c729f0c11 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1501 microversion: 2.1 time: 0.449226 Jul 20 04:54:20.440388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4334/5459] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:19 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1501 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:20.453734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-94b86527-e1d2-4800-a61e-35f3744deacf req-06c0f8a4-40c0-4b5d-9933-f1c11408e931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ef2ab0-45a5-45df-84d9-6ad638279015", "name": "network-vif-plugged", "status": "completed", "tag": "314e1fb4-1557-49c7-b090-e63515605cf8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:20.468897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-94b86527-e1d2-4800-a61e-35f3744deacf req-06c0f8a4-40c0-4b5d-9933-f1c11408e931 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.469432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-94b86527-e1d2-4800-a61e-35f3744deacf req-06c0f8a4-40c0-4b5d-9933-f1c11408e931 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.493044 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-94b86527-e1d2-4800-a61e-35f3744deacf req-06c0f8a4-40c0-4b5d-9933-f1c11408e931 service nova] Creating event network-vif-plugged:314e1fb4-1557-49c7-b090-e63515605cf8 for instance 25ef2ab0-45a5-45df-84d9-6ad638279015 on n-h2-764486-11 Jul 20 04:54:20.503012 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-94b86527-e1d2-4800-a61e-35f3744deacf req-06c0f8a4-40c0-4b5d-9933-f1c11408e931 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060081 Jul 20 04:54:20.504265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4335/5460] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:20.512405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:20.528677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:20.541625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.542088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.543793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.544339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.589086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lazy-loading 'flavor' on Instance uuid 27b420b5-91f9-47fc-99f9-512a7e4aaa40 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:20.752031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97160bf7-85dd-49ce-a8ef-2b78d2d0e644 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action" status: 202 len: 0 microversion: 2.1 time: 0.234226 Jul 20 04:54:20.757008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4336/5461] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:54:20 2022] POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:54:20.778436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:20.779985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:20.797350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.797967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:20.800461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:20.800914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.122397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:21.133166 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c013f7c1-294d-469a-9e3e-e2b30e3678fb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1509 microversion: 2.1 time: 0.370399 Jul 20 04:54:21.134679 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4337/5462] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:20 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:21.140678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:21.141686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:21.150571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.151674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.155845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.156906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.662948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:21.679061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-783c3951-b860-4d31-9193-1c48be7f6352 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1427 microversion: 2.1 time: 0.542250 Jul 20 04:54:21.680980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4338/5463] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:21 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1427 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:21.691944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:21.694514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:21.711235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.712871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.715565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:21.716166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:21.931039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:21.941339 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6861d4ca-2a30-43c9-abba-3e2b53bebef5 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1352 microversion: 2.1 time: 0.258895 Jul 20 04:54:21.956526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4339/5464] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:21 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1352 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:22.164243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:22.167342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:22.214313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.221052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:22.226434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.227445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:22.655741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:22.665819 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4897c869-8ec2-4c72-9008-9aa2ed5586ed tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1492 microversion: 2.1 time: 0.516037 Jul 20 04:54:22.679692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4340/5465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:22 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1492 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:22.697610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:22.698225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:22.713656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.714099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:22.714883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:22.715779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.151610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:23.180053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb3080d6-5c59-4220-88f9-d25c11a1d514 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1606 microversion: 2.1 time: 0.486346 Jul 20 04:54:23.181248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4341/5466] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:22 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1606 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:23.189825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:23.191038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:23.218736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:23.222124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.224556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:23.225587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.427547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47387237-0981-4e38-81fa-4e3ad68ebd67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action" status: 202 len: 0 microversion: 2.1 time: 0.242908 Jul 20 04:54:23.454182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4342/5467] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:54:23 2022] POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:54:23.485319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:23.487830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:23.518204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:23.521804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:23.526170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:23.528166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.665034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:24.677485 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36e97b57-3519-412c-bb52-9f5599c49619 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1471 microversion: 2.1 time: 1.218617 Jul 20 04:54:24.678091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4343/5468] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:23 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1471 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:24.688269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:24.691343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:24.706368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.706829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:24.707633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:24.708078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.082175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:25.097859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d358a9ae-7f86-46fc-93ee-c759a6e7561d tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1606 microversion: 2.1 time: 0.418622 Jul 20 04:54:25.112717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4344/5469] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:24 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1606 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:25.121926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.123356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.178460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.183563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.183563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.183563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.843332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:25.857250 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d9b0360-ba43-4480-85b3-2f503679f36e tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1498 microversion: 2.1 time: 0.752996 Jul 20 04:54:25.870665 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4345/5470] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:25 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1498 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:25.870665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:25.871209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:25.891284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.891743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:25.892566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:25.893024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.170409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:26.174783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:26.185629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-168ff644-2d50-4f11-9bbc-9b9d3db20422 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1606 microversion: 2.1 time: 0.325725 Jul 20 04:54:26.189073 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4346/5471] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:25 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1606 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:26.199720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:26.199720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:26.215957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.221661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.221661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.221661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.720846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:26.755581 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5523df95-a42a-4f4d-a5f4-920091b1af39 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1471 microversion: 2.1 time: 0.564132 Jul 20 04:54:26.761181 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4347/5472] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:26 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1471 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:26.789108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-72f64534-b9b6-4891-b1e2-892ad38c5bc4 req-13a9ec75-85cb-499d-ac6e-0c04fdac801e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551d39a9-4afb-430d-8b1d-1d66b4b7981d", "tag": "1709b439-d551-4214-8a65-d671a5c58add"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:26.827609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72f64534-b9b6-4891-b1e2-892ad38c5bc4 req-13a9ec75-85cb-499d-ac6e-0c04fdac801e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:26.828081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72f64534-b9b6-4891-b1e2-892ad38c5bc4 req-13a9ec75-85cb-499d-ac6e-0c04fdac801e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:26.929106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-72f64534-b9b6-4891-b1e2-892ad38c5bc4 req-13a9ec75-85cb-499d-ac6e-0c04fdac801e service nova] Creating event network-changed:1709b439-d551-4214-8a65-d671a5c58add for instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d on n-h1-764486-11 Jul 20 04:54:26.940151 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-72f64534-b9b6-4891-b1e2-892ad38c5bc4 req-13a9ec75-85cb-499d-ac6e-0c04fdac801e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176041 Jul 20 04:54:26.940825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4348/5473] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:26.974577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:26.983360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:26.995949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.005610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.009057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.011437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.517016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:27.527714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f8360dc-94b4-46fe-94c4-d3340d172119 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1501 microversion: 2.1 time: 0.584788 Jul 20 04:54:27.541249 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4349/5474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:26 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1501 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:27.548620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:27.552054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:27.559512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.560175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.561166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.562177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.627398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lazy-loading 'flavor' on Instance uuid 27b420b5-91f9-47fc-99f9-512a7e4aaa40 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:27.843857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16796c4c-8e0d-4665-8b3b-dd169ebb2c22 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action" status: 202 len: 0 microversion: 2.1 time: 0.298898 Jul 20 04:54:27.847960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4350/5475] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:54:27 2022] POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:54:27.864069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:27.870151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:27.885572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.887166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:27.889570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:27.891311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.644389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:28.693073 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3dfa08f5-5797-4503-8d0d-eacd0f05e7bd tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1471 microversion: 2.1 time: 0.842840 Jul 20 04:54:28.710335 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4351/5476] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:27 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1471 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:28.723983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:28.725038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:28.739881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:28.750043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.752045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:28.753637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:28.754553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.535590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:29.546481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5fb8c86f-1b21-43aa-9f72-3bcd2f18219c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1492 microversion: 2.1 time: 0.833595 Jul 20 04:54:29.553154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4352/5477] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:28 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1492 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:29.583401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:29.584638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:29.609956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.610704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.611895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.612680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.772181 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce421599-aba7-4616-bbaf-8207a5ad587c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action" status: 202 len: 0 microversion: 2.1 time: 0.203047 Jul 20 04:54:29.773509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4353/5478] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:54:29 2022] POST /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:54:29.809556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:29.812149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:29.827769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.831071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.832906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:29.833921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:29.994619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:31.187874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:31.199381 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-625dd72a-e96b-4d15-8cf4-5ae6bc751d36 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1471 microversion: 2.1 time: 1.404422 Jul 20 04:54:31.209318 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4354/5479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:29 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1471 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:31.216915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:31.223536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:31.246404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:31.247170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.248157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:31.252621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:31.999563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:32.007673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4e2a06dd-e08b-4d2a-a8a8-41272a49fbdb tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1498 microversion: 2.1 time: 0.796991 Jul 20 04:54:32.014724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4355/5480] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:31 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1498 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:32.228676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:32.229315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:32.239483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.245571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:32.245571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:32.245571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.022814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:33.048790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4818a55c-e3b1-49ec-a6cd-f9f8a2063b7c tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1471 microversion: 2.1 time: 0.825670 Jul 20 04:54:33.051882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4356/5481] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:32 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1471 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:33.058493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a1eee8cc-4138-4692-91a2-ae89d1116f60 req-6a82a2aa-5442-4bdd-aadc-e5ff6dcc1441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551d39a9-4afb-430d-8b1d-1d66b4b7981d", "name": "network-vif-plugged", "status": "completed", "tag": "1709b439-d551-4214-8a65-d671a5c58add"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:33.094361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1eee8cc-4138-4692-91a2-ae89d1116f60 req-6a82a2aa-5442-4bdd-aadc-e5ff6dcc1441 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.095431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a1eee8cc-4138-4692-91a2-ae89d1116f60 req-6a82a2aa-5442-4bdd-aadc-e5ff6dcc1441 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.118894 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a1eee8cc-4138-4692-91a2-ae89d1116f60 req-6a82a2aa-5442-4bdd-aadc-e5ff6dcc1441 service nova] Creating event network-vif-plugged:1709b439-d551-4214-8a65-d671a5c58add for instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d on n-h1-764486-11 Jul 20 04:54:33.141553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a1eee8cc-4138-4692-91a2-ae89d1116f60 req-6a82a2aa-5442-4bdd-aadc-e5ff6dcc1441 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086058 Jul 20 04:54:33.156504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4357/5482] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:33.169063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:33.176072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:33.199082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.199918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.209531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.210728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.894532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:33.904749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-375863f6-afce-4e78-af1f-d7779d565d94 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1501 microversion: 2.1 time: 0.746135 Jul 20 04:54:33.919798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4358/5483] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:33 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1501 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:33.942740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:33.944011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:33.963678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.967958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:33.974726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:33.977815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.081373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:54:34.292692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-822afe71-3dda-4fc4-a5e1-6b320dcccc70 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "DELETE /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 204 len: 0 microversion: 2.1 time: 0.363821 Jul 20 04:54:34.293543 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4359/5484] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:54:33 2022] DELETE /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:54:34.303127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b874f35f-a0ae-4f5d-a0b4-d034ac31f70b req-6e881b86-525a-435e-9378-ecec6ddbbfdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ef2ab0-45a5-45df-84d9-6ad638279015", "tag": "314e1fb4-1557-49c7-b090-e63515605cf8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:34.351110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b874f35f-a0ae-4f5d-a0b4-d034ac31f70b req-6e881b86-525a-435e-9378-ecec6ddbbfdc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.354638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b874f35f-a0ae-4f5d-a0b4-d034ac31f70b req-6e881b86-525a-435e-9378-ecec6ddbbfdc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.405045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b874f35f-a0ae-4f5d-a0b4-d034ac31f70b req-6e881b86-525a-435e-9378-ecec6ddbbfdc service nova] Creating event network-changed:314e1fb4-1557-49c7-b090-e63515605cf8 for instance 25ef2ab0-45a5-45df-84d9-6ad638279015 on n-h2-764486-11 Jul 20 04:54:34.416601 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b874f35f-a0ae-4f5d-a0b4-d034ac31f70b req-6e881b86-525a-435e-9378-ecec6ddbbfdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118749 Jul 20 04:54:34.418576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4360/5485] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:34.452716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:34.453438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:34.465855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.471708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.475057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.476041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.579720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:34.889929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:34.901558 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7a53d07e-f2dc-4780-a08c-4ddddf315408 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1471 microversion: 2.1 time: 0.462000 Jul 20 04:54:34.903152 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4361/5486] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:34 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:34.918389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:34.919602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:34.927915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.928702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:34.930770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:34.931610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:35.270983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:35.283956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1dca2fd1-f833-4813-a60a-6ce4cb840865 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1507 microversion: 2.1 time: 0.370308 Jul 20 04:54:35.286654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4362/5487] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:34 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:35.923955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:35.925085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:35.954164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:35.955092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:35.958931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:35.959572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:36.344176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:36.361220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fdbd748-2f27-4415-a337-7a71f9b6a1ad tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1643 microversion: 2.1 time: 0.444487 Jul 20 04:54:36.364045 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4363/5488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:35 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1643 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:36.369420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:36.370535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:36.392717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:36.394109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:36.395415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:36.396766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:37.462777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:37.475318 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c82119b-51cf-4f15-a9a8-e98dc09d7d5f tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1507 microversion: 2.1 time: 1.109592 Jul 20 04:54:37.482767 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4364/5489] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:36 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1507 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:37.499295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:37.501529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:37.521502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:37.522222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:37.524263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:37.525513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:37.844760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:37.859219 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-386bed0a-adb8-4d42-8efe-888c97b223de tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1643 microversion: 2.1 time: 0.373500 Jul 20 04:54:37.862620 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4365/5490] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:37 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1643 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:37.886248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:37.888675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:37.919873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:37.926860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:37.928526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:37.934138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.673722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-565a1f70-7fbb-45ec-a300-1161753ea734 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1796 microversion: 2.1 time: 0.791903 Jul 20 04:54:38.675151 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4366/5491] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:37 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1796 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:38.702737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:38.717881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:38.728132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.728598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.729394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.729839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.834930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.836232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:38.841157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lazy-loading 'fault' on Instance uuid 27b420b5-91f9-47fc-99f9-512a7e4aaa40 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:54:38.948863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cfe671e48f4b70aa3e0a77cdb3b93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a024443bdd4415a9e5537d0be6ee0a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:38.959861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-457619db-e9c0-4ce0-a9f0-45eff97db22c tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 200 len: 1304 microversion: 2.1 time: 0.283493 Jul 20 04:54:38.965829 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4367/5492] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:38 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 1304 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:38.972841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-20887e1b-3ddb-4641-bbd2-3168155b590f req-1474554c-29df-4552-af32-2e887207f2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b420b5-91f9-47fc-99f9-512a7e4aaa40", "name": "network-vif-deleted", "tag": "f16ab84a-3a53-4c92-bffa-ff7e24efdf59"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:38.996817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-20887e1b-3ddb-4641-bbd2-3168155b590f req-1474554c-29df-4552-af32-2e887207f2ec service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:38.997627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-20887e1b-3ddb-4641-bbd2-3168155b590f req-1474554c-29df-4552-af32-2e887207f2ec service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:39.018460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-20887e1b-3ddb-4641-bbd2-3168155b590f req-1474554c-29df-4552-af32-2e887207f2ec service nova] Creating event network-vif-deleted:f16ab84a-3a53-4c92-bffa-ff7e24efdf59 for instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 on n-h2-764486-11 Jul 20 04:54:39.036495 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-20887e1b-3ddb-4641-bbd2-3168155b590f req-1474554c-29df-4552-af32-2e887207f2ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067126 Jul 20 04:54:39.037126 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4368/5493] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:54:39.990808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:40.025495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] [instance: 27b420b5-91f9-47fc-99f9-512a7e4aaa40] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:40.058930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:40.059725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:40.081411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:40.081411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:40.145784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] HTTP exception thrown: Instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 could not be found. Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Request method failure captured: Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 HTTP/1.1 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14pdmh2AWs2BnoOjIUhRHhrkUqAHI3dXvG1-QtKWcc5npBdVGos1nkFMQHEcRYbBEqawLlIp9_qeM-36jK90bbFiWBYFb7cPDpZb_dZqLZrGEdv7yOn6s-ktlhdCqWCQZ6m3lfdZPvzq9rJT3We5gRXiypZUkoqvq39NGCcWuUGGRU8 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0a024443bdd4415a9e5537d0be6ee0a7 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestServerAdvancedOps-1925099407 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0a024443bdd4415a9e5537d0be6ee0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a024443bdd4415a9e5537d0be6ee0a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0a024443bdd4415a9e5537d0be6ee0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0a024443bdd4415a9e5537d0be6ee0a7", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestServerAdvancedOps-1925099407 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0a024443bdd4415a9e5537d0be6ee0a7 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestServerAdvancedOps-1925099407 Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestServerAdvancedOps-1925099407-project Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 74cfe671e48f4b70aa3e0a77cdb3b93e Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestServerAdvancedOps-1925099407-project Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 could not be found. Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '27b420b5-91f9-47fc-99f9-512a7e4aaa40'} Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 could not be found. Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 could not be found. Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:54:40.154403 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 could not be found. Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] Returning 404 to user: Instance 27b420b5-91f9-47fc-99f9-512a7e4aaa40 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15881c29-14eb-4033-ba60-128f772f0c67 tempest-TestServerAdvancedOps-1925099407 tempest-TestServerAdvancedOps-1925099407-project] 10.222.0.49 "GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40" status: 404 len: 111 microversion: 2.1 time: 0.177263 Jul 20 04:54:40.158294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4369/5494] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:39 2022] GET /compute/v2.1/servers/27b420b5-91f9-47fc-99f9-512a7e4aaa40 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:54:43.078756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-581442a3-e4f8-4de8-9068-a8712ae47250 req-7541610b-9e43-466c-adba-3edcc75ae532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551d39a9-4afb-430d-8b1d-1d66b4b7981d", "tag": "1709b439-d551-4214-8a65-d671a5c58add"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:43.122906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-581442a3-e4f8-4de8-9068-a8712ae47250 req-7541610b-9e43-466c-adba-3edcc75ae532 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:43.129407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-581442a3-e4f8-4de8-9068-a8712ae47250 req-7541610b-9e43-466c-adba-3edcc75ae532 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:43.167039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-581442a3-e4f8-4de8-9068-a8712ae47250 req-7541610b-9e43-466c-adba-3edcc75ae532 service nova] Creating event network-changed:1709b439-d551-4214-8a65-d671a5c58add for instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d on n-h1-764486-11 Jul 20 04:54:43.196197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-581442a3-e4f8-4de8-9068-a8712ae47250 req-7541610b-9e43-466c-adba-3edcc75ae532 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123587 Jul 20 04:54:43.197356 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4370/5495] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:54:54.609129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:54.615105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=48 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:54:54.618668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1966146009", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "51593aa8-eca9-48fe-9bf2-a55477869bdf", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:54:55.133833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:54:55.869867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:54:55.870913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:54:55.871463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:54:55.871882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:54:55.872537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:54:55.891694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.892456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.893446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:55.894049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:55.918302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:54:55.927539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:54:55.951962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:54:55.954182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='51593aa8-eca9-48fe-9bf2-a55477869bdf',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:54:56.073211 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-922143b1-6815-41f0-811d-e81724e56823 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466452 Jul 20 04:54:56.074273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4371/5496] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:54:56.091488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e40229a-0ce8-4b41-bd18-8f2702aab4ef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:56.093079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e40229a-0ce8-4b41-bd18-8f2702aab4ef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:56.188150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e40229a-0ce8-4b41-bd18-8f2702aab4ef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:56.202333 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e40229a-0ce8-4b41-bd18-8f2702aab4ef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1057 microversion: 2.1 time: 0.114658 Jul 20 04:54:56.202996 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4372/5497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:56 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1057 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:57.237471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:57.242760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:57.258607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.259364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.260344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:57.261894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:57.402857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:57.434869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-482a48b7-9e6d-4c75-a5c4-4ea43548077f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1109 microversion: 2.1 time: 0.207061 Jul 20 04:54:57.435781 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4373/5498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:57 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1109 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:54:58.457469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:58.458785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:58.475771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:58.476312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.477179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:58.477619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:58.591612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:54:58.607561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-662c5326-b6ba-42b7-b53e-f0532b8c7f05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1127 microversion: 2.1 time: 0.150596 Jul 20 04:54:58.610399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4374/5499] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:58 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1127 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:54:59.636720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:54:59.637364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:54:59.646256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:59.646706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:54:59.647782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:54:59.648218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:00.253904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:00.263278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a96a6962-d6df-4d1e-9400-ce9753c063f4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.630792 Jul 20 04:55:00.276514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4375/5500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:54:59 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:01.290293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:01.291804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:01.335286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:01.335919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:01.340946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:01.343517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:02.310172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:02.324974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d68b0d2-3b73-461a-b356-a05b3fb9084f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 1.032954 Jul 20 04:55:02.325676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4376/5501] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:01 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:02.345951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-90bd3697-1b16-4c58-a483-6f599da2da3e req-d07d966d-54ce-4484-9d5a-298072fa5bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649f15da-4981-4dad-a9d5-ed3c7293bde6", "tag": "e521004e-e9ab-48dd-bff9-c406e66ae004"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:02.367213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-90bd3697-1b16-4c58-a483-6f599da2da3e req-d07d966d-54ce-4484-9d5a-298072fa5bb1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:02.367902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-90bd3697-1b16-4c58-a483-6f599da2da3e req-d07d966d-54ce-4484-9d5a-298072fa5bb1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:02.435157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-90bd3697-1b16-4c58-a483-6f599da2da3e req-d07d966d-54ce-4484-9d5a-298072fa5bb1 service nova] Creating event network-changed:e521004e-e9ab-48dd-bff9-c406e66ae004 for instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 on n-h1-764486-11 Jul 20 04:55:02.452437 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-90bd3697-1b16-4c58-a483-6f599da2da3e req-d07d966d-54ce-4484-9d5a-298072fa5bb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124775 Jul 20 04:55:02.453532 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4377/5502] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:03.344729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:03.345818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:03.380585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:03.385461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:03.387233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:03.391623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:04.280036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:04.304234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-594d4bad-93e4-4120-954a-bb6b5bd236c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.964445 Jul 20 04:55:04.318363 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4378/5503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:03 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:05.335506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:05.336415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:05.362245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.362705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.363496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.363930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.844176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:05.864792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b606350-c1a6-4dc2-8de6-23a24aac7ac4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.521868 Jul 20 04:55:05.866404 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4379/5504] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:05 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:05.873798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:05.874504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:05.885130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.886017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.887287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:05.888088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:05.933112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:05.963325 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8b3ba148-7ee1-47e9-b833-56389fc6408f tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.095619 Jul 20 04:55:05.977181 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4380/5505] 10.222.0.49 () {58 vars in 1292 bytes} [Wed Jul 20 04:55:05 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015/os-server-password => generated 116 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:06.895876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:06.897665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:06.908193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:06.911210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:06.916928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:06.918243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:06.920612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:07.875159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:07.898759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebcaf6a2-6747-4476-9304-738d7460528c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 1.007000 Jul 20 04:55:07.899902 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4381/5506] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:06 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:08.926140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:08.928606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:08.940103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:08.941075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:08.942459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:08.943963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:09.149987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:09.165767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ffe7b6a-5ee6-4df2-a771-ac23f756d449 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.244978 Jul 20 04:55:09.188323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4382/5507] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:08 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:10.206725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:10.208105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:10.220827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.221784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.225362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:10.226139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:10.442893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:10.457609 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8aba2e63-c38c-4b3f-8430-b66a762dff93 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.255027 Jul 20 04:55:10.460343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4383/5508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:10 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:11.485334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:11.490616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:11.536304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:11.540550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:11.546482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:11.547593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:12.836682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:12.853770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e7efa1d-e510-4764-97ee-fae8f419ed06 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 1.379644 Jul 20 04:55:12.865951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4384/5509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:11 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:13.880422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:13.883705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:13.900751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:13.901917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:13.904272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:13.905387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:14.614279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:14.623400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f80112dd-5b44-4e1c-a3d7-324c155d2c90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.752964 Jul 20 04:55:14.627743 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4385/5510] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:13 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:15.658771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:15.659946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:15.677889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.678371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:15.681034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:15.681504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:16.131565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:16.141826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b49cff77-651f-4b8d-9391-d749ddedd280 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.489925 Jul 20 04:55:16.142463 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4386/5511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:15 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:17.158787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:17.160043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:17.171294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.175071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.176073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:17.176694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:17.508026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:17.527758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dea80f15-76f2-4799-a802-d04a9bb2d123 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.372777 Jul 20 04:55:17.532905 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4387/5512] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:17 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:18.550919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:18.551869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:18.572520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:18.574495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:18.576215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:18.579535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:19.279706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:19.300108 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83a436a1-65d1-43d5-ace1-e32fd07042ca tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.755542 Jul 20 04:55:19.305603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4388/5513] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:18 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:20.322812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:20.323859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:20.343050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:20.345022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:20.351039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:20.352102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:21.285640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:21.298816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3ae940d-3169-48e6-9c3c-50ba42ea8533 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.980946 Jul 20 04:55:21.310714 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4389/5514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:20 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:22.320247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:22.321529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:22.352238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:22.353956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:22.355629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:22.358215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:22.368954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:22.855103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:22.870171 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-247f01af-c303-44e0-b858-883f529f4f8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.556127 Jul 20 04:55:22.870785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4390/5515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:22 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:23.891984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:23.892847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:23.901265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:23.901729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:23.902756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:23.904107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:24.416742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:24.429095 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ecd3405-b9f1-4a78-850a-54c0e264e9cc tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.540592 Jul 20 04:55:24.442020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4391/5516] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:23 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:25.134606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1261688335", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "fe736dc0-0183-4e0a-8127-f103e409ceb7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1040523037", "security_groups": []}, "os:scheduler_hints": {"different_host": ["551d39a9-4afb-430d-8b1d-1d66b4b7981d"]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:25.157099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:25.272831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] validate_networks() for [('fe736dc0-0183-4e0a-8127-f103e409ceb7', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:55:25.974311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:55:25.974743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:55:25.975229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:55:25.975647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:55:25.976066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:55:26.002951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.005144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.007733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.012676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.111558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Getting quotas for project 8d7cbda236d149e7ad47dd14fb2b9830. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:55:26.127446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Getting quotas for user 21586a3ec5c8404faa79726006308ab4 and project 8d7cbda236d149e7ad47dd14fb2b9830. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:55:26.158459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:55:26.166384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:55:26.308703 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b52fbe5-10b5-4969-8c4e-ab51114809af tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.173461 Jul 20 04:55:26.318711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4392/5517] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:55:25 2022] POST /compute/v2.1/servers => generated 361 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:55:26.318711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:26.318711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:26.347170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.347624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.349046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:26.349671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:26.778854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:26.832640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35314224-1513-4c0d-a23f-d0215a76cc34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.511943 Jul 20 04:55:26.861515 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4393/5518] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:26 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:26.902363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1660e8e0-c0c6-480a-a842-d64b2e8190e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:26.903609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1660e8e0-c0c6-480a-a842-d64b2e8190e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:27.064149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1660e8e0-c0c6-480a-a842-d64b2e8190e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:27.086313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1660e8e0-c0c6-480a-a842-d64b2e8190e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1242 microversion: 2.1 time: 0.223204 Jul 20 04:55:27.087304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4394/5519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:26 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:27.874811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:27.875722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:27.885241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:27.885702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:27.886500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:27.886944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.279443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:28.290647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29f46315-b16f-4f7e-a450-d28ca0b502f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.419731 Jul 20 04:55:28.301310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4395/5520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:27 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:28.309426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:28.312510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:28.322733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:28.323521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.324572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:28.325225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:28.486024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:28.495179 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-717ae392-2b1f-433f-bc4a-901dab69f872 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1302 microversion: 2.1 time: 0.192173 Jul 20 04:55:28.496612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4396/5521] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:28 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1302 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:29.309670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:29.311007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:29.328025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.341411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.344726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.346021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.648922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:29.665350 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41dfeff9-a432-4b16-b116-31c69a57abcb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.358888 Jul 20 04:55:29.675822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4397/5522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:29 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:29.696127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:29.699585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:29.733999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.756411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.757787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:29.758518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:29.950766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:29.970256 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7046f01d-0d0f-441f-9a8e-b167472ba248 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.283861 Jul 20 04:55:29.980858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4398/5523] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:29 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:30.683064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:30.683895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:30.711801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.719591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.721740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:30.723100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:30.964076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:30.981657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3010fb94-3696-49c6-9176-42b7fe26f616 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1169 microversion: 2.1 time: 0.302762 Jul 20 04:55:30.982284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4399/5524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:30 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1169 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:30.988080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:30.989610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:31.005135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:31.005573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:31.006367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:31.006813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:31.154071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:31.164303 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1729ddd5-1a83-406e-8fef-843b4eb4cb8a tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.180008 Jul 20 04:55:31.165619 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4400/5525] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:30 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:31.908386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8c693886-f368-486d-9abd-00f8381648cb req-d6b8f8c3-609a-463d-a94e-c37dcf7687e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88156bd-685c-4b8b-abfe-2bf2d17be49b", "tag": "887520b3-7000-4ab9-b7d0-78e0bfcaa8d5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:31.922224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8c693886-f368-486d-9abd-00f8381648cb req-d6b8f8c3-609a-463d-a94e-c37dcf7687e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:31.923947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8c693886-f368-486d-9abd-00f8381648cb req-d6b8f8c3-609a-463d-a94e-c37dcf7687e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:31.950982 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8c693886-f368-486d-9abd-00f8381648cb req-d6b8f8c3-609a-463d-a94e-c37dcf7687e5 service nova] Creating event network-changed:887520b3-7000-4ab9-b7d0-78e0bfcaa8d5 for instance d88156bd-685c-4b8b-abfe-2bf2d17be49b on n-h2-764486-11 Jul 20 04:55:31.961544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8c693886-f368-486d-9abd-00f8381648cb req-d6b8f8c3-609a-463d-a94e-c37dcf7687e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056425 Jul 20 04:55:31.962662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4401/5526] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:55:32.011402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:32.013881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:32.037019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:32.038139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:32.041302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:32.042842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:32.967625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:32.983023 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a1cdc81-658d-4036-8817-9a9c22d97d8e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1215 microversion: 2.1 time: 0.981215 Jul 20 04:55:32.984011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4402/5527] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:31 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1215 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:33.002433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:33.007375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:33.016411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:33.018323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:33.019391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:33.020064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:33.155444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:33.165605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f559b6a-29c3-409b-ba9c-5300b2bf79e9 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.180236 Jul 20 04:55:33.168396 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4403/5528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:32 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:34.004930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:34.005594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:34.018324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:34.020015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:34.020958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:34.021781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:34.307082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:34.316652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c5f3d09-0cb8-4acf-a2aa-5b8f07d52f95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.318792 Jul 20 04:55:34.326744 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4404/5529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:33 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:34.333700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:34.334734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:34.345165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:34.346117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:34.351087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:34.351681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:34.527156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:34.539958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f3eb4cf-cfae-41d2-8d20-61bc7ed82a87 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.211695 Jul 20 04:55:34.541637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4405/5530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:34 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:35.334922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:35.335631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:35.342975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.343731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.344617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.345141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.556810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:35.572054 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a5b734b-8024-4b21-b3f1-367eb38d41ed tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.241527 Jul 20 04:55:35.572779 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4406/5531] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:35 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:35.585170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:35.587503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:35.594280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.594839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.595636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:35.596142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:35.766758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:35.777062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aae863d8-b933-4875-ae0d-640728d58c32 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.202756 Jul 20 04:55:35.789217 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4407/5532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:35 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:36.594856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:36.595748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:36.605696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:36.610988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:36.611653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.612674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:36.613871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.816590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:36.836389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b636b67-98d4-4f78-9c65-5e6a9224c740 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.250576 Jul 20 04:55:36.837486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4408/5533] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:36 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:36.846529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:36.848906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:36.901279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:36.902833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.905741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:36.906386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:36.969323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:37.070337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:37.084879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:37.099515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8fc4aadb-7bc7-46fb-90af-a2b9f01001bb tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.258958 Jul 20 04:55:37.100131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4409/5534] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:36 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:37.853756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:37.854537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:37.870697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:37.878337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:37.890465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:37.891581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:38.163173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:38.185115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e8479b5-63f0-48d0-9454-93a02b2bda90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.333441 Jul 20 04:55:38.197548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4410/5535] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:37 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:38.219711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:38.220661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:38.228170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:38.229416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:38.230445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:38.231343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:38.444901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:38.459638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51746c25-4666-4c2a-8736-c1ec0d0e4fbe tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.260468 Jul 20 04:55:38.461580 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4411/5536] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:38 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:39.202643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:39.203298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:39.223112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:39.223112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:39.223112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:39.223112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:39.501590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:39.513721 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51f0ac3c-6781-4f73-b321-a9109185a5b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.314774 Jul 20 04:55:39.530035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4412/5537] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:39 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:39.536673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:39.537851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:39.570937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:39.573452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:39.575842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:39.576389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:39.761349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:39.772851 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71111ffc-471d-4d78-a759-d829006214a7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.241236 Jul 20 04:55:39.773856 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4413/5538] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:39 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:39.881937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d9ab553d-fb1a-4d63-a3c1-cf40efee3e20 req-3f22632a-c24b-496c-9717-091820fe8abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88156bd-685c-4b8b-abfe-2bf2d17be49b", "name": "network-vif-plugged", "status": "completed", "tag": "887520b3-7000-4ab9-b7d0-78e0bfcaa8d5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:39.900980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d9ab553d-fb1a-4d63-a3c1-cf40efee3e20 req-3f22632a-c24b-496c-9717-091820fe8abb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:39.903148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d9ab553d-fb1a-4d63-a3c1-cf40efee3e20 req-3f22632a-c24b-496c-9717-091820fe8abb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:39.942848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d9ab553d-fb1a-4d63-a3c1-cf40efee3e20 req-3f22632a-c24b-496c-9717-091820fe8abb service nova] Creating event network-vif-plugged:887520b3-7000-4ab9-b7d0-78e0bfcaa8d5 for instance d88156bd-685c-4b8b-abfe-2bf2d17be49b on n-h2-764486-11 Jul 20 04:55:39.955798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d9ab553d-fb1a-4d63-a3c1-cf40efee3e20 req-3f22632a-c24b-496c-9717-091820fe8abb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079144 Jul 20 04:55:39.957248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4414/5539] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:55:40.543941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:40.544601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:40.615070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:40.615603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:40.617816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:40.618413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:40.959421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:40.976737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85cbe418-6c0b-43f4-b8be-8163cc1c6bae tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.437895 Jul 20 04:55:40.978985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4415/5540] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:40 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:40.986660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:40.987219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:41.000472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:41.001203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:41.006083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:41.006724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:41.168449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:41.184686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60d7adad-4e94-4b6e-9bf4-eca925882db6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1300 microversion: 2.1 time: 0.203102 Jul 20 04:55:41.185293 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4416/5541] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:40 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1300 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:41.998558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:41.999959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:42.011418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.013558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.029230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.032629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.508723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:42.531583 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d75d9462-ff54-48b8-afee-ccc21a4bedb5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.534709 Jul 20 04:55:42.531583 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4417/5542] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:41 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:42.544267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:42.544946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:42.558489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.564858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.566329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.567118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.720884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:42.748273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-222567a6-d2d3-455c-b0ad-334b11f23a1d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1472 microversion: 2.1 time: 0.215242 Jul 20 04:55:42.758040 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4418/5543] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:42 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:42.779493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:42.780026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:42.787269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.788067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.789160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.789591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.934363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:42.947676 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8201a9c9-d522-46e9-b22e-fe2877a01995 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1472 microversion: 2.1 time: 0.179090 Jul 20 04:55:42.948859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4419/5544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:42 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:42.968818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:42.970338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:42.982499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.982958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:42.990260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:42.990765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.152167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f81091af-792f-4c56-a3d5-99e0402c2ce1 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1625 microversion: 2.1 time: 0.188079 Jul 20 04:55:43.156589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4420/5545] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:42 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1625 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:43.174127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:43.175123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:43.202878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.203765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.212532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.214872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.488143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-adedd71d-35d1-4736-976d-b60e96fa2b94 tempest-TestSecurityGroupsBasicOps-2100951158 tempest-TestSecurityGroupsBasicOps-2100951158-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1914 microversion: 2.1 time: 0.319484 Jul 20 04:55:43.496591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4421/5546] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:43 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1914 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:43.547137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:43.547761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:43.560689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.561153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.561960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.562404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.851399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:43.859942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d891c33f-2b05-4f0d-8929-222d17450b3d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.316610 Jul 20 04:55:43.865631 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4422/5547] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:43 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:43.870799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:43.875619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:43.893932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.895515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.897210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:43.905878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:43.998864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:55:44.239820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48c28679-0d29-4159-a17b-85d4e3bca26f tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 204 len: 0 microversion: 2.1 time: 0.372470 Jul 20 04:55:44.242202 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4423/5548] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:55:43 2022] DELETE /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:55:44.254071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:44.255580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:44.284955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:44.285671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:44.286664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:44.287101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:44.422860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:44.426560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:44.434456 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d874174-7e12-4517-ac78-5db4527e5aa6 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1478 microversion: 2.1 time: 0.187800 Jul 20 04:55:44.435910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4424/5549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:44 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1478 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:44.882982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:44.883806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:44.899157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:44.907279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:44.910468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:44.911087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:45.141480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:45.151824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5505c5aa-3be1-421f-88c3-726e44580e8d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.274014 Jul 20 04:55:45.152881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4425/5550] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:44 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:45.453233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:45.454086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:45.460923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:45.461452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:45.462243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:45.462680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:45.601733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:45.610380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20604f05-8827-4196-9085-b88c5da048f1 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1478 microversion: 2.1 time: 0.161060 Jul 20 04:55:45.621308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4426/5551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:45 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:45.888155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-47e93038-6a8b-4259-989a-4d9f1d53b29e req-134c5439-f0ec-43a0-a683-918b2539d053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649f15da-4981-4dad-a9d5-ed3c7293bde6", "name": "network-vif-plugged", "status": "completed", "tag": "e521004e-e9ab-48dd-bff9-c406e66ae004"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:45.912984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-47e93038-6a8b-4259-989a-4d9f1d53b29e req-134c5439-f0ec-43a0-a683-918b2539d053 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:45.913958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-47e93038-6a8b-4259-989a-4d9f1d53b29e req-134c5439-f0ec-43a0-a683-918b2539d053 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:45.943176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-47e93038-6a8b-4259-989a-4d9f1d53b29e req-134c5439-f0ec-43a0-a683-918b2539d053 service nova] Creating event network-vif-plugged:e521004e-e9ab-48dd-bff9-c406e66ae004 for instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 on n-h1-764486-11 Jul 20 04:55:45.960483 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-47e93038-6a8b-4259-989a-4d9f1d53b29e req-134c5439-f0ec-43a0-a683-918b2539d053 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079724 Jul 20 04:55:45.961419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4427/5552] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:46.172375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:46.173319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:46.225957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:46.226464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:46.227638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:46.230394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:46.690180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:46.718562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25b9d6a4-1464-41a9-bfab-ddb2d2edc8a2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1203 microversion: 2.1 time: 0.551910 Jul 20 04:55:46.719392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4428/5553] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:46 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1203 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:46.741348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:46.742303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:46.749246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:46.750075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:46.751017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:46.751856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:46.896429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:46.908673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-322e7bca-8a3a-4aa9-a07b-070c65fbe3d7 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 200 len: 1478 microversion: 2.1 time: 0.183453 Jul 20 04:55:46.909286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4429/5554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:46 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 1478 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:47.154562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-467a6b46-9a3e-4a13-906d-496ea9a94821 req-9cda8ac8-3733-4683-b0c7-7c73afcc078f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88156bd-685c-4b8b-abfe-2bf2d17be49b", "name": "network-vif-deleted", "tag": "887520b3-7000-4ab9-b7d0-78e0bfcaa8d5"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:47.158371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:47.174440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-467a6b46-9a3e-4a13-906d-496ea9a94821 req-9cda8ac8-3733-4683-b0c7-7c73afcc078f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:47.174891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-467a6b46-9a3e-4a13-906d-496ea9a94821 req-9cda8ac8-3733-4683-b0c7-7c73afcc078f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:47.200892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-467a6b46-9a3e-4a13-906d-496ea9a94821 req-9cda8ac8-3733-4683-b0c7-7c73afcc078f service nova] Creating event network-vif-deleted:887520b3-7000-4ab9-b7d0-78e0bfcaa8d5 for instance d88156bd-685c-4b8b-abfe-2bf2d17be49b on n-h2-764486-11 Jul 20 04:55:47.211497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-467a6b46-9a3e-4a13-906d-496ea9a94821 req-9cda8ac8-3733-4683-b0c7-7c73afcc078f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300772 Jul 20 04:55:47.219489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4430/5555] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:47.744929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:47.746140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:47.766440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:47.766440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:47.770117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:47.771479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.095186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:48.111787 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ad17c57-591b-4857-9aa2-f017cfd8c4e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1390 microversion: 2.1 time: 0.377508 Jul 20 04:55:48.115224 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4431/5556] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:47 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:48.142994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:48.147894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: d88156bd-685c-4b8b-abfe-2bf2d17be49b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:48.170684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:48.171776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.176223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:48.186937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.253330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] HTTP exception thrown: Instance d88156bd-685c-4b8b-abfe-2bf2d17be49b could not be found. Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Request method failure captured: Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b HTTP/1.1 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14pg1Stk410RDfzl935ZABY6og7djkD3cTYVi6yn4IZkldd0kK3Q6JW-s967gryyx5QbB16-Hel6lkO8GWk2-UGy-9LTSIXj6N0lGmSrO0ixykSJHY80hiwsaCBneh84DtjAjYnOfBVhWHE_WlrUk0g2Pq7o0mZhC2qNWaNpnzi-xjU Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8d7cbda236d149e7ad47dd14fb2b9830 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1174329016 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7cbda236d149e7ad47dd14fb2b9830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7cbda236d149e7ad47dd14fb2b9830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7cbda236d149e7ad47dd14fb2b9830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7cbda236d149e7ad47dd14fb2b9830", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1174329016 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8d7cbda236d149e7ad47dd14fb2b9830 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1174329016 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestSecurityGroupsBasicOps-1174329016-project Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 21586a3ec5c8404faa79726006308ab4 Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1174329016-project Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance d88156bd-685c-4b8b-abfe-2bf2d17be49b could not be found. Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'd88156bd-685c-4b8b-abfe-2bf2d17be49b'} Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d88156bd-685c-4b8b-abfe-2bf2d17be49b could not be found. Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d88156bd-685c-4b8b-abfe-2bf2d17be49b could not be found. Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:55:48.257069 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d88156bd-685c-4b8b-abfe-2bf2d17be49b could not be found. Jul 20 04:55:48.266280 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:55:48.273788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Returning 404 to user: Instance d88156bd-685c-4b8b-abfe-2bf2d17be49b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:55:48.274669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03bfc674-76af-4309-a895-c3a4ed6ab192 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b" status: 404 len: 111 microversion: 2.1 time: 0.158706 Jul 20 04:55:48.299004 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4432/5557] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:48 2022] GET /compute/v2.1/servers/d88156bd-685c-4b8b-abfe-2bf2d17be49b => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:55:48.322016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:48.323583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:48.337382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:48.343727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.344871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:48.348131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.634174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:48.643718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a566a78-39c8-415a-bd76-c0a3a2caf662 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1390 microversion: 2.1 time: 0.341809 Jul 20 04:55:48.649723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4433/5558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:48 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1390 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:48.665625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:48.666802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:48.677938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:48.678460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:48.679569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:48.680012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.256761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:49.285857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f771949-8532-468b-8aaa-39ada1311864 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1390 microversion: 2.1 time: 0.606459 Jul 20 04:55:49.287741 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4434/5559] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:48 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1390 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:49.425168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:49.427388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:49.444233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.445029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.445990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.446593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.507701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:55:49.654681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bea553d6-b12a-4047-ba3f-e833511c05ad tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 204 len: 0 microversion: 2.1 time: 0.237039 Jul 20 04:55:49.659052 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4435/5560] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:55:49 2022] DELETE /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:55:49.667238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:49.669116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:49.676440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.677188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.678702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:49.679651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:49.995588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:50.003951 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f6d5ac7-790a-4809-931d-4a00d3dfadbb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1396 microversion: 2.1 time: 0.341344 Jul 20 04:55:50.004580 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4436/5561] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:49 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1396 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:51.027367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:51.028047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:51.047184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:51.048130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:51.049301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:51.050712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:51.343849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:51.354790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ebd49ed-e7f1-46d5-a5f5-ca00a3d39b24 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1396 microversion: 2.1 time: 0.333819 Jul 20 04:55:51.375582 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4437/5562] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:51 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1396 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:52.380489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:52.382022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:52.401271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:52.407140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:52.409725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:52.417733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:52.784060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:52.799286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7cab4268-fcda-499e-b4a2-34dbadd3c227 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1396 microversion: 2.1 time: 0.429853 Jul 20 04:55:52.799913 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4438/5563] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:52 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1396 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:53.305235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6646cbd4-61c4-47c5-abc4-84405de41193 req-7f0dd0ac-c9b8-47ba-b1b2-5a3e02a6749a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649f15da-4981-4dad-a9d5-ed3c7293bde6", "name": "network-vif-deleted", "tag": "e521004e-e9ab-48dd-bff9-c406e66ae004"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:53.349395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6646cbd4-61c4-47c5-abc4-84405de41193 req-7f0dd0ac-c9b8-47ba-b1b2-5a3e02a6749a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:53.358651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6646cbd4-61c4-47c5-abc4-84405de41193 req-7f0dd0ac-c9b8-47ba-b1b2-5a3e02a6749a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:53.388005 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6646cbd4-61c4-47c5-abc4-84405de41193 req-7f0dd0ac-c9b8-47ba-b1b2-5a3e02a6749a service nova] Creating event network-vif-deleted:e521004e-e9ab-48dd-bff9-c406e66ae004 for instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 on n-h1-764486-11 Jul 20 04:55:53.403119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6646cbd4-61c4-47c5-abc4-84405de41193 req-7f0dd0ac-c9b8-47ba-b1b2-5a3e02a6749a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118273 Jul 20 04:55:53.426261 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4439/5564] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:55:53.820969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:53.822178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:53.843557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:53.847568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:53.848437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:53.848885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:54.031249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:54.043768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-babea157-1030-4618-a4e4-e6f10aee1af0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1188 microversion: 2.1 time: 0.231672 Jul 20 04:55:54.044990 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4440/5565] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:53 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1188 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:55:55.061591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:55.062386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:55.075333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:55.075963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:55.079206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:55.081676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:55.215525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:55.230041 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01d6113a-b9db-41d1-a014-5479e48efe0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1188 microversion: 2.1 time: 0.172438 Jul 20 04:55:55.231405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4441/5566] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:55 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1188 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:56.247705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:56.249299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:56.266065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:56.266955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:56.268002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:56.268735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:56.303291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:55:56.498102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:56.511214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2baf0eb-d23b-4721-9b7b-c3b13e55eb1d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1188 microversion: 2.1 time: 0.267232 Jul 20 04:55:56.512301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4442/5567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:56 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:57.424715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:57.424715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:57.433715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.434170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.434976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.435413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.498987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:55:57.642275 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0700341e-c024-464a-9de4-f0e8db49d1dc tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "DELETE /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 204 len: 0 microversion: 2.1 time: 0.223872 Jul 20 04:55:57.644915 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4443/5568] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:55:57 2022] DELETE /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:55:57.653389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1f898691-35d8-4a61-8e27-233b3610a524 req-48fb3f18-9dc4-4427-aa66-2c6c1398e0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551d39a9-4afb-430d-8b1d-1d66b4b7981d", "tag": "1709b439-d551-4214-8a65-d671a5c58add"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:55:57.666909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1f898691-35d8-4a61-8e27-233b3610a524 req-48fb3f18-9dc4-4427-aa66-2c6c1398e0e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.667563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1f898691-35d8-4a61-8e27-233b3610a524 req-48fb3f18-9dc4-4427-aa66-2c6c1398e0e5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.686556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1f898691-35d8-4a61-8e27-233b3610a524 req-48fb3f18-9dc4-4427-aa66-2c6c1398e0e5 service nova] Creating event network-changed:1709b439-d551-4214-8a65-d671a5c58add for instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d on n-h1-764486-11 Jul 20 04:55:57.693137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1f898691-35d8-4a61-8e27-233b3610a524 req-48fb3f18-9dc4-4427-aa66-2c6c1398e0e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046067 Jul 20 04:55:57.694669 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4444/5569] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:55:57.702214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:57.703132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:57.711201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.711843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.712881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.713472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.819378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:57.834349 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-866e6851-e2ab-40f5-8fc1-03399c3c962d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1188 microversion: 2.1 time: 0.137574 Jul 20 04:55:57.836288 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4445/5570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:57 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1188 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:57.845516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:57.846277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:57.854328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.855106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:57.856120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:57.856815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:58.047513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:58.063126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ac46a27-c62e-45ae-877c-342d688e5e4e tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1767 microversion: 2.1 time: 0.220660 Jul 20 04:55:58.065131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4446/5571] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:57 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1767 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:58.854825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:58.856649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:58.869108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:58.869946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:58.871079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:58.871763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:59.110940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:59.123127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87ddefd5-b639-4193-becb-7a0160c51a05 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 200 len: 1188 microversion: 2.1 time: 0.275279 Jul 20 04:55:59.132472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4447/5572] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:58 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 1188 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:55:59.137743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:55:59.138354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:55:59.152564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:59.153016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:59.163526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:55:59.164264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:55:59.753492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:55:59.762740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9492d2b4-4d44-49d9-b366-84f415405ced tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1767 microversion: 2.1 time: 0.628842 Jul 20 04:55:59.763880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4448/5573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:55:59 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1767 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:00.142623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:00.144217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:00.154561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.155993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.161792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.162301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.233418 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 HTTP/1.1 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '649f15da-4981-4dad-a9d5-ed3c7293bde6'} Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:00.246535 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:00.250718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7170d331-076e-446e-a397-bceaf80b3847 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 404 len: 111 microversion: 2.1 time: 0.110998 Jul 20 04:56:00.253077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4449/5574] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:00 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:00.401528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-88abd1e8-b6a2-47d4-9ecf-0515d01513b8 req-0ba4b418-1b83-4679-80a0-cc9becfc79c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551d39a9-4afb-430d-8b1d-1d66b4b7981d", "name": "network-vif-deleted", "tag": "1709b439-d551-4214-8a65-d671a5c58add"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:00.425052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-88abd1e8-b6a2-47d4-9ecf-0515d01513b8 req-0ba4b418-1b83-4679-80a0-cc9becfc79c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.426711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-88abd1e8-b6a2-47d4-9ecf-0515d01513b8 req-0ba4b418-1b83-4679-80a0-cc9becfc79c1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.455531 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-88abd1e8-b6a2-47d4-9ecf-0515d01513b8 req-0ba4b418-1b83-4679-80a0-cc9becfc79c1 service nova] Creating event network-vif-deleted:1709b439-d551-4214-8a65-d671a5c58add for instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d on n-h1-764486-11 Jul 20 04:56:00.469688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-88abd1e8-b6a2-47d4-9ecf-0515d01513b8 req-0ba4b418-1b83-4679-80a0-cc9becfc79c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070622 Jul 20 04:56:00.471882 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4450/5575] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:00.784491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:00.785576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:00.826358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.833383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.851235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.852477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.962942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:00.964835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:00.965354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lazy-loading 'fault' on Instance uuid 551d39a9-4afb-430d-8b1d-1d66b4b7981d {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:56:01.052264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21586a3ec5c8404faa79726006308ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7cbda236d149e7ad47dd14fb2b9830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:01.064823 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-840c7dbd-0e42-471f-8322-aecf7790fc6d tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 200 len: 1384 microversion: 2.1 time: 0.287118 Jul 20 04:56:01.071612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4451/5576] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:00 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 1384 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:02.086545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:02.087895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] [instance: 551d39a9-4afb-430d-8b1d-1d66b4b7981d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:02.095114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:02.095771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:02.097343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:02.097776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:02.115064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] HTTP exception thrown: Instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d could not be found. Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Request method failure captured: Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d HTTP/1.1 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14pg1Stk410RDfzl935ZABY6og7djkD3cTYVi6yn4IZkldd0kK3Q6JW-s967gryyx5QbB16-Hel6lkO8GWk2-UGy-9LTSIXj6N0lGmSrO0ixykSJHY80hiwsaCBneh84DtjAjYnOfBVhWHE_WlrUk0g2Pq7o0mZhC2qNWaNpnzi-xjU Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 8d7cbda236d149e7ad47dd14fb2b9830 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1174329016 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7cbda236d149e7ad47dd14fb2b9830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7cbda236d149e7ad47dd14fb2b9830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7cbda236d149e7ad47dd14fb2b9830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7cbda236d149e7ad47dd14fb2b9830", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1174329016 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 8d7cbda236d149e7ad47dd14fb2b9830 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1174329016 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestSecurityGroupsBasicOps-1174329016-project Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 21586a3ec5c8404faa79726006308ab4 Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1174329016-project Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d could not be found. Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '551d39a9-4afb-430d-8b1d-1d66b4b7981d'} Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d could not be found. Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d could not be found. Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:02.117043 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d could not be found. Jul 20 04:56:02.124584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:02.133687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Returning 404 to user: Instance 551d39a9-4afb-430d-8b1d-1d66b4b7981d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:02.134785 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47c868a8-f673-434a-aea0-1c10e9b88c27 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d" status: 404 len: 111 microversion: 2.1 time: 0.052106 Jul 20 04:56:02.135371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4452/5577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:02 2022] GET /compute/v2.1/servers/551d39a9-4afb-430d-8b1d-1d66b4b7981d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:06.895346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:06.895971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:06.906457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:06.906910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:06.907688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:06.908117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:06.944330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 HTTP/1.1 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '649f15da-4981-4dad-a9d5-ed3c7293bde6'} Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:06.946606 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:06.950841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6290b43-c7dd-4ce3-8f24-71dd4681e9d4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 404 len: 111 microversion: 2.1 time: 0.057601 Jul 20 04:56:06.962314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4453/5578] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:06 2022] DELETE /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:56:06.968556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:06.969178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 649f15da-4981-4dad-a9d5-ed3c7293bde6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:06.987742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:06.988196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:06.991619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:06.992308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:07.036128 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 HTTP/1.1 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '649f15da-4981-4dad-a9d5-ed3c7293bde6'} Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:07.042059 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 649f15da-4981-4dad-a9d5-ed3c7293bde6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:07.046184 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-445674fc-8252-4379-9639-777bb2ae2189 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6" status: 404 len: 111 microversion: 2.1 time: 0.080589 Jul 20 04:56:07.047875 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4454/5579] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:06 2022] GET /compute/v2.1/servers/649f15da-4981-4dad-a9d5-ed3c7293bde6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:08.518503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9873bd88-f6d8-4ef8-9c6a-785b094fa022 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] Calling method '.version_select at 0x7f838a005f70>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:08.576042 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9873bd88-f6d8-4ef8-9c6a-785b094fa022 tempest-TestSecurityGroupsBasicOps-1174329016 tempest-TestSecurityGroupsBasicOps-1174329016-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1040523037" status: 202 len: 0 microversion: 2.1 time: 0.066666 Jul 20 04:56:08.585489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4455/5580] 10.222.0.49 () {58 vars in 1277 bytes} [Wed Jul 20 04:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1040523037 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 04:56:25.272257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1403936224", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "47d9f1fc-2abe-4dea-a349-0ebf63ea97f3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:25.305907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:25.306836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:25.419852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] validate_networks() for [('47d9f1fc-2abe-4dea-a349-0ebf63ea97f3', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:56:26.831698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:56:26.833567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:56:26.834300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:56:26.835110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:56:26.835766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:56:26.848750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.851279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.854078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:26.854827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:26.888797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Getting quotas for project 1a96691c9d124738ad370262c11243c8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:56:26.898107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Getting quotas for user 9fbcd2ef40b14de79837b810ab00bbd1 and project 1a96691c9d124738ad370262c11243c8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:56:26.912579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:56:26.915257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:56:26.996161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-710ad4e2-3056-4fff-bbe8-f8942ae08f9e tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728513 Jul 20 04:56:27.000923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4456/5581] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:56:27.011840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34797117-b25b-4467-8c10-e722855dcc62 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:27.012962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34797117-b25b-4467-8c10-e722855dcc62 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:27.208961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34797117-b25b-4467-8c10-e722855dcc62 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:27.224341 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34797117-b25b-4467-8c10-e722855dcc62 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1214 microversion: 2.1 time: 0.215338 Jul 20 04:56:27.230721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4457/5582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:27 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:28.245654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:28.246421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:28.269118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.271618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:28.279859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:28.283828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:29.085454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:29.106828 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-034cc894-167f-49d1-970b-52f14fb4dcd6 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1218 microversion: 2.1 time: 0.856721 Jul 20 04:56:29.107372 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4458/5583] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:28 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1218 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:30.123879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:30.124615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:30.140573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.141018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.141858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:30.142289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:30.469473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:30.487476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e35abea-3691-4df9-bd93-da2e779527e5 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1272 microversion: 2.1 time: 0.361533 Jul 20 04:56:30.488229 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4459/5584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:30 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:31.506444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:31.507939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:31.528399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.528860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:31.529661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:31.530101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:32.043102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:32.057047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f482094-6fd5-4483-8f5d-50ea86ac82e1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1314 microversion: 2.1 time: 0.551632 Jul 20 04:56:32.058551 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4460/5585] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:31 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:33.076035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:33.077253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:33.093648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:33.094103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:33.095569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:33.096012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.096953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:34.128882 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d964b15e-369d-48f1-a9c9-3009004c029c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1314 microversion: 2.1 time: 1.056658 Jul 20 04:56:34.143214 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4461/5586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:33 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:34.218280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-91282e81-232c-4681-925c-b72ff4fea3e8 req-ceb129cc-84c4-4749-b3ce-c85c3755992e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5e86f1-ec7b-47dd-ad9f-51253c113e1d", "tag": "abcc9b47-0b9c-4f64-8783-1e745f741264"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:34.236937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-91282e81-232c-4681-925c-b72ff4fea3e8 req-ceb129cc-84c4-4749-b3ce-c85c3755992e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:34.239197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-91282e81-232c-4681-925c-b72ff4fea3e8 req-ceb129cc-84c4-4749-b3ce-c85c3755992e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:34.265907 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-91282e81-232c-4681-925c-b72ff4fea3e8 req-ceb129cc-84c4-4749-b3ce-c85c3755992e service nova] Creating event network-changed:abcc9b47-0b9c-4f64-8783-1e745f741264 for instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d on n-h1-764486-11 Jul 20 04:56:34.286809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-91282e81-232c-4681-925c-b72ff4fea3e8 req-ceb129cc-84c4-4749-b3ce-c85c3755992e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073292 Jul 20 04:56:34.290018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4462/5587] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:56:35.160135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:35.161313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:35.193277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.194369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.195897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:35.196688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:35.670958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:35.681998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd185d4e-d208-476e-9f23-098d5c477bd0 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1314 microversion: 2.1 time: 0.534983 Jul 20 04:56:35.682260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4463/5588] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:35 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:36.704645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:36.705429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:36.716329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.718255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.726870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:36.727507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:36.874769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:37.228454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:37.468555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:37.511910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c83cc14a-0103-4520-b744-2f5ec6780091 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1314 microversion: 2.1 time: 0.809907 Jul 20 04:56:37.514273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4464/5589] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:36 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:38.532860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:38.534184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:38.545690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.554761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.555791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:38.556312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:38.822787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:38.831221 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c53c9ed5-062e-4836-886d-cb612dec732b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1314 microversion: 2.1 time: 0.301621 Jul 20 04:56:38.844408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4465/5590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:38 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:39.926963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-568d2ecf-51e1-454d-b40e-96a338d8c8ad req-9b5b2643-304c-424e-a45c-4248da3d4436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e86f1-ec7b-47dd-ad9f-51253c113e1d", "name": "network-vif-plugged", "status": "completed", "tag": "abcc9b47-0b9c-4f64-8783-1e745f741264"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:39.952005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-568d2ecf-51e1-454d-b40e-96a338d8c8ad req-9b5b2643-304c-424e-a45c-4248da3d4436 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:39.955766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-568d2ecf-51e1-454d-b40e-96a338d8c8ad req-9b5b2643-304c-424e-a45c-4248da3d4436 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:40.012008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-568d2ecf-51e1-454d-b40e-96a338d8c8ad req-9b5b2643-304c-424e-a45c-4248da3d4436 service nova] Creating event network-vif-plugged:abcc9b47-0b9c-4f64-8783-1e745f741264 for instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d on n-h1-764486-11 Jul 20 04:56:40.020043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-568d2ecf-51e1-454d-b40e-96a338d8c8ad req-9b5b2643-304c-424e-a45c-4248da3d4436 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.559789 Jul 20 04:56:40.026853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4466/5591] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:56:40.076664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:40.078682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:40.088850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:40.089297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:40.090089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:40.090712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:40.360283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:40.371949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4f2e359-6542-4b52-a73c-e1562a8bf113 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1314 microversion: 2.1 time: 0.323115 Jul 20 04:56:40.373313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4467/5592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:40 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:41.394377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:41.395878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:41.407250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.408046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.409150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:41.409744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:41.592858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:41.601939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f14ab71f-63ab-476d-b4f7-e83d10dfd5ee tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1499 microversion: 2.1 time: 0.215776 Jul 20 04:56:41.602528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4468/5593] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:41 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1499 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:42.308864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:42.309378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:42.322224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.322654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.323484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.323935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.369535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:56:42.501726 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f39e6d13-2aeb-430a-b50d-31f099387449 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 204 len: 0 microversion: 2.1 time: 0.197714 Jul 20 04:56:42.502891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4469/5594] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:56:42 2022] DELETE /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:56:42.514151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:42.514880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:42.524936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.525745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.526881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:42.527525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:42.700921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:42.710441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-479cb91b-af08-48bf-ad4c-411b3a975085 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1505 microversion: 2.1 time: 0.202260 Jul 20 04:56:42.711732 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4470/5595] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:42 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:56:43.735202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:43.741334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:43.757487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:43.758144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:43.759089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:43.759689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:44.014814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:44.044684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2e05034-f1ff-40c9-a5f1-6e92b01eb09d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 200 len: 1505 microversion: 2.1 time: 0.316552 Jul 20 04:56:44.057693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4471/5596] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:43 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:44.450723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-794890cd-3824-4a22-a20a-2259f35bf4ff req-cc427551-1145-497d-bf52-be43edbc55dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5e86f1-ec7b-47dd-ad9f-51253c113e1d", "name": "network-vif-deleted", "tag": "abcc9b47-0b9c-4f64-8783-1e745f741264"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:44.461563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-794890cd-3824-4a22-a20a-2259f35bf4ff req-cc427551-1145-497d-bf52-be43edbc55dc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:44.462303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-794890cd-3824-4a22-a20a-2259f35bf4ff req-cc427551-1145-497d-bf52-be43edbc55dc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:44.807571 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-794890cd-3824-4a22-a20a-2259f35bf4ff req-cc427551-1145-497d-bf52-be43edbc55dc service nova] Creating event network-vif-deleted:abcc9b47-0b9c-4f64-8783-1e745f741264 for instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d on n-h1-764486-11 Jul 20 04:56:44.813671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-794890cd-3824-4a22-a20a-2259f35bf4ff req-cc427551-1145-497d-bf52-be43edbc55dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367142 Jul 20 04:56:44.814516 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4472/5597] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:56:45.066175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:45.067130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: bd5e86f1-ec7b-47dd-ad9f-51253c113e1d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:45.074596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:45.075332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:45.076399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:45.077574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:45.101658 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] HTTP exception thrown: Instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d could not be found. Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Request method failure captured: Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d HTTP/1.1 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14r1pFECgpGzNSvSaq1vPszgfDOoVxZ_PONHzSgv2ontQbuWyeiyX8ZZS-FXxCSGk6jz8xjsvWzeKeRUwAkiThfLiZ7dOc9kzmDtE16he_Zi6qmJ3KAgIxszGPUKGI3zP1gIsGJDVAQJPZGIS1A5ozZUJMNUfskbHC_mK-k_-lNoVUY Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1a96691c9d124738ad370262c11243c8 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesActionsTest-1585005579 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a96691c9d124738ad370262c11243c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a96691c9d124738ad370262c11243c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a96691c9d124738ad370262c11243c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a96691c9d124738ad370262c11243c8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesActionsTest-1585005579 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1a96691c9d124738ad370262c11243c8 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesActionsTest-1585005579 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesActionsTest-1585005579-project Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9fbcd2ef40b14de79837b810ab00bbd1 Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesActionsTest-1585005579-project Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d could not be found. Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'bd5e86f1-ec7b-47dd-ad9f-51253c113e1d'} Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d could not be found. Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d could not be found. Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:56:45.102025 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d could not be found. Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Returning 404 to user: Instance bd5e86f1-ec7b-47dd-ad9f-51253c113e1d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f703ecce-663e-4b96-a0c6-5b3ef1ec228f tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d" status: 404 len: 111 microversion: 2.1 time: 0.043923 Jul 20 04:56:45.106771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4473/5598] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:45 2022] GET /compute/v2.1/servers/bd5e86f1-ec7b-47dd-ad9f-51253c113e1d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:56:45.264231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-473379891", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "47d9f1fc-2abe-4dea-a349-0ebf63ea97f3"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:56:55.100535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:55.278685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:56:57.534262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] validate_networks() for [('47d9f1fc-2abe-4dea-a349-0ebf63ea97f3', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:56:58.225934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:56:58.226564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:56:58.227194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:56:58.227607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:56:58.228018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:56:58.251441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:58.251895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:58.252740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:58.253180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:58.307557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Getting quotas for project 1a96691c9d124738ad370262c11243c8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:56:58.314616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Getting quotas for user 9fbcd2ef40b14de79837b810ab00bbd1 and project 1a96691c9d124738ad370262c11243c8. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:56:58.332089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:56:58.334771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:56:58.395880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-773a404a-80e3-4abe-b8eb-c0bdfb34474d tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.136418 Jul 20 04:56:58.402564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4474/5599] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:56:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 13144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:56:58.411027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-29318e63-72e2-4fb0-a5de-214ea62718a1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:58.412076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-29318e63-72e2-4fb0-a5de-214ea62718a1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:58.474958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-29318e63-72e2-4fb0-a5de-214ea62718a1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:58.484175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-29318e63-72e2-4fb0-a5de-214ea62718a1 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1213 microversion: 2.1 time: 0.079892 Jul 20 04:56:58.496182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4475/5600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:58 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:56:59.505762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:56:59.507117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:56:59.528135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:59.528789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:59.529966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:56:59.530194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:56:59.653667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:56:59.663522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4c7f467-b060-4341-9955-f9fd35e27d57 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1209 microversion: 2.1 time: 0.163214 Jul 20 04:56:59.664542 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4476/5601] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:56:59 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:00.689520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:00.691192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:00.702287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:00.705305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:00.713823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:00.714577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:01.141314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:01.154754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4c1b16d-e572-40c2-a22e-ccc7e2089e43 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1271 microversion: 2.1 time: 0.468613 Jul 20 04:57:01.168066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4477/5602] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:00 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1271 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:02.177289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:02.178027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:02.189830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:02.193472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:02.194699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:02.196793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:02.511122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:02.525789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05885a38-1a69-4dc7-bb7f-ff412d90fc6a tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1313 microversion: 2.1 time: 0.349316 Jul 20 04:57:02.548067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4478/5603] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:02 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:03.458184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-eb9a7d54-c76e-4828-a911-679a011750b4 req-61843325-8a57-4442-a76b-c6c6e4c97683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29bde4f6-af32-4bf0-957c-36ed93ab3824", "tag": "627d6965-0227-4577-8bd5-368d3ec8d6f2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:03.500998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb9a7d54-c76e-4828-a911-679a011750b4 req-61843325-8a57-4442-a76b-c6c6e4c97683 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:03.504832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb9a7d54-c76e-4828-a911-679a011750b4 req-61843325-8a57-4442-a76b-c6c6e4c97683 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:03.541740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eb9a7d54-c76e-4828-a911-679a011750b4 req-61843325-8a57-4442-a76b-c6c6e4c97683 service nova] Creating event network-changed:627d6965-0227-4577-8bd5-368d3ec8d6f2 for instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 on n-h1-764486-11 Jul 20 04:57:03.559474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-eb9a7d54-c76e-4828-a911-679a011750b4 req-61843325-8a57-4442-a76b-c6c6e4c97683 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107038 Jul 20 04:57:03.560848 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4479/5604] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:03.578297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:03.579345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:03.589716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:03.590165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:03.595000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:03.595699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:04.168818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:04.189704 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92ee06aa-e987-44ee-9175-2f81a1399b54 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1313 microversion: 2.1 time: 0.621395 Jul 20 04:57:04.193950 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4480/5605] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:03 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:05.211498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:05.214672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:05.236766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:05.242950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:05.243911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:05.249314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:05.700238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:05.710027 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0a70d7d0-194d-4801-b000-839487e5f7c7 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1313 microversion: 2.1 time: 0.502279 Jul 20 04:57:05.716095 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4481/5606] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:05 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:06.754341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:06.754866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:06.766801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:06.767816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:06.769432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:06.770247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:07.236869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:07.289843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-daa3fa60-9be3-433e-83c4-9bfc7e37c1dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1313 microversion: 2.1 time: 0.561774 Jul 20 04:57:07.293566 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4482/5607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:06 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:07.888596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1897188353", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "697a441a-0352-4295-8512-c740bd038927", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:07.999827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:57:08.273637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:08.480428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:08.561733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:57:08.562304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:57:08.562893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:57:08.563426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:57:08.564073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:57:08.574825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:08.575622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:08.576842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:08.577501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:08.598765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:57:08.605490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:57:08.693805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:57:08.697246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='697a441a-0352-4295-8512-c740bd038927',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:57:08.862451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39dcb723-66b6-4102-ad6f-c81ac120adf2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979443 Jul 20 04:57:08.868847 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4483/5608] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:57:08.874463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:08.875073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:08.882237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:08.882999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:08.883952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:08.884642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:09.067164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:09.087226 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c61e77c8-a34d-400a-a546-372add47ffb2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1313 microversion: 2.1 time: 0.216641 Jul 20 04:57:09.094089 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4484/5609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:08 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:09.110833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a58257d1-a8e7-46ce-9071-61bf5aa2c5e5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:09.111524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a58257d1-a8e7-46ce-9071-61bf5aa2c5e5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:09.193817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a58257d1-a8e7-46ce-9071-61bf5aa2c5e5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:09.205634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a58257d1-a8e7-46ce-9071-61bf5aa2c5e5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1071 microversion: 2.1 time: 0.109143 Jul 20 04:57:09.206805 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4485/5610] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:09 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1071 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:09.863367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-eec663cf-3318-47ef-8721-e9fd623375f2 req-9d030e42-4460-41d5-9d9c-06e6cc890d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bde4f6-af32-4bf0-957c-36ed93ab3824", "name": "network-vif-plugged", "status": "completed", "tag": "627d6965-0227-4577-8bd5-368d3ec8d6f2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:09.899722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eec663cf-3318-47ef-8721-e9fd623375f2 req-9d030e42-4460-41d5-9d9c-06e6cc890d28 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:09.901864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eec663cf-3318-47ef-8721-e9fd623375f2 req-9d030e42-4460-41d5-9d9c-06e6cc890d28 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:09.918151 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eec663cf-3318-47ef-8721-e9fd623375f2 req-9d030e42-4460-41d5-9d9c-06e6cc890d28 service nova] Creating event network-vif-plugged:627d6965-0227-4577-8bd5-368d3ec8d6f2 for instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 on n-h1-764486-11 Jul 20 04:57:09.927651 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-eec663cf-3318-47ef-8721-e9fd623375f2 req-9d030e42-4460-41d5-9d9c-06e6cc890d28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078672 Jul 20 04:57:09.931104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4486/5611] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:10.114439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:10.115154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:10.131398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:10.132610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:10.133618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:10.134545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:10.326030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:10.336574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15c5883f-277a-4716-a88b-5a44c51c62fd tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1313 microversion: 2.1 time: 0.228622 Jul 20 04:57:10.347257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4487/5612] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:10 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:10.353206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:10.354103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:10.363620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:10.364326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:10.371516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:10.372306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:10.492219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:10.503704 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8811f0f6-7938-4f6f-ad09-37aaadfe99b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1169 microversion: 2.1 time: 0.154576 Jul 20 04:57:10.505180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4488/5613] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:10 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1169 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:11.355133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:11.356001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:11.382470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:11.382858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:11.391996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:11.392647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:11.888611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:11.920860 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ac708c0-269a-41e1-8863-a322c2e33f6b tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1498 microversion: 2.1 time: 0.569254 Jul 20 04:57:11.942708 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4489/5614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:11 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1498 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:11.949525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:11.954988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:11.975577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:11.976277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:11.977331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:11.977949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:12.352214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:12.368220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db92fd11-0144-4808-9281-9ff1189e99e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.422646 Jul 20 04:57:12.369258 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4490/5615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:11 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:13.392066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:13.393547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:13.446127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:13.447251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:13.450215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:13.453033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:13.935171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:13.953871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c607b40-c9ec-4c11-b8ef-d78ea7f43a0d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.566270 Jul 20 04:57:13.955273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4491/5616] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:13 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:13.960166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ad82b672-5750-431f-b92b-ec1d18862566 req-bc187f24-866e-4a24-a3b2-00f2ddca73fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbd82c0-80ba-4e7e-b979-d3fd95cf9685", "tag": "93094e4d-4731-4299-b5d1-2a9ce2316583"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:13.981171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ad82b672-5750-431f-b92b-ec1d18862566 req-bc187f24-866e-4a24-a3b2-00f2ddca73fa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:13.985023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ad82b672-5750-431f-b92b-ec1d18862566 req-bc187f24-866e-4a24-a3b2-00f2ddca73fa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.004405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ad82b672-5750-431f-b92b-ec1d18862566 req-bc187f24-866e-4a24-a3b2-00f2ddca73fa service nova] Creating event network-changed:93094e4d-4731-4299-b5d1-2a9ce2316583 for instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 on n-h2-764486-11 Jul 20 04:57:14.022091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ad82b672-5750-431f-b92b-ec1d18862566 req-bc187f24-866e-4a24-a3b2-00f2ddca73fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065286 Jul 20 04:57:14.022855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4492/5617] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:14.040213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:14.041188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:14.049058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.057743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.059509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.060390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.113624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:57:14.315024 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8c3bcbe-05c0-4e7a-8e01-4f31253476d4 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "DELETE /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 204 len: 0 microversion: 2.1 time: 0.290292 Jul 20 04:57:14.315909 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4493/5618] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:57:14 2022] DELETE /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:57:14.326785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:14.327747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:14.352162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.359144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.360466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.361257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.424603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:14.658290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:14.666664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d1f3ed0-04c6-43d5-a970-e2f832af6d9c tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1504 microversion: 2.1 time: 0.344270 Jul 20 04:57:14.673897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4494/5619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:14 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:14.974981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:14.975607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:14.986216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.986676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:14.987482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:14.988109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:15.283555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:15.293489 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d175ee65-2e2d-476b-812f-b963ae28baeb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.322916 Jul 20 04:57:15.298812 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4495/5620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:14 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:15.721482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:15.723042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:15.738822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:15.739526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:15.740772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:15.741146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:16.088104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:16.106641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f839f104-557a-4fba-92d5-8063f32a70e2 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1504 microversion: 2.1 time: 0.387973 Jul 20 04:57:16.110393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4496/5621] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:15 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:16.328229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:16.335170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:16.352708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:16.355422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:16.359070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:16.359572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:16.704275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:16.712988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-848b7854-1eae-49a5-8d65-b6e810dd0260 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.398184 Jul 20 04:57:16.722705 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4497/5622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:16 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:16.728099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6eb65748-64a3-413c-aa77-45c23615e6af req-0412b9cb-cccb-4b83-be9f-db54a2df2e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29bde4f6-af32-4bf0-957c-36ed93ab3824", "name": "network-vif-deleted", "tag": "627d6965-0227-4577-8bd5-368d3ec8d6f2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:16.747754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6eb65748-64a3-413c-aa77-45c23615e6af req-0412b9cb-cccb-4b83-be9f-db54a2df2e41 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:16.749017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6eb65748-64a3-413c-aa77-45c23615e6af req-0412b9cb-cccb-4b83-be9f-db54a2df2e41 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:16.768174 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6eb65748-64a3-413c-aa77-45c23615e6af req-0412b9cb-cccb-4b83-be9f-db54a2df2e41 service nova] Creating event network-vif-deleted:627d6965-0227-4577-8bd5-368d3ec8d6f2 for instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 on n-h1-764486-11 Jul 20 04:57:16.774404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6eb65748-64a3-413c-aa77-45c23615e6af req-0412b9cb-cccb-4b83-be9f-db54a2df2e41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049908 Jul 20 04:57:16.775026 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4498/5623] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:17.131678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:17.134166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:17.156656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:17.157163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:17.158033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:17.158510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:17.276162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:17.276918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:17.277609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lazy-loading 'fault' on Instance uuid 29bde4f6-af32-4bf0-957c-36ed93ab3824 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:57:17.345222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd2ef40b14de79837b810ab00bbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a96691c9d124738ad370262c11243c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:17.367458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-174b6388-de7c-445a-8c3c-1beeccd32701 tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 200 len: 1303 microversion: 2.1 time: 0.242577 Jul 20 04:57:17.368765 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4499/5624] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:17 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:17.730501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:17.731913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:17.754449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:17.755133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:17.756092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:17.756717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:17.941606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:17.952397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9746b13-233a-42b8-943a-d10ee17e1c34 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.226199 Jul 20 04:57:17.954485 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4500/5625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:17 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:18.385235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:18.386107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] [instance: 29bde4f6-af32-4bf0-957c-36ed93ab3824] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:18.393017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.393681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.394622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.395221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.410282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] HTTP exception thrown: Instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 could not be found. Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Request method failure captured: Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 HTTP/1.1 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14r1pFECgpGzNSvSaq1vPszgfDOoVxZ_PONHzSgv2ontQbuWyeiyX8ZZS-FXxCSGk6jz8xjsvWzeKeRUwAkiThfLiZ7dOc9kzmDtE16he_Zi6qmJ3KAgIxszGPUKGI3zP1gIsGJDVAQJPZGIS1A5ozZUJMNUfskbHC_mK-k_-lNoVUY Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1a96691c9d124738ad370262c11243c8 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-VolumesActionsTest-1585005579 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1a96691c9d124738ad370262c11243c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a96691c9d124738ad370262c11243c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1a96691c9d124738ad370262c11243c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1a96691c9d124738ad370262c11243c8", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-VolumesActionsTest-1585005579 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1a96691c9d124738ad370262c11243c8 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-VolumesActionsTest-1585005579 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-VolumesActionsTest-1585005579-project Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 9fbcd2ef40b14de79837b810ab00bbd1 Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-VolumesActionsTest-1585005579-project Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 could not be found. Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '29bde4f6-af32-4bf0-957c-36ed93ab3824'} Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 could not be found. Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 could not be found. Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:57:18.412147 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 could not be found. Jul 20 04:57:18.416831 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:57:18.418117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] Returning 404 to user: Instance 29bde4f6-af32-4bf0-957c-36ed93ab3824 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:57:18.419002 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e7687b1b-7ec2-4a66-b5cc-60f04e2234dc tempest-VolumesActionsTest-1585005579 tempest-VolumesActionsTest-1585005579-project] 10.222.0.49 "GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824" status: 404 len: 111 microversion: 2.1 time: 0.037759 Jul 20 04:57:18.419580 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4501/5626] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:18 2022] GET /compute/v2.1/servers/29bde4f6-af32-4bf0-957c-36ed93ab3824 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:57:18.970442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:18.971020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:18.972991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:18.993485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.993639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:18.994367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:18.995002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:19.200778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:19.205436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:19.220533 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc478061-5766-42e4-a45d-742028c17a88 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.254012 Jul 20 04:57:19.236769 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4502/5627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:18 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:20.238432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:20.239738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:20.247219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.248200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.249551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:20.250185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:20.501445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:20.509657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-791153c9-8e18-4f52-a3eb-7a8ed7ddb083 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.275494 Jul 20 04:57:20.520266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4503/5628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:20 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:21.528517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:21.530098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:21.538354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:21.571016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:21.571016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:21.581224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:21.584670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:21.908381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:21.928568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94986d5e-e335-494d-8ec2-18bd37cb7da4 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.402886 Jul 20 04:57:21.937363 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4504/5629] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:21 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:22.950485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:22.952514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:22.985653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:22.988747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:22.990626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:22.991688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:23.439396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:23.448186 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32c04bc0-a027-4384-831c-1e72079acea5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.504731 Jul 20 04:57:23.449986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4505/5630] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:22 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:24.470431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:24.471529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:24.542867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:24.551401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:24.563309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:24.569931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:25.056532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:25.068852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a66f1b23-bbcb-4ff2-a5c3-88606201eca5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1229 microversion: 2.1 time: 0.605289 Jul 20 04:57:25.069460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4506/5631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:24 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1229 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:26.109605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:26.110424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:26.140230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:26.141609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:26.146826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:26.155255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:26.373945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:26.394351 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32e99842-6cec-4d9e-bde1-f770763d37ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.297799 Jul 20 04:57:26.403602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4507/5632] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:26 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:27.411483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:27.412447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:27.438630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:27.438630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:27.441649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:27.444243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:27.721288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:27.743991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8621f073-92e5-4932-a217-e3b9d3171d5f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.336639 Jul 20 04:57:27.749007 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4508/5633] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:27 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:28.765925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:28.767056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:28.779514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:28.779974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:28.780801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:28.789001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:29.073527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:29.081840 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a0defd0-81cd-4279-9b18-5ae3c91a4ead tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.320414 Jul 20 04:57:29.092500 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4509/5634] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:28 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:30.109265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:30.111055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:30.123524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:30.124059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:30.125176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:30.137076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:30.410373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:30.423812 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b78a9f32-ccd3-4421-ac6e-019a79d88c4c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.318949 Jul 20 04:57:30.424985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4510/5635] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:30 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:31.444679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:31.446318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:31.463558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:31.464281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:31.467143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:31.468565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:31.814336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:31.823917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:31.830350 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06b20ab5-ed8b-4d78-a916-06dd856d196b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.392887 Jul 20 04:57:31.832011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4511/5636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:31 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:32.852676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:32.854535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:32.869723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:32.889956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:32.897382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:32.897862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:33.214237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:33.228522 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6928155-4e05-4d34-92a4-dfbe5088d348 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.383782 Jul 20 04:57:33.231098 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4512/5637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:32 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:34.247332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:34.247993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:34.267782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:34.268197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:34.269039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:34.269632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:34.562389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:34.578236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbd204f4-a2bf-4ee9-9dc0-265f8030d3ea tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.334789 Jul 20 04:57:34.579518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4513/5638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:34 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:35.436323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-17186960-c7cf-41c8-a838-c51622860ea5 req-469c09a7-cb4c-4a87-9e00-02af057516a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbd82c0-80ba-4e7e-b979-d3fd95cf9685", "name": "network-vif-plugged", "status": "completed", "tag": "93094e4d-4731-4299-b5d1-2a9ce2316583"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:35.463128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-17186960-c7cf-41c8-a838-c51622860ea5 req-469c09a7-cb4c-4a87-9e00-02af057516a8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:35.464265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-17186960-c7cf-41c8-a838-c51622860ea5 req-469c09a7-cb4c-4a87-9e00-02af057516a8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:35.510702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-17186960-c7cf-41c8-a838-c51622860ea5 req-469c09a7-cb4c-4a87-9e00-02af057516a8 service nova] Creating event network-vif-plugged:93094e4d-4731-4299-b5d1-2a9ce2316583 for instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 on n-h2-764486-11 Jul 20 04:57:35.527215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-17186960-c7cf-41c8-a838-c51622860ea5 req-469c09a7-cb4c-4a87-9e00-02af057516a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101186 Jul 20 04:57:35.530837 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4514/5639] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:57:35.596466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:35.597202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:35.608704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:35.609151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:35.609931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:35.610368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:35.828448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:35.837751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c69a065-640c-4fcc-b56d-65e91eb6846e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.245807 Jul 20 04:57:35.839839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4515/5640] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:35 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:57:36.859195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:36.859861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:36.871076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:36.871786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:36.872801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:36.873402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:37.134092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:37.144139 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b373c38-421f-47c3-97be-81900b03e67e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1217 microversion: 2.1 time: 0.291404 Jul 20 04:57:37.147665 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4516/5641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:36 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:38.165735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:38.166977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:38.203061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:38.207433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:38.210677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:38.212064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:38.526003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:38.537611 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ace7908-38ce-47a5-af4c-a3d67915b10a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1404 microversion: 2.1 time: 0.376468 Jul 20 04:57:38.540228 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4517/5642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:38 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1404 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:38.558255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:57:38.559579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:38.571336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:38.573141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:38.574494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:38.576900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:38.960152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:57:39.009647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b4b94503-f62c-4ba7-b3d1-7be8aea758f7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1404 microversion: 2.1 time: 0.454587 Jul 20 04:57:39.049222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4518/5643] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:57:38 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:57:39.081037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1529108899"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:57:39.082117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:57:39.096668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:39.100498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:39.102073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:57:39.102539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:57:39.339639 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Attempting to quiesce instance before volume snapshot. Jul 20 04:57:39.360604 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 20 04:57:39.544176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Creating snapshot from volume 697a441a-0352-4295-8512-c740bd038927. {{(pid=123724) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 20 04:57:49.090848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=30 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:49.997348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:57:59.783444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb07b2b4-a3c9-40db-ac4e-9ac67d182090 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685/action" status: 202 len: 0 microversion: 2.1 time: 20.709507 Jul 20 04:57:59.784153 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4519/5644] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:57:39 2022] POST /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685/action => generated 0 bytes in 20711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 04:58:00.129712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1569385674", "imageRef": "6e01bfba-04ae-459a-bf48-470aeb649d43", "flavorRef": "452", "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:00.221571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:58:01.247246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:58:01.247940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:58:01.248314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:58:01.248787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:58:01.249220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:58:01.278803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:01.281187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:01.282039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:01.282485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:01.343783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:58:01.360514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:58:01.398468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:58:01.409293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5028fe48-a8ab-400e-91c9-7410949e7544',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:58:01.538078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-046fbdd5-3762-4a80-98d2-f99784d51f4b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413708 Jul 20 04:58:01.540571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4520/5645] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:58:01.555541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f3d8536-0d6b-4c32-9703-afd976599bc8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:01.556518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f3d8536-0d6b-4c32-9703-afd976599bc8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:01.752440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f3d8536-0d6b-4c32-9703-afd976599bc8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:01.765249 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f3d8536-0d6b-4c32-9703-afd976599bc8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1230 microversion: 2.1 time: 0.219792 Jul 20 04:58:01.777870 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4521/5646] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:01 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1230 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:02.784186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:02.785850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:02.821995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:02.822455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:02.823316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:02.823894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:03.081952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:03.098161 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b18aceb2-18d0-4369-ab6c-262cea3dc874 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1226 microversion: 2.1 time: 0.318058 Jul 20 04:58:03.110277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4522/5647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:02 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1226 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:04.119923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:04.121341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:04.139412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:04.140172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:04.142384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:04.143909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:05.432711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:05.444271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05106715-1a9d-44b5-80b7-634c7abd0e44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 1.330354 Jul 20 04:58:05.452206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4523/5648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:04 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:06.472543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:06.473879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:06.490212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:06.491836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:06.495715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:06.496700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:07.567200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:07.586862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b68d8ce-71cf-41e8-a53e-7fe1aaf7abb1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 1.112417 Jul 20 04:58:07.589841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4524/5649] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:06 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:07.606541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-37526ef1-b6d1-4e8d-a50e-432aef8eb268 req-63214acb-67a2-4d67-8771-c67f2099f2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de30777f-079d-4c5f-a367-27201074c048", "tag": "12d2c042-fb72-4c0b-a2df-f6d1be253602"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:07.631514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-37526ef1-b6d1-4e8d-a50e-432aef8eb268 req-63214acb-67a2-4d67-8771-c67f2099f2b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:07.634496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-37526ef1-b6d1-4e8d-a50e-432aef8eb268 req-63214acb-67a2-4d67-8771-c67f2099f2b4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:07.667577 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-37526ef1-b6d1-4e8d-a50e-432aef8eb268 req-63214acb-67a2-4d67-8771-c67f2099f2b4 service nova] Creating event network-changed:12d2c042-fb72-4c0b-a2df-f6d1be253602 for instance de30777f-079d-4c5f-a367-27201074c048 on n-h1-764486-11 Jul 20 04:58:07.679429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-37526ef1-b6d1-4e8d-a50e-432aef8eb268 req-63214acb-67a2-4d67-8771-c67f2099f2b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086953 Jul 20 04:58:07.682187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4525/5650] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:08.613103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:08.627200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:08.651110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:08.661344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:08.662919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:08.663678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:09.095074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:09.108567 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a46e7b96-c5b3-4880-b1f7-6b588c580464 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.500109 Jul 20 04:58:09.110773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4526/5651] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:08 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:10.130079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:10.131174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:10.168721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:10.169461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:10.170494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:10.170711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:10.413735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:10.421970 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09a433cc-346d-41e9-90d3-379604a7573d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.300460 Jul 20 04:58:10.424877 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4527/5652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:10 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:11.440884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:11.442619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:11.450981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:11.453447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.454517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.455684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:11.456148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:11.715963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:11.744288 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-61bcead0-0ba0-45f8-b2fd-1a7f71889791 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.308710 Jul 20 04:58:11.755495 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4528/5653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:11 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:12.774771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:12.775513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:12.793270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:12.798146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:12.798848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:12.800514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:12.801164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:13.124724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:13.138881 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-04ba9317-88b7-4c83-a8ea-658c845118a5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.366572 Jul 20 04:58:13.138881 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4529/5654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:12 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:14.158114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:14.159208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:14.184931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:14.185738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:14.187646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:14.189291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:14.428241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:14.441988 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89cf8adf-2be7-4b31-810a-8e710954ac75 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.288574 Jul 20 04:58:14.443066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4530/5655] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:14 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:15.503934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:15.505984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:15.543874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.544268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:15.555795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:15.566236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:15.856189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:15.866103 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-87d543c0-047e-47bc-b395-d59c810e2164 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.406900 Jul 20 04:58:15.872246 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4531/5656] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:15 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:16.893570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:16.894472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:16.911804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:16.912834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:16.913830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:16.914590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:17.177948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:17.188942 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0275e98-20a4-4f82-98e1-cadc3685289a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.300648 Jul 20 04:58:17.195972 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4532/5657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:16 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:18.216673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:18.218201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:18.229558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:18.230167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:18.231132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:18.232063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:18.425956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:18.435433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b580892-b893-4e9d-8953-26b74bdff63d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.224383 Jul 20 04:58:18.436626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4533/5658] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:18 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:19.453780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:19.455571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:19.463265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:19.464136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:19.465131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:19.465798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:19.728902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:19.737634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c4b75c9-bcfc-4656-ba32-1e887cb9d98b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.288928 Jul 20 04:58:19.741046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4534/5659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:19 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:20.757972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:20.760064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:20.771645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:20.772431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:20.773636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:20.774315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:20.972441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:20.981490 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d80417b7-8185-49a8-a1bb-eb300e161a83 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.228199 Jul 20 04:58:20.991917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4535/5660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:20 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:22.000019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:22.000701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:22.011578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:22.011975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:22.012800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:22.016548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:22.233939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:22.244939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80ade160-a2ef-4d5a-ba4c-b18334426059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.248385 Jul 20 04:58:22.246332 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4536/5661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:21 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:23.263054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:23.263820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:23.276102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:23.276916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:23.277884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:23.278507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:23.523086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:23.539127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32f75036-8adf-4c0c-8d69-4c723854759f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.279757 Jul 20 04:58:23.540044 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4537/5662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:23 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:24.556939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:24.557592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:24.570580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:24.571056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:24.571870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:24.572411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:24.787468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:24.791735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:24.797432 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6f480fdf-91d1-4a02-9bfe-323afa08bc96 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.244973 Jul 20 04:58:24.799322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4538/5663] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:24 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:25.817768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:25.818889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:25.835493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:25.836192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:25.843551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:25.844592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:26.152604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:26.161639 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afa3ba7b-069f-443d-b5d5-42d6d34aa4d7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.350218 Jul 20 04:58:26.165056 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4539/5664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:25 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:27.180510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:27.181293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:27.193846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:27.194318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:27.196046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:27.196880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:27.423549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:27.434249 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1bec0f53-4998-403e-a48d-68e431560a45 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1342 microversion: 2.1 time: 0.257512 Jul 20 04:58:27.436677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4540/5665] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:27 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1342 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:28.464063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:28.466719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:28.482900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:28.484970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:28.487366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:28.488064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:28.755773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:28.764572 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4044ac33-216e-47ab-adf0-b8e77845b14e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1388 microversion: 2.1 time: 0.315176 Jul 20 04:58:28.768510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4541/5666] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:28 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1388 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:29.783245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:29.784776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:29.792032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:29.794902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:29.795628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:29.796739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:29.797378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:29.959774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:29.969720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7bdc311b-df35-487c-8d03-e501d2133c84 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.190262 Jul 20 04:58:29.972266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4542/5667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:29 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:30.988970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:30.989651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:31.007425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:31.007905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:31.008751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:31.009212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:31.598071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:31.616513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2a91042-fbb4-4ec9-929d-69d3ddd22ff5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.631714 Jul 20 04:58:31.624651 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4543/5668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:30 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:32.635175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:32.635796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:32.661368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:32.661793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:32.662648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:32.665126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:33.072146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:33.095582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00ab02cb-416a-4b08-acc3-9fea448cf94b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.465149 Jul 20 04:58:33.114615 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4544/5669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:32 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:34.132762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:34.138267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:34.146900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:34.147967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:34.149982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:34.155600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:34.426206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:34.441624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-557e6cb3-897a-4bb2-9a2b-75d1796fb059 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.314882 Jul 20 04:58:34.457399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4545/5670] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:34 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:35.465744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:35.466386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:35.479312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:35.480687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:35.482904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:35.484233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:36.164676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:36.175494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12d6c4d2-3924-4772-86eb-af13bc763034 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.714254 Jul 20 04:58:36.191070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4546/5671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:35 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:36.201134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b722049d-f00f-4727-b6fa-4588a15c68f0 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'create', calling method: .version_select at 0x7f838a0c9670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1066641058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYK9haDuqZimmBUnE51zmb6Tfau+t3uEFjB51LV7RrhGZO41eCfEF8Ql17m5SbE8vs9FCzKStkAOzL+C/8WAeBEJE5XGUHNgDTEgtl6BM6UhegJx1bAp0nv6c0r80pKMQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:36.250341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b722049d-f00f-4727-b6fa-4588a15c68f0 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:58:36.271944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b722049d-f00f-4727-b6fa-4588a15c68f0 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for user d82a6e42f25e4d1db8c37bdf66c8d3c4 and project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:58:36.331351 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b722049d-f00f-4727-b6fa-4588a15c68f0 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.137412 Jul 20 04:58:36.332941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4547/5672] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:58:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:37.195272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:37.196156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:37.229163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:37.229677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:37.234790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:37.238154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:38.273560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:38.289187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3bb2ab5-93e6-403e-ae60-d4ce58d0f327 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 1.095423 Jul 20 04:58:38.310960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4548/5673] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:37 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:38.851802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-216672907", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "4093f54f-1d3b-4fe6-a0a9-de67bd9cce6b"}], "key_name": "tempest-TestNetworkBasicOps-1066641058", "security_groups": [{"name": "tempest-secgroup-smoke-941732613"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:39.083686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] validate_networks() for [('4093f54f-1d3b-4fe6-a0a9-de67bd9cce6b', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:58:39.855842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:58:39.856480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:58:39.857157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:58:39.857592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:58:39.858055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:58:39.870538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:39.872156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:39.874093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:39.874810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:39.931706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:58:39.938217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for user d82a6e42f25e4d1db8c37bdf66c8d3c4 and project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:58:39.983744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:58:39.986947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:58:40.112204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b291b7b0-1a23-4d82-8cbc-69193a8f799f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.265409 Jul 20 04:58:40.114057 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4549/5674] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:58:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:58:40.124981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:40.127396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:40.140334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:40.141650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:40.150783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:40.151874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:40.381982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:40.393359 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b455b517-ab22-4ce3-8f63-84c4a3ebb8c3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.277817 Jul 20 04:58:40.395434 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4550/5675] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:40 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:40.434678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-110fa013-215f-4234-98e4-d34b7aabfb75 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:40.439309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-110fa013-215f-4234-98e4-d34b7aabfb75 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:40.537685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-110fa013-215f-4234-98e4-d34b7aabfb75 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:40.548847 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-110fa013-215f-4234-98e4-d34b7aabfb75 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1248 microversion: 2.1 time: 0.151695 Jul 20 04:58:40.580700 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4551/5676] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:40 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1248 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:40.592886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d013fa5b-f17d-4f93-9e55-c7a4640a106f req-95970c07-0ce8-4209-9b7b-4766fffcae35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30777f-079d-4c5f-a367-27201074c048", "name": "network-vif-plugged", "status": "completed", "tag": "12d2c042-fb72-4c0b-a2df-f6d1be253602"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:40.608992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d013fa5b-f17d-4f93-9e55-c7a4640a106f req-95970c07-0ce8-4209-9b7b-4766fffcae35 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:40.609448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d013fa5b-f17d-4f93-9e55-c7a4640a106f req-95970c07-0ce8-4209-9b7b-4766fffcae35 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:40.646852 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d013fa5b-f17d-4f93-9e55-c7a4640a106f req-95970c07-0ce8-4209-9b7b-4766fffcae35 service nova] Creating event network-vif-plugged:12d2c042-fb72-4c0b-a2df-f6d1be253602 for instance de30777f-079d-4c5f-a367-27201074c048 on n-h1-764486-11 Jul 20 04:58:40.652646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d013fa5b-f17d-4f93-9e55-c7a4640a106f req-95970c07-0ce8-4209-9b7b-4766fffcae35 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064416 Jul 20 04:58:40.653846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4552/5677] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:41.413099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:41.416365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:41.436572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:41.437014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:41.437888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:41.438456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:41.680341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:41.693029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17d271ed-8943-43d0-af15-fc94d5fcf8f9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1376 microversion: 2.1 time: 0.285379 Jul 20 04:58:41.695770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4553/5678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:41 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1376 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:41.712058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:41.713795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:41.727979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:41.728496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:41.729310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:41.729799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:41.867399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:41.875824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4912ec74-5828-4418-b85d-0bf49039f5c6 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1300 microversion: 2.1 time: 0.177758 Jul 20 04:58:41.881570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4554/5679] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:41 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:42.715411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:42.716099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:42.727753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:42.728315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:42.734120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:42.734120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:42.945135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:42.967300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2673df1-7874-4781-9b65-db50dadce251 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1564 microversion: 2.1 time: 0.258284 Jul 20 04:58:42.968115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4555/5680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:42 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1564 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:42.974617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:42.983036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:42.990315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:42.991202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:42.992212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:42.992837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.188472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:43.197041 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c611f71b-9e1f-44ed-9798-18e1d9dadf74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.226237 Jul 20 04:58:43.197636 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4556/5681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:42 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:43.203033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:43.203849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:43.212007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:43.212691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.213654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:43.214263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.419083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:43.433838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bcf9dd5a-c817-42f3-8ecb-52a98fa7b47f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1564 microversion: 2.1 time: 0.232173 Jul 20 04:58:43.434761 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4557/5682] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:43 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1564 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:43.576932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:43.577770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:43.601651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:43.602127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.602946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:43.603396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.659057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:58:43.663639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:43.785759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6d92cac5-1f87-4cf7-ab34-d82ddec614ce tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 204 len: 0 microversion: 2.1 time: 0.212481 Jul 20 04:58:43.790891 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4558/5683] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:58:43 2022] DELETE /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:58:43.796926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:43.797648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:43.804610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:43.805077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.806107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:43.806801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:43.991235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:44.000613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66de01d3-acf5-4857-a9d3-790ff1b29c5e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1570 microversion: 2.1 time: 0.208009 Jul 20 04:58:44.001730 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4559/5684] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:43 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:44.218795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:44.224097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:44.284192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:44.286898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:44.289034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:44.291584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:44.661445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:44.679447 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-64700b0e-2d32-4884-bda0-c93e943b9829 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.468661 Jul 20 04:58:44.684424 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4560/5685] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:44 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:45.019059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:45.019777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:45.027368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:45.028438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:45.029601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:45.030210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:45.311202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:45.325966 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdba0459-6f32-4c26-91c3-065eb08ec544 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1570 microversion: 2.1 time: 0.310914 Jul 20 04:58:45.327719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4561/5686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:45 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1570 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:45.341727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-387b3abd-4635-46dc-9539-606d9ef84adc req-ca528c51-7c74-4774-a0e5-e25463123b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6413de6-b7fd-433f-bb21-9654f9c6653d", "tag": "2e37cf49-f5f5-4abb-a8af-1d8b40dc0712"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:45.361601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-387b3abd-4635-46dc-9539-606d9ef84adc req-ca528c51-7c74-4774-a0e5-e25463123b67 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:45.362666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-387b3abd-4635-46dc-9539-606d9ef84adc req-ca528c51-7c74-4774-a0e5-e25463123b67 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:45.382829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-387b3abd-4635-46dc-9539-606d9ef84adc req-ca528c51-7c74-4774-a0e5-e25463123b67 service nova] Creating event network-changed:2e37cf49-f5f5-4abb-a8af-1d8b40dc0712 for instance a6413de6-b7fd-433f-bb21-9654f9c6653d on n-h2-764486-11 Jul 20 04:58:45.399041 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-387b3abd-4635-46dc-9539-606d9ef84adc req-ca528c51-7c74-4774-a0e5-e25463123b67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069758 Jul 20 04:58:45.413887 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4562/5687] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:45.706507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:45.709040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:45.716102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:45.717612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:45.718802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:45.721102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:46.079646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:46.092467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb5c9b82-23df-4b78-b06f-8ad21c620a0a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.392217 Jul 20 04:58:46.102949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4563/5688] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:45 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:46.359662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:46.368953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:46.403389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:46.403932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:46.404808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:46.405269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:46.759641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:46.785784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d54f081f-9e43-47a1-a4c5-7cdf6d750005 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1528 microversion: 2.1 time: 0.433545 Jul 20 04:58:46.792269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4564/5689] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:46 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:47.314597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c1e2d83e-b716-4460-b683-b74869796c9f req-63dc0dc5-4804-4ba1-8b5c-d51b7a60757b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30777f-079d-4c5f-a367-27201074c048", "name": "network-vif-deleted", "tag": "12d2c042-fb72-4c0b-a2df-f6d1be253602"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:47.327896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c1e2d83e-b716-4460-b683-b74869796c9f req-63dc0dc5-4804-4ba1-8b5c-d51b7a60757b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:47.328335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c1e2d83e-b716-4460-b683-b74869796c9f req-63dc0dc5-4804-4ba1-8b5c-d51b7a60757b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:47.385201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c1e2d83e-b716-4460-b683-b74869796c9f req-63dc0dc5-4804-4ba1-8b5c-d51b7a60757b service nova] Creating event network-vif-deleted:12d2c042-fb72-4c0b-a2df-f6d1be253602 for instance de30777f-079d-4c5f-a367-27201074c048 on n-h1-764486-11 Jul 20 04:58:47.397063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c1e2d83e-b716-4460-b683-b74869796c9f req-63dc0dc5-4804-4ba1-8b5c-d51b7a60757b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.603305 Jul 20 04:58:47.397917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4565/5690] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:47.420762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:47.421827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:47.436494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:47.449014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:47.452111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:47.452941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:47.816283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:47.836708 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e52daffa-b825-48ee-adad-c5d32f1e8f15 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.430436 Jul 20 04:58:47.846384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4566/5691] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:47 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:47.852604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:47.867427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:47.874213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:47.874681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:47.875676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:47.876295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:48.000284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:48.017340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d74fcac0-6521-4205-bec8-c11469e95362 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1361 microversion: 2.1 time: 0.167496 Jul 20 04:58:48.018068 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4567/5692] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:47 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:48.859582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:48.862212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:48.913685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:48.931396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:48.932710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:48.933448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:49.250803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:49.260871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-224fb353-97b2-40e1-be48-38a5eef68e7d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.410655 Jul 20 04:58:49.266050 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4568/5693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:48 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:49.278864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:49.281898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:49.299773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:49.303205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:49.305295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:49.306975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:49.501050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:49.513317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e152efb7-ef13-425e-bd4d-5a0e15436928 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1361 microversion: 2.1 time: 0.245810 Jul 20 04:58:49.513920 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4569/5694] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:49 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:50.282821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:50.284086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:50.286592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:50.298164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:50.298638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:50.299448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:50.299907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:50.547329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:50.613903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:50.624643 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08e54c0b-077e-4749-b015-e67f90d947a2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.346062 Jul 20 04:58:50.626405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4570/5695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:50 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:50.632503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:50.633429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:50.640522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:50.641291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:50.642325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:50.642991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:50.768813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:50.780985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00916760-2023-4c46-a74f-1f7ece978c03 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1361 microversion: 2.1 time: 0.153028 Jul 20 04:58:50.789988 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4571/5696] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:50 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:51.645152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:51.645968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:51.658579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:51.659051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:51.659858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:51.660437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:51.890379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:51.901096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3594d944-ac6d-48f5-b7bd-c309d86a3d52 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.260924 Jul 20 04:58:51.902722 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4572/5697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:51 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:51.907791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:51.908807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:51.916436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:51.917357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:51.918378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:51.919070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:52.023277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:52.031773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e77038c4-782f-4f9b-9954-b701b8b43abb tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1361 microversion: 2.1 time: 0.127654 Jul 20 04:58:52.052325 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4573/5698] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:51 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:52.390410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22129f71-bd14-427a-a7d8-fa976d44e77b tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1302841934", "availability_zone": "foo_zone"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:52.426750 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:52.426750 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:52.428327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.aggregate [None req-22129f71-bd14-427a-a7d8-fa976d44e77b tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Generated uuid e95b7347-c8fb-4bd8-af1f-cac2b674b7cb for aggregate {{(pid=123724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 04:58:52.463200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:52.488842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22129f71-bd14-427a-a7d8-fa976d44e77b tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.173484 Jul 20 04:58:52.490525 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4574/5699] 10.222.0.49 () {60 vars in 1163 bytes} [Wed Jul 20 04:58:52 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:58:52.501387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34431923-c09c-41d1-9092-11501066e987 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:52.506717 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:52.506717 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:52.552659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34431923-c09c-41d1-9092-11501066e987 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.055438 Jul 20 04:58:52.554337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4575/5700] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:58:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:58:52.564580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95bc38c2-0da2-4767-b0ff-ee52d34938cd tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:52.568672 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:52.568672 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:52.570474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95bc38c2-0da2-4767-b0ff-ee52d34938cd tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:52.571298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95bc38c2-0da2-4767-b0ff-ee52d34938cd tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:52.572498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95bc38c2-0da2-4767-b0ff-ee52d34938cd tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:52.573125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95bc38c2-0da2-4767-b0ff-ee52d34938cd tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:52.615752 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95bc38c2-0da2-4767-b0ff-ee52d34938cd tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.055092 Jul 20 04:58:52.617748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4576/5701] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Jul 20 04:58:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:58:52.626819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c55610b6-3787-4ed0-a6f3-580cf6e322a4 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:52.627957 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:52.627957 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:52.636389 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c55610b6-3787-4ed0-a6f3-580cf6e322a4 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013098 Jul 20 04:58:52.637554 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4577/5702] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Jul 20 04:58:52 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:58:52.650684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dca670f8-f775-47dc-867a-2eb119c5b246 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:52.653537 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:52.653537 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:52.664615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dca670f8-f775-47dc-867a-2eb119c5b246 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:52.665404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dca670f8-f775-47dc-867a-2eb119c5b246 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:52.962968 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dca670f8-f775-47dc-867a-2eb119c5b246 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.316298 Jul 20 04:58:52.963638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4578/5703] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:58:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:52.969036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:52.969189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:52.976807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:52.977283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:52.978099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:52.978557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:52.985532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:58:53.167348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:53.179890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7dcc46e9-1822-4d0c-8ce7-1c0a50ee8507 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1377 microversion: 2.1 time: 0.215077 Jul 20 04:58:53.189061 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4579/5704] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:52 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1377 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:53.194637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86c26f9a-9925-4018-a5e3-9748cbdc8b32 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:53.195409 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:53.195409 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:53.204516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86c26f9a-9925-4018-a5e3-9748cbdc8b32 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.014165 Jul 20 04:58:53.211319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4580/5705] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:58:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:53.211319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:53.211319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:53.217275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:53.217730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:53.218551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:53.219022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:53.292298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:53.303207 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c74aa539-bf2c-45a9-a980-b32ecd6b4407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1361 microversion: 2.1 time: 0.097014 Jul 20 04:58:53.303799 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4581/5706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:53 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:53.308450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35ae8799-31e1-4807-8343-07b2685ad29d tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1005321144", "availability_zone": "foo_zone"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:53.416984 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:53.416984 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:53.478747 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35ae8799-31e1-4807-8343-07b2685ad29d tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.173670 Jul 20 04:58:53.479442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4582/5707] 10.222.0.49 () {60 vars in 1172 bytes} [Wed Jul 20 04:58:53 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:53.491591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8df6360e-fb30-4ad2-a38f-75ba735fa5ef tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:53.493032 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:53.493032 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:53.529031 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8df6360e-fb30-4ad2-a38f-75ba735fa5ef tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.041985 Jul 20 04:58:53.536664 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4583/5708] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:58:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:53.542206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b87e413b-9b11-4c5a-806b-5027ac1ee8b3 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:53.542986 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:53.542986 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:53.553429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b87e413b-9b11-4c5a-806b-5027ac1ee8b3 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.015508 Jul 20 04:58:53.560186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4584/5709] 10.222.0.49 () {58 vars in 1151 bytes} [Wed Jul 20 04:58:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:53.567378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b82195d-3bb4-4565-90ee-0c19fe5af899 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-764486-11"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:53.568689 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:53.568689 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:53.578874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b82195d-3bb4-4565-90ee-0c19fe5af899 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:53.579342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b82195d-3bb4-4565-90ee-0c19fe5af899 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:53.761242 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b82195d-3bb4-4565-90ee-0c19fe5af899 tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.198081 Jul 20 04:58:53.762335 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4585/5710] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jul 20 04:58:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:53.773419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23867f96-db4f-4464-a58b-059219e8b2ae tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:53.774856 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 04:58:53.774856 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 04:58:53.806498 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23867f96-db4f-4464-a58b-059219e8b2ae tempest-TestAggregatesBasicOps-1073854854 tempest-TestAggregatesBasicOps-1073854854-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.037311 Jul 20 04:58:53.807108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4586/5711] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jul 20 04:58:53 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 04:58:53.840794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-75f47482-8ca8-4514-bedd-6763888db1fd req-788e8a11-b5af-4c0c-987a-a7db51bf49f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6413de6-b7fd-433f-bb21-9654f9c6653d", "name": "network-vif-plugged", "status": "completed", "tag": "2e37cf49-f5f5-4abb-a8af-1d8b40dc0712"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:53.868159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-75f47482-8ca8-4514-bedd-6763888db1fd req-788e8a11-b5af-4c0c-987a-a7db51bf49f9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:53.868767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-75f47482-8ca8-4514-bedd-6763888db1fd req-788e8a11-b5af-4c0c-987a-a7db51bf49f9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:53.887264 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-75f47482-8ca8-4514-bedd-6763888db1fd req-788e8a11-b5af-4c0c-987a-a7db51bf49f9 service nova] Creating event network-vif-plugged:2e37cf49-f5f5-4abb-a8af-1d8b40dc0712 for instance a6413de6-b7fd-433f-bb21-9654f9c6653d on n-h2-764486-11 Jul 20 04:58:53.902043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-75f47482-8ca8-4514-bedd-6763888db1fd req-788e8a11-b5af-4c0c-987a-a7db51bf49f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066331 Jul 20 04:58:53.903644 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4587/5712] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:58:54.198357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:54.199236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:54.209424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:54.209906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:54.210730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:54.211174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:54.488665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:54.508615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-98601e47-5c0b-4dd8-8aa7-0760733259fd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1373 microversion: 2.1 time: 0.314408 Jul 20 04:58:54.518467 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4588/5713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:54 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1373 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:54.523964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:54.524893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:54.542315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:54.542668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:54.543487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:54.546211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:54.615955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:54.615955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:54.616422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lazy-loading 'fault' on Instance uuid de30777f-079d-4c5f-a367-27201074c048 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:58:54.666402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:54.674680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dccb2e22-7ef5-4540-ac07-78af66462e1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 200 len: 1366 microversion: 2.1 time: 0.155026 Jul 20 04:58:54.675207 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4589/5714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:54 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:55.527482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:55.528917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:55.535710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:55.536965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:55.538002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:55.538493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:55.691156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:55.703615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a5cbb593-0bf5-4f30-8c47-418e836ea7b5 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1545 microversion: 2.1 time: 0.180706 Jul 20 04:58:55.704437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4590/5715] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:55 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1545 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:58:55.711394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:55.712272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:55.722633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:55.723433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:55.724649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:55.725260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:55.751173 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 HTTP/1.1 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de30777f-079d-4c5f-a367-27201074c048'} Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:58:55.753361 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-350ef69d-fae1-46cc-b4d6-7b5f36212aaa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 404 len: 111 microversion: 2.1 time: 0.050001 Jul 20 04:58:55.758209 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4591/5716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:55 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:58:55.762094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:58:55.763245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:58:55.770953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:55.771428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:55.772229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:55.773320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:55.923338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:58:55.932991 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9de71a91-31a7-4ec3-b12e-6dd563554f01 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1545 microversion: 2.1 time: 0.175097 Jul 20 04:58:55.933591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4592/5717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:58:55 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1545 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:58:59.007062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1bab845a-c88a-41be-9f61-81018968caef req-fb936100-0941-4ef2-8362-e7142aa9a714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6413de6-b7fd-433f-bb21-9654f9c6653d", "tag": "2e37cf49-f5f5-4abb-a8af-1d8b40dc0712"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:58:59.034999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1bab845a-c88a-41be-9f61-81018968caef req-fb936100-0941-4ef2-8362-e7142aa9a714 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:58:59.035514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1bab845a-c88a-41be-9f61-81018968caef req-fb936100-0941-4ef2-8362-e7142aa9a714 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:58:59.081618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1bab845a-c88a-41be-9f61-81018968caef req-fb936100-0941-4ef2-8362-e7142aa9a714 service nova] Creating event network-changed:2e37cf49-f5f5-4abb-a8af-1d8b40dc0712 for instance a6413de6-b7fd-433f-bb21-9654f9c6653d on n-h2-764486-11 Jul 20 04:58:59.094612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1bab845a-c88a-41be-9f61-81018968caef req-fb936100-0941-4ef2-8362-e7142aa9a714 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091890 Jul 20 04:58:59.096474 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4593/5718] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 04:59:03.499045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:03.504079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:03.504706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:03.512023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:03.512524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:03.513301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:03.513747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:03.542696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:59:03.622142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09ec1423-2910-40d2-99c0-4fb91c955df6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 204 len: 0 microversion: 2.1 time: 0.124496 Jul 20 04:59:03.622608 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4594/5719] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:03 2022] DELETE /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 04:59:03.631301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:03.632023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:03.638241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:03.638711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:03.639579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:03.640013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:03.881425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:03.889275 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d05ecc1-762f-40e2-8767-d544143d7c17 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1410 microversion: 2.1 time: 0.262265 Jul 20 04:59:03.889870 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4595/5720] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:03 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1410 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:04.917557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:04.920405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:04.941862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:04.942339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:04.943653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:04.945927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:05.098415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:05.107115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9c20e36-9591-4abb-b28a-b0b6bec500a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1410 microversion: 2.1 time: 0.203444 Jul 20 04:59:05.107991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4596/5721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:04 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1410 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:05.885301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-33e21206-fdc6-42ff-b343-3263d08d8cac req-9b1a77b0-b3d0-4ebc-a745-31ae84ee3c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbd82c0-80ba-4e7e-b979-d3fd95cf9685", "name": "network-vif-deleted", "tag": "93094e4d-4731-4299-b5d1-2a9ce2316583"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:05.894968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-33e21206-fdc6-42ff-b343-3263d08d8cac req-9b1a77b0-b3d0-4ebc-a745-31ae84ee3c0e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:05.895651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-33e21206-fdc6-42ff-b343-3263d08d8cac req-9b1a77b0-b3d0-4ebc-a745-31ae84ee3c0e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:05.923282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-33e21206-fdc6-42ff-b343-3263d08d8cac req-9b1a77b0-b3d0-4ebc-a745-31ae84ee3c0e service nova] Creating event network-vif-deleted:93094e4d-4731-4299-b5d1-2a9ce2316583 for instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 on n-h2-764486-11 Jul 20 04:59:05.929543 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-33e21206-fdc6-42ff-b343-3263d08d8cac req-9b1a77b0-b3d0-4ebc-a745-31ae84ee3c0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048223 Jul 20 04:59:05.931662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4597/5722] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:06.133974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:06.135079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:06.144860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:06.146380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:06.154984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:06.155788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:06.238345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:06.248034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8079cfc1-a791-4877-8da5-5a31ca3016cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1202 microversion: 2.1 time: 0.126029 Jul 20 04:59:06.248681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4598/5723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:06 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1202 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:07.265680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:07.266448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:07.269496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:07.274302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:07.274769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:07.275957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:07.276435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:07.346141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:07.356243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a7a8f5c-fefc-4548-aa1a-d31d770e3efa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1202 microversion: 2.1 time: 0.095109 Jul 20 04:59:07.357314 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4599/5724] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:07 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:08.374572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:08.375889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:08.383953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:08.384455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:08.385264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:08.385720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:08.462312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:08.470528 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-783f526f-e0ad-40b7-8b64-2d010425c5b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1202 microversion: 2.1 time: 0.099812 Jul 20 04:59:08.471355 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4600/5725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:08 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:09.488434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:09.489057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:09.496453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:09.496941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:09.497813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:09.498265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:09.563456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:09.567693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:09.574204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-00d5d08d-d53f-45fb-9c4e-51402f6e58e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1202 microversion: 2.1 time: 0.089336 Jul 20 04:59:09.574818 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4601/5726] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:09 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:09.824686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:09.825275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:09.831445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:09.832009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:09.832908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:09.833427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:09.861794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 04:59:09.945767 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-261db521-97e6-4030-b8be-78d002677cce tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "DELETE /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 204 len: 0 microversion: 2.1 time: 0.365642 Jul 20 04:59:09.946681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4602/5727] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:09 2022] DELETE /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 04:59:09.955862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:09.956837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:09.963488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:09.963948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:09.964780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:09.965221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:10.103710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:10.111272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a32f515b-7c41-4fec-a902-17c88c12e705 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1730 microversion: 2.1 time: 0.159701 Jul 20 04:59:10.112066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4603/5728] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:09 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:10.591015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:10.591686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:10.598679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:10.599137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:10.599908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:10.600371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:10.670732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:10.685420 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48ae7f00-6717-4a39-bac3-e7cb7d267fe1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1202 microversion: 2.1 time: 0.098249 Jul 20 04:59:10.686316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4604/5729] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:10 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:11.130772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:11.131438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:11.137650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:11.138119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:11.138914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:11.139368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:11.286455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:11.296071 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e20877e0-9be0-4602-8ea4-8c877c2eeea7 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1730 microversion: 2.1 time: 0.171156 Jul 20 04:59:11.296740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4605/5730] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:11 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:11.703096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:11.703871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:11.717255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:11.717740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:11.718578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:11.719041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:11.873393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:11.885087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea69e45c-b5a3-459c-a032-d5a9d1802a87 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1202 microversion: 2.1 time: 0.185407 Jul 20 04:59:11.887936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4606/5731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:11 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:11.904256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-73d0d1a8-9943-4c68-806f-6c37ee888d13 req-b3932091-35a8-4db4-bc7a-e0da337a2dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ef2ab0-45a5-45df-84d9-6ad638279015", "name": "network-vif-deleted", "tag": "314e1fb4-1557-49c7-b090-e63515605cf8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:11.918483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-73d0d1a8-9943-4c68-806f-6c37ee888d13 req-b3932091-35a8-4db4-bc7a-e0da337a2dc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:11.918952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-73d0d1a8-9943-4c68-806f-6c37ee888d13 req-b3932091-35a8-4db4-bc7a-e0da337a2dc8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:11.946860 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-73d0d1a8-9943-4c68-806f-6c37ee888d13 req-b3932091-35a8-4db4-bc7a-e0da337a2dc8 service nova] Creating event network-vif-deleted:314e1fb4-1557-49c7-b090-e63515605cf8 for instance 25ef2ab0-45a5-45df-84d9-6ad638279015 on n-h2-764486-11 Jul 20 04:59:11.958498 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-73d0d1a8-9943-4c68-806f-6c37ee888d13 req-b3932091-35a8-4db4-bc7a-e0da337a2dc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069051 Jul 20 04:59:11.964949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4607/5732] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:12.315244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:12.316181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:12.336790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:12.337264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:12.338080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:12.351483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:12.455373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:12.456089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:12.456758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lazy-loading 'fault' on Instance uuid 25ef2ab0-45a5-45df-84d9-6ad638279015 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:59:12.539480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5412dce0e2c545ff86ca4ed2e9d20027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c18121794c11bfaadef8264a4a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:12.547983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9cb3ad2f-e31f-4eb7-9719-7f8c86d65ce0 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 200 len: 1388 microversion: 2.1 time: 0.237883 Jul 20 04:59:12.549067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4608/5733] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:12 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 1388 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:12.904305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:12.905183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:12.913040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:12.913558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:12.914419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:12.914867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:12.957570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:12.958300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:12.958943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lazy-loading 'fault' on Instance uuid 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 04:59:13.044381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:13.053945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c595df08-34a4-45af-912d-bbb176380336 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 200 len: 1161 microversion: 2.1 time: 0.153157 Jul 20 04:59:13.064906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4609/5734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:12 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 1161 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:13.565687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:13.566361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:13.572768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:13.573242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:13.574028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:13.574515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:13.589431 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] HTTP exception thrown: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Request method failure captured: Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 HTTP/1.1 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14pE8U7YsZczIsg-jJWLAtAuyUyxq8tlnsY0XCudJm2qXc2He7Q8nkz282YJLtOudjNTauEGGtWneBZuu8U0BqpcXaKvkxnQpQtKhUBVYNWqHhLdPtei1lGhv1oDLp_xzivHd95QBSmql1FzskJKnY3Vt0dwer5d96gznNpbQS9_9l8 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c465c18121794c11bfaadef8264a4a61 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c465c18121794c11bfaadef8264a4a61", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c465c18121794c11bfaadef8264a4a61 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestServerBasicOps-1474482800-project Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5412dce0e2c545ff86ca4ed2e9d20027 Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestServerBasicOps-1474482800-project Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '25ef2ab0-45a5-45df-84d9-6ad638279015'} Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:13.591133 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Returning 404 to user: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72cdb1d3-9c26-4a89-9d12-5456da9c8db3 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 404 len: 111 microversion: 2.1 time: 0.031008 Jul 20 04:59:13.596122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4610/5735] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:13 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:14.064147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:14.064724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:14.072955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:14.073550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:14.074390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:14.074850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:14.090247 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] HTTP exception thrown: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Request method failure captured: Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 HTTP/1.1 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14pE8U7YsZczIsg-jJWLAtAuyUyxq8tlnsY0XCudJm2qXc2He7Q8nkz282YJLtOudjNTauEGGtWneBZuu8U0BqpcXaKvkxnQpQtKhUBVYNWqHhLdPtei1lGhv1oDLp_xzivHd95QBSmql1FzskJKnY3Vt0dwer5d96gznNpbQS9_9l8 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c465c18121794c11bfaadef8264a4a61 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c465c18121794c11bfaadef8264a4a61", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c465c18121794c11bfaadef8264a4a61 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestServerBasicOps-1474482800-project Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5412dce0e2c545ff86ca4ed2e9d20027 Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestServerBasicOps-1474482800-project Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '25ef2ab0-45a5-45df-84d9-6ad638279015'} Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:14.091861 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Returning 404 to user: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab4d0164-4981-4a94-9fda-70d5d61e90e4 tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "DELETE /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 404 len: 111 microversion: 2.1 time: 0.033410 Jul 20 04:59:14.096815 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4611/5736] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:14 2022] DELETE /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:59:14.099175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:14.099811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:14.106448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:14.106920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:14.107721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:14.108178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:14.127683 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 HTTP/1.1 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9fbd82c0-80ba-4e7e-b979-d3fd95cf9685'} Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:14.129496 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4109c076-2798-4e07-85b1-42c9782432b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 404 len: 111 microversion: 2.1 time: 0.036145 Jul 20 04:59:14.136345 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4612/5737] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:14 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:14.140491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:14.141128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] [instance: 25ef2ab0-45a5-45df-84d9-6ad638279015] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:14.147766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:14.148240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:14.149237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:14.149823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:14.166000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] HTTP exception thrown: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Request method failure captured: Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 HTTP/1.1 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14pE8U7YsZczIsg-jJWLAtAuyUyxq8tlnsY0XCudJm2qXc2He7Q8nkz282YJLtOudjNTauEGGtWneBZuu8U0BqpcXaKvkxnQpQtKhUBVYNWqHhLdPtei1lGhv1oDLp_xzivHd95QBSmql1FzskJKnY3Vt0dwer5d96gznNpbQS9_9l8 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: c465c18121794c11bfaadef8264a4a61 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c465c18121794c11bfaadef8264a4a61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c465c18121794c11bfaadef8264a4a61", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: c465c18121794c11bfaadef8264a4a61 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestServerBasicOps-1474482800 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestServerBasicOps-1474482800-project Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 5412dce0e2c545ff86ca4ed2e9d20027 Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestServerBasicOps-1474482800-project Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '25ef2ab0-45a5-45df-84d9-6ad638279015'} Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:14.167972 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Returning 404 to user: Instance 25ef2ab0-45a5-45df-84d9-6ad638279015 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca37fb8b-02f3-42af-8bf9-db5781332cae tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015" status: 404 len: 111 microversion: 2.1 time: 0.032928 Jul 20 04:59:14.174439 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4613/5738] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:14 2022] GET /compute/v2.1/servers/25ef2ab0-45a5-45df-84d9-6ad638279015 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:14.389473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-820a58c4-5518-48fd-b7d8-f66a9e1b49ed tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] Calling method '.version_select at 0x7f839ce609d0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:14.419769 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-820a58c4-5518-48fd-b7d8-f66a9e1b49ed tempest-TestServerBasicOps-1474482800 tempest-TestServerBasicOps-1474482800-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2125629057" status: 202 len: 0 microversion: 2.1 time: 0.034091 Jul 20 04:59:14.420684 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4614/5739] 10.222.0.49 () {58 vars in 1253 bytes} [Wed Jul 20 04:59:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2125629057 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 04:59:17.361367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:17.362564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:17.373168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:17.373921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:17.374877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:17.375647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:17.393938 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 HTTP/1.1 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de30777f-079d-4c5f-a367-27201074c048'} Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:17.395708 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f57c8dc-7e7f-4dad-ba58-0def8141f772 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 404 len: 111 microversion: 2.1 time: 0.041217 Jul 20 04:59:17.401354 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4615/5740] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:17 2022] DELETE /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:59:17.406190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:17.406907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: de30777f-079d-4c5f-a367-27201074c048] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:17.415153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:17.415643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:17.416492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:17.416953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:17.432736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 HTTP/1.1 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'de30777f-079d-4c5f-a367-27201074c048'} Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:17.434246 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance de30777f-079d-4c5f-a367-27201074c048 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59944c59-1b90-44e6-b63a-a0ca78585579 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048" status: 404 len: 111 microversion: 2.1 time: 0.033913 Jul 20 04:59:17.439000 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4616/5741] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:17 2022] GET /compute/v2.1/servers/de30777f-079d-4c5f-a367-27201074c048 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:18.367907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:18.368638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:18.409474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.414101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.418709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.424189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.488558 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 HTTP/1.1 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9fbd82c0-80ba-4e7e-b979-d3fd95cf9685'} Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:18.494793 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.500242 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.506859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:18.508017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3e22c869-c218-4c74-8284-593970979a2a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 404 len: 111 microversion: 2.1 time: 0.145251 Jul 20 04:59:18.510569 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4617/5742] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 04:59:18 2022] DELETE /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 04:59:18.518425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:18.519301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:18.526233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.527198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.529167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:18.531123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:18.550497 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 HTTP/1.1 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '9fbd82c0-80ba-4e7e-b979-d3fd95cf9685'} Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 04:59:18.554739 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ceb52058-21ba-4f3a-9049-7f415b4b354d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685" status: 404 len: 111 microversion: 2.1 time: 0.044402 Jul 20 04:59:18.559342 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4618/5743] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:18 2022] GET /compute/v2.1/servers/9fbd82c0-80ba-4e7e-b979-d3fd95cf9685 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 04:59:18.702744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74fcd630-ce6b-4da4-b44f-ac65736881c5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: .version_select at 0x7f839cef8dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1340508644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo6rcxjbPuU2JGJinlMtNGVucn5O7wLjHC06iyFp19vzR0/AXVgorfK1M2ZHYyVQUL7Co2GbOEr2xcN9nVfCDo9hG0cdV+ak0VzillvQACEpTSA21hXiXb3wZFcQVOjww=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:18.756237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-74fcd630-ce6b-4da4-b44f-ac65736881c5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:18.767644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-74fcd630-ce6b-4da4-b44f-ac65736881c5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:18.805405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74fcd630-ce6b-4da4-b44f-ac65736881c5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.107235 Jul 20 04:59:18.819800 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4619/5744] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:59:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:23.642173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:23.643140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:23.651704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:23.652703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:23.653691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:23.654303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:23.722827 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a1e27ad-89a0-4a43-a190-5b4c9808612d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d/action" status: 200 len: 24572 microversion: 2.1 time: 0.085006 Jul 20 04:59:23.723595 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4620/5745] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 04:59:23 2022] POST /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d/action => generated 24572 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 04:59:36.809585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-099b5d3a-0410-49a9-836f-e520443d1b6f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Action: 'create', calling method: .version_select at 0x7f838bbd69d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1108802924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKM6Nm3BTVd8EkRoq82dGhvxA+W3gn/vbFTRtWh7dlFs0Lk5rBwnKZmcIi80RNfm8VSu/ef1/IgjQEBLK+yh9pnBzuPN3dxk+ClI1JLeZECvaoX2PC5ttOuECDeenvMR/w=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:36.814304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:36.815073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:36.815870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:36.834076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-099b5d3a-0410-49a9-836f-e520443d1b6f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Getting quotas for project 0225b17a2a144158972ce65a90a721ac. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:36.842936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-099b5d3a-0410-49a9-836f-e520443d1b6f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Getting quotas for user f03f0844a21645ed95ab6bdf623b98d8 and project 0225b17a2a144158972ce65a90a721ac. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:36.870523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-099b5d3a-0410-49a9-836f-e520443d1b6f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065176 Jul 20 04:59:36.871136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4621/5746] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:59:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:38.071512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1439471155", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6cbd8a87-9c09-459a-b40b-23c8dd0b364a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1108802924", "security_groups": [{"name": "tempest-secgroup-smoke-2095216365"}], "networks": [{"uuid": "d241e705-0210-4499-b76d-4a5688a759ca"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:38.225728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] validate_networks() for [('d241e705-0210-4499-b76d-4a5688a759ca', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:59:38.738168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:38.738908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:38.739642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:38.740201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:38.740784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:38.752507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.753057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.754022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:38.755125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:38.773227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Getting quotas for project 0225b17a2a144158972ce65a90a721ac. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:38.779957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Getting quotas for user f03f0844a21645ed95ab6bdf623b98d8 and project 0225b17a2a144158972ce65a90a721ac. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:38.850957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:59:38.853829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cbd8a87-9c09-459a-b40b-23c8dd0b364a',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:59:38.997320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c197debf-3a56-444f-aff8-28842acfc885 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.935617 Jul 20 04:59:39.003304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4622/5747] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:59:39.009884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ef089e4-bde8-4655-ba35-7343b9b06447 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:39.013283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ef089e4-bde8-4655-ba35-7343b9b06447 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:39.085735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ef089e4-bde8-4655-ba35-7343b9b06447 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:39.096292 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ef089e4-bde8-4655-ba35-7343b9b06447 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1099 microversion: 2.1 time: 0.090844 Jul 20 04:59:39.097304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4623/5748] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:39 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1099 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:39.449244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c77cf2d-31b1-4858-9bfd-f59c86c8649a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'create', calling method: .version_select at 0x7f838bebe790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-669127852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI3gaR8Ptj17faujvMrJO7Nn9W963WiVvYgdaQXVBuI6DD25rULOXldQVoGZ8t+ihp7fanmH1/Ia+7OrJ012UpbSypUGh3+90ml5VRV4X8Q0MpYivRWg++xz4Y6oEU+ag=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:39.465915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7c77cf2d-31b1-4858-9bfd-f59c86c8649a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:39.471048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-7c77cf2d-31b1-4858-9bfd-f59c86c8649a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for user d82a6e42f25e4d1db8c37bdf66c8d3c4 and project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:39.497093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c77cf2d-31b1-4858-9bfd-f59c86c8649a tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052459 Jul 20 04:59:39.497716 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4624/5749] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 04:59:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:40.115091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:40.115874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:40.127447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.128591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.137772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:40.138660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:40.287542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:40.303326 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f42ba430-8e95-40e7-aa16-3b2af419b1aa tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1205 microversion: 2.1 time: 0.193608 Jul 20 04:59:40.304129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4625/5750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:40 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1205 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:40.632103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1016409415", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340508644", "security_groups": [{"name": "tempest-secgroup-smoke-74141323"}], "block_device_mapping_v2": [{"uuid": "1935e437-bb80-40fe-a78f-b581600ee100", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:40.855346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:59:41.557238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:41.559013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:41.559720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:41.561515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:41.562266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:41.576187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.576684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.577880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:41.578713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:41.608152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:41.614024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:41.719835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:59:41.723034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1935e437-bb80-40fe-a78f-b581600ee100',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:59:42.055932 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e98ba5d6-be2b-48f3-9fbf-a2c7242b6a5a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.431465 Jul 20 04:59:42.058974 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4626/5751] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 04:59:42.070151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-952271147", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "84134ebe-6256-402b-a88f-09c1150b50e8"}], "key_name": "tempest-TestNetworkBasicOps-669127852", "security_groups": [{"name": "tempest-secgroup-smoke-1361412448"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:42.308368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] validate_networks() for [('84134ebe-6256-402b-a88f-09c1150b50e8', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 04:59:43.136130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 04:59:43.137168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 04:59:43.137168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 04:59:43.137527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 04:59:43.137968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 04:59:43.148729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.149781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.150629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.151113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.178833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 04:59:43.185710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for user d82a6e42f25e4d1db8c37bdf66c8d3c4 and project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 04:59:43.201053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 04:59:43.203299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 04:59:43.263995 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81931fe9-510e-4a92-ad37-f762c92072cd tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.203221 Jul 20 04:59:43.264713 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4627/5752] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 04:59:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 04:59:43.270122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.271104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:43.279486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.280397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.281499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.281657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.559272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:43.569690 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8638948-3cee-4803-b8eb-a0557571f35b tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1283 microversion: 2.1 time: 0.303874 Jul 20 04:59:43.574090 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4628/5753] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:43 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1283 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:43.589042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.595315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:43.602570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.602956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.604139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.604978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.819450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:43.839857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ed8408b-81c8-4221-a5df-42f97f240d54 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1211 microversion: 2.1 time: 0.255296 Jul 20 04:59:43.840507 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4629/5754] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:43 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:43.862381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ebc112fe-d1d1-47de-b527-c0200ec3d67b req-7799414d-ed71-44ea-a80e-30a6be99c30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:43.881874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ebc112fe-d1d1-47de-b527-c0200ec3d67b req-7799414d-ed71-44ea-a80e-30a6be99c30c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:43.882330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ebc112fe-d1d1-47de-b527-c0200ec3d67b req-7799414d-ed71-44ea-a80e-30a6be99c30c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:43.896436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ebc112fe-d1d1-47de-b527-c0200ec3d67b req-7799414d-ed71-44ea-a80e-30a6be99c30c service nova] Creating event network-changed:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 04:59:43.902279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ebc112fe-d1d1-47de-b527-c0200ec3d67b req-7799414d-ed71-44ea-a80e-30a6be99c30c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052222 Jul 20 04:59:43.906505 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4630/5755] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:43.912759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9cf97a59-07a1-4213-8a32-37c481ed9e0f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:43.914061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9cf97a59-07a1-4213-8a32-37c481ed9e0f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:44.048923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cf97a59-07a1-4213-8a32-37c481ed9e0f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:44.059246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9cf97a59-07a1-4213-8a32-37c481ed9e0f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1247 microversion: 2.1 time: 0.151240 Jul 20 04:59:44.061828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4631/5756] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:43 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1247 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:44.591897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:44.593263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:44.604798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:44.612071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:44.612972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:44.613428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.042306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:45.051925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2da3888d-51ae-4d42-ae15-306afa85688d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1283 microversion: 2.1 time: 0.465030 Jul 20 04:59:45.055893 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4632/5757] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:44 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1283 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:45.065708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:45.069633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:45.089016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.089916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.090599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.091668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.598842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:45.621456 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a5842285-91f0-4e8d-97b5-08d253615036 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1277 microversion: 2.1 time: 0.563838 Jul 20 04:59:45.623776 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4633/5758] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:45 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1277 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:45.630120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:45.631046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:45.636117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:45.645955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.646425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.647295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:45.647936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:45.724452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:45.734973 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8eacf262-a7c7-44b0-854b-449011873358 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1305 microversion: 2.1 time: 0.109789 Jul 20 04:59:45.735590 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4634/5759] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:45 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:46.037188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c236bb86-482d-4d93-8abb-19d20dd3f6be req-fa8f76ac-b11f-4224-9df5-6bf3874def91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b6dbd0-07b8-471e-8a2d-e12765a388a6", "tag": "07ac7840-b601-4412-acf3-424195ca57b2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:46.062981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c236bb86-482d-4d93-8abb-19d20dd3f6be req-fa8f76ac-b11f-4224-9df5-6bf3874def91 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.063454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c236bb86-482d-4d93-8abb-19d20dd3f6be req-fa8f76ac-b11f-4224-9df5-6bf3874def91 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.081149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c236bb86-482d-4d93-8abb-19d20dd3f6be req-fa8f76ac-b11f-4224-9df5-6bf3874def91 service nova] Creating event network-changed:07ac7840-b601-4412-acf3-424195ca57b2 for instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 on n-h2-764486-11 Jul 20 04:59:46.089582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c236bb86-482d-4d93-8abb-19d20dd3f6be req-fa8f76ac-b11f-4224-9df5-6bf3874def91 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057107 Jul 20 04:59:46.090520 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4635/5760] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:46.097290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:46.098213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:46.106070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.106532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.107339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.107979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.276673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:46.285637 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2da9070d-4f1d-4088-91a4-2770954e6c14 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1283 microversion: 2.1 time: 0.193472 Jul 20 04:59:46.295621 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4636/5761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:46 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1283 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:46.641413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:46.643320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:46.653915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.654667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.655723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.656277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.827558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:46.835555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1fbd0a9a-6af2-4996-89ae-96ddfb8732ac tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1277 microversion: 2.1 time: 0.199680 Jul 20 04:59:46.836309 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4637/5762] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:46 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:46.848269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:46.848958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:46.856024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.856526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:46.857502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:46.857966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.018440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:47.029017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea3be6a9-7798-4eb4-ab40-89d1a6eb34f4 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1373 microversion: 2.1 time: 0.184613 Jul 20 04:59:47.031222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4638/5763] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:46 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:47.304268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:47.305626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:47.317830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.318385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.319296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.319760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.505374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:47.516496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-611aaa98-33ba-45f1-8f66-1c138f3af78c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.217416 Jul 20 04:59:47.518253 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4639/5764] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:47 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:47.853602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:47.854333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:47.862688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.863442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:47.864514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:47.865846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.030790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:48.041229 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bff654d-20d6-4107-8837-66b3be8506fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1277 microversion: 2.1 time: 0.192292 Jul 20 04:59:48.041932 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4640/5765] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:47 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:48.047093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:48.048011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:48.056448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.057178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.058170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.058795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.209484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:48.218103 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d716382e-df8b-464c-8270-1f5b75a07bb2 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1373 microversion: 2.1 time: 0.174937 Jul 20 04:59:48.222014 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4641/5766] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:48 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 04:59:48.223108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c7ad66e7-cdce-4bb1-a38f-ca188aad4ffc req-57456659-3a00-433a-9e51-b19c1e06e270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db88417-735f-4c76-850c-1c3029ea5376", "tag": "65c441a0-53ec-402d-b57b-1f8612a35956"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:48.231728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c7ad66e7-cdce-4bb1-a38f-ca188aad4ffc req-57456659-3a00-433a-9e51-b19c1e06e270 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.232187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c7ad66e7-cdce-4bb1-a38f-ca188aad4ffc req-57456659-3a00-433a-9e51-b19c1e06e270 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.245444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c7ad66e7-cdce-4bb1-a38f-ca188aad4ffc req-57456659-3a00-433a-9e51-b19c1e06e270 service nova] Creating event network-changed:65c441a0-53ec-402d-b57b-1f8612a35956 for instance 2db88417-735f-4c76-850c-1c3029ea5376 on n-h1-764486-11 Jul 20 04:59:48.250457 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c7ad66e7-cdce-4bb1-a38f-ca188aad4ffc req-57456659-3a00-433a-9e51-b19c1e06e270 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030611 Jul 20 04:59:48.251382 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4642/5767] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 04:59:48.535612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:48.536449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:48.542931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.543400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.544170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:48.544652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:48.677796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:48.686213 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22296cda-c1cd-41bb-9e8d-617cf8b66662 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.154961 Jul 20 04:59:48.687046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4643/5768] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:48 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:49.059463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:49.060343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:49.067390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.067865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.068679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.069142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.217889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:49.226125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0cfc152-4363-4f10-94ae-f4bf85942e90 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1277 microversion: 2.1 time: 0.171149 Jul 20 04:59:49.227028 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4644/5769] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:49 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:49.241516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:49.242172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:49.252765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.253243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.254067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.254631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.277248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:49.413091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:49.422487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce183e3d-6dc1-406e-8aec-f7b69a04d5f9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1373 microversion: 2.1 time: 0.184707 Jul 20 04:59:49.424461 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4645/5770] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:49 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:49.703547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:49.704187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:49.711509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.712602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.713421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:49.713878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:49.878907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:49.888096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8bcd102f-f90b-4078-ba09-07f7ef4062f4 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.188503 Jul 20 04:59:49.888765 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4646/5771] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:49 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:50.244295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:50.245043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:50.252437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.253120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.253919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.254444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.399465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:50.408265 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9959fabf-3564-4f61-8a98-6e7ed63a61c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1277 microversion: 2.1 time: 0.168473 Jul 20 04:59:50.409094 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4647/5772] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:50 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:50.439329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:50.439964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:50.446086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.446678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.447468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.447921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.586891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:50.595007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1268d366-2ffd-48ec-b59d-bdff1a87e20c tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1373 microversion: 2.1 time: 0.159630 Jul 20 04:59:50.595521 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4648/5773] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:50 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:50.906065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:50.906619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:50.912811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.913383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:50.914090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:50.914560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.051777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:51.059306 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-737c4c52-5573-4c43-942c-76700539ca83 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.157567 Jul 20 04:59:51.059879 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4649/5774] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:50 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:51.425303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:51.425994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:51.432870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.433331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.434117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.434559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.565181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:51.573379 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70b519ee-fc14-4d40-895f-b3051b272d81 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.151314 Jul 20 04:59:51.573951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4650/5775] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:51 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:51.612055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:51.612705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:51.618662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.619122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.620411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:51.620858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:51.749919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:51.757102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca48bdaf-9682-469d-8a24-3c65c863364b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1373 microversion: 2.1 time: 0.148768 Jul 20 04:59:51.757693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4651/5776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:51 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1373 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:52.006789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e13911ee-b5bc-44fb-8cdb-b591cd7e897f req-8af6dcc0-aa76-471c-8715-ce8a7d0b4a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db88417-735f-4c76-850c-1c3029ea5376", "name": "network-vif-plugged", "status": "completed", "tag": "65c441a0-53ec-402d-b57b-1f8612a35956"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:52.015530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e13911ee-b5bc-44fb-8cdb-b591cd7e897f req-8af6dcc0-aa76-471c-8715-ce8a7d0b4a56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.016011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e13911ee-b5bc-44fb-8cdb-b591cd7e897f req-8af6dcc0-aa76-471c-8715-ce8a7d0b4a56 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.028043 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e13911ee-b5bc-44fb-8cdb-b591cd7e897f req-8af6dcc0-aa76-471c-8715-ce8a7d0b4a56 service nova] Creating event network-vif-plugged:65c441a0-53ec-402d-b57b-1f8612a35956 for instance 2db88417-735f-4c76-850c-1c3029ea5376 on n-h1-764486-11 Jul 20 04:59:52.033331 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e13911ee-b5bc-44fb-8cdb-b591cd7e897f req-8af6dcc0-aa76-471c-8715-ce8a7d0b4a56 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030338 Jul 20 04:59:52.033932 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4652/5777] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:52.076597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:52.077333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:52.083874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.084345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.085165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.085647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.224541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:52.232562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83490805-125c-478d-9590-e46f34e130c6 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.160469 Jul 20 04:59:52.233142 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4653/5778] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:52 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:52.591449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:52.591991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:52.598586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.599052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.599828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.600276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.735032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:52.743080 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-285368c1-4a30-43b7-9a16-66b251960297 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.156509 Jul 20 04:59:52.743819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4654/5779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:52 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:52.774698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:52.775319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:52.782378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.782845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.783689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:52.784143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:52.917129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:52.924833 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec539a79-6661-43d7-9ce0-a8e89700c297 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1373 microversion: 2.1 time: 0.153999 Jul 20 04:59:52.925414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4655/5780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:52 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:53.249536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:53.250174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:53.252173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:53.257778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.258249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.259035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.259493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.393516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:53.401123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-36cc7adf-fa75-437a-bee8-d1739f21abcf tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.155600 Jul 20 04:59:53.401708 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4656/5781] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:53 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:53.760520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:53.761149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:53.768103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.768609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.769381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.769829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.920737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:53.928693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4c7a18b-132d-4220-8853-15863351a6a3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.172449 Jul 20 04:59:53.929270 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4657/5782] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:53 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:53.942017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:53.942655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:53.948697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.949167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:53.949954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:53.950437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.053545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=30 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:54.088310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:54.096553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-206c258a-0003-4bc5-96d9-9d04767ebcb9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1546 microversion: 2.1 time: 0.158847 Jul 20 04:59:54.097160 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4658/5783] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:53 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:54.113301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:54.114085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:54.121129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.121590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.122539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.122817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.254926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:54.263122 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08509844-a479-4ad6-99f4-4a8f472cfa89 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1546 microversion: 2.1 time: 0.153605 Jul 20 04:59:54.263750 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4659/5784] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:54 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:54.418541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:54.419215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:54.426714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.427234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.429600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.429600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.731592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:54.739695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de1cdc23-b8df-41e4-8240-47c6941ac71d tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.325194 Jul 20 04:59:54.740284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4660/5785] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:54 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:54.945917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:54.946568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:54.953506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.953973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:54.954751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:54.955203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.084757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:55.092246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-db05acfb-2ab0-40cf-959b-ec283a2b828b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.150390 Jul 20 04:59:55.092847 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4661/5786] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:54 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:55.757539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:55.758256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:55.765013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:55.765556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.766410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:55.766930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:55.906800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:55.910781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 04:59:55.915544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-adc53dba-20ba-4fdb-a41e-35015a68b60f tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.161917 Jul 20 04:59:55.916384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4662/5787] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:55 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:56.015499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-594e560c-f7ce-4cb3-a897-cd8741173b3d req-7f59f642-d415-499b-b8e8-62f9d5dabf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "name": "network-vif-plugged", "status": "completed", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 04:59:56.026911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-594e560c-f7ce-4cb3-a897-cd8741173b3d req-7f59f642-d415-499b-b8e8-62f9d5dabf4d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.027228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-594e560c-f7ce-4cb3-a897-cd8741173b3d req-7f59f642-d415-499b-b8e8-62f9d5dabf4d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.039854 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-594e560c-f7ce-4cb3-a897-cd8741173b3d req-7f59f642-d415-499b-b8e8-62f9d5dabf4d service nova] Creating event network-vif-plugged:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 04:59:56.045254 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-594e560c-f7ce-4cb3-a897-cd8741173b3d req-7f59f642-d415-499b-b8e8-62f9d5dabf4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034306 Jul 20 04:59:56.046202 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4663/5788] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 04:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 04:59:56.110196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:56.110909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:56.117207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.117794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.118673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.119125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.254364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:56.262952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81c9d137-bfb1-4ec5-bea7-89e24a1b6bb8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.157656 Jul 20 04:59:56.263539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4664/5789] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:56 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:56.933749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:56.934374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:56.940488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.940949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:56.941729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:56.942184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:57.081436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:57.089548 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3092aded-2d95-470e-af4a-11a6fa4c2f05 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1271 microversion: 2.1 time: 0.160210 Jul 20 04:59:57.090165 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4665/5790] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:56 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:57.279760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:57.280599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:57.288456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:57.288924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:57.289714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:57.290163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:57.460765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:57.468679 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-beef24e7-c5d1-4e52-a97d-01358382f36d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.192774 Jul 20 04:59:57.469498 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4666/5791] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:57 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:58.106972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:58.107770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:58.114786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.115239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.116034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.116512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.249185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:58.256946 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-257ecd31-3296-49a1-a395-4717da4ddfd5 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1460 microversion: 2.1 time: 0.153995 Jul 20 04:59:58.257753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4667/5792] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:58 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:58.272970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:58.273593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:58.279477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.279941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.280997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.281443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.423567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:58.435320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b3cc2222-8042-4d88-aefa-e19c01866a34 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1460 microversion: 2.1 time: 0.165884 Jul 20 04:59:58.435924 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4668/5793] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:58 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1460 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:58.486639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:58.487397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:58.493624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.494279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.496677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:58.497243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:58.678323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:58.688256 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d1e4230-adb8-4998-9725-ce73bbe87c00 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.206211 Jul 20 04:59:58.698355 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4669/5794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:58 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 04:59:59.706411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 04:59:59.707776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 04:59:59.716161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:59.716977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:59.717950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 04:59:59.718568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 04:59:59.903429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 04:59:59.912462 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7057c276-35d5-4d79-8660-af94d59cfaef tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.209986 Jul 20 04:59:59.913070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4670/5795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 04:59:59 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:00.830729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-65e8aa24-b95c-460e-8ce2-9b4c2d34e565 req-7f7739cc-7404-4a48-925d-ff2a467b40a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:00.841273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65e8aa24-b95c-460e-8ce2-9b4c2d34e565 req-7f7739cc-7404-4a48-925d-ff2a467b40a7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:00.842098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65e8aa24-b95c-460e-8ce2-9b4c2d34e565 req-7f7739cc-7404-4a48-925d-ff2a467b40a7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:00.854773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-65e8aa24-b95c-460e-8ce2-9b4c2d34e565 req-7f7739cc-7404-4a48-925d-ff2a467b40a7 service nova] Creating event network-changed:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 05:00:00.860794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-65e8aa24-b95c-460e-8ce2-9b4c2d34e565 req-7f7739cc-7404-4a48-925d-ff2a467b40a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033871 Jul 20 05:00:00.861642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4671/5796] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:00:00.933306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:00.934219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:00.941260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:00.941961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:00.942855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:00.943403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:01.091072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:01.100342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7dfee3ff-2821-4279-98a0-afcac2a78cf5 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.173883 Jul 20 05:00:01.102004 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4672/5797] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:00 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:01.999124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7c576318-ea43-4098-b085-b19ec26f391b req-abe4ac7f-effb-4f66-962d-6d302dafac83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b6dbd0-07b8-471e-8a2d-e12765a388a6", "name": "network-vif-plugged", "status": "completed", "tag": "07ac7840-b601-4412-acf3-424195ca57b2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:02.008964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c576318-ea43-4098-b085-b19ec26f391b req-abe4ac7f-effb-4f66-962d-6d302dafac83 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:02.009415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c576318-ea43-4098-b085-b19ec26f391b req-abe4ac7f-effb-4f66-962d-6d302dafac83 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:02.021374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7c576318-ea43-4098-b085-b19ec26f391b req-abe4ac7f-effb-4f66-962d-6d302dafac83 service nova] Creating event network-vif-plugged:07ac7840-b601-4412-acf3-424195ca57b2 for instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 on n-h2-764486-11 Jul 20 05:00:02.027011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7c576318-ea43-4098-b085-b19ec26f391b req-abe4ac7f-effb-4f66-962d-6d302dafac83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Jul 20 05:00:02.028558 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4673/5798] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:00:02.119201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:02.119924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:02.127304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:02.128181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:02.129098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:02.129669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:02.279957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:02.289028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49a5fecf-5d87-41e4-806e-727c252bf363 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.174145 Jul 20 05:00:02.289766 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4674/5799] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:02 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:02.875381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-df3c3138-a4b1-42fa-9b54-21b711c0eec4 req-33efc590-0186-4790-97cf-04cf1b503ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}, {"name": "network-changed", "server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:02.886554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-df3c3138-a4b1-42fa-9b54-21b711c0eec4 req-33efc590-0186-4790-97cf-04cf1b503ec1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:02.887954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-df3c3138-a4b1-42fa-9b54-21b711c0eec4 req-33efc590-0186-4790-97cf-04cf1b503ec1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:02.899695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-df3c3138-a4b1-42fa-9b54-21b711c0eec4 req-33efc590-0186-4790-97cf-04cf1b503ec1 service nova] Creating event network-changed:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 05:00:02.900174 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-df3c3138-a4b1-42fa-9b54-21b711c0eec4 req-33efc590-0186-4790-97cf-04cf1b503ec1 service nova] Creating event network-changed:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 05:00:02.905261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-df3c3138-a4b1-42fa-9b54-21b711c0eec4 req-33efc590-0186-4790-97cf-04cf1b503ec1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034028 Jul 20 05:00:02.906154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4675/5800] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:03.308322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:03.309054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:03.315442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:03.316139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:03.316987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:03.317436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:03.464076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:03.472624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-becc0cb1-eb64-4cc0-b01d-b55f127e678d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1265 microversion: 2.1 time: 0.169585 Jul 20 05:00:03.473454 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4676/5801] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:03 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:04.489721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:04.490406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:04.498544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:04.499008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:04.499830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:04.500282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:04.635948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:04.644369 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c24573b-cc8b-4b31-907a-fdf39f39f8b7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1453 microversion: 2.1 time: 0.158630 Jul 20 05:00:04.644971 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4677/5802] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:04 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:04.660871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:04.661496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:04.667452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:04.667914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:04.669442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:04.669442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:04.809539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:04.817734 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59efdfdc-1ca2-4759-a1c6-4791bc047617 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1453 microversion: 2.1 time: 0.160611 Jul 20 05:00:04.818323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4678/5803] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:04 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:06.537048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-37c4d7b9-c8df-4a5e-9a72-db2fdc59c1b7 req-bc1b11c4-426e-4645-9333-4a64ca157605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b6dbd0-07b8-471e-8a2d-e12765a388a6", "tag": "07ac7840-b601-4412-acf3-424195ca57b2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:06.546201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-37c4d7b9-c8df-4a5e-9a72-db2fdc59c1b7 req-bc1b11c4-426e-4645-9333-4a64ca157605 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:06.546654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-37c4d7b9-c8df-4a5e-9a72-db2fdc59c1b7 req-bc1b11c4-426e-4645-9333-4a64ca157605 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:06.558348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-37c4d7b9-c8df-4a5e-9a72-db2fdc59c1b7 req-bc1b11c4-426e-4645-9333-4a64ca157605 service nova] Creating event network-changed:07ac7840-b601-4412-acf3-424195ca57b2 for instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 on n-h2-764486-11 Jul 20 05:00:06.563831 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-37c4d7b9-c8df-4a5e-9a72-db2fdc59c1b7 req-bc1b11c4-426e-4645-9333-4a64ca157605 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030734 Jul 20 05:00:06.564500 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4679/5804] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:00:21.880050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=90 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:21.880967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=82 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:21.886656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:21.887842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:21.896834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.897414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.898351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:21.898858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:21.928939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:00:22.035785 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9b379e8-e4cc-48ab-bc1e-58aa44926798 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 204 len: 0 microversion: 2.1 time: 0.157324 Jul 20 05:00:22.036987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4680/5805] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:21 2022] DELETE /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:00:22.049043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:22.050489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:22.062763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.063766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.065423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:22.066539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:22.255369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:22.264255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-acf356f6-887b-4272-9753-1b026691cfc3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1552 microversion: 2.1 time: 0.220016 Jul 20 05:00:22.264946 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4681/5806] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:22 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:23.285009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:23.285658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:23.295489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.295604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.296642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.297157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.450123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:23.459164 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-878f1061-addb-47c0-9ffe-3415b1c8c7ae tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1552 microversion: 2.1 time: 0.180016 Jul 20 05:00:23.459755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4682/5807] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:23 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:23.972258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b58fb706-447d-411a-8859-5e5a67df2c8a req-c7027151-c993-4ff4-a490-20ba5eb8a347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db88417-735f-4c76-850c-1c3029ea5376", "name": "network-vif-deleted", "tag": "65c441a0-53ec-402d-b57b-1f8612a35956"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:23.981515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b58fb706-447d-411a-8859-5e5a67df2c8a req-c7027151-c993-4ff4-a490-20ba5eb8a347 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:23.982470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b58fb706-447d-411a-8859-5e5a67df2c8a req-c7027151-c993-4ff4-a490-20ba5eb8a347 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:23.994445 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b58fb706-447d-411a-8859-5e5a67df2c8a req-c7027151-c993-4ff4-a490-20ba5eb8a347 service nova] Creating event network-vif-deleted:65c441a0-53ec-402d-b57b-1f8612a35956 for instance 2db88417-735f-4c76-850c-1c3029ea5376 on n-h1-764486-11 Jul 20 05:00:24.000589 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b58fb706-447d-411a-8859-5e5a67df2c8a req-c7027151-c993-4ff4-a490-20ba5eb8a347 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Jul 20 05:00:24.001625 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4683/5808] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:00:24.478860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:24.480336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:24.490149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.490823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.492074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.492678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.535032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:24.535975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:24.537073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lazy-loading 'fault' on Instance uuid 2db88417-735f-4c76-850c-1c3029ea5376 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:00:24.584785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:24.592516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2629cf08-e121-4af2-8c39-01ee503ad880 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 200 len: 1337 microversion: 2.1 time: 0.120104 Jul 20 05:00:24.593135 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4684/5809] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:24 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 1337 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:25.610850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:25.611612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 2db88417-735f-4c76-850c-1c3029ea5376] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:25.620434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:25.620983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:25.621829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:25.622276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:25.637774 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] HTTP exception thrown: Instance 2db88417-735f-4c76-850c-1c3029ea5376 could not be found. Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Request method failure captured: Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 HTTP/1.1 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14tzj3lEnQa2F2-mXPvw1_2kIGCgnBtz2OSRq1LE6TgAw4zmpjSuC4FK1R-5Utv8mJuaN1m6kSa0wlZbQaLIQhLELjrgzkjKcX0E8MudGkuyNP43Pkix4mtGL351VsfxqsNV2p7HIEBVUuM88W-o3ddXGBduWECc4CyM0VfkiLK51Ok Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1f9856b0ebdf47e1849ffae04824c274 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1f9856b0ebdf47e1849ffae04824c274", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1f9856b0ebdf47e1849ffae04824c274 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkBasicOps-1557647048-project Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d82a6e42f25e4d1db8c37bdf66c8d3c4 Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkBasicOps-1557647048-project Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2db88417-735f-4c76-850c-1c3029ea5376 could not be found. Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2db88417-735f-4c76-850c-1c3029ea5376'} Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db88417-735f-4c76-850c-1c3029ea5376 could not be found. Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db88417-735f-4c76-850c-1c3029ea5376 could not be found. Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:25.640111 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db88417-735f-4c76-850c-1c3029ea5376 could not be found. Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Returning 404 to user: Instance 2db88417-735f-4c76-850c-1c3029ea5376 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66256f19-1d59-4304-af1e-99fa114f1c7b tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376" status: 404 len: 111 microversion: 2.1 time: 0.035210 Jul 20 05:00:25.647035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4685/5810] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:25 2022] GET /compute/v2.1/servers/2db88417-735f-4c76-850c-1c3029ea5376 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:00:25.824317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3728244e-362b-4e19-b815-2dbf0870c210 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '.version_select at 0x7f838bace430>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:25.855436 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3728244e-362b-4e19-b815-2dbf0870c210 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-669127852" status: 202 len: 0 microversion: 2.1 time: 0.035429 Jul 20 05:00:25.860484 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4686/5811] 10.222.0.49 () {58 vars in 1253 bytes} [Wed Jul 20 05:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-669127852 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:00:28.049217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:28.049988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:28.062910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:28.063974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.065213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:28.065900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.123023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:00:28.240790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3ece9ec4-c2e1-4c5f-86d0-cdd3c1874d57 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 204 len: 0 microversion: 2.1 time: 0.197834 Jul 20 05:00:28.242031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4687/5812] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:28 2022] DELETE /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:00:28.248337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-77f2ba67-1676-4c42-9f2e-357e25dd013e req-4f250990-f9cd-4382-a69a-e379348f4263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6413de6-b7fd-433f-bb21-9654f9c6653d", "tag": "2e37cf49-f5f5-4abb-a8af-1d8b40dc0712"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:28.258663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-77f2ba67-1676-4c42-9f2e-357e25dd013e req-4f250990-f9cd-4382-a69a-e379348f4263 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:28.259266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-77f2ba67-1676-4c42-9f2e-357e25dd013e req-4f250990-f9cd-4382-a69a-e379348f4263 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.271746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-77f2ba67-1676-4c42-9f2e-357e25dd013e req-4f250990-f9cd-4382-a69a-e379348f4263 service nova] Creating event network-changed:2e37cf49-f5f5-4abb-a8af-1d8b40dc0712 for instance a6413de6-b7fd-433f-bb21-9654f9c6653d on n-h2-764486-11 Jul 20 05:00:28.277243 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-77f2ba67-1676-4c42-9f2e-357e25dd013e req-4f250990-f9cd-4382-a69a-e379348f4263 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033871 Jul 20 05:00:28.277864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4688/5813] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:28.287167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:28.287856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:28.294260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:28.295414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.296212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:28.296728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:28.441736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:28.452972 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-883ff275-4c9c-4d09-9ad1-c7f55477ffb3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1670 microversion: 2.1 time: 0.170183 Jul 20 05:00:28.454006 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4689/5814] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:28 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:29.472296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:29.473121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:29.481728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:29.482243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:29.483659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:29.484174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:29.629975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:29.639301 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f0e3c382-0bde-4a65-af26-187c0269e075 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1670 microversion: 2.1 time: 0.170913 Jul 20 05:00:29.640127 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4690/5815] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:29 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:30.661230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:30.661986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:30.671946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:30.672966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:30.674192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:30.675014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:30.761145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:30.770014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c19a59c2-d78b-477f-b9c4-d4d4bb0ccc74 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 200 len: 1484 microversion: 2.1 time: 0.116778 Jul 20 05:00:30.770630 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4691/5816] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:30 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 1484 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:30.775044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-91b815b4-5d79-45a6-9ac7-e62d3785cb2e req-c469f0cb-9996-4384-835e-d086a7402e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6413de6-b7fd-433f-bb21-9654f9c6653d", "name": "network-vif-deleted", "tag": "2e37cf49-f5f5-4abb-a8af-1d8b40dc0712"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:30.785144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-91b815b4-5d79-45a6-9ac7-e62d3785cb2e req-c469f0cb-9996-4384-835e-d086a7402e63 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:30.785610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-91b815b4-5d79-45a6-9ac7-e62d3785cb2e req-c469f0cb-9996-4384-835e-d086a7402e63 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:30.799904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-91b815b4-5d79-45a6-9ac7-e62d3785cb2e req-c469f0cb-9996-4384-835e-d086a7402e63 service nova] Creating event network-vif-deleted:2e37cf49-f5f5-4abb-a8af-1d8b40dc0712 for instance a6413de6-b7fd-433f-bb21-9654f9c6653d on n-h2-764486-11 Jul 20 05:00:30.804886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-91b815b4-5d79-45a6-9ac7-e62d3785cb2e req-c469f0cb-9996-4384-835e-d086a7402e63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 Jul 20 05:00:30.805736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4692/5817] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:31.797790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:31.798564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: a6413de6-b7fd-433f-bb21-9654f9c6653d] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:31.805428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.805898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.806752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:31.807338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:31.822781 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] HTTP exception thrown: Instance a6413de6-b7fd-433f-bb21-9654f9c6653d could not be found. Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Request method failure captured: Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d HTTP/1.1 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14tzj3lEnQa2F2-mXPvw1_2kIGCgnBtz2OSRq1LE6TgAw4zmpjSuC4FK1R-5Utv8mJuaN1m6kSa0wlZbQaLIQhLELjrgzkjKcX0E8MudGkuyNP43Pkix4mtGL351VsfxqsNV2p7HIEBVUuM88W-o3ddXGBduWECc4CyM0VfkiLK51Ok Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1f9856b0ebdf47e1849ffae04824c274 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1f9856b0ebdf47e1849ffae04824c274", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1f9856b0ebdf47e1849ffae04824c274 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkBasicOps-1557647048-project Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d82a6e42f25e4d1db8c37bdf66c8d3c4 Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkBasicOps-1557647048-project Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance a6413de6-b7fd-433f-bb21-9654f9c6653d could not be found. Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'a6413de6-b7fd-433f-bb21-9654f9c6653d'} Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6413de6-b7fd-433f-bb21-9654f9c6653d could not be found. Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6413de6-b7fd-433f-bb21-9654f9c6653d could not be found. Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:31.824595 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6413de6-b7fd-433f-bb21-9654f9c6653d could not be found. Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Returning 404 to user: Instance a6413de6-b7fd-433f-bb21-9654f9c6653d could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-930e2ab2-49fc-47c6-a9c2-109a6711384f tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d" status: 404 len: 111 microversion: 2.1 time: 0.034590 Jul 20 05:00:31.830034 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4693/5818] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:31 2022] GET /compute/v2.1/servers/a6413de6-b7fd-433f-bb21-9654f9c6653d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:00:32.002532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c42c2787-0631-418f-b03a-5ee4fc142585 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '.version_select at 0x7f838bd38310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:32.026608 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c42c2787-0631-418f-b03a-5ee4fc142585 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1066641058" status: 202 len: 0 microversion: 2.1 time: 0.028135 Jul 20 05:00:32.027230 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4694/5819] 10.222.0.49 () {58 vars in 1256 bytes} [Wed Jul 20 05:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1066641058 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:00:37.834260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:37.835533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:37.842612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:37.843087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:37.843929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:37.844617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:37.874458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:00:37.974172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c5ab141-b598-4861-b778-959da4b61403 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 204 len: 0 microversion: 2.1 time: 0.146944 Jul 20 05:00:37.975343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4695/5820] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:00:37 2022] DELETE /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:00:37.982153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9053cc7b-b806-4802-a5e1-429b0b8d56d7 req-8928bd09-bf1d-4c3d-95a7-fd28fc05112b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:37.993309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9053cc7b-b806-4802-a5e1-429b0b8d56d7 req-8928bd09-bf1d-4c3d-95a7-fd28fc05112b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:37.994670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9053cc7b-b806-4802-a5e1-429b0b8d56d7 req-8928bd09-bf1d-4c3d-95a7-fd28fc05112b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:38.012535 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9053cc7b-b806-4802-a5e1-429b0b8d56d7 req-8928bd09-bf1d-4c3d-95a7-fd28fc05112b service nova] Creating event network-changed:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 05:00:38.018956 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9053cc7b-b806-4802-a5e1-429b0b8d56d7 req-8928bd09-bf1d-4c3d-95a7-fd28fc05112b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041749 Jul 20 05:00:38.019683 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4696/5821] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:38.027806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:38.029469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:38.040946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:38.041566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:38.042395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:38.042854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:38.049298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:38.241184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:38.250562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39ad8fa6-ce60-42b9-be61-8dd3c18dfa0c tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1585 microversion: 2.1 time: 0.229012 Jul 20 05:00:38.251116 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4697/5822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:38 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1585 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:39.271469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:39.273103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:39.280675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:39.281369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:39.282393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:39.283120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:39.499472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:39.508162 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c6bfbfc-95fc-4932-89d5-3a5fb57d9347 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1585 microversion: 2.1 time: 0.241278 Jul 20 05:00:39.510169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4698/5823] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:39 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1585 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:40.414695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-318b78b4-c30f-4316-9376-e29ac4d33f1b req-35d78297-d4db-4c88-8c0b-d176421dff99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cdd678b-2365-48b0-b509-c6751b2caf44", "name": "network-vif-deleted", "tag": "ffed49b9-6f1f-4cea-80ed-88c498d9a880"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:40.436856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-318b78b4-c30f-4316-9376-e29ac4d33f1b req-35d78297-d4db-4c88-8c0b-d176421dff99 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:40.437315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-318b78b4-c30f-4316-9376-e29ac4d33f1b req-35d78297-d4db-4c88-8c0b-d176421dff99 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:40.494464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-318b78b4-c30f-4316-9376-e29ac4d33f1b req-35d78297-d4db-4c88-8c0b-d176421dff99 service nova] Creating event network-vif-deleted:ffed49b9-6f1f-4cea-80ed-88c498d9a880 for instance 1cdd678b-2365-48b0-b509-c6751b2caf44 on n-h1-764486-11 Jul 20 05:00:40.508757 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-318b78b4-c30f-4316-9376-e29ac4d33f1b req-35d78297-d4db-4c88-8c0b-d176421dff99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098769 Jul 20 05:00:40.511180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4699/5824] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:40.530516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:40.531877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:40.551661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:40.552937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:40.554220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:40.554929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:40.751571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:40.760382 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-406a0a69-f042-47d3-87c9-44bd78c5ba63 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1230 microversion: 2.1 time: 0.236784 Jul 20 05:00:40.764603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4700/5825] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:40 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1230 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:41.782406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:41.783469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:41.801356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:41.801899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.802996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:41.803733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:41.894567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:41.906876 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aec43f55-674a-43ba-b5e6-ce740bbb9a74 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1230 microversion: 2.1 time: 0.131172 Jul 20 05:00:41.921244 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4701/5826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:41 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1230 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:42.884609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e720c377-7943-404a-9162-847bb87bed11 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'create', calling method: .version_select at 0x7f838bd20820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1064358184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7RQpBfwdcTf5Xl/jhMsL9vsUcQPv5fuZCtKOM1s9WKbU6pRe5b47pn4mPFSftAfMzDmFC8iOb1/eUCkyO/eR54p3YJpfcPxdJm11mlwrSEoM4w9kxNtFPvWwfqlRL6pQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:42.914656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e720c377-7943-404a-9162-847bb87bed11 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:42.944771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e720c377-7943-404a-9162-847bb87bed11 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for user d82a6e42f25e4d1db8c37bdf66c8d3c4 and project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:43.000538 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e720c377-7943-404a-9162-847bb87bed11 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.120799 Jul 20 05:00:43.001093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4702/5827] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:00:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:00:43.011820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:43.012769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:43.026170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:43.028969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:43.030167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:43.030737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:43.157701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:43.171559 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ff05ddd8-5ac6-4395-b25d-2e9e0a5edfd8 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1230 microversion: 2.1 time: 0.166696 Jul 20 05:00:43.173684 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4703/5828] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:43 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1230 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:44.191666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:44.193203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:44.213552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:44.214015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:44.214835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:44.215359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:44.356266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:44.375762 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b3a9703-aa29-4ee2-a89c-83de2a933a25 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1230 microversion: 2.1 time: 0.188195 Jul 20 05:00:44.378828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4704/5829] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:44 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1230 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:45.056219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1469657911", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0b7d2de8-aadd-4722-b0d0-db96c957cdd5"}], "key_name": "tempest-TestNetworkBasicOps-1064358184", "security_groups": [{"name": "tempest-secgroup-smoke-545225977"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:45.189558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] validate_networks() for [('0b7d2de8-aadd-4722-b0d0-db96c957cdd5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:00:45.623935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:00:45.624836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:00:45.625099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:00:45.625873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:00:45.626613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:00:45.643376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.643872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.644812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.645222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.668401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:00:45.674846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Getting quotas for user d82a6e42f25e4d1db8c37bdf66c8d3c4 and project 1f9856b0ebdf47e1849ffae04824c274. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:00:45.690603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:00:45.693740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:00:45.706652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:45.753257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b6d7baeb-2f5f-4259-884d-f2796df4f795 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.701473 Jul 20 05:00:45.758496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4705/5830] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:00:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:00:45.759338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:45.759975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:45.769854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.770325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.771133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:45.771590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:45.849550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03f0844a21645ed95ab6bdf623b98d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0225b17a2a144158972ce65a90a721ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:45.857945 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-364b75f6-2909-4a82-a086-9bc5c7e09f39 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 200 len: 1230 microversion: 2.1 time: 0.102684 Jul 20 05:00:45.858694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4706/5831] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:45 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:45.864174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3bc0b4f5-2136-46ed-a300-7729953fbaee tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:45.864174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3bc0b4f5-2136-46ed-a300-7729953fbaee tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:45.943911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3bc0b4f5-2136-46ed-a300-7729953fbaee tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:45.954237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3bc0b4f5-2136-46ed-a300-7729953fbaee tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1249 microversion: 2.1 time: 0.094203 Jul 20 05:00:45.964806 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4707/5832] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:45 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:46.875129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:46.875771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] [instance: 1cdd678b-2365-48b0-b509-c6751b2caf44] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:46.883766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.884238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.885071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.885529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.900158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] HTTP exception thrown: Instance 1cdd678b-2365-48b0-b509-c6751b2caf44 could not be found. Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Request method failure captured: Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 HTTP/1.1 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14r3z2vly5H9N3iPcqrX74iIQm78fxyzyF6DFjZ7bFotP41o6rZLGqCds_a1cCli4nuDl-9HgngOpIibINMJgIHYq5irr20nr0f_gPI-jD2MBk3y3AltmbCn9cMy5XzeAeG9xmZJd3KPRBnZACw6E54zGdCn9HWXAoyIEvFL2bZgBWM Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 0225b17a2a144158972ce65a90a721ac Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBackupRestore-810008574 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0225b17a2a144158972ce65a90a721ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225b17a2a144158972ce65a90a721ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225b17a2a144158972ce65a90a721ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0225b17a2a144158972ce65a90a721ac", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBackupRestore-810008574 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 0225b17a2a144158972ce65a90a721ac Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBackupRestore-810008574 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBackupRestore-810008574-project Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f03f0844a21645ed95ab6bdf623b98d8 Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBackupRestore-810008574-project Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1cdd678b-2365-48b0-b509-c6751b2caf44 could not be found. Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1cdd678b-2365-48b0-b509-c6751b2caf44'} Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cdd678b-2365-48b0-b509-c6751b2caf44 could not be found. Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cdd678b-2365-48b0-b509-c6751b2caf44 could not be found. Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:00:46.901874 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cdd678b-2365-48b0-b509-c6751b2caf44 could not be found. Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Returning 404 to user: Instance 1cdd678b-2365-48b0-b509-c6751b2caf44 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47adc50b-3c80-4194-b1d1-1579ee9422c3 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44" status: 404 len: 111 microversion: 2.1 time: 0.032237 Jul 20 05:00:46.908424 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4708/5833] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:46 2022] GET /compute/v2.1/servers/1cdd678b-2365-48b0-b509-c6751b2caf44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:00:46.971907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:46.973164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:46.980084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.980718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:46.981588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:46.982754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:47.120136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:47.128410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da0dd26a-c0f2-4307-9d95-6327d19c0a03 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1309 microversion: 2.1 time: 0.161136 Jul 20 05:00:47.129106 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4709/5834] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:46 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:47.235718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3a1382a3-409b-470e-a54f-92ca7ca54909 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] Calling method '.version_select at 0x7f838af19160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:47.255438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3a1382a3-409b-470e-a54f-92ca7ca54909 tempest-TestVolumeBackupRestore-810008574 tempest-TestVolumeBackupRestore-810008574-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1108802924" status: 202 len: 0 microversion: 2.1 time: 0.023346 Jul 20 05:00:47.256047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4710/5835] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 05:00:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1108802924 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:00:48.147094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:48.147731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:48.159674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.160150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.160979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:48.161434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:48.431824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:48.451526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38792cc0-246b-48ec-b39c-9a3c191e2920 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1374 microversion: 2.1 time: 0.309124 Jul 20 05:00:48.463513 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4711/5836] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:48 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1374 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:49.022960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-98550c4e-4d7c-4b0f-a0a4-f41a7c81dc2c req-890220af-217e-45f7-b9d2-19cda32028bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f397a0-f1a0-4ea0-94fd-06347c1a4bb7", "tag": "07a2024f-5954-4038-8585-e382f312940f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:49.048841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-98550c4e-4d7c-4b0f-a0a4-f41a7c81dc2c req-890220af-217e-45f7-b9d2-19cda32028bd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.049680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-98550c4e-4d7c-4b0f-a0a4-f41a7c81dc2c req-890220af-217e-45f7-b9d2-19cda32028bd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.085201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-98550c4e-4d7c-4b0f-a0a4-f41a7c81dc2c req-890220af-217e-45f7-b9d2-19cda32028bd service nova] Creating event network-changed:07a2024f-5954-4038-8585-e382f312940f for instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 on n-h1-764486-11 Jul 20 05:00:49.093630 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-98550c4e-4d7c-4b0f-a0a4-f41a7c81dc2c req-890220af-217e-45f7-b9d2-19cda32028bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073699 Jul 20 05:00:49.095048 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4712/5837] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:49.473155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:49.474808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:49.492991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.494495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:49.496537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:49.500962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:50.045654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:50.062918 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9d1f413-a855-4c1a-b518-b3c2af8dd9e9 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1374 microversion: 2.1 time: 0.594327 Jul 20 05:00:50.073758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4713/5838] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:49 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1374 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:51.081209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:51.082774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:51.100525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:51.101615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:51.102647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:51.103352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:51.400332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:51.415066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-372ec87a-79e6-4019-a36e-638a45cd7744 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1374 microversion: 2.1 time: 0.338202 Jul 20 05:00:51.415559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4714/5839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:51 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1374 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:52.433001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:52.434370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:52.442060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:52.443126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:52.444291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:52.445100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:52.603848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:52.612503 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3ec91fc-672b-4f96-a279-e9c26cf0bed1 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1374 microversion: 2.1 time: 0.183962 Jul 20 05:00:52.613164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4715/5840] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:52 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:53.630698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:53.631483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:53.639102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:53.639570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:53.641057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:53.641535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:53.858157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:53.867096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d5f018b-b6a2-499b-af74-5460060b1951 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1374 microversion: 2.1 time: 0.240402 Jul 20 05:00:53.867823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4716/5841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:53 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:54.382070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-77f5fb4b-d5b5-4075-86ad-aef5fff3f20e req-f5a7cf65-fbde-4c3b-9792-7041f5ba58fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f397a0-f1a0-4ea0-94fd-06347c1a4bb7", "name": "network-vif-plugged", "status": "completed", "tag": "07a2024f-5954-4038-8585-e382f312940f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:54.411132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-77f5fb4b-d5b5-4075-86ad-aef5fff3f20e req-f5a7cf65-fbde-4c3b-9792-7041f5ba58fa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:54.414354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-77f5fb4b-d5b5-4075-86ad-aef5fff3f20e req-f5a7cf65-fbde-4c3b-9792-7041f5ba58fa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:54.432434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-77f5fb4b-d5b5-4075-86ad-aef5fff3f20e req-f5a7cf65-fbde-4c3b-9792-7041f5ba58fa service nova] Creating event network-vif-plugged:07a2024f-5954-4038-8585-e382f312940f for instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 on n-h1-764486-11 Jul 20 05:00:54.444304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-77f5fb4b-d5b5-4075-86ad-aef5fff3f20e req-f5a7cf65-fbde-4c3b-9792-7041f5ba58fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066915 Jul 20 05:00:54.445328 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4717/5842] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:00:54.886794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:54.888315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:54.906563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:54.907485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:54.908780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:54.910146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:55.112784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:55.127322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-876e7cd3-125d-4dac-a0b8-25b66b891864 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1374 microversion: 2.1 time: 0.242525 Jul 20 05:00:55.128605 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4718/5843] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:54 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:00:56.145097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:56.145760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.147785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:56.149355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:56.155476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.155948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.156782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.157276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.318083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:56.326026 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfbd7329-5ab9-41a2-a956-7845fce991aa tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1547 microversion: 2.1 time: 0.185301 Jul 20 05:00:56.326616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4719/5844] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:56 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:56.345435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:00:56.346184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:00:56.353524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.354086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.355005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:56.355532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:56.361977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:00:56.499900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:00:56.508163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac465a8f-15a7-4960-b2de-c03a63e53428 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1547 microversion: 2.1 time: 0.169045 Jul 20 05:00:56.508854 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4720/5845] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:00:56 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:00:58.354283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d93255bc-a165-49bf-be17-8c1ab615037b req-20bdd338-eb73-4bfa-8bd1-a87d2812a823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f397a0-f1a0-4ea0-94fd-06347c1a4bb7", "tag": "07a2024f-5954-4038-8585-e382f312940f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:00:58.364816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d93255bc-a165-49bf-be17-8c1ab615037b req-20bdd338-eb73-4bfa-8bd1-a87d2812a823 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:00:58.365644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d93255bc-a165-49bf-be17-8c1ab615037b req-20bdd338-eb73-4bfa-8bd1-a87d2812a823 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:00:58.381293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d93255bc-a165-49bf-be17-8c1ab615037b req-20bdd338-eb73-4bfa-8bd1-a87d2812a823 service nova] Creating event network-changed:07a2024f-5954-4038-8585-e382f312940f for instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 on n-h1-764486-11 Jul 20 05:00:58.388629 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d93255bc-a165-49bf-be17-8c1ab615037b req-20bdd338-eb73-4bfa-8bd1-a87d2812a823 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038130 Jul 20 05:00:58.390533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4721/5846] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:01:22.729502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:22.730893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:22.736931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:22.738011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:22.746092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:22.746545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:22.747345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:22.747795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:22.803146 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06d44f04-14cc-4b94-8cf4-7957a03e8f66 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7/action" status: 200 len: 24569 microversion: 2.1 time: 0.075314 Jul 20 05:01:22.804320 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4722/5847] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:01:22 2022] POST /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7/action => generated 24569 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:01:34.204077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:34.205837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:34.208962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:34.209714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:01:34.216661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.217133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.217928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:34.218386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:34.275561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b00f435c-5bde-4501-9bbb-6f32615f7285 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "POST /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7/action" status: 200 len: 32647 microversion: 2.1 time: 0.075657 Jul 20 05:01:34.276235 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4723/5848] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:01:34 2022] POST /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7/action => generated 32647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:01:35.259307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.259950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.267534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.268014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.268803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.269253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.296390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:01:35.379421 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1541af22-4067-488c-94f4-c4072c5db3d3 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "DELETE /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 204 len: 0 microversion: 2.1 time: 0.124094 Jul 20 05:01:35.380338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4724/5849] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:01:35 2022] DELETE /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:01:35.389044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d631e0b2-451a-42a5-89e9-0a16306d51df req-a8fc7cc9-0948-4d3c-8e77-c189da698a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f397a0-f1a0-4ea0-94fd-06347c1a4bb7", "tag": "07a2024f-5954-4038-8585-e382f312940f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:35.397583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d631e0b2-451a-42a5-89e9-0a16306d51df req-a8fc7cc9-0948-4d3c-8e77-c189da698a3d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.398039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d631e0b2-451a-42a5-89e9-0a16306d51df req-a8fc7cc9-0948-4d3c-8e77-c189da698a3d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.410532 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d631e0b2-451a-42a5-89e9-0a16306d51df req-a8fc7cc9-0948-4d3c-8e77-c189da698a3d service nova] Creating event network-changed:07a2024f-5954-4038-8585-e382f312940f for instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 on n-h1-764486-11 Jul 20 05:01:35.415725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d631e0b2-451a-42a5-89e9-0a16306d51df req-a8fc7cc9-0948-4d3c-8e77-c189da698a3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033857 Jul 20 05:01:35.416331 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4725/5850] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:01:35.421357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:35.422061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:35.429176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.429671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.430495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:35.430954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:35.580587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:35.589869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21f2cab3-336f-4ca0-8373-5805099f2491 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1672 microversion: 2.1 time: 0.170929 Jul 20 05:01:35.589869 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4726/5851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:35 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:01:36.608703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:36.609431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:36.617219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.617859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.618698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:36.619153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:36.852427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82a6e42f25e4d1db8c37bdf66c8d3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9856b0ebdf47e1849ffae04824c274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:01:36.868307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bdf83818-0b7e-4c60-a30f-8a600af5fe1e tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 200 len: 1672 microversion: 2.1 time: 0.263520 Jul 20 05:01:36.869540 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4727/5852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:36 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:01:37.348903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ee211c35-11fb-48f8-8683-8680f22177d4 req-54c1d314-caad-4233-a9e0-f577bcf29a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f397a0-f1a0-4ea0-94fd-06347c1a4bb7", "name": "network-vif-deleted", "tag": "07a2024f-5954-4038-8585-e382f312940f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:01:37.357532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ee211c35-11fb-48f8-8683-8680f22177d4 req-54c1d314-caad-4233-a9e0-f577bcf29a90 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.358014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ee211c35-11fb-48f8-8683-8680f22177d4 req-54c1d314-caad-4233-a9e0-f577bcf29a90 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.369544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ee211c35-11fb-48f8-8683-8680f22177d4 req-54c1d314-caad-4233-a9e0-f577bcf29a90 service nova] Creating event network-vif-deleted:07a2024f-5954-4038-8585-e382f312940f for instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 on n-h1-764486-11 Jul 20 05:01:37.374397 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ee211c35-11fb-48f8-8683-8680f22177d4 req-54c1d314-caad-4233-a9e0-f577bcf29a90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184354 Jul 20 05:01:37.375021 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4728/5853] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:01:37.889098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:37.889803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] [instance: 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:01:37.897460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.897937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.898717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:01:37.899188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:01:37.913627 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] HTTP exception thrown: Instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 could not be found. Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Request method failure captured: Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 HTTP/1.1 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14tzj3lEnQa2F2-mXPvw1_2kIGCgnBtz2OSRq1LE6TgAw4zmpjSuC4FK1R-5Utv8mJuaN1m6kSa0wlZbQaLIQhLELjrgzkjKcX0E8MudGkuyNP43Pkix4mtGL351VsfxqsNV2p7HIEBVUuM88W-o3ddXGBduWECc4CyM0VfkiLK51Ok Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 1f9856b0ebdf47e1849ffae04824c274 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1f9856b0ebdf47e1849ffae04824c274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1f9856b0ebdf47e1849ffae04824c274", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 1f9856b0ebdf47e1849ffae04824c274 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkBasicOps-1557647048 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkBasicOps-1557647048-project Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d82a6e42f25e4d1db8c37bdf66c8d3c4 Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkBasicOps-1557647048-project Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 could not be found. Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '15f397a0-f1a0-4ea0-94fd-06347c1a4bb7'} Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 could not be found. Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 could not be found. Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:01:37.915330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 could not be found. Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Returning 404 to user: Instance 15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06e0df72-99b8-4ae1-a9fe-6aaf31c5177d tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7" status: 404 len: 111 microversion: 2.1 time: 0.032663 Jul 20 05:01:37.923380 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4729/5854] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:01:37 2022] GET /compute/v2.1/servers/15f397a0-f1a0-4ea0-94fd-06347c1a4bb7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:01:38.084109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa1fab98-ea1f-4dcf-9060-c23e6169fe40 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] Calling method '.version_select at 0x7f838ba743a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:01:38.109423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa1fab98-ea1f-4dcf-9060-c23e6169fe40 tempest-TestNetworkBasicOps-1557647048 tempest-TestNetworkBasicOps-1557647048-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1064358184" status: 202 len: 0 microversion: 2.1 time: 0.029044 Jul 20 05:01:38.112940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4730/5855] 10.222.0.49 () {58 vars in 1256 bytes} [Wed Jul 20 05:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1064358184 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:02:04.407045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:04.407828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:04.412344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:04.413115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:04.419148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:04.419608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.420407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:04.420875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.448972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:02:04.522680 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dec6b502-2d5b-4137-bb12-2a7fa02886d0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 204 len: 0 microversion: 2.1 time: 0.119206 Jul 20 05:02:04.523557 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4731/5856] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:02:04 2022] DELETE /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:02:04.531698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:04.532441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:04.539515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:04.539987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.540796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:04.541249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:04.674084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:04.682886 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-872bcdf3-e219-4705-b419-5ca3fe4f1dd8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1578 microversion: 2.1 time: 0.155215 Jul 20 05:02:04.683583 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4732/5857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:04 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:05.700922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:05.701711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:05.708823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.709292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.710083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:05.710537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:05.845679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:05.853837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6aa8864-7a0d-4fbc-ba2e-5add9b71e8f3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1578 microversion: 2.1 time: 0.156966 Jul 20 05:02:05.854411 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4733/5858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:05 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:06.871913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:06.872719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:06.879712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:06.880183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:06.881091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:06.881677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:06.948460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:06.956329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33fc6f0e-e2f1-4c37-9e54-b3f3f63d9fb0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1512 microversion: 2.1 time: 0.088985 Jul 20 05:02:06.956988 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4734/5859] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:06 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:07.529007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b0e3fd91-025c-47e7-ae0a-3c6c045a9b4b req-a15d6782-8c52-41ae-ae10-dbf9e40d23cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b6dbd0-07b8-471e-8a2d-e12765a388a6", "name": "network-vif-deleted", "tag": "07ac7840-b601-4412-acf3-424195ca57b2"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:07.538777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b0e3fd91-025c-47e7-ae0a-3c6c045a9b4b req-a15d6782-8c52-41ae-ae10-dbf9e40d23cd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.539314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b0e3fd91-025c-47e7-ae0a-3c6c045a9b4b req-a15d6782-8c52-41ae-ae10-dbf9e40d23cd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:07.554216 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b0e3fd91-025c-47e7-ae0a-3c6c045a9b4b req-a15d6782-8c52-41ae-ae10-dbf9e40d23cd service nova] Creating event network-vif-deleted:07ac7840-b601-4412-acf3-424195ca57b2 for instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 on n-h2-764486-11 Jul 20 05:02:07.559476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b0e3fd91-025c-47e7-ae0a-3c6c045a9b4b req-a15d6782-8c52-41ae-ae10-dbf9e40d23cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034329 Jul 20 05:02:07.560183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4735/5860] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:07.974688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:07.975411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:07.983054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.983595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:07.984413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:07.984866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:08.055568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:08.063541 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-755ab819-a3b6-4166-bba8-f4cebdb56631 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1226 microversion: 2.1 time: 0.093669 Jul 20 05:02:08.064294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4736/5861] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:07 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:09.080887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:09.081592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:09.089250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.089722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.090559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:09.091065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:09.163731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:09.172213 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22cc1858-c866-4a83-b12b-4ff5f9ee76ee tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1226 microversion: 2.1 time: 0.095686 Jul 20 05:02:09.172871 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4737/5862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:09 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:10.188965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:10.189636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:10.196532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:10.197005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:10.197795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:10.198248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:10.268544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:10.277561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8597c1d5-9a05-4d64-8f47-8c52b0395dd6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1226 microversion: 2.1 time: 0.092707 Jul 20 05:02:10.278140 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4738/5863] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:10 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:11.295354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:11.296019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:11.302894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.303359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.304137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:11.304612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:11.366452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:11.374192 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e51e2b3-ff01-4f26-9547-3d849d66f4ff tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 200 len: 1226 microversion: 2.1 time: 0.082801 Jul 20 05:02:11.374777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4739/5864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:11 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:12.390914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:12.391605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:12.399185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:12.399647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:12.400456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:12.400907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:12.414217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 HTTP/1.1 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f2b6dbd0-07b8-471e-8a2d-e12765a388a6'} Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:02:12.416144 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:02:12.421703 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8202a893-8fe1-4e3a-bb6e-4880cb75d407 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 404 len: 111 microversion: 2.1 time: 0.030623 Jul 20 05:02:12.426730 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4740/5865] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:12 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:02:12.514396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1142933531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340508644", "security_groups": [{"name": "tempest-secgroup-smoke-74141323"}], "block_device_mapping_v2": [{"uuid": "1935e437-bb80-40fe-a78f-b581600ee100", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:12.627680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:02:13.100183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:02:13.100662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:02:13.101150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:02:13.101570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:02:13.102018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:02:13.110983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.111437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.112242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:13.112744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:13.129936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:02:13.135151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:02:13.193732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:02:13.195831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1935e437-bb80-40fe-a78f-b581600ee100',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:02:13.326499 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-71af869a-b3a5-47af-a9af-69e1fe05ae0e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.816130 Jul 20 05:02:13.327157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4741/5866] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:02:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:02:13.337224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d3d3127-7df9-43f5-9535-d70700d2d0a9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:13.337850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d3d3127-7df9-43f5-9535-d70700d2d0a9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:13.394626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d3d3127-7df9-43f5-9535-d70700d2d0a9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:13.402868 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d3d3127-7df9-43f5-9535-d70700d2d0a9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1095 microversion: 2.1 time: 0.069369 Jul 20 05:02:13.403456 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4742/5867] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:13 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:14.420828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdfae953-4590-45c1-8500-0a8a52d64a2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:14.421674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdfae953-4590-45c1-8500-0a8a52d64a2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:14.478861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdfae953-4590-45c1-8500-0a8a52d64a2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:14.486115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdfae953-4590-45c1-8500-0a8a52d64a2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1095 microversion: 2.1 time: 0.069206 Jul 20 05:02:14.486692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4743/5868] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:14 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:15.505019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:15.505840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:15.513369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.513913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:15.514775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:15.515291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:15.582050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:15.589968 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-186350ca-ae86-4f22-91a6-1c3ef1d89721 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1211 microversion: 2.1 time: 0.090498 Jul 20 05:02:15.590886 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4744/5869] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:15 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:16.607306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:16.607981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:16.620462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.621066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.621974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.622548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.821963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:16.830998 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72d7cc38-836e-4a57-8973-1fe4aa0f0ab6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1277 microversion: 2.1 time: 0.226895 Jul 20 05:02:16.832157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4745/5870] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:16 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:16.847850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cb83c751-cb13-4a52-936a-0adb7d2ad03c req-3685b950-dfd3-41df-8f81-66ab57d08c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0215dcee-e20b-4c6c-a0c0-d8329d02319c", "tag": "f06f0714-91cd-426d-8d2a-4b8006c8d8ba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:16.857311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cb83c751-cb13-4a52-936a-0adb7d2ad03c req-3685b950-dfd3-41df-8f81-66ab57d08c23 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:16.858235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cb83c751-cb13-4a52-936a-0adb7d2ad03c req-3685b950-dfd3-41df-8f81-66ab57d08c23 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:16.871382 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cb83c751-cb13-4a52-936a-0adb7d2ad03c req-3685b950-dfd3-41df-8f81-66ab57d08c23 service nova] Creating event network-changed:f06f0714-91cd-426d-8d2a-4b8006c8d8ba for instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c on n-h1-764486-11 Jul 20 05:02:16.876983 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cb83c751-cb13-4a52-936a-0adb7d2ad03c req-3685b950-dfd3-41df-8f81-66ab57d08c23 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041850 Jul 20 05:02:16.877790 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4746/5871] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:02:17.850577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:17.851630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:17.858095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.858568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.859462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:17.860195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:17.999074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:18.008033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d0e1bb30-23f0-40ec-bbb8-cce9f65e4b42 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1277 microversion: 2.1 time: 0.163072 Jul 20 05:02:18.008772 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4747/5872] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:17 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:19.025770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:19.026405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:19.034029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:19.034493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:19.035601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:19.036119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:19.169748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:19.177477 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25c21ca9-5659-4262-b009-aae1e741dc1a tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1277 microversion: 2.1 time: 0.155845 Jul 20 05:02:19.178146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4748/5873] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:19 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:20.194953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:20.195654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:20.202166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.202627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.203554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:20.204056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:20.349469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:20.357585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5320cbdc-8d74-4666-9627-e0b719cca170 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1277 microversion: 2.1 time: 0.167511 Jul 20 05:02:20.358171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4749/5874] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:20 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:02:21.374459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:21.375156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:21.382526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.382994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.383774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:21.384223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:21.404688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:21.516852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:21.525034 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c40d76c2-4c48-43ad-bbb0-5724f083ded8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.154632 Jul 20 05:02:21.525612 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4750/5875] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:21 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:22.542135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:22.542757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:22.549693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:22.550158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:22.550927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:22.551371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:22.685255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:22.692898 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28078b82-d528-470e-be25-84ede8cb5f2f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.154837 Jul 20 05:02:22.693479 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4751/5876] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:22 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:23.709846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:23.710521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:23.712440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:23.718633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:23.719098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:23.719879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:23.720330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:24.160410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:24.168784 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05749e01-b6d4-4699-9363-5092db678fa8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.462957 Jul 20 05:02:24.169364 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4752/5877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:23 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:25.185384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:25.186027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:25.187773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:02:25.194547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:25.195000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:25.195772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:25.196222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:25.325032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:25.332613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a0f2507-7eeb-4c49-882b-8064c70dd281 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.151190 Jul 20 05:02:25.333185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4753/5878] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:25 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:26.349415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:26.350110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:26.357024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:26.357490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:26.358265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:26.358717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:26.493009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:26.500746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-034a012d-2273-4dea-a8bb-4d6c512237c6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.155087 Jul 20 05:02:26.501222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4754/5879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:26 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:27.517434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:27.518196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:27.525901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:27.526370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:27.527157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:27.527617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:27.658244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:27.666018 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5797c27e-ea44-46c6-9767-da7c6588759e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.152386 Jul 20 05:02:27.666604 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4755/5880] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:27 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:28.682857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:28.683524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:28.690514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:28.690986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:28.691761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:28.692208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:28.833808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:28.842029 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0004e048-f857-4589-adca-ed95e943c8e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.163066 Jul 20 05:02:28.842828 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4756/5881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:28 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:29.038184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-92af55b8-ba65-4242-b63d-fe47e569c340 req-67f10a33-f52e-4a30-a104-ab16ad5fd235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0215dcee-e20b-4c6c-a0c0-d8329d02319c", "name": "network-vif-plugged", "status": "completed", "tag": "f06f0714-91cd-426d-8d2a-4b8006c8d8ba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:29.046692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-92af55b8-ba65-4242-b63d-fe47e569c340 req-67f10a33-f52e-4a30-a104-ab16ad5fd235 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:29.047152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-92af55b8-ba65-4242-b63d-fe47e569c340 req-67f10a33-f52e-4a30-a104-ab16ad5fd235 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:29.057944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-92af55b8-ba65-4242-b63d-fe47e569c340 req-67f10a33-f52e-4a30-a104-ab16ad5fd235 service nova] Creating event network-vif-plugged:f06f0714-91cd-426d-8d2a-4b8006c8d8ba for instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c on n-h1-764486-11 Jul 20 05:02:29.062786 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-92af55b8-ba65-4242-b63d-fe47e569c340 req-67f10a33-f52e-4a30-a104-ab16ad5fd235 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156620 Jul 20 05:02:29.063393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4757/5882] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:02:29.860551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:29.861296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:29.868094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:29.868586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:29.869369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:29.869819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:30.001807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:30.010123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8af1afbc-f269-4aa6-91ba-4fce95abe221 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1265 microversion: 2.1 time: 0.154858 Jul 20 05:02:30.010701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4758/5883] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:29 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:31.027806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:31.028501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:31.035456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:31.035921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.036789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:31.037240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.170914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:31.178443 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed2192f3-b2af-461a-9766-494ea0af6930 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1453 microversion: 2.1 time: 0.154679 Jul 20 05:02:31.179019 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4759/5884] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:31 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:31.194301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:02:31.194912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:02:31.200681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:31.201142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.201920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:31.202368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:31.331911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:02:31.340135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0060c13b-802b-4756-abbf-3dd0ddcfca59 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1453 microversion: 2.1 time: 0.149905 Jul 20 05:02:31.340802 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4760/5885] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:02:31 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:02:32.912411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9ae5d28f-15fe-46e8-9ab0-6f4f7a5836aa req-6e99c4b0-d638-4980-bfe6-81227e6584d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0215dcee-e20b-4c6c-a0c0-d8329d02319c", "tag": "f06f0714-91cd-426d-8d2a-4b8006c8d8ba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:02:32.921745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ae5d28f-15fe-46e8-9ab0-6f4f7a5836aa req-6e99c4b0-d638-4980-bfe6-81227e6584d7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:02:32.922206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ae5d28f-15fe-46e8-9ab0-6f4f7a5836aa req-6e99c4b0-d638-4980-bfe6-81227e6584d7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:02:32.933782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9ae5d28f-15fe-46e8-9ab0-6f4f7a5836aa req-6e99c4b0-d638-4980-bfe6-81227e6584d7 service nova] Creating event network-changed:f06f0714-91cd-426d-8d2a-4b8006c8d8ba for instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c on n-h1-764486-11 Jul 20 05:02:32.938736 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9ae5d28f-15fe-46e8-9ab0-6f4f7a5836aa req-6e99c4b0-d638-4980-bfe6-81227e6584d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030909 Jul 20 05:02:32.939662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4761/5886] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:04:14.309407 n-d-764486-11 devstack@n-api.service[123724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7d8453db-b494-4f77-8fbb-6fd93e2eea16] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:04:14.310612 n-d-764486-11 devstack@n-api.service[123724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed159f5b-c8c3-4f72-9e8d-10afd691f49f] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 20 05:04:14.311818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:14.312669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=60 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:14.317505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-37736700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340508644", "security_groups": [{"name": "tempest-secgroup-smoke-74141323"}], "block_device_mapping_v2": [{"uuid": "9a82af4e-3481-47cc-aeb6-ddf6fed21afc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e2ca05b-a63b-43f4-af16-38e2572af713"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:14.432667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] validate_networks() for [('4e2ca05b-a63b-43f4-af16-38e2572af713', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:04:14.799510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:04:14.799951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:04:14.800585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:04:14.801014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:04:14.801444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:04:14.810997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:14.811459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:14.812276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:14.812762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:14.830988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:04:14.836300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Getting quotas for user fdc38638958b426f92a6a0090b0b12bd and project 3c4d1a3289fb42a9ada449a7e8701f4b. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:04:14.893960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:04:14.896143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a82af4e-3481-47cc-aeb6-ddf6fed21afc',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:04:15.021227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c407f93f-b4b4-4705-979f-1e3aa87f06fa tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.713758 Jul 20 05:04:15.021878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4762/5887] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:04:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:04:15.031631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59a18ee2-70dd-4049-98c7-05dd56ac12f8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:15.032253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59a18ee2-70dd-4049-98c7-05dd56ac12f8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:15.085803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59a18ee2-70dd-4049-98c7-05dd56ac12f8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:15.093451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59a18ee2-70dd-4049-98c7-05dd56ac12f8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1093 microversion: 2.1 time: 0.065534 Jul 20 05:04:15.094027 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4763/5888] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:15 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:16.111390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:16.112095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:16.132165 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] [7d8453db-b494-4f77-8fbb-6fd93e2eea16] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49156. Jul 20 05:04:16.136316 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed159f5b-c8c3-4f72-9e8d-10afd691f49f] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49158. Jul 20 05:04:16.139914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.140655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:16.141559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:16.142128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:16.212776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:16.221274 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-970a4b32-fd8c-42ac-986e-f97fdb6f1cb3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1209 microversion: 2.1 time: 0.113892 Jul 20 05:04:16.221856 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4764/5889] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:16 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:04:17.238132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:17.238997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:17.246520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.246990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.248718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.249187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.426082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:17.439526 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55368f62-a4f0-4f03-8bf4-eb8ab6b088e1 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1275 microversion: 2.1 time: 0.205381 Jul 20 05:04:17.440519 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4765/5890] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:17 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:17.538992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-19ece948-82aa-4693-b54a-20d5ee363f87 req-f8b2523d-6edd-4006-93d7-7beae147536d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03eb3a1d-8382-4fef-b85a-022e7d9ced05", "tag": "db524cf6-7e4d-476c-8ead-87af5c3d094f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:17.565251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19ece948-82aa-4693-b54a-20d5ee363f87 req-f8b2523d-6edd-4006-93d7-7beae147536d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:17.565867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19ece948-82aa-4693-b54a-20d5ee363f87 req-f8b2523d-6edd-4006-93d7-7beae147536d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:17.579989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-19ece948-82aa-4693-b54a-20d5ee363f87 req-f8b2523d-6edd-4006-93d7-7beae147536d service nova] Creating event network-changed:db524cf6-7e4d-476c-8ead-87af5c3d094f for instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 on n-h2-764486-11 Jul 20 05:04:17.590141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-19ece948-82aa-4693-b54a-20d5ee363f87 req-f8b2523d-6edd-4006-93d7-7beae147536d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055299 Jul 20 05:04:17.591137 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4766/5891] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:04:18.457139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:18.457983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:18.466432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.466908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.467706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:18.468190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:18.614283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:18.623215 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d33ddb37-e7fc-4277-ad91-cdfeefd06663 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1275 microversion: 2.1 time: 0.170449 Jul 20 05:04:18.623833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4767/5892] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:18 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:19.640398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:19.641189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:19.649405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:19.649880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:19.650790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:19.651250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:19.787179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:19.795443 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38739b93-e182-42e0-a147-d67999ed20e2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1275 microversion: 2.1 time: 0.158975 Jul 20 05:04:19.796138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4768/5893] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:19 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:20.813332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:20.813951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:20.821379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.821856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.822662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:20.823118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:20.960906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:20.969131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3ced748-1b41-4d4c-8036-9fad2650e942 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1275 microversion: 2.1 time: 0.159704 Jul 20 05:04:20.969740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4769/5894] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:20 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:21.986121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:21.986802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:21.993698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.994157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:21.994926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:21.995370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:22.135623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:22.143146 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e68b55b3-5fd0-48d2-a1f9-d3c098e9b290 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.161009 Jul 20 05:04:22.143721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4770/5895] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:21 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:23.160967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:23.162047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:23.168705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.169169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.169954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:23.170404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:23.305636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:23.313190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cad772e8-9660-40b2-a0ff-b392e218b68c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.156191 Jul 20 05:04:23.313760 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4771/5896] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:23 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:24.330000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:24.330683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:24.338158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.338621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:24.339395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:24.339841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:24.470321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:24.478618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4136f697-8f8d-4eee-97af-3e1840323d6b tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.152611 Jul 20 05:04:24.479203 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4772/5897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:24 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:25.495685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:25.496286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:25.498492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:25.499195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:25.505864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:25.506322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.507093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:25.507540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:25.643018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:25.650634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bd018b82-8899-4f33-aeee-983991b2391e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.159472 Jul 20 05:04:25.651229 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4773/5898] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:25 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:26.667994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:26.669082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:26.675967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.676438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.677212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:26.677657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:26.823608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:26.832647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19d6a82c-2acf-4246-9dca-057d49dd3e64 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.169074 Jul 20 05:04:26.833219 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4774/5899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:26 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:27.851003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:27.851684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:27.860699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.861162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:27.862163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:27.862745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:28.010306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:28.018604 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8a466b7a-3f50-4e98-8495-5f1b9329071e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.172608 Jul 20 05:04:28.019222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4775/5900] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:27 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:29.035287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:29.035977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:29.043612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:29.044377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.045162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:29.045608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:29.179244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:29.187809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85717bc8-167e-4209-a159-da689701c7a8 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.156466 Jul 20 05:04:29.188319 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4776/5901] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:29 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:30.205529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:30.206163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:30.213115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.213581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.214362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:30.214816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:30.348255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:30.355819 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68a12cb4-2aaf-4006-becf-027fe1886d44 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.154331 Jul 20 05:04:30.356419 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4777/5902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:30 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:31.255666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-34bb58f7-5993-48f4-ab3b-0079819185c7 req-b522c78b-9b38-4ffa-a3b6-c811f476cda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03eb3a1d-8382-4fef-b85a-022e7d9ced05", "name": "network-vif-plugged", "status": "completed", "tag": "db524cf6-7e4d-476c-8ead-87af5c3d094f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:31.265457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-34bb58f7-5993-48f4-ab3b-0079819185c7 req-b522c78b-9b38-4ffa-a3b6-c811f476cda9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.265879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-34bb58f7-5993-48f4-ab3b-0079819185c7 req-b522c78b-9b38-4ffa-a3b6-c811f476cda9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.277926 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-34bb58f7-5993-48f4-ab3b-0079819185c7 req-b522c78b-9b38-4ffa-a3b6-c811f476cda9 service nova] Creating event network-vif-plugged:db524cf6-7e4d-476c-8ead-87af5c3d094f for instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 on n-h2-764486-11 Jul 20 05:04:31.282908 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-34bb58f7-5993-48f4-ab3b-0079819185c7 req-b522c78b-9b38-4ffa-a3b6-c811f476cda9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jul 20 05:04:31.283676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4778/5903] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:04:31.373599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:31.374321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:31.380712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.381224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.382002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:31.382451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:31.519953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:31.528342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30c30a3a-1633-498d-8387-0fa7b78bc4b3 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.159554 Jul 20 05:04:31.528938 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4779/5904] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:31 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:32.545953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:32.546663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:32.553902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.554374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.555162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:32.555649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:32.692194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:32.700390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d7eb561-984e-41fc-895f-476d97b5aefd tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1263 microversion: 2.1 time: 0.158267 Jul 20 05:04:32.700991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4780/5905] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:32 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:33.717604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:33.718319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:33.725339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.725801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.726585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.727036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.746814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:04:33.861941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:33.870106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10879ef8-1a1d-4d99-ab8e-48005ece6c79 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1451 microversion: 2.1 time: 0.156371 Jul 20 05:04:33.870692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4781/5906] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:33 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:33.885905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:04:33.886522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:04:33.892378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.892864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:33.893658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:33.894094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:34.022910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:04:34.030608 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a0c72c98-512d-46ee-8441-24a48ef94087 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1451 microversion: 2.1 time: 0.148731 Jul 20 05:04:34.031180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4782/5907] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:04:33 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:04:34.572725 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:04:34.572891 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:04:36.031535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-648875e1-3e53-4bcb-bdc0-495d904cd047 req-124f014f-667a-4fe4-bfb9-2daeeb37961a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03eb3a1d-8382-4fef-b85a-022e7d9ced05", "tag": "db524cf6-7e4d-476c-8ead-87af5c3d094f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:04:36.041045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-648875e1-3e53-4bcb-bdc0-495d904cd047 req-124f014f-667a-4fe4-bfb9-2daeeb37961a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:04:36.041511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-648875e1-3e53-4bcb-bdc0-495d904cd047 req-124f014f-667a-4fe4-bfb9-2daeeb37961a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:04:36.052755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-648875e1-3e53-4bcb-bdc0-495d904cd047 req-124f014f-667a-4fe4-bfb9-2daeeb37961a service nova] Creating event network-changed:db524cf6-7e4d-476c-8ead-87af5c3d094f for instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 on n-h2-764486-11 Jul 20 05:04:36.058106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-648875e1-3e53-4bcb-bdc0-495d904cd047 req-124f014f-667a-4fe4-bfb9-2daeeb37961a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128984 Jul 20 05:04:36.058824 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4783/5908] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:15.615947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:15.617108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:15.622754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:15.623353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:15.632279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.632764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.633551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.634001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.660054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:06:15.740559 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-704ff1a3-6e16-44a6-a4c2-06cc79b594b2 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 204 len: 0 microversion: 2.1 time: 0.127009 Jul 20 05:06:15.740559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4784/5909] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:06:15 2022] DELETE /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:06:15.746477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b2a27ab0-6eda-4d0f-8134-b8cdb88662ca req-baa7c83e-37e9-417b-b801-d72f1204f0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03eb3a1d-8382-4fef-b85a-022e7d9ced05", "tag": "db524cf6-7e4d-476c-8ead-87af5c3d094f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:15.756526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b2a27ab0-6eda-4d0f-8134-b8cdb88662ca req-baa7c83e-37e9-417b-b801-d72f1204f0d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.756984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b2a27ab0-6eda-4d0f-8134-b8cdb88662ca req-baa7c83e-37e9-417b-b801-d72f1204f0d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.769599 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b2a27ab0-6eda-4d0f-8134-b8cdb88662ca req-baa7c83e-37e9-417b-b801-d72f1204f0d4 service nova] Creating event network-changed:db524cf6-7e4d-476c-8ead-87af5c3d094f for instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 on n-h2-764486-11 Jul 20 05:06:15.774707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b2a27ab0-6eda-4d0f-8134-b8cdb88662ca req-baa7c83e-37e9-417b-b801-d72f1204f0d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032541 Jul 20 05:06:15.775308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4785/5910] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:15.780305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:15.781042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:15.788388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.788388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:15.789182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:15.789653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:16.033253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:16.041858 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a7e5204-4d9d-46c8-a30b-b9d309070ef0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1576 microversion: 2.1 time: 0.265394 Jul 20 05:06:16.042451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4786/5911] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:15 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:17.061323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:17.062010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:17.068700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:17.069174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:17.069958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:17.071011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:17.205328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:17.213143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1affb493-0200-436d-b34c-4ce3d8b52985 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1576 microversion: 2.1 time: 0.155974 Jul 20 05:06:17.213980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4787/5912] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:17 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:18.080672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a616c1f1-650c-4a16-96ce-b8a0f9fd1805 req-8f40e0db-2667-4a66-89a3-c3c47399629f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03eb3a1d-8382-4fef-b85a-022e7d9ced05", "name": "network-vif-deleted", "tag": "db524cf6-7e4d-476c-8ead-87af5c3d094f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:18.089976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a616c1f1-650c-4a16-96ce-b8a0f9fd1805 req-8f40e0db-2667-4a66-89a3-c3c47399629f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:18.090438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a616c1f1-650c-4a16-96ce-b8a0f9fd1805 req-8f40e0db-2667-4a66-89a3-c3c47399629f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.102072 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a616c1f1-650c-4a16-96ce-b8a0f9fd1805 req-8f40e0db-2667-4a66-89a3-c3c47399629f service nova] Creating event network-vif-deleted:db524cf6-7e4d-476c-8ead-87af5c3d094f for instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 on n-h2-764486-11 Jul 20 05:06:18.107672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a616c1f1-650c-4a16-96ce-b8a0f9fd1805 req-8f40e0db-2667-4a66-89a3-c3c47399629f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Jul 20 05:06:18.108599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4788/5913] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:18.230842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:18.231648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:18.238199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:18.238669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.239462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:18.239917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:18.304199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:18.311954 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-151d4ada-19b1-4f03-b2d4-d99c6ac77c95 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1224 microversion: 2.1 time: 0.085528 Jul 20 05:06:18.312553 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4789/5914] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:18 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:19.329332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:19.329958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:19.336883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.337345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.338128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:19.338588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:19.403554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:19.411304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0853d073-0566-466b-a22f-1ae41f9c675f tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1224 microversion: 2.1 time: 0.086095 Jul 20 05:06:19.411885 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4790/5915] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:19 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:20.428832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:20.429445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:20.436829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:20.437296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.438091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:20.438542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:20.502867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:20.511183 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afbddea0-c54f-416a-8f09-bfadc40e3929 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1224 microversion: 2.1 time: 0.086593 Jul 20 05:06:20.511799 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4791/5916] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:20 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:21.528679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:21.529389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:21.536504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:21.536973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:21.537764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:21.538215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:21.601358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:21.609137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b05ae832-6099-423d-bc83-8aef94ce0fe7 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1224 microversion: 2.1 time: 0.084387 Jul 20 05:06:21.609726 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4792/5917] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:21 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:22.627165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:22.627801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:22.634841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:22.635316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.636443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:22.636909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.673058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:22.673520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:22.673985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lazy-loading 'fault' on Instance uuid 03eb3a1d-8382-4fef-b85a-022e7d9ced05 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:06:22.718024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:22.725012 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea1660c7-9331-48c1-888d-408a020a20e0 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 200 len: 1183 microversion: 2.1 time: 0.102325 Jul 20 05:06:22.725598 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4793/5918] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:22 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 1183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:23.741797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:23.742488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 03eb3a1d-8382-4fef-b85a-022e7d9ced05] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:23.749559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:23.749925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:23.750703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:23.751146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:23.764555 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 could not be found. Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 HTTP/1.1 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 could not be found. Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '03eb3a1d-8382-4fef-b85a-022e7d9ced05'} Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 could not be found. Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 could not be found. Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:23.766193 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 could not be found. Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 03eb3a1d-8382-4fef-b85a-022e7d9ced05 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9835e01-9611-4004-afda-2b86030a7d13 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05" status: 404 len: 111 microversion: 2.1 time: 0.029846 Jul 20 05:06:23.772543 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4794/5919] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:23 2022] GET /compute/v2.1/servers/03eb3a1d-8382-4fef-b85a-022e7d9ced05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:06:29.948924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:29.949552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:29.957034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:29.957575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:29.958465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:29.958980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:29.985858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:06:30.067754 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-17d68388-e17d-4fce-b4b8-6b09541a2098 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 204 len: 0 microversion: 2.1 time: 0.123019 Jul 20 05:06:30.067754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4795/5920] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:06:29 2022] DELETE /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:06:30.074088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9bed7da8-934e-4767-8d00-a7229d686141 req-1e91bf05-1ccd-4ee7-864e-5b797315fab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0215dcee-e20b-4c6c-a0c0-d8329d02319c", "tag": "f06f0714-91cd-426d-8d2a-4b8006c8d8ba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:30.083703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9bed7da8-934e-4767-8d00-a7229d686141 req-1e91bf05-1ccd-4ee7-864e-5b797315fab9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:30.084301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9bed7da8-934e-4767-8d00-a7229d686141 req-1e91bf05-1ccd-4ee7-864e-5b797315fab9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:30.096107 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9bed7da8-934e-4767-8d00-a7229d686141 req-1e91bf05-1ccd-4ee7-864e-5b797315fab9 service nova] Creating event network-changed:f06f0714-91cd-426d-8d2a-4b8006c8d8ba for instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c on n-h1-764486-11 Jul 20 05:06:30.101104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9bed7da8-934e-4767-8d00-a7229d686141 req-1e91bf05-1ccd-4ee7-864e-5b797315fab9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032010 Jul 20 05:06:30.101788 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4796/5921] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:06:30.107595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:30.108217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:30.118997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:30.119459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:30.121099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:30.121410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:30.263724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:30.272068 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76e71b24-4445-4844-a79a-a14ba00ac0c9 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1578 microversion: 2.1 time: 0.168809 Jul 20 05:06:30.272681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4797/5922] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:30 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:06:31.289253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:31.289941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:31.297236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:31.297705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:31.298497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:31.299082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:31.431262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:31.438891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d67dff8-077b-4588-ae11-23adf2d75167 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1578 microversion: 2.1 time: 0.153716 Jul 20 05:06:31.439468 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4798/5923] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:31 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:32.143580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dd77091f-9b87-49ed-bf5f-2d7f83028a63 req-25352bb4-2cd2-4ae9-abc1-7ee1f5340f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0215dcee-e20b-4c6c-a0c0-d8329d02319c", "name": "network-vif-deleted", "tag": "f06f0714-91cd-426d-8d2a-4b8006c8d8ba"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:32.153036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd77091f-9b87-49ed-bf5f-2d7f83028a63 req-25352bb4-2cd2-4ae9-abc1-7ee1f5340f38 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.153503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd77091f-9b87-49ed-bf5f-2d7f83028a63 req-25352bb4-2cd2-4ae9-abc1-7ee1f5340f38 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.165602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dd77091f-9b87-49ed-bf5f-2d7f83028a63 req-25352bb4-2cd2-4ae9-abc1-7ee1f5340f38 service nova] Creating event network-vif-deleted:f06f0714-91cd-426d-8d2a-4b8006c8d8ba for instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c on n-h1-764486-11 Jul 20 05:06:32.171681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dd77091f-9b87-49ed-bf5f-2d7f83028a63 req-25352bb4-2cd2-4ae9-abc1-7ee1f5340f38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031843 Jul 20 05:06:32.172288 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4799/5924] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:06:32.456008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:32.456750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:32.464503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.464969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.465957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:32.466407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:32.471708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:32.540041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:32.548523 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09efbb7f-f0d1-462e-bc71-be90053ced5d tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1226 microversion: 2.1 time: 0.096613 Jul 20 05:06:32.559265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4800/5925] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:32 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:33.566969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:33.567690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:33.574540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:33.575005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:33.575787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:33.576242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:33.639006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:33.647102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4aa850c7-8fa5-4aca-ae3a-35964771d0cf tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1226 microversion: 2.1 time: 0.084701 Jul 20 05:06:33.647680 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4801/5926] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:33 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:34.663136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:34.663921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:34.671818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:34.672298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:34.673126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:34.673578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:34.740496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:34.754001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2dba61f0-bcfb-4b1f-a9fb-92094a235593 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1226 microversion: 2.1 time: 0.094678 Jul 20 05:06:34.754596 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4802/5927] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:34 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:35.771343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:35.771970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:35.779049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:35.779509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:35.780283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:35.780751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:35.842298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc38638958b426f92a6a0090b0b12bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4d1a3289fb42a9ada449a7e8701f4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:35.855719 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67855319-e47c-4b92-bb85-e0a1e5234b2c tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 200 len: 1226 microversion: 2.1 time: 0.088706 Jul 20 05:06:35.856313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4803/5928] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:35 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:06:36.873364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:36.874027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: 0215dcee-e20b-4c6c-a0c0-d8329d02319c] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:36.881080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:36.881548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:36.882326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:36.882777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:36.896155 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c could not be found. Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c HTTP/1.1 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c could not be found. Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '0215dcee-e20b-4c6c-a0c0-d8329d02319c'} Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c could not be found. Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c could not be found. Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:36.897841 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c could not be found. Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance 0215dcee-e20b-4c6c-a0c0-d8329d02319c could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a8caab1-9560-4fe7-85e7-7465fca1ed25 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c" status: 404 len: 111 microversion: 2.1 time: 0.030633 Jul 20 05:06:36.902785 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4804/5929] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:36 2022] GET /compute/v2.1/servers/0215dcee-e20b-4c6c-a0c0-d8329d02319c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:06:37.333427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:37.333939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:37.340427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:37.340846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.341628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:37.342077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.356057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 HTTP/1.1 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f2b6dbd0-07b8-471e-8a2d-e12765a388a6'} Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:37.357709 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49051153-3683-467f-9c3b-773bdaef7420 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 404 len: 111 microversion: 2.1 time: 0.030165 Jul 20 05:06:37.362422 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4805/5930] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:06:37 2022] DELETE /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:06:37.367188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:37.367801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] [instance: f2b6dbd0-07b8-471e-8a2d-e12765a388a6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:37.373834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:37.374298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.375122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:37.375566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:37.388873 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] HTTP exception thrown: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Request method failure captured: Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 HTTP/1.1 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14oeKJ0hRPNfSYpMC4CT62NandpF3HFkyBU0Umrsy5AuaxHqg9Jvi_MorIDNNe0Cd-w5HPNHYfdpgSmsVEdqtn2wAD-fBCoRi_9T3tH6WUv5LOPLQzFpWnJgZl_TED-TiLeM4plwhh8w0Ae9qjlMfsYfAFKW7Kx50cwm56atr_nB0qo Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c4d1a3289fb42a9ada449a7e8701f4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c4d1a3289fb42a9ada449a7e8701f4b", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 3c4d1a3289fb42a9ada449a7e8701f4b Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestVolumeBootPattern-1395721757 Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: fdc38638958b426f92a6a0090b0b12bd Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestVolumeBootPattern-1395721757-project Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f2b6dbd0-07b8-471e-8a2d-e12765a388a6'} Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:06:37.390398 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Returning 404 to user: Instance f2b6dbd0-07b8-471e-8a2d-e12765a388a6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4edf68e3-21e7-4d25-a2a7-022892c018e6 tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6" status: 404 len: 111 microversion: 2.1 time: 0.028097 Jul 20 05:06:37.395470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4806/5931] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:37 2022] GET /compute/v2.1/servers/f2b6dbd0-07b8-471e-8a2d-e12765a388a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:06:40.802272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2316d093-3309-4edc-ad30-66bc4800cc2e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] Calling method '.version_select at 0x7f8389f521f0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:40.828681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2316d093-3309-4edc-ad30-66bc4800cc2e tempest-TestVolumeBootPattern-1395721757 tempest-TestVolumeBootPattern-1395721757-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1340508644" status: 202 len: 0 microversion: 2.1 time: 0.031096 Jul 20 05:06:40.832626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4807/5932] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jul 20 05:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1340508644 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:06:59.280885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=28 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:59.281797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:06:59.390967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2023075775", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:06:59.445146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] validate_networks() for None {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:06:59.722884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:06:59.723327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:06:59.723816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:06:59.724242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:06:59.724723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:06:59.733956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.734419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.735240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:06:59.735692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:06:59.753281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Getting quotas for project b860a4b35018483980b8b2090c1f6732. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:06:59.759393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Getting quotas for user 0806a87172434ee1a07866b71ebd02c1 and project b860a4b35018483980b8b2090c1f6732. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:06:59.771621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:06:59.773939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:06:59.817474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba9d8836-d502-410c-8ccb-39c951e855eb tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541483 Jul 20 05:06:59.818129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4808/5933] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:06:59.828097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a308b131-c4eb-4722-9b3a-039c9a8a8901 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:06:59.828754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a308b131-c4eb-4722-9b3a-039c9a8a8901 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:06:59.882145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a308b131-c4eb-4722-9b3a-039c9a8a8901 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:06:59.888894 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a308b131-c4eb-4722-9b3a-039c9a8a8901 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1222 microversion: 2.1 time: 0.064530 Jul 20 05:06:59.889461 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4809/5934] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:06:59 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:00.906406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-766e45b9-8033-4f55-9f6c-ddd20eee5b2b tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:00.907420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-766e45b9-8033-4f55-9f6c-ddd20eee5b2b tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:00.959003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-766e45b9-8033-4f55-9f6c-ddd20eee5b2b tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:00.965778 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-766e45b9-8033-4f55-9f6c-ddd20eee5b2b tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1222 microversion: 2.1 time: 0.063422 Jul 20 05:07:00.966352 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4810/5935] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:00 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:01.982778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ea9898f-8c6e-4945-9411-5d2d66c2e77a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:01.983420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ea9898f-8c6e-4945-9411-5d2d66c2e77a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:02.040925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ea9898f-8c6e-4945-9411-5d2d66c2e77a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:02.047779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ea9898f-8c6e-4945-9411-5d2d66c2e77a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1222 microversion: 2.1 time: 0.068936 Jul 20 05:07:02.048390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4811/5936] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:01 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:03.064986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:03.065832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:03.072979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:03.073446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:03.074231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:03.074682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:03.143437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:03.151220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8f86e43-2740-4459-8474-b58a98e66819 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1280 microversion: 2.1 time: 0.090093 Jul 20 05:07:03.161231 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4812/5937] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:03 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:04.168972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:04.169673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:04.177343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:04.177808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.178638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:04.179086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.397852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:04.405647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cff4d28d-a778-45a0-b50d-1bda5287ef2a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.240514 Jul 20 05:07:04.406162 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4813/5938] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:04 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:04.546775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8848cb28-9d1f-45da-8cd7-307a04abdb9e req-ed732900-67b6-4498-b65e-32dbf8c4140a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4599799-c8c7-41b1-960f-c38c3bfb85fe", "tag": "e7048bc5-fff1-4e48-adcf-0c224c001fca"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:04.557529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8848cb28-9d1f-45da-8cd7-307a04abdb9e req-ed732900-67b6-4498-b65e-32dbf8c4140a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:04.558282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8848cb28-9d1f-45da-8cd7-307a04abdb9e req-ed732900-67b6-4498-b65e-32dbf8c4140a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:04.573246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8848cb28-9d1f-45da-8cd7-307a04abdb9e req-ed732900-67b6-4498-b65e-32dbf8c4140a service nova] Creating event network-changed:e7048bc5-fff1-4e48-adcf-0c224c001fca for instance b4599799-c8c7-41b1-960f-c38c3bfb85fe on n-h1-764486-11 Jul 20 05:07:04.578642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8848cb28-9d1f-45da-8cd7-307a04abdb9e req-ed732900-67b6-4498-b65e-32dbf8c4140a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036828 Jul 20 05:07:04.579576 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4814/5939] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:05.422554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:05.423258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:05.430611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:05.431072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:05.431845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:05.432288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:05.559693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:05.567846 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-920a7923-4722-45fa-9c4c-f803f8e1518a tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.149669 Jul 20 05:07:05.568437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4815/5940] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:05 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:06.585126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:06.585807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:06.592645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:06.593110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:06.593885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:06.594329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:06.725074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:06.732513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-76d7a912-843b-4bb0-b6d8-5e918cfa7947 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.152094 Jul 20 05:07:06.733092 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4816/5941] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:06 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:07.749521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:07.750151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:07.757790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.758256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.759034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:07.759537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:07.888161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:07.895683 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08181a11-9e30-4e0e-9c32-1bbcba606bf8 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.150114 Jul 20 05:07:07.896256 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4817/5942] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:07 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:08.914768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:08.915441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:08.922429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.922905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:08.923692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:08.924147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:09.053778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:09.061330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-715c9e4b-1f62-411c-ac83-f71019dabccd tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.151278 Jul 20 05:07:09.061917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4818/5943] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:08 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:10.078698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:10.079343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:10.081255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:10.087719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.088205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.088984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.089431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.227113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:10.234676 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88af18b4-aded-481d-b3e2-9117fbec9a3e tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.159937 Jul 20 05:07:10.235261 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4819/5944] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:10 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:10.270496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a05466d2-b9f8-4ff1-a410-82310a995faa req-32f530cd-2373-4301-b8cb-ad1d4192bf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4599799-c8c7-41b1-960f-c38c3bfb85fe", "name": "network-vif-plugged", "status": "completed", "tag": "e7048bc5-fff1-4e48-adcf-0c224c001fca"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:10.278621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a05466d2-b9f8-4ff1-a410-82310a995faa req-32f530cd-2373-4301-b8cb-ad1d4192bf11 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:10.279084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a05466d2-b9f8-4ff1-a410-82310a995faa req-32f530cd-2373-4301-b8cb-ad1d4192bf11 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:10.291396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a05466d2-b9f8-4ff1-a410-82310a995faa req-32f530cd-2373-4301-b8cb-ad1d4192bf11 service nova] Creating event network-vif-plugged:e7048bc5-fff1-4e48-adcf-0c224c001fca for instance b4599799-c8c7-41b1-960f-c38c3bfb85fe on n-h1-764486-11 Jul 20 05:07:10.296830 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a05466d2-b9f8-4ff1-a410-82310a995faa req-32f530cd-2373-4301-b8cb-ad1d4192bf11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 Jul 20 05:07:10.297858 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4820/5945] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:11.252182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:11.252994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:11.260559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.261046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.261812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:11.262264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:11.395268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:11.402908 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1e4f1e92-3e2e-4cfe-abe6-91a0ca8b16d9 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1322 microversion: 2.1 time: 0.155528 Jul 20 05:07:11.403504 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4821/5946] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:11 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:12.420367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:12.421068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:12.422992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:12.430144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.430606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.431391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.431840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.561990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:12.570284 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-01190974-a18c-477f-9aaf-1d48cb0e52c3 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1472 microversion: 2.1 time: 0.153854 Jul 20 05:07:12.570867 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4822/5947] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:12 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:12.640101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da88809e-cd04-4df9-b364-ae9b1a2cc79b tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Calling method '.version_select at 0x7f839a53f310>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:12.705976 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da88809e-cd04-4df9-b364-ae9b1a2cc79b tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/82da7d0d234e4ec78be9f9e5f8352827" status: 200 len: 371 microversion: 2.1 time: 0.121161 Jul 20 05:07:12.706573 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4823/5948] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 05:07:12 2022] GET /compute/v2.1/os-quota-sets/82da7d0d234e4ec78be9f9e5f8352827 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:07:12.717143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7a42789-7bb5-4897-b696-f4e129e00dd2 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1740770600", "id": 1937015372, "os-flavor-access:is_public": "True"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:12.718823 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:07:12.718823 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 05:07:12.740195 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c7a42789-7bb5-4897-b696-f4e129e00dd2 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.026576 Jul 20 05:07:12.740974 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4824/5949] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:07:12 2022] POST /compute/v2.1/flavors => generated 438 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:07:12.751700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1937015372"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:12.752698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:12.759919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.760436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.761649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.762096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.906218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8a5ef18f349647f480314b9663e56392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da7d0d234e4ec78be9f9e5f8352827', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:12.912850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1740770600 {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:07:12.919434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.919898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.920724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:12.921175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:12.942452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Getting quotas for project b860a4b35018483980b8b2090c1f6732. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:07:12.947468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Getting quotas for user 0806a87172434ee1a07866b71ebd02c1 and project b860a4b35018483980b8b2090c1f6732. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:07:12.960212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] ram quota exceeded for 82da7d0d234e4ec78be9f9e5f8352827, tried to resize instance. Jul 20 05:07:12.960793 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Request method failure captured: Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe/action HTTP/1.1 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 39 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi141zJxMROfgz1TEvBBtosAal46j70_UsdSczpKG03EfsN80guf6AxD_wFB_oCKh-qqh-WvfnbzkugzF8aZaidPQku2NmLvH_mP-mmDXQpwrXLEy3w_iXHtmJYjt8HmwBJXAHDIA-FHmAqA1vA3MnaOmhe_zEzzN1sRuoT8I8cVCP-cc Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 82da7d0d234e4ec78be9f9e5f8352827 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1353740198 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82da7d0d234e4ec78be9f9e5f8352827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82da7d0d234e4ec78be9f9e5f8352827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82da7d0d234e4ec78be9f9e5f8352827"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82da7d0d234e4ec78be9f9e5f8352827", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1353740198 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 82da7d0d234e4ec78be9f9e5f8352827 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1353740198 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1353740198-project-admin Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8a5ef18f349647f480314b9663e56392 Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1353740198-project-admin Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: {"resize": {"flavorRef": "1937015372"}} Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'b4599799-c8c7-41b1-960f-c38c3bfb85fe', 'body': {'resize': {'flavorRef': '1937015372'}}} Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:07:12.962893 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9f5183f-6030-4a64-b033-27cd0e4f8ec6 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe/action" status: 403 len: 118 microversion: 2.1 time: 0.216532 Jul 20 05:07:12.968803 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4825/5950] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:12 2022] POST /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe/action => generated 118 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:07:12.972848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-650e6a29-5d25-4063-b5ba-30329426a2b4 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:12.973788 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:07:12.973788 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 05:07:12.991330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-650e6a29-5d25-4063-b5ba-30329426a2b4 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1937015372" status: 202 len: 0 microversion: 2.1 time: 0.021882 Jul 20 05:07:12.991918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4826/5951] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 05:07:12 2022] DELETE /compute/v2.1/flavors/1937015372 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:07:12.999497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a7a9be61-00a4-49dd-b0f8-6a2bdbc76b88 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.018293 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a7a9be61-00a4-49dd-b0f8-6a2bdbc76b88 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022152 Jul 20 05:07:13.018859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4827/5952] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 05:07:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:13.035455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2895230-be4b-4efb-b640-a5eed7412e0a tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Calling method '.version_select at 0x7f838ae77ca0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.102056 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2895230-be4b-4efb-b640-a5eed7412e0a tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/82da7d0d234e4ec78be9f9e5f8352827" status: 200 len: 371 microversion: 2.1 time: 0.069884 Jul 20 05:07:13.102564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4828/5953] 10.222.0.49 () {58 vars in 1241 bytes} [Wed Jul 20 05:07:13 2022] GET /compute/v2.1/os-quota-sets/82da7d0d234e4ec78be9f9e5f8352827 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:07:13.112328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b45e5ea-ac0b-4446-98d2-544d5a8e0309 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1765936125", "id": 1404206499, "os-flavor-access:is_public": "True"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:13.114381 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:07:13.114381 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 05:07:13.128475 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b45e5ea-ac0b-4446-98d2-544d5a8e0309 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.019688 Jul 20 05:07:13.129597 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4829/5954] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:07:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:07:13.139676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1404206499"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:13.140653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:13.146748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.147210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.147990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.148471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.177347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8a5ef18f349647f480314b9663e56392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da7d0d234e4ec78be9f9e5f8352827', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:13.183129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1765936125 {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:07:13.189399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.189849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.190650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.191096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.211630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Getting quotas for project b860a4b35018483980b8b2090c1f6732. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:07:13.216775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Getting quotas for user 0806a87172434ee1a07866b71ebd02c1 and project b860a4b35018483980b8b2090c1f6732. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:07:13.228867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] cores quota exceeded for 82da7d0d234e4ec78be9f9e5f8352827, tried to resize instance. Jul 20 05:07:13.229414 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Request method failure captured: Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe/action HTTP/1.1 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 39 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi141zJxMROfgz1TEvBBtosAal46j70_UsdSczpKG03EfsN80guf6AxD_wFB_oCKh-qqh-WvfnbzkugzF8aZaidPQku2NmLvH_mP-mmDXQpwrXLEy3w_iXHtmJYjt8HmwBJXAHDIA-FHmAqA1vA3MnaOmhe_zEzzN1sRuoT8I8cVCP-cc Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 82da7d0d234e4ec78be9f9e5f8352827 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1353740198 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader,admin Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader,admin Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82da7d0d234e4ec78be9f9e5f8352827"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82da7d0d234e4ec78be9f9e5f8352827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82da7d0d234e4ec78be9f9e5f8352827"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82da7d0d234e4ec78be9f9e5f8352827", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1353740198 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 82da7d0d234e4ec78be9f9e5f8352827 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1353740198 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1353740198-project-admin Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8a5ef18f349647f480314b9663e56392 Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1353740198-project-admin Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: {"resize": {"flavorRef": "1404206499"}} Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'b4599799-c8c7-41b1-960f-c38c3bfb85fe', 'body': {'resize': {'flavorRef': '1404206499'}}} Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:07:13.231383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0dfb4efd-035e-452d-aeac-ac304f0a570e tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe/action" status: 403 len: 113 microversion: 2.1 time: 0.096811 Jul 20 05:07:13.236931 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4830/5955] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:13 2022] POST /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe/action => generated 113 bytes in 98 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:07:13.241584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a7a51d1-e062-4555-9292-851649c54167 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.242356 n-d-764486-11 devstack@n-api.service[123724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 05:07:13.242356 n-d-764486-11 devstack@n-api.service[123724]: warnings.warn(msg) Jul 20 05:07:13.244224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:13.261204 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a7a51d1-e062-4555-9292-851649c54167 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1404206499" status: 202 len: 0 microversion: 2.1 time: 0.023519 Jul 20 05:07:13.261758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4831/5956] 10.222.0.49 () {58 vars in 1160 bytes} [Wed Jul 20 05:07:13 2022] DELETE /compute/v2.1/flavors/1404206499 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:07:13.269286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-029e94c9-2c14-40de-8075-e4329f7edf20 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.287257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-029e94c9-2c14-40de-8075-e4329f7edf20 tempest-ServersAdminNegativeTestJSON-1353740198 tempest-ServersAdminNegativeTestJSON-1353740198-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021298 Jul 20 05:07:13.287814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4832/5957] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Jul 20 05:07:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:13.304790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.305302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:13.311209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.311661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.312482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.312921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.337387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:07:13.382709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:13.414588 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a9a5b24-b844-480e-9bcf-912b238113ee tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 204 len: 0 microversion: 2.1 time: 0.113988 Jul 20 05:07:13.415183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4833/5958] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:07:13 2022] DELETE /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:07:13.423512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:13.424234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:13.432794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.433270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.434033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:13.434478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:13.569641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:13.577434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e894483-34ac-40fe-8642-1ae0ad36e553 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1478 microversion: 2.1 time: 0.158032 Jul 20 05:07:13.578038 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4834/5959] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:13 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:14.594736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:14.595425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:14.602839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.603300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.604078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:14.604557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:14.733200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806a87172434ee1a07866b71ebd02c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b860a4b35018483980b8b2090c1f6732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:14.740869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95554502-60bc-4f40-b29d-3111355fc076 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 200 len: 1478 microversion: 2.1 time: 0.150099 Jul 20 05:07:14.741446 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4835/5960] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:14 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 1478 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:15.220963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-50684a42-ad41-4dbe-8763-3c27e904d737 req-6a070bd4-3b19-4e6c-bbd1-aa0105479602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4599799-c8c7-41b1-960f-c38c3bfb85fe", "name": "network-vif-deleted", "tag": "e7048bc5-fff1-4e48-adcf-0c224c001fca"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:15.230040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-50684a42-ad41-4dbe-8763-3c27e904d737 req-6a070bd4-3b19-4e6c-bbd1-aa0105479602 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.230439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-50684a42-ad41-4dbe-8763-3c27e904d737 req-6a070bd4-3b19-4e6c-bbd1-aa0105479602 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:15.244855 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-50684a42-ad41-4dbe-8763-3c27e904d737 req-6a070bd4-3b19-4e6c-bbd1-aa0105479602 service nova] Creating event network-vif-deleted:e7048bc5-fff1-4e48-adcf-0c224c001fca for instance b4599799-c8c7-41b1-960f-c38c3bfb85fe on n-h1-764486-11 Jul 20 05:07:15.249725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-50684a42-ad41-4dbe-8763-3c27e904d737 req-6a070bd4-3b19-4e6c-bbd1-aa0105479602 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032531 Jul 20 05:07:15.250377 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4836/5961] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:15.758541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:15.759252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] [instance: b4599799-c8c7-41b1-960f-c38c3bfb85fe] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:15.765542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.766004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:15.766774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:15.767224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:15.780937 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] HTTP exception thrown: Instance b4599799-c8c7-41b1-960f-c38c3bfb85fe could not be found. Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Request method failure captured: Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe HTTP/1.1 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi141yPSFX5FuZ-djo3hni_FJm58J5uDhsLebyuDK-N5VlDoliLJbSlOEda5khcwHC4brvx2QLnNRlH9CsVs3I1250iHETTLQ5UlcSYKs3DRPck7naNagZX8kcMdwHAQWplSW7hF0SsclvHCkZFlRenuBOf6Q8rIJdFa2C7wrWCtmlQTs Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: b860a4b35018483980b8b2090c1f6732 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1492486968 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b860a4b35018483980b8b2090c1f6732"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b860a4b35018483980b8b2090c1f6732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b860a4b35018483980b8b2090c1f6732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b860a4b35018483980b8b2090c1f6732", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1492486968 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: b860a4b35018483980b8b2090c1f6732 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1492486968 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersAdminNegativeTestJSON-1492486968-project Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 0806a87172434ee1a07866b71ebd02c1 Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1492486968-project Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance b4599799-c8c7-41b1-960f-c38c3bfb85fe could not be found. Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'b4599799-c8c7-41b1-960f-c38c3bfb85fe'} Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4599799-c8c7-41b1-960f-c38c3bfb85fe could not be found. Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4599799-c8c7-41b1-960f-c38c3bfb85fe could not be found. Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:15.782584 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4599799-c8c7-41b1-960f-c38c3bfb85fe could not be found. Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] Returning 404 to user: Instance b4599799-c8c7-41b1-960f-c38c3bfb85fe could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea016d74-cfd2-49b6-8796-8127ebdef508 tempest-ServersAdminNegativeTestJSON-1492486968 tempest-ServersAdminNegativeTestJSON-1492486968-project] 10.222.0.49 "GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe" status: 404 len: 111 microversion: 2.1 time: 0.030519 Jul 20 05:07:15.788822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4837/5962] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:15 2022] GET /compute/v2.1/servers/b4599799-c8c7-41b1-960f-c38c3bfb85fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:07:21.672685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-572919983", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "dfdc5346-3b00-4858-b30f-f1e5448ba9e1"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:21.725607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] validate_networks() for [('dfdc5346-3b00-4858-b30f-f1e5448ba9e1', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:07:22.110958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:22.111401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:22.111899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:22.112330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:22.112815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:22.123043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:22.123534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:22.124453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:22.124842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:22.142705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Getting quotas for project 43a66d02c5914692af7d8c68d6618ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:07:22.148495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Getting quotas for user 8e5361fafed2493f8b2242730db27743 and project 43a66d02c5914692af7d8c68d6618ff9. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:07:22.161284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:07:22.163567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:07:22.208303 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5f98bba-df48-4141-99a8-3b1491b197aa tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665377 Jul 20 05:07:22.208981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4838/5963] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:07:22.219077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4922c618-c469-41ee-8fdb-1a6d10e3fdab tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:22.219712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4922c618-c469-41ee-8fdb-1a6d10e3fdab tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:22.276389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4922c618-c469-41ee-8fdb-1a6d10e3fdab tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:22.284692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4922c618-c469-41ee-8fdb-1a6d10e3fdab tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1214 microversion: 2.1 time: 0.069428 Jul 20 05:07:22.286258 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4839/5964] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:22 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:07:23.304484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:23.305822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:23.314671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:23.315139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:23.315937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:23.316446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:23.392037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:23.400166 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca060f62-2cb5-4f87-9042-be0f3e132770 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1272 microversion: 2.1 time: 0.101282 Jul 20 05:07:23.400792 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4840/5965] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:23 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:24.417670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:24.418339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:24.431035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:24.434952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:24.445774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:24.446772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:24.655828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:24.664446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9196c0c-2e62-4cd8-9625-bd113942edfe tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.250518 Jul 20 05:07:24.665412 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4841/5966] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:24 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:24.778911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0cdb8c35-f665-49e1-a832-7e0fce873840 req-f9f713e6-93c7-4084-869d-3354a5d6c418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd", "tag": "ef9d8492-9495-4cf7-8814-4429efe61e9a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:24.815098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0cdb8c35-f665-49e1-a832-7e0fce873840 req-f9f713e6-93c7-4084-869d-3354a5d6c418 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:24.815936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0cdb8c35-f665-49e1-a832-7e0fce873840 req-f9f713e6-93c7-4084-869d-3354a5d6c418 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:24.837017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0cdb8c35-f665-49e1-a832-7e0fce873840 req-f9f713e6-93c7-4084-869d-3354a5d6c418 service nova] Creating event network-changed:ef9d8492-9495-4cf7-8814-4429efe61e9a for instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd on n-h1-764486-11 Jul 20 05:07:24.847803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0cdb8c35-f665-49e1-a832-7e0fce873840 req-f9f713e6-93c7-4084-869d-3354a5d6c418 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074298 Jul 20 05:07:24.849530 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4842/5967] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:25.681604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:25.682310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:25.689504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:25.690208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:25.691011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:25.691450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:25.819351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:25.827008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85c6543d-d01b-48fd-aef1-4a59088a1145 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.149958 Jul 20 05:07:25.827585 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4843/5968] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:25 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:26.844591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:26.845252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:26.852200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:26.852699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:26.853476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:26.853924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:26.984518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:26.992073 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13659bba-1875-494e-a246-83cedb7f71dc tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.151498 Jul 20 05:07:26.992671 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4844/5969] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:26 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:28.009106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:28.009719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:28.016694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:28.017158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:28.017945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:28.018396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:28.151584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:28.159152 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4c14074-ef07-4216-9276-d3d87f8795d8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.154017 Jul 20 05:07:28.159734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4845/5970] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:28 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:29.176659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:29.177649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:29.184619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:29.185078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:29.185859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:29.186300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:29.321200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:29.328826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9a32200-1583-45ed-85d2-b3867038e371 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.156462 Jul 20 05:07:29.329406 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4846/5971] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:29 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:30.345371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:30.346052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:30.353451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.353927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.354780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.355383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.494269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:30.502149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b734c622-1f55-42c9-a7f6-aae0461f5c3a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.160811 Jul 20 05:07:30.502746 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4847/5972] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:30 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:30.571849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9ab74515-d29a-48be-8e35-708d750bfe48 req-65266efa-6060-4844-88f3-dbc4e4a4dee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd", "name": "network-vif-plugged", "status": "completed", "tag": "ef9d8492-9495-4cf7-8814-4429efe61e9a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:30.579921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ab74515-d29a-48be-8e35-708d750bfe48 req-65266efa-6060-4844-88f3-dbc4e4a4dee0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:30.580413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ab74515-d29a-48be-8e35-708d750bfe48 req-65266efa-6060-4844-88f3-dbc4e4a4dee0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:30.591368 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9ab74515-d29a-48be-8e35-708d750bfe48 req-65266efa-6060-4844-88f3-dbc4e4a4dee0 service nova] Creating event network-vif-plugged:ef9d8492-9495-4cf7-8814-4429efe61e9a for instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd on n-h1-764486-11 Jul 20 05:07:30.596344 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9ab74515-d29a-48be-8e35-708d750bfe48 req-65266efa-6060-4844-88f3-dbc4e4a4dee0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092443 Jul 20 05:07:30.596917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4848/5973] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:07:31.521750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:31.522558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:31.528782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.529243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.530012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:31.530455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:31.662431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:31.670312 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-531ae163-d7e3-43e7-8527-8bb79d72b326 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1314 microversion: 2.1 time: 0.154327 Jul 20 05:07:31.670886 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4849/5974] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:31 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:32.686919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:32.687548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:32.689565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:32.690360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:32.697219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.697687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.698464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.698914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.832160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:32.840789 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e377e471-17a2-4200-8419-4f88975fdac9 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1502 microversion: 2.1 time: 0.157709 Jul 20 05:07:32.841571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4850/5975] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:32 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:32.857553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:07:32.858459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:32.864583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.865044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.865823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.866272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.897525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:32.903880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:07:32.911255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:07:32.911691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:07:32.912180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:07:32.912625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:07:32.913047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:07:32.977518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2dacb283-7ec3-4929-806a-85c46102aa87 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "POST /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd/action" status: 202 len: 0 microversion: 2.1 time: 0.123767 Jul 20 05:07:32.978357 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4851/5976] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:07:32 2022] POST /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:07:32.986608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:32.987463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:32.994127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.994653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:32.995455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:32.995913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:33.135328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:33.142963 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a249cec2-843c-4cc4-9154-feadcb27a7c4 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1511 microversion: 2.1 time: 0.160346 Jul 20 05:07:33.143548 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4852/5977] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:32 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:34.161909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:34.162634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:34.169918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:34.170380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:34.171235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:34.171683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:34.175868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:34.306991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:34.314672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d194014-4c3b-4b07-ad02-b9862ca91a7a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1511 microversion: 2.1 time: 0.157268 Jul 20 05:07:34.315251 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4853/5978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:34 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:35.333009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:35.333823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:35.340750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:35.341215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:35.342033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:35.342439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:35.475267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:35.483574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fe67549-f420-4fa9-92cb-abda1239e1c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.155039 Jul 20 05:07:35.484161 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4854/5979] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:35 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:36.501024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:36.501702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:36.508637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:36.509100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:36.509869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:36.510313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:36.644190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:36.652197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7ee188c-38b8-44ff-8d42-6da842bfda48 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.155061 Jul 20 05:07:36.652807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4855/5980] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:36 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:37.669387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:37.670085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:37.677766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:37.678223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:37.678987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:37.679429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:37.811659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:37.819528 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6872445-213b-4d4e-8508-0cbfb1460d57 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.154068 Jul 20 05:07:37.820116 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4856/5981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:37 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:38.836279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:38.837019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:38.844003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.844503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.845310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:38.845758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:38.988807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:38.998936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-28bddd2c-8943-4b50-8fbf-b2e1f3d7a65a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.166599 Jul 20 05:07:38.999532 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4857/5982] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:38 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:40.015132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:40.015782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:40.023444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:40.023922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:40.024700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:40.025143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:40.160085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:40.167790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-654f10d6-0d63-4bc2-aacd-d5c02a4b9f70 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.156649 Jul 20 05:07:40.168375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4858/5983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:40 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:41.185867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:41.186539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:41.193555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.194019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.194796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:41.195246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:41.325431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:41.333501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-910ea597-e149-4262-9f2c-7dd43f71ed1a tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.151550 Jul 20 05:07:41.334071 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4859/5984] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:41 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:42.350373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:42.351027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:42.357780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.358233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.359016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:42.359462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:42.491570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:42.499061 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e3a8297-2cdf-4e23-b7a8-ba0e22f4a6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.153333 Jul 20 05:07:42.499629 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4860/5985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:42 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:43.515601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:43.516261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:43.519138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:43.525255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:43.525719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:43.526527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:43.526981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:43.659526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:43.667648 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3f34069e-bcbb-4f32-98ef-1abf613190e8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.155943 Jul 20 05:07:43.668228 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4861/5986] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:43 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:44.685610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:44.686241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:44.693954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:44.694419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:44.695205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:44.695660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:44.824163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:44.831738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a430e443-450e-4ee3-9629-d6ed4afe99ad tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.150129 Jul 20 05:07:44.832316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4862/5987] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:44 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:45.848745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:45.849599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:45.856755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:45.857220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:45.857999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:45.858450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:45.993535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:46.001094 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2223d87c-f405-40c3-8bbe-8b19940a7eb7 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.156261 Jul 20 05:07:46.001623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4863/5988] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:45 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:47.018844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:47.019560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:47.026279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:47.026751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.027586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:47.028041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:47.156312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:47.164473 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a5495dad-2e09-466c-8af6-fd13c3a63a3e tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.149835 Jul 20 05:07:47.165081 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4864/5989] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:47 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:48.182241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:48.182872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:48.189693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.190152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:48.190922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:48.191372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:48.324944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:48.332540 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1116a37a-4eed-408b-8b5e-972c77e23778 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.155201 Jul 20 05:07:48.333121 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4865/5990] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:48 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:49.350454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:49.351136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:49.358441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:49.359000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:49.359682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:49.360133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:49.493453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:49.500973 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60c928ec-1a14-4c46-990e-9cf4d8de4fe3 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.154472 Jul 20 05:07:49.501553 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4866/5991] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:49 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:50.518061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:50.518750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:50.526408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.526922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:50.527801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:50.528285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:50.658433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:50.666335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08a0a94b-78e6-49ad-a840-bdce77371dcd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.152141 Jul 20 05:07:50.666968 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4867/5992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:50 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:51.688327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:51.689036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:51.696422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:51.696890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:51.697665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:51.698116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:51.831062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:51.839185 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0500212-c16b-4abb-ad50-6ee1a0e3ac91 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.154773 Jul 20 05:07:51.839764 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4868/5993] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:51 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:52.856422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:52.857077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:52.864155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:52.864662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:52.865463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:52.865906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:52.995785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:52.999199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:07:53.004273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97ae33f9-f158-4039-a9cb-4efe4488c6fd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.151850 Jul 20 05:07:53.004892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4869/5994] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:52 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:54.021410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:54.022059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:54.029285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:54.029762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:54.030546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:54.031001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:54.165612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:54.173255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02e71334-99c3-401b-af8e-6c4c4d306cd1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.155852 Jul 20 05:07:54.173831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4870/5995] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:54 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:55.191175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:55.191886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:55.199396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:55.199862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:55.200667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:55.201121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:55.328022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:55.335587 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4aaf4eda-1dee-4a28-94ed-ed16f14dde52 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.148363 Jul 20 05:07:55.336151 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4871/5996] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:55 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:56.352683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:56.353375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:56.360275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:56.360774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:56.361555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:56.362012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:56.494204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:56.502802 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b94dcbf1-6311-44ca-82a4-7360166e09ff tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.154080 Jul 20 05:07:56.503383 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4872/5997] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:56 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:57.520521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:57.521715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:57.528718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:57.529173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:57.529943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:57.530386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:57.665348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:57.672807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d1a34ba-1faa-4310-b93e-ece525de84c8 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.156297 Jul 20 05:07:57.673389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4873/5998] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:57 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:58.690794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:58.691444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:58.698573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.699143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.699943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:58.700435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:58.830963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:07:58.839280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2c4aee3-63b2-428f-9595-5b591b4e27c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.153080 Jul 20 05:07:58.839859 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4874/5999] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:58 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:07:59.856667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:07:59.857320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:07:59.864296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.864792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:07:59.866098 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:07:59.866544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:00.005419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:00.012939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63c3c838-5452-480b-9421-17c8482d7c23 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.160254 Jul 20 05:08:00.013740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4875/6000] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:07:59 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:01.031387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:01.032079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:01.039074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.039542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.040324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:01.040804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:01.173702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:01.181962 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73b97ba6-c70a-4b2c-8234-9713bfd91147 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1516 microversion: 2.1 time: 0.154522 Jul 20 05:08:01.182536 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4876/6001] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:01 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:02.199460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:02.200103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:02.207314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.207784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.208609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.209752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.345162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:02.352815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b0f4252-95e9-4269-9e3c-25eb1bc55ccd tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1515 microversion: 2.1 time: 0.157286 Jul 20 05:08:02.353390 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4877/6002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:02 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:02.539038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-094bad78-f7a8-4dfb-b1b8-006966e8bb57 req-5a2caa2b-dfbc-4b29-bf85-89c7584e4442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd", "name": "network-vif-unplugged", "status": "completed", "tag": "ef9d8492-9495-4cf7-8814-4429efe61e9a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:02.547394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-094bad78-f7a8-4dfb-b1b8-006966e8bb57 req-5a2caa2b-dfbc-4b29-bf85-89c7584e4442 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:02.547856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-094bad78-f7a8-4dfb-b1b8-006966e8bb57 req-5a2caa2b-dfbc-4b29-bf85-89c7584e4442 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:02.563136 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-094bad78-f7a8-4dfb-b1b8-006966e8bb57 req-5a2caa2b-dfbc-4b29-bf85-89c7584e4442 service nova] Creating event network-vif-unplugged:ef9d8492-9495-4cf7-8814-4429efe61e9a for instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd on n-h2-764486-11 Jul 20 05:08:02.569623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-094bad78-f7a8-4dfb-b1b8-006966e8bb57 req-5a2caa2b-dfbc-4b29-bf85-89c7584e4442 service nova] Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:02.581193 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-094bad78-f7a8-4dfb-b1b8-006966e8bb57 req-5a2caa2b-dfbc-4b29-bf85-89c7584e4442 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117952 Jul 20 05:08:02.581818 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4878/6003] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:03.370839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:03.371788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:03.378149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:03.378612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.379399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:03.379854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:03.510220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:03.517706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-754c0332-7373-4018-aaa3-aaa90ff58110 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1513 microversion: 2.1 time: 0.152102 Jul 20 05:08:03.518276 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4879/6004] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:03 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:04.535190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:04.535909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:04.543323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.543778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.544601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.545050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.679766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:04.688219 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e53630e-f879-4e52-bd59-730bf5d6d5b2 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1513 microversion: 2.1 time: 0.156851 Jul 20 05:08:04.689078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4880/6005] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:04 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:04.693676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2538a1e0-450e-40ae-96f7-31cfc8cb7f85 req-013a18df-7380-4d8e-9ba1-855aca1d56bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd", "tag": "ef9d8492-9495-4cf7-8814-4429efe61e9a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:04.702259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2538a1e0-450e-40ae-96f7-31cfc8cb7f85 req-013a18df-7380-4d8e-9ba1-855aca1d56bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:04.702718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2538a1e0-450e-40ae-96f7-31cfc8cb7f85 req-013a18df-7380-4d8e-9ba1-855aca1d56bc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:04.714443 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2538a1e0-450e-40ae-96f7-31cfc8cb7f85 req-013a18df-7380-4d8e-9ba1-855aca1d56bc service nova] Creating event network-changed:ef9d8492-9495-4cf7-8814-4429efe61e9a for instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd on n-h2-764486-11 Jul 20 05:08:04.719885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-2538a1e0-450e-40ae-96f7-31cfc8cb7f85 req-013a18df-7380-4d8e-9ba1-855aca1d56bc service nova] Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:08:04.731578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2538a1e0-450e-40ae-96f7-31cfc8cb7f85 req-013a18df-7380-4d8e-9ba1-855aca1d56bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041129 Jul 20 05:08:04.732399 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4881/6006] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:05.706026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:05.706815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:05.713911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.714376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.715153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.715601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.848254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:05.855699 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6522beba-105b-4b9d-b56f-1511000b4532 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1510 microversion: 2.1 time: 0.153946 Jul 20 05:08:05.856265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4882/6007] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:05 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:05.871565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:05.872060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:05.877716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.878175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.878943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:05.879383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:05.905530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:08:05.956337 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Found an unconfirmed migration during delete, id: 16, status: finished Jul 20 05:08:07.312648 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2f1e597-502a-4a6c-ad14-c1944d8be458 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 204 len: 0 microversion: 2.1 time: 1.444003 Jul 20 05:08:07.316723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4883/6008] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:05 2022] DELETE /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 0 bytes in 1446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:08:07.323437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:07.324156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:07.331293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.331768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.332595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:07.333055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:07.462040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:07.465905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:07.470965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-42e52a08-6be2-452d-a9d4-92012c1b1914 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1502 microversion: 2.1 time: 0.152655 Jul 20 05:08:07.471549 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4884/6009] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:07 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:08.178602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-38297ae2-1179-45ff-8c89-e229db8f7573 req-138daf57-6d16-4deb-8b35-7236ee721e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd", "name": "network-vif-plugged", "status": "completed", "tag": "ef9d8492-9495-4cf7-8814-4429efe61e9a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:08.190672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-38297ae2-1179-45ff-8c89-e229db8f7573 req-138daf57-6d16-4deb-8b35-7236ee721e96 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.191199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-38297ae2-1179-45ff-8c89-e229db8f7573 req-138daf57-6d16-4deb-8b35-7236ee721e96 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.203124 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-38297ae2-1179-45ff-8c89-e229db8f7573 req-138daf57-6d16-4deb-8b35-7236ee721e96 service nova] Creating event network-vif-plugged:ef9d8492-9495-4cf7-8814-4429efe61e9a for instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd on n-h2-764486-11 Jul 20 05:08:08.207912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-38297ae2-1179-45ff-8c89-e229db8f7573 req-138daf57-6d16-4deb-8b35-7236ee721e96 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034513 Jul 20 05:08:08.208537 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4885/6010] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:08.488755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:08.489510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:08.496511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.496982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.497770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:08.498222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:08.632989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5361fafed2493f8b2242730db27743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a66d02c5914692af7d8c68d6618ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:08.641329 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-26e60f04-c1d9-4378-9818-f637c16f68c1 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 200 len: 1502 microversion: 2.1 time: 0.157325 Jul 20 05:08:08.641921 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4886/6011] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:08 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:09.217569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dba28ae5-da0b-43a8-a1d2-d03d74374c67 req-99d5bb77-f22f-4de9-b0c0-b2195b5382b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd", "name": "network-vif-deleted", "tag": "ef9d8492-9495-4cf7-8814-4429efe61e9a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:09.227656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dba28ae5-da0b-43a8-a1d2-d03d74374c67 req-99d5bb77-f22f-4de9-b0c0-b2195b5382b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.228112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dba28ae5-da0b-43a8-a1d2-d03d74374c67 req-99d5bb77-f22f-4de9-b0c0-b2195b5382b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.241271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dba28ae5-da0b-43a8-a1d2-d03d74374c67 req-99d5bb77-f22f-4de9-b0c0-b2195b5382b1 service nova] Creating event network-vif-deleted:ef9d8492-9495-4cf7-8814-4429efe61e9a for instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd on n-h2-764486-11 Jul 20 05:08:09.246807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dba28ae5-da0b-43a8-a1d2-d03d74374c67 req-99d5bb77-f22f-4de9-b0c0-b2195b5382b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Jul 20 05:08:09.248132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4887/6012] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:09.659728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:09.660460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:09.667340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.667801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.668602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.669046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.682334 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] HTTP exception thrown: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Request method failure captured: Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd HTTP/1.1 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi142JaWEfxrx0lcuimqmQczCzvn67-exA_ISyvUoIAfMacK_hJzGXtGTGVRdLuoyiyBvMEALpVRazm3jKDqJ_ooC-eWwcYtpGbg1WwL_OeHGz2cBgqXSiR_CqdSZ5e0-HuzSk66e3NOF-J_VVb5gXCkfKfBm1_VnX-s3dSBzt6sZDjNM Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 43a66d02c5914692af7d8c68d6618ff9 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_43a66d02c5914692af7d8c68d6618ff9", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 43a66d02c5914692af7d8c68d6618ff9 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1639823008-project Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8e5361fafed2493f8b2242730db27743 Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1639823008-project Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd'} Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:09.683958 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Returning 404 to user: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea560c3e-bb8a-486a-8fbc-e1428ab71ecf tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 404 len: 111 microversion: 2.1 time: 0.030013 Jul 20 05:08:09.692783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4888/6013] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:09 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:08:09.702199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:09.702891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:09.710777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.711242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.712026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.712503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.725719 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] HTTP exception thrown: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Request method failure captured: Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd HTTP/1.1 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi142JaWEfxrx0lcuimqmQczCzvn67-exA_ISyvUoIAfMacK_hJzGXtGTGVRdLuoyiyBvMEALpVRazm3jKDqJ_ooC-eWwcYtpGbg1WwL_OeHGz2cBgqXSiR_CqdSZ5e0-HuzSk66e3NOF-J_VVb5gXCkfKfBm1_VnX-s3dSBzt6sZDjNM Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 43a66d02c5914692af7d8c68d6618ff9 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_43a66d02c5914692af7d8c68d6618ff9", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 43a66d02c5914692af7d8c68d6618ff9 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1639823008-project Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8e5361fafed2493f8b2242730db27743 Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1639823008-project Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd'} Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:09.727272 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Returning 404 to user: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:09.732197 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df22bab0-7274-4881-9de8-7da7a57e972b tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 404 len: 111 microversion: 2.1 time: 0.031940 Jul 20 05:08:09.733242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4889/6014] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:08:09 2022] DELETE /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:09.737974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:09.738603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] [instance: 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:09.744786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.745197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.746006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:09.746455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:09.763605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] HTTP exception thrown: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Request method failure captured: Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd HTTP/1.1 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi142JaWEfxrx0lcuimqmQczCzvn67-exA_ISyvUoIAfMacK_hJzGXtGTGVRdLuoyiyBvMEALpVRazm3jKDqJ_ooC-eWwcYtpGbg1WwL_OeHGz2cBgqXSiR_CqdSZ5e0-HuzSk66e3NOF-J_VVb5gXCkfKfBm1_VnX-s3dSBzt6sZDjNM Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 43a66d02c5914692af7d8c68d6618ff9 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/43a66d02c5914692af7d8c68d6618ff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_43a66d02c5914692af7d8c68d6618ff9", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 43a66d02c5914692af7d8c68d6618ff9 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1639823008 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-DeleteServersTestJSON-1639823008-project Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 8e5361fafed2493f8b2242730db27743 Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-DeleteServersTestJSON-1639823008-project Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd'} Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:08:09.765107 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] Returning 404 to user: Instance 1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-22a69c9c-3afc-4115-9b70-d6f79fdc2321 tempest-DeleteServersTestJSON-1639823008 tempest-DeleteServersTestJSON-1639823008-project] 10.222.0.49 "GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd" status: 404 len: 111 microversion: 2.1 time: 0.032452 Jul 20 05:08:09.770410 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4890/6015] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:09 2022] GET /compute/v2.1/servers/1e6e4ace-00d4-48fb-9f8f-3de1feefb3cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:08:18.461236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-180656690", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "aff28185-a147-4e90-8455-c27c083fa138"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:18.479151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:18.535803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] validate_networks() for [('aff28185-a147-4e90-8455-c27c083fa138', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:08:18.940150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:08:18.940811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:08:18.941361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:08:18.941845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:08:18.942332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:08:18.970417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:18.971390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.972494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:18.973129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:18.992047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Getting quotas for project 073013f61d084f3bbe2d8e81ca9a63f2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:08:19.003246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Getting quotas for user 12738444bccd4706adafbb95b0f79798 and project 073013f61d084f3bbe2d8e81ca9a63f2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:08:19.017086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:08:19.019424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:08:19.067732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b684e98-912e-4e1d-8f62-dd5bf9cc006e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737014 Jul 20 05:08:19.068589 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4891/6016] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:08:19.083682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2fe18bf7-c41c-4a9e-aaef-5123c8e6b64e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:19.085157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2fe18bf7-c41c-4a9e-aaef-5123c8e6b64e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:19.154585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2fe18bf7-c41c-4a9e-aaef-5123c8e6b64e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:19.163606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2fe18bf7-c41c-4a9e-aaef-5123c8e6b64e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1217 microversion: 2.1 time: 0.088522 Jul 20 05:08:19.167336 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4892/6017] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:19 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:20.182196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:20.182857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:20.190503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.191042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.191828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:20.192281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:20.261169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:20.269598 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32106658-ce34-4262-a20d-8461454b9cc4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1275 microversion: 2.1 time: 0.092512 Jul 20 05:08:20.270191 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4893/6018] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:20 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:21.288601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:21.291424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:21.301971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.303633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.305544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.306085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.567819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:21.579203 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1090fa3b-d3e6-4d48-b1e9-50d674ae2a28 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1317 microversion: 2.1 time: 0.295438 Jul 20 05:08:21.580525 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4894/6019] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:21 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:21.585690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-00aad4a6-fc0d-401e-b3ce-4811d2b248be req-1c76887f-1a93-4835-b2a2-0e07e5b2fd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4159ce8b-604b-417d-9499-240ac915baa6", "tag": "557e3969-e83c-4dc5-ac35-1d807a4e998e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:21.595705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-00aad4a6-fc0d-401e-b3ce-4811d2b248be req-1c76887f-1a93-4835-b2a2-0e07e5b2fd15 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:21.596259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-00aad4a6-fc0d-401e-b3ce-4811d2b248be req-1c76887f-1a93-4835-b2a2-0e07e5b2fd15 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:21.609642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-00aad4a6-fc0d-401e-b3ce-4811d2b248be req-1c76887f-1a93-4835-b2a2-0e07e5b2fd15 service nova] Creating event network-changed:557e3969-e83c-4dc5-ac35-1d807a4e998e for instance 4159ce8b-604b-417d-9499-240ac915baa6 on n-h1-764486-11 Jul 20 05:08:21.616384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-00aad4a6-fc0d-401e-b3ce-4811d2b248be req-1c76887f-1a93-4835-b2a2-0e07e5b2fd15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033730 Jul 20 05:08:21.617334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4895/6020] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:08:22.597178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:22.597924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:22.604589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.605057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:22.605863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:22.606303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:22.744474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:22.752674 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ed3a37d-c1d8-40dc-aa79-580b18adf051 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1317 microversion: 2.1 time: 0.160511 Jul 20 05:08:22.753264 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4896/6021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:22 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:23.770821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:23.771538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:23.779617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:23.780073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:23.780883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:23.781327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:23.909184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:23.916689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4367aa4c-c918-41b0-9381-058216d35d73 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1317 microversion: 2.1 time: 0.149719 Jul 20 05:08:23.917270 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4897/6022] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:23 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:24.933862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:24.934517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:24.941656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.942117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:24.942894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:24.943379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:25.076253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:25.083662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a7a097e-daa6-4a30-9092-0fac0b341090 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1317 microversion: 2.1 time: 0.153701 Jul 20 05:08:25.084817 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4898/6023] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:24 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:26.101719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:26.102520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:26.109281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.109742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.110519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.110964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.244330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:26.252078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d9192d2a-e7e5-48c2-b2c8-a8f52e4ed556 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1317 microversion: 2.1 time: 0.155107 Jul 20 05:08:26.252707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4899/6024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:26 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:26.594673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5a58a6a2-1c66-4d56-a460-dc87404cbb8b req-48075fc6-5923-429b-84ff-f88db208380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4159ce8b-604b-417d-9499-240ac915baa6", "name": "network-vif-plugged", "status": "completed", "tag": "557e3969-e83c-4dc5-ac35-1d807a4e998e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:26.607046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a58a6a2-1c66-4d56-a460-dc87404cbb8b req-48075fc6-5923-429b-84ff-f88db208380d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:26.607515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5a58a6a2-1c66-4d56-a460-dc87404cbb8b req-48075fc6-5923-429b-84ff-f88db208380d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:26.619805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5a58a6a2-1c66-4d56-a460-dc87404cbb8b req-48075fc6-5923-429b-84ff-f88db208380d service nova] Creating event network-vif-plugged:557e3969-e83c-4dc5-ac35-1d807a4e998e for instance 4159ce8b-604b-417d-9499-240ac915baa6 on n-h1-764486-11 Jul 20 05:08:26.625517 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5a58a6a2-1c66-4d56-a460-dc87404cbb8b req-48075fc6-5923-429b-84ff-f88db208380d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Jul 20 05:08:26.626140 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4900/6025] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:08:27.269123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:27.269829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:27.276972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.277511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:27.278478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:27.278923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:27.407439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:27.415388 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d10b904-a669-46a3-a0ea-20796d0fbd15 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1317 microversion: 2.1 time: 0.150605 Jul 20 05:08:27.415953 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4901/6026] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:27 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:28.432501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:28.433118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:28.439961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.440459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.441233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.441680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.569541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:28.577169 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6fa2955e-3ade-4780-8645-b32563891017 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1507 microversion: 2.1 time: 0.148944 Jul 20 05:08:28.577740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4902/6027] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:28 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:28.593563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:28.594182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:28.600119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.600615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.601401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.601848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.735217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:28.742989 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-51601e82-0421-440c-a54a-e80095186879 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1507 microversion: 2.1 time: 0.153063 Jul 20 05:08:28.743569 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4903/6028] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:28 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:28.759123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:28.760243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:28.766269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.766726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.767493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.767934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.835994 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-623bc18a-25c2-43c9-be20-1452d33d4950 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "PUT /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1079 microversion: 2.1 time: 0.081113 Jul 20 05:08:28.836655 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4904/6029] 10.222.0.49 () {60 vars in 1255 bytes} [Wed Jul 20 05:08:28 2022] PUT /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:28.850245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:28.850833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:28.857306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.857772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.858552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:28.859001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:28.981567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:28.986299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:28.994612 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63580816-7276-4db4-bb6a-cf1675387aea tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1505 microversion: 2.1 time: 0.148137 Jul 20 05:08:28.995175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4905/6030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:28 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:29.010389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:29.011007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:29.016817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.017280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.018072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.018522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.148228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:29.155773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60f6b785-4133-4bd0-a60a-e5204e5a1618 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1505 microversion: 2.1 time: 0.149518 Jul 20 05:08:29.156337 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4906/6031] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:29 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:29.171266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:08:29.172249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:29.173965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:29.179958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.180434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.181207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.181649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.185842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:29.210653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:29.216433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:08:29.222550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:08:29.222981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:08:29.223461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:08:29.223874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:08:29.224290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:08:29.285303 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4bf96b5-8120-4108-89c1-7d1ceb930397 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6/action" status: 202 len: 0 microversion: 2.1 time: 0.117523 Jul 20 05:08:29.286209 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4907/6032] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:08:29 2022] POST /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:08:29.294702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:29.295332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:29.301464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.301933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.302854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:29.304049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:29.440025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:29.447711 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11dc281d-8fe7-4cee-8630-15e336f5be1d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1516 microversion: 2.1 time: 0.156750 Jul 20 05:08:29.448289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4908/6033] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:29 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:30.465405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:30.466052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:30.473201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.473663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.474433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:30.474878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:30.609146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:30.617320 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2aab7a76-e0f9-4589-a8ea-e191ad1d680b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1516 microversion: 2.1 time: 0.155865 Jul 20 05:08:30.617900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4909/6034] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:30 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:31.635063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:31.635728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:31.642647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.643116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.643893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:31.644398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:31.782073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:31.789755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f4a8ed88-9552-41f2-8a4b-5f593396d759 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.159127 Jul 20 05:08:31.790345 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4910/6035] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:31 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:08:32.808045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:32.808732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:32.815698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.816164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.816973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:32.817426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:32.946233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:32.953958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0fffd02f-22e9-4326-9741-7465929b296e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.150047 Jul 20 05:08:32.954470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4911/6036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:32 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:33.970884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:33.971523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:33.979135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.979592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:33.980387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:33.980829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:34.113030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:34.120698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b856ddd-159c-4294-befd-0292c67dad8f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.153687 Jul 20 05:08:34.121281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4912/6037] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:33 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:35.138479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:35.139163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:35.146056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.146511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.147280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:35.147722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:35.276684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:35.284105 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2f0f1dc-dcf4-4f94-98cf-c2b7f4a87f22 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.149618 Jul 20 05:08:35.284710 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4913/6038] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:35 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:36.301773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:36.302582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:36.310244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.310708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.311482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:36.311930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:36.440311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:36.447875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb87ca77-94e1-4bec-a67c-f94df3172d1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.150046 Jul 20 05:08:36.448470 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4914/6039] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:36 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:37.465583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:37.466290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:37.473187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.473647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:37.474429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:37.474875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:37.605003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:37.612464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e442dc51-a8cb-40fb-8244-4fac2fb1c312 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.151352 Jul 20 05:08:37.613035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4915/6040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:37 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:38.629994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:38.630653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:38.637544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:38.638003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:38.638786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:38.639240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:38.779519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:38.787279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c237133a-4841-4007-b035-93954f728df4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.161241 Jul 20 05:08:38.787910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4916/6041] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:38 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:39.805159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:39.805786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:39.812830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.813294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.814083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:39.814534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:39.947546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:39.955391 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbe48802-6d52-4cfa-9747-af6ec749d516 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.155170 Jul 20 05:08:39.955973 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4917/6042] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:39 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:40.972833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:40.973512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:40.980734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.981196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:40.981966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:40.982546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:41.112745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:41.120119 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e359ac61-b7af-49bf-b3a8-bf617799b7af tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.151222 Jul 20 05:08:41.120724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4918/6043] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:40 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:42.138624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:42.139378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:42.146121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.146581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.147350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:42.147794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:42.277884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:42.285491 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8feb81f-faad-4c38-ae66-2e74f9b559d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.150921 Jul 20 05:08:42.286069 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4919/6044] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:42 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:43.302601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:43.303291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:43.310425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.310885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.311659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:43.312108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:43.443386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:43.451377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02058bf0-6a8f-47b3-bd79-7cd2768b9a67 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.152709 Jul 20 05:08:43.451959 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4920/6045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:43 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:44.469389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:44.470081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:44.476970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:44.477430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:44.478198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:44.478645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:44.609945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:44.618145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68f8eeb3-8661-417c-8bd7-fcdd5d707828 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.152194 Jul 20 05:08:44.618701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4921/6046] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:44 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:45.635568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:45.636302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:45.643167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.643625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.644428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:45.644874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:45.666406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:45.785701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:45.793412 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78d211ba-6703-4c9e-8ad5-769a0e1109f8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.162216 Jul 20 05:08:45.793999 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4922/6047] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:45 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:46.812318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:46.812995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:46.819035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:46.819492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.820778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:46.821226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:46.948429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:46.956340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bca890ad-7db1-45d1-9621-cb5ea2e461df tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.148209 Jul 20 05:08:46.956874 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4923/6048] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:46 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:47.974591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:47.975264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:47.982223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.982685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:47.983455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:47.983897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:48.116426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:48.124650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d617363d-4781-495a-a7d5-9ebff98f47ae tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.153997 Jul 20 05:08:48.125236 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4924/6049] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:47 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:49.142181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:49.142880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:49.145525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:08:49.151437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.151896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.152693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:49.153140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:49.281804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:49.289189 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1ad080d-aed8-4b25-8242-3b63eec5a834 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.150905 Jul 20 05:08:49.289757 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4925/6050] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:49 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:50.306538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:50.307237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:50.314168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.314626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.315393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:50.315836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:50.444237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:50.451805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-08055c43-29eb-4420-9545-dd093f708410 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.149522 Jul 20 05:08:50.452402 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4926/6051] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:50 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:51.469410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:51.470112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:51.477447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.477907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.478675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:51.479120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:51.611714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:51.619678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d29e562d-df63-472d-8217-3cb4afd92d6e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.154238 Jul 20 05:08:51.620252 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4927/6052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:51 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:52.637234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:52.637932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:52.644824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.645290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.646060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:52.646505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:52.775988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:52.783714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-530c1447-8df4-40df-9aca-b1af9305921d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.151033 Jul 20 05:08:52.784295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4928/6053] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:52 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:53.799829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:53.800499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:53.808236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.808847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.809622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:53.810067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:53.943360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:53.950824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2965dfb-0a21-4fee-9f70-c9c31d9b42e9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.154887 Jul 20 05:08:53.951416 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4929/6054] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:53 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:54.968121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:54.968812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:54.975611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.976070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:54.976875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:54.977320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:55.107118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:55.114666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cd40100-694e-4c05-aa19-808806af0ab0 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.150470 Jul 20 05:08:55.115250 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4930/6055] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:54 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:56.132245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:56.132938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:56.139696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:56.140159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:56.140975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:56.141426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:56.271065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:56.279746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-70c86ef2-f02e-4329-bd76-3782973dbb2f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.151463 Jul 20 05:08:56.280323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4931/6056] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:56 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:57.296661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:57.297369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:57.304562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.305028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.306295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:57.306743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:57.441131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:57.449289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da87e3b4-a48c-4f1b-8183-d4027135f0e4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.156561 Jul 20 05:08:57.449864 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4932/6057] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:57 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:58.467446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:58.468144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:58.475022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:58.475480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:58.476250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:58.476718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:58.603528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:58.611019 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc56efff-6666-457d-977d-4638c4a219e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.147618 Jul 20 05:08:58.611583 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4933/6058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:58 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:08:59.628142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:08:59.628856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:08:59.635900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:59.636376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:59.637164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:08:59.637622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:08:59.771210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:08:59.780040 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84575785-4061-4fbb-aea1-f0c93ab5e96d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.155661 Jul 20 05:08:59.780570 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4934/6059] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:08:59 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:00.797017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:00.797626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:00.804921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:00.805381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:00.806778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:00.807221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:00.941828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:00.949434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0709028-ac5b-4bb0-9651-72d9fe14eb4f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.156283 Jul 20 05:09:00.950020 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4935/6060] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:00 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:01.966523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:01.967201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:01.974049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.974511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:01.975280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:01.975723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:02.107478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:02.115074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a4630bbe-c6a7-42c5-bb7d-f2bb097fd711 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.152476 Jul 20 05:09:02.115639 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4936/6061] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:01 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:03.132641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:03.133337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:03.140635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:03.141093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:03.141864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:03.142308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:03.269440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:03.277590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6649219-39fb-4115-94d4-6282640e0630 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1521 microversion: 2.1 time: 0.148921 Jul 20 05:09:03.278175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4937/6062] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:03 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:03.891108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-21d73f44-8571-4e16-aab8-7cfc32dc7087 req-cf747b9f-1ad1-42b8-b01b-34abe074d4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4159ce8b-604b-417d-9499-240ac915baa6", "name": "network-vif-unplugged", "status": "completed", "tag": "557e3969-e83c-4dc5-ac35-1d807a4e998e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:03.899380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-21d73f44-8571-4e16-aab8-7cfc32dc7087 req-cf747b9f-1ad1-42b8-b01b-34abe074d4e6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:03.899843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-21d73f44-8571-4e16-aab8-7cfc32dc7087 req-cf747b9f-1ad1-42b8-b01b-34abe074d4e6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:03.911749 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-21d73f44-8571-4e16-aab8-7cfc32dc7087 req-cf747b9f-1ad1-42b8-b01b-34abe074d4e6 service nova] Creating event network-vif-unplugged:557e3969-e83c-4dc5-ac35-1d807a4e998e for instance 4159ce8b-604b-417d-9499-240ac915baa6 on n-h2-764486-11 Jul 20 05:09:03.917815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-21d73f44-8571-4e16-aab8-7cfc32dc7087 req-cf747b9f-1ad1-42b8-b01b-34abe074d4e6 service nova] Instance 4159ce8b-604b-417d-9499-240ac915baa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:03.928606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-21d73f44-8571-4e16-aab8-7cfc32dc7087 req-cf747b9f-1ad1-42b8-b01b-34abe074d4e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041322 Jul 20 05:09:03.929471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4938/6063] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:04.296599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:04.297367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:04.304492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:04.304959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:04.305802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:04.306255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:04.326753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:04.452863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:04.460311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8e500e86-b9bc-4462-8c1c-8b29e2c7e6f9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1520 microversion: 2.1 time: 0.168928 Jul 20 05:09:04.460918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4939/6064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:04 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:05.479005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:05.479696 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:05.486884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:05.487344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:05.488113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:05.488590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:05.621914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:05.629673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e48d225-4893-4ad2-b60b-d7d597b2e4bb tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1518 microversion: 2.1 time: 0.155075 Jul 20 05:09:05.630257 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4940/6065] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:05 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:05.947128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b8f5f013-e103-4c97-ae18-d42e3c71992c req-cba125f7-dc7c-4194-adc4-a6d1aa80b798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4159ce8b-604b-417d-9499-240ac915baa6", "tag": "557e3969-e83c-4dc5-ac35-1d807a4e998e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:05.955152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8f5f013-e103-4c97-ae18-d42e3c71992c req-cba125f7-dc7c-4194-adc4-a6d1aa80b798 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:05.955605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8f5f013-e103-4c97-ae18-d42e3c71992c req-cba125f7-dc7c-4194-adc4-a6d1aa80b798 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:05.967603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b8f5f013-e103-4c97-ae18-d42e3c71992c req-cba125f7-dc7c-4194-adc4-a6d1aa80b798 service nova] Creating event network-changed:557e3969-e83c-4dc5-ac35-1d807a4e998e for instance 4159ce8b-604b-417d-9499-240ac915baa6 on n-h2-764486-11 Jul 20 05:09:05.972887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-b8f5f013-e103-4c97-ae18-d42e3c71992c req-cba125f7-dc7c-4194-adc4-a6d1aa80b798 service nova] Instance 4159ce8b-604b-417d-9499-240ac915baa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:05.983441 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b8f5f013-e103-4c97-ae18-d42e3c71992c req-cba125f7-dc7c-4194-adc4-a6d1aa80b798 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040583 Jul 20 05:09:05.984026 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4941/6066] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:06.648823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.649655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.655941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.656429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.657213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.657663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.802330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:06.811212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-df802171-ceca-4e07-ba91-234f8c661658 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1515 microversion: 2.1 time: 0.167458 Jul 20 05:09:06.811724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4942/6067] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:06.827260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:06.827818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.834013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.834480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.835271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.835726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.902196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b986f4cc-d997-45d5-95f3-cb77fdda7f01 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6/action" status: 204 len: 0 microversion: 2.1 time: 0.078682 Jul 20 05:09:06.902868 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4943/6068] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:06 2022] POST /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:09:06.911427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:06.912140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:06.918990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.919436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:06.920255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:06.920878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:07.110152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:07.117912 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ff26314-28d1-4d6d-a89b-a78d427a9c71 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1515 microversion: 2.1 time: 0.210539 Jul 20 05:09:07.118484 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4944/6069] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:06 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:08.136078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:08.136878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:08.144412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.145156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.146144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.146783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.290844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:08.301008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a74fa268-1c99-43d6-84cf-9d9a4cf20155 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1507 microversion: 2.1 time: 0.169635 Jul 20 05:09:08.302263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4945/6070] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:08 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:08.319122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:08.319752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:08.326899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.327365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.328159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.328637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.463257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:08.471373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2b5c385-3d44-46ef-8673-6c74f23198ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1507 microversion: 2.1 time: 0.156187 Jul 20 05:09:08.471940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4946/6071] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:08 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:08.476407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-818fe1bd-2416-4410-8e7e-2fe087a50707 req-98743beb-3ca1-4a1e-a0ea-5380a82f5500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4159ce8b-604b-417d-9499-240ac915baa6", "name": "network-vif-plugged", "status": "completed", "tag": "557e3969-e83c-4dc5-ac35-1d807a4e998e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:08.484748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-818fe1bd-2416-4410-8e7e-2fe087a50707 req-98743beb-3ca1-4a1e-a0ea-5380a82f5500 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:08.485205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-818fe1bd-2416-4410-8e7e-2fe087a50707 req-98743beb-3ca1-4a1e-a0ea-5380a82f5500 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:08.497290 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-818fe1bd-2416-4410-8e7e-2fe087a50707 req-98743beb-3ca1-4a1e-a0ea-5380a82f5500 service nova] Creating event network-vif-plugged:557e3969-e83c-4dc5-ac35-1d807a4e998e for instance 4159ce8b-604b-417d-9499-240ac915baa6 on n-h2-764486-11 Jul 20 05:09:08.502332 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-818fe1bd-2416-4410-8e7e-2fe087a50707 req-98743beb-3ca1-4a1e-a0ea-5380a82f5500 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029138 Jul 20 05:09:08.503193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4947/6072] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:08.509297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c14e686-8c2f-4f6b-8a2d-0beeb6d247ec tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'create', calling method: .version_select at 0x7f8389f62670>, body: {"keypair": {"name": "tempest-keypair-1471959119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLETDNKoPpCto7I2pbZDm0r3jHytpWGvSg/8Q+Be88okMKJyMqclPDxJDeU7OezKBZnYJjScjFr5lOR9ypltdLF8UhSFJJyZspVVu/4169NOu58b20kw/QV8wJkemiUnKw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:08.523427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6c14e686-8c2f-4f6b-8a2d-0beeb6d247ec tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Getting quotas for project 073013f61d084f3bbe2d8e81ca9a63f2. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:08.530710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-6c14e686-8c2f-4f6b-8a2d-0beeb6d247ec tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Getting quotas for user 12738444bccd4706adafbb95b0f79798 and project 073013f61d084f3bbe2d8e81ca9a63f2. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:08.556673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c14e686-8c2f-4f6b-8a2d-0beeb6d247ec tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051978 Jul 20 05:09:08.557269 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4948/6073] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:09:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:10.079050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:10.079790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:10.086463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.086922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.088225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.088694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.223777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:10.232129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec2418c5-54ee-4ac1-a305-a3b84b76eb6d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 200 len: 1507 microversion: 2.1 time: 0.157929 Jul 20 05:09:10.232744 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4949/6074] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:10 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:10.247642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:10.248151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:10.254066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.254538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.255318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.255766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.282753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:10.356410 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da451868-1026-43a6-8bef-873b3632dab1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 204 len: 0 microversion: 2.1 time: 0.112016 Jul 20 05:09:10.357010 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4950/6075] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:10 2022] DELETE /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:09:10.413184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1314501343", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "aff28185-a147-4e90-8455-c27c083fa138"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:10.465577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] validate_networks() for [('aff28185-a147-4e90-8455-c27c083fa138', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:09:10.828804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:09:10.829251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:09:10.829742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:09:10.830163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:09:10.830587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:09:10.839688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.840149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.841003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:10.841453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:10.858011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Getting quotas for project 073013f61d084f3bbe2d8e81ca9a63f2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:09:10.863364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Getting quotas for user 12738444bccd4706adafbb95b0f79798 and project 073013f61d084f3bbe2d8e81ca9a63f2. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:09:10.876198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:09:10.878587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:09:10.923880 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-959694c4-06a1-416b-9b53-41dd34a2ccb7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514987 Jul 20 05:09:10.924623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4951/6076] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:09:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:09:10.935256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e9d6c4a-fabc-4a20-85a0-111b19c56528 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:10.935875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e9d6c4a-fabc-4a20-85a0-111b19c56528 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:10.989683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e9d6c4a-fabc-4a20-85a0-111b19c56528 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:10.997745 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e9d6c4a-fabc-4a20-85a0-111b19c56528 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1218 microversion: 2.1 time: 0.066703 Jul 20 05:09:10.998323 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4952/6077] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:10 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:12.016568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:12.017969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:12.027290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:12.028133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:12.029239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:12.029925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:12.110092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:12.123490 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aae11420-c153-42ff-8924-7abc2f76752b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1270 microversion: 2.1 time: 0.111746 Jul 20 05:09:12.124134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4953/6078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:12 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:12.388302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a8368ce5-84bc-4eb5-9b82-b24f76dfd525 req-baa8271d-0211-4123-8abb-5163d0eff648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4159ce8b-604b-417d-9499-240ac915baa6", "name": "network-vif-deleted", "tag": "557e3969-e83c-4dc5-ac35-1d807a4e998e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:12.398570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a8368ce5-84bc-4eb5-9b82-b24f76dfd525 req-baa8271d-0211-4123-8abb-5163d0eff648 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:12.399044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a8368ce5-84bc-4eb5-9b82-b24f76dfd525 req-baa8271d-0211-4123-8abb-5163d0eff648 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:12.413574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a8368ce5-84bc-4eb5-9b82-b24f76dfd525 req-baa8271d-0211-4123-8abb-5163d0eff648 service nova] Creating event network-vif-deleted:557e3969-e83c-4dc5-ac35-1d807a4e998e for instance 4159ce8b-604b-417d-9499-240ac915baa6 on n-h2-764486-11 Jul 20 05:09:12.421816 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a8368ce5-84bc-4eb5-9b82-b24f76dfd525 req-baa8271d-0211-4123-8abb-5163d0eff648 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037574 Jul 20 05:09:12.422910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4954/6079] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:13.142754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:13.143572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:13.150010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:13.151023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:13.151810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:13.152273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:13.301564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:13.310294 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10943902-a538-4e32-b722-808a8260ed1f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1318 microversion: 2.1 time: 0.172643 Jul 20 05:09:13.311156 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4955/6080] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:13 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:14.327623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:14.328244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:14.335035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:14.335493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:14.336287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:14.336769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:14.470989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:14.479052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee1a2c8e-3530-4636-9ca3-62853f3b381f tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1318 microversion: 2.1 time: 0.154994 Jul 20 05:09:14.479620 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4956/6081] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:14 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:14.484955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d4018815-f1d9-4e90-af75-0ba6206f4872 req-4de03310-f3c3-430a-9957-c6b44e91af4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6ec598-c144-42e2-a0f6-7c07db89e859", "tag": "24d3a8aa-d7be-4330-a631-23ff5f7ddea1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:14.492930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d4018815-f1d9-4e90-af75-0ba6206f4872 req-4de03310-f3c3-430a-9957-c6b44e91af4c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:14.493396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d4018815-f1d9-4e90-af75-0ba6206f4872 req-4de03310-f3c3-430a-9957-c6b44e91af4c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:14.505194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d4018815-f1d9-4e90-af75-0ba6206f4872 req-4de03310-f3c3-430a-9957-c6b44e91af4c service nova] Creating event network-changed:24d3a8aa-d7be-4330-a631-23ff5f7ddea1 for instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 on n-h2-764486-11 Jul 20 05:09:14.510297 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d4018815-f1d9-4e90-af75-0ba6206f4872 req-4de03310-f3c3-430a-9957-c6b44e91af4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028741 Jul 20 05:09:14.510934 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4957/6082] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:15.497875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:15.498660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:15.504973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:15.505434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:15.506207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:15.506651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:15.524293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:15.649308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:15.657623 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1128bca2-0d05-43cc-a4d1-4d1d336ae8d3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1318 microversion: 2.1 time: 0.165368 Jul 20 05:09:15.658375 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4958/6083] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:15 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:16.675608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:16.676277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:16.678363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:16.685612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:16.686073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:16.686854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:16.687297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:16.820730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:16.828752 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8bea4f43-1c3e-4a60-83b7-83d154db0082 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1318 microversion: 2.1 time: 0.156987 Jul 20 05:09:16.829352 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4959/6084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:16 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:17.851510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:17.852224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:17.859549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:17.860008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:17.860820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:17.861264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:17.990907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:17.999014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1efb3b43-be77-4847-9ccf-8a9ff89725e8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1318 microversion: 2.1 time: 0.151466 Jul 20 05:09:17.999654 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4960/6085] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:17 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:18.501728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b7ea146a-fba5-4dd4-9e89-e35cee3fd30f req-dfda7203-c967-4f97-a6c5-aacbd382b582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ec598-c144-42e2-a0f6-7c07db89e859", "name": "network-vif-plugged", "status": "completed", "tag": "24d3a8aa-d7be-4330-a631-23ff5f7ddea1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:18.510828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b7ea146a-fba5-4dd4-9e89-e35cee3fd30f req-dfda7203-c967-4f97-a6c5-aacbd382b582 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:18.511410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b7ea146a-fba5-4dd4-9e89-e35cee3fd30f req-dfda7203-c967-4f97-a6c5-aacbd382b582 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:18.523297 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b7ea146a-fba5-4dd4-9e89-e35cee3fd30f req-dfda7203-c967-4f97-a6c5-aacbd382b582 service nova] Creating event network-vif-plugged:24d3a8aa-d7be-4330-a631-23ff5f7ddea1 for instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 on n-h2-764486-11 Jul 20 05:09:18.528838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b7ea146a-fba5-4dd4-9e89-e35cee3fd30f req-dfda7203-c967-4f97-a6c5-aacbd382b582 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030910 Jul 20 05:09:18.529435 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4961/6086] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:19.016324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:19.017095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:19.024360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:19.024846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:19.025667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:19.026249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:19.160802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:19.168224 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb3b5cca-3209-493a-b7a8-4cfe4e94f70e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1318 microversion: 2.1 time: 0.156298 Jul 20 05:09:19.168826 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4962/6087] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:19 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:20.186412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:20.187069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:20.194186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.194664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.195454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.195912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.323466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:20.331109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-624428d2-cd84-49ab-9d76-d8536b9ee729 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1508 microversion: 2.1 time: 0.149427 Jul 20 05:09:20.331686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4963/6088] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:20 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:20.346879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:20.347500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:20.353295 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.353762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.355159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.355619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.486427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:20.494076 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a5752f0-9ef9-4432-9254-2ba946bd96e3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1508 microversion: 2.1 time: 0.150764 Jul 20 05:09:20.494653 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4964/6089] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:20 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:20.510157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:20.511141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:20.517147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.517612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.518393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.518844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.550331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:20.556550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:09:20.562776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:09:20.563218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:09:20.563709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:09:20.564133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:09:20.564584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:09:20.628109 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-998ae004-72a0-41df-8fda-c5692e581eb3 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859/action" status: 202 len: 0 microversion: 2.1 time: 0.121395 Jul 20 05:09:20.628977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4965/6090] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:20 2022] POST /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:09:20.636678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:20.637305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:20.643513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.643979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.644813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:20.645267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:20.778617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:20.786554 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10750f33-4863-4ba7-9e90-ae220ba166ce tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1515 microversion: 2.1 time: 0.153455 Jul 20 05:09:20.787209 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4966/6091] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:20 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:21.804878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:21.805586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:21.808445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:21.809738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:21.817061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:21.817529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:21.818335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:21.818782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:21.953584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:21.961490 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c54ad7a-4e70-4d2b-bbb0-6f7dc13057dc tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1515 microversion: 2.1 time: 0.161822 Jul 20 05:09:21.962093 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4967/6092] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:21 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:22.978711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:22.979384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:22.987016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:22.987617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:22.988505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:22.988997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:23.131692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:23.140422 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eb8a7c70-1c99-4c62-88ac-68d43f5430b5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.165698 Jul 20 05:09:23.141012 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4968/6093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:22 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:24.158447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:24.159099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:24.166078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:24.166542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:24.167364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:24.167815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:24.300038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:24.308474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-06b96413-055e-4c0a-b902-7f380f4ad716 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.154021 Jul 20 05:09:24.309061 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4969/6094] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:24 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:25.326284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:25.326959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:25.333817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.334275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.335043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:25.335485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:25.468321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:25.475950 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6941cf1f-9c14-4087-b5ab-7027bb2d7885 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.153692 Jul 20 05:09:25.476564 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4970/6095] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:25 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:26.493219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:26.494206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:26.500926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.501424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.502206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:26.502655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:26.640208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:26.647874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7130ffdb-efd8-464e-8be7-d097b7f453c9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.158709 Jul 20 05:09:26.648471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4971/6096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:26 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:27.665269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:27.665964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:27.672889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:27.673360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:27.674142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:27.674591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:27.806920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:27.814582 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-540c186e-af69-4f59-8d6e-af93b8fc5f79 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.153244 Jul 20 05:09:27.815239 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4972/6097] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:27 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:28.832630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:28.833319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:28.840911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:28.841197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.841978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:28.842430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:28.976701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:28.985163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37a94bc9-1de9-4199-94ef-b8d3996b240a tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.157176 Jul 20 05:09:28.985684 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4973/6098] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:28 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:30.002690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:30.003357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:30.010245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:30.010736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:30.011510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:30.011960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:30.027323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:30.149130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:30.156707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-211ba648-0976-435c-a90d-7a4a4d7f2cb9 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.158038 Jul 20 05:09:30.157302 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4974/6099] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:29 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:31.174692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:31.175352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:31.183207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:31.183667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:31.184480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:31.184929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:31.322638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:31.331064 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8dd3f253-2304-499b-8894-3bd8ab8b8858 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.160372 Jul 20 05:09:31.331641 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4975/6100] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:31 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:32.348451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:32.349116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:32.356181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.356851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.357473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:32.357924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:32.486603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:32.495601 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0dd8cc10-027e-479c-bd2c-a3cea7335132 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.151157 Jul 20 05:09:32.496183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4976/6101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:32 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:33.512597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:33.513328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:33.520455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.520921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.521743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:33.522169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:33.660512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:33.668100 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cd05a6f9-16e6-42d4-b127-0dbb936bf31c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.159436 Jul 20 05:09:33.668710 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4977/6102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:33 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:34.686713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:34.687379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:34.694435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.694903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.695685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:34.696134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:34.827949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:34.835545 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be823620-3d8d-40d4-9621-731b618a9d27 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.154103 Jul 20 05:09:34.836116 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4978/6103] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:34 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:35.853245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:35.854169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:35.860882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.861337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.862114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:35.862556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:35.996959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:36.006162 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54380a72-e911-4b8d-a81f-d359612c1c39 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.156735 Jul 20 05:09:36.006681 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4979/6104] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:35 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:37.023890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:37.024606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:37.032446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:37.032912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:37.033729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:37.034175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:37.175645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:37.184114 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f5fc65f-5693-4a0b-a170-d9b2f35f64f6 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.164747 Jul 20 05:09:37.184731 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4980/6105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:37 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:38.201499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:38.202198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:38.209385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.209852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.210645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:38.211090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:38.349328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:38.357478 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0947552-d06b-491b-81d1-05596234adc2 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.159974 Jul 20 05:09:38.358061 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4981/6106] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:38 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:39.375376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:39.376059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:39.383087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.383558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:39.384337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:39.384811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:39.520084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:39.527652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5f12208-9d59-400c-9f77-9f4bf61a02f4 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.156250 Jul 20 05:09:39.528215 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4982/6107] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:39 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:40.544824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:40.545517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:40.552464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.552925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.553702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:40.554146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:40.693152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:40.701534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-027e1a0f-644a-4eab-bc68-9dede7b4a63b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.160690 Jul 20 05:09:40.702132 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4983/6108] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:40 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:41.718721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:41.719410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:41.726338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.726857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.727642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:41.728123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:41.861173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:41.868850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0b2c3cf-7edd-4ad5-8727-24c2f29fff7d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.154024 Jul 20 05:09:41.869441 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4984/6109] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:41 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:42.887671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:42.888403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:42.895361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:42.895809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:42.896623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:42.897073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:43.028679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:43.036200 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b63444c0-de59-4732-badb-e763990691fe tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.153027 Jul 20 05:09:43.036808 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4985/6110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:42 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:44.053804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:44.054463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:44.061760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:44.062220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:44.062997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:44.063442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:44.198906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:44.206741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-288f560d-5df8-439f-906f-136fcf3c2be7 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.156928 Jul 20 05:09:44.207335 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4986/6111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:44 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:45.225099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:45.225886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:45.233932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:45.234391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:45.235169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:45.235702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:45.378408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:45.385932 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69883d1c-907d-437c-ac7f-6c663faa034e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.165019 Jul 20 05:09:45.386514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4987/6112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:45 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:46.403406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:46.404064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:46.410323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:46.410790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:46.411575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:46.412024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:46.542120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:46.550824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25b8d8c0-c21d-4e4c-8331-18f0019519bf tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.151652 Jul 20 05:09:46.551415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4988/6113] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:46 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:47.568874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:47.569579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:47.572155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=64 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:47.578739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:47.579207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:47.579998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:47.580492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:47.716968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:47.724592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc08941d-89c6-4356-b659-11680fb178c5 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.159651 Jul 20 05:09:47.725172 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4989/6114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:47 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:48.742302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:48.742929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:48.750824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:48.751281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:48.752063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:48.752539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:48.885837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:48.893635 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0af3dc6-e5e3-43de-9e10-88060a08dd49 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1520 microversion: 2.1 time: 0.155220 Jul 20 05:09:48.894251 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4990/6115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:48 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:49.911237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:49.911888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:49.919924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:49.920038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:49.920849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:49.921737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:49.925182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:50.176377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:50.187697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f25dfc1f-f7b8-48a9-96f0-c6378dceb106 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1519 microversion: 2.1 time: 0.280536 Jul 20 05:09:50.197997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4991/6116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:49 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:50.277835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bf549d5c-97d2-4bc9-a833-a6044152e501 req-08c7f058-ca67-4730-9014-e176418d30d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ec598-c144-42e2-a0f6-7c07db89e859", "name": "network-vif-unplugged", "status": "completed", "tag": "24d3a8aa-d7be-4330-a631-23ff5f7ddea1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:50.286559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf549d5c-97d2-4bc9-a833-a6044152e501 req-08c7f058-ca67-4730-9014-e176418d30d0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:50.287017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bf549d5c-97d2-4bc9-a833-a6044152e501 req-08c7f058-ca67-4730-9014-e176418d30d0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:50.299944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bf549d5c-97d2-4bc9-a833-a6044152e501 req-08c7f058-ca67-4730-9014-e176418d30d0 service nova] Creating event network-vif-unplugged:24d3a8aa-d7be-4330-a631-23ff5f7ddea1 for instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 on n-h1-764486-11 Jul 20 05:09:50.306905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-bf549d5c-97d2-4bc9-a833-a6044152e501 req-08c7f058-ca67-4730-9014-e176418d30d0 service nova] Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:50.321373 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bf549d5c-97d2-4bc9-a833-a6044152e501 req-08c7f058-ca67-4730-9014-e176418d30d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131344 Jul 20 05:09:50.322496 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4992/6117] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:09:51.207234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:51.207962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:51.214889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:51.215342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:51.216125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:51.216598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:51.673632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:51.681585 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7cdef05d-04f5-4f62-a3d0-d20bb39b50b8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1517 microversion: 2.1 time: 0.479486 Jul 20 05:09:51.682227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4993/6118] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:51 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1517 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:52.336312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e2eee151-ebd6-4735-9e43-c500f99119d5 req-e16b54aa-7a49-4be2-988f-46b9057785e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6ec598-c144-42e2-a0f6-7c07db89e859", "tag": "24d3a8aa-d7be-4330-a631-23ff5f7ddea1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:52.345953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e2eee151-ebd6-4735-9e43-c500f99119d5 req-e16b54aa-7a49-4be2-988f-46b9057785e7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:52.346409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e2eee151-ebd6-4735-9e43-c500f99119d5 req-e16b54aa-7a49-4be2-988f-46b9057785e7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:52.358656 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e2eee151-ebd6-4735-9e43-c500f99119d5 req-e16b54aa-7a49-4be2-988f-46b9057785e7 service nova] Creating event network-changed:24d3a8aa-d7be-4330-a631-23ff5f7ddea1 for instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 on n-h1-764486-11 Jul 20 05:09:52.364076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-e2eee151-ebd6-4735-9e43-c500f99119d5 req-e16b54aa-7a49-4be2-988f-46b9057785e7 service nova] Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:09:52.374689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e2eee151-ebd6-4735-9e43-c500f99119d5 req-e16b54aa-7a49-4be2-988f-46b9057785e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042035 Jul 20 05:09:52.375301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4994/6119] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:52.700308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:52.701418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:52.708465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:52.708932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:52.709938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:52.710401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:52.946912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:52.955416 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c34a393-92df-4878-bd73-37fbc2ec043d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1514 microversion: 2.1 time: 0.259909 Jul 20 05:09:52.956017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4995/6120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:52 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:52.972980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:52.973652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:52.982356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:52.982833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:52.983640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:52.984092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:53.059388 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34b1bc64-5b57-4b74-b9c6-d34c2d198702 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "POST /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859/action" status: 204 len: 0 microversion: 2.1 time: 0.090553 Jul 20 05:09:53.060104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4996/6121] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:09:52 2022] POST /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:09:53.068707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:53.069427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:53.076849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:53.077325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:53.078145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:53.078594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:53.225229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:53.236491 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7c71e6f-02b2-4f7f-8095-8e103691f113 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1514 microversion: 2.1 time: 0.171660 Jul 20 05:09:53.237426 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4997/6122] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:53 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:09:54.255457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:54.257031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:54.264801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:54.265272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:54.266118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:54.267243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:54.415877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:54.424207 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d3e8b38c-2940-4c7a-9eb3-04f4df66c141 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1514 microversion: 2.1 time: 0.172560 Jul 20 05:09:54.424941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4998/6123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:54 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:55.442418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:55.443112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:55.450513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.450980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.451762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.452209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.585383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:55.593893 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68973431-7d2a-4225-8ae3-65c9c9bcfc09 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1506 microversion: 2.1 time: 0.155305 Jul 20 05:09:55.594526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 4999/6124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:55 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:55.609913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:55.610530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:55.616569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.617030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.617795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.618254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.751553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:55.759245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a7a84b60-2e17-4737-ba6e-b86d775b23de tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1506 microversion: 2.1 time: 0.153112 Jul 20 05:09:55.759814 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5000/6125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:55 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:55.776165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:55.777535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:55.783683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.784085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.784886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.785337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.912769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:55.920219 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5469d03-ae5a-4687-9674-c7627bd55785 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1506 microversion: 2.1 time: 0.148048 Jul 20 05:09:55.920823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5001/6126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:55 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:55.936362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:55.936877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:55.942843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.943306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.944114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:55.944585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:55.969668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:56.043451 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-038fd14f-67fc-48a1-96c2-3f915052ea4e tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 204 len: 0 microversion: 2.1 time: 0.110832 Jul 20 05:09:56.043969 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5002/6127] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:55 2022] DELETE /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:09:56.062447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:56.063045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:56.069114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:56.069582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:56.070359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:56.070808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:56.098695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:09:56.434242 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.compute.api [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Instance is already in deleting state, ignoring this request Jul 20 05:09:56.435063 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1da9ff65-32d4-4b0e-bd68-2be888b55707 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 204 len: 0 microversion: 2.1 time: 0.377435 Jul 20 05:09:56.435640 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5003/6128] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:56 2022] DELETE /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:09:56.443996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:56.444623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:56.451838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:56.452300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:56.453471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:56.453924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:56.457993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:09:56.589253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:56.597759 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4b6148f6-bdbd-47c0-a08c-010b484be9d8 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1512 microversion: 2.1 time: 0.157434 Jul 20 05:09:56.598340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5004/6129] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:56 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:57.048858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b411bd2b-f799-4092-831e-50fa281571d3 req-6df27b9c-f672-4db0-b425-d30009cc442f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ec598-c144-42e2-a0f6-7c07db89e859", "name": "network-vif-plugged", "status": "completed", "tag": "24d3a8aa-d7be-4330-a631-23ff5f7ddea1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:57.057829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b411bd2b-f799-4092-831e-50fa281571d3 req-6df27b9c-f672-4db0-b425-d30009cc442f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:57.058289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b411bd2b-f799-4092-831e-50fa281571d3 req-6df27b9c-f672-4db0-b425-d30009cc442f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:57.070321 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b411bd2b-f799-4092-831e-50fa281571d3 req-6df27b9c-f672-4db0-b425-d30009cc442f service nova] Creating event network-vif-plugged:24d3a8aa-d7be-4330-a631-23ff5f7ddea1 for instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 on n-h1-764486-11 Jul 20 05:09:57.076141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b411bd2b-f799-4092-831e-50fa281571d3 req-6df27b9c-f672-4db0-b425-d30009cc442f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030720 Jul 20 05:09:57.076981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5005/6130] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:57.616686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:57.617585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:57.624850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:57.625327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:57.626127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:57.626587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:57.824995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12738444bccd4706adafbb95b0f79798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073013f61d084f3bbe2d8e81ca9a63f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:09:57.832554 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-872b9bb3-8aef-42c8-9c1e-031da974649d tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 200 len: 1512 microversion: 2.1 time: 0.221064 Jul 20 05:09:57.833371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5006/6131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:57 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:09:57.935492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a6db9e38-8b2f-4c87-97f0-3ab274690106 req-1acecf78-20a1-42ee-a602-6bb2743650b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ec598-c144-42e2-a0f6-7c07db89e859", "name": "network-vif-deleted", "tag": "24d3a8aa-d7be-4330-a631-23ff5f7ddea1"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:09:57.943949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a6db9e38-8b2f-4c87-97f0-3ab274690106 req-1acecf78-20a1-42ee-a602-6bb2743650b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:57.944563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a6db9e38-8b2f-4c87-97f0-3ab274690106 req-1acecf78-20a1-42ee-a602-6bb2743650b1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:57.956849 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a6db9e38-8b2f-4c87-97f0-3ab274690106 req-1acecf78-20a1-42ee-a602-6bb2743650b1 service nova] Creating event network-vif-deleted:24d3a8aa-d7be-4330-a631-23ff5f7ddea1 for instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 on n-h1-764486-11 Jul 20 05:09:57.961909 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a6db9e38-8b2f-4c87-97f0-3ab274690106 req-1acecf78-20a1-42ee-a602-6bb2743650b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030817 Jul 20 05:09:57.962740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5007/6132] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:09:58.851586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:58.852287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 3d6ec598-c144-42e2-a0f6-7c07db89e859] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:58.858580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:58.859039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:58.859808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:58.860250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:58.873814 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] HTTP exception thrown: Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 could not be found. Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Request method failure captured: Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 HTTP/1.1 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi143CEapNhSCddjiI6IqEfDI31k2XrsCLe4BNVU6QcZJnAhYk2oIRO_ngHQN-J1Ok5AVfqVfDGLqQ5eL4jxHmREVlYEDf6n55Q5Zu-_8AAJHMpcWEFLf9NmM9bRbBFNVvR86To69ErgLmxRwFlsviVy2CmfegZv2RTVP_XzqH6fwxKFg Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 073013f61d084f3bbe2d8e81ca9a63f2 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_073013f61d084f3bbe2d8e81ca9a63f2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 073013f61d084f3bbe2d8e81ca9a63f2 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-461792078-project Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 12738444bccd4706adafbb95b0f79798 Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-461792078-project Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 could not be found. Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '3d6ec598-c144-42e2-a0f6-7c07db89e859'} Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 could not be found. Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 could not be found. Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:58.875472 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 could not be found. Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Returning 404 to user: Instance 3d6ec598-c144-42e2-a0f6-7c07db89e859 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d4e540c9-e932-4403-869f-42a92ebcf8f1 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859" status: 404 len: 111 microversion: 2.1 time: 0.030682 Jul 20 05:09:58.881377 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5008/6133] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:58 2022] GET /compute/v2.1/servers/3d6ec598-c144-42e2-a0f6-7c07db89e859 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:09:58.885383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2befc0e-3b34-4538-b669-63028f4b3f47 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '.version_select at 0x7f8389ef0670>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:58.904013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2befc0e-3b34-4538-b669-63028f4b3f47 tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471959119" status: 202 len: 0 microversion: 2.1 time: 0.022242 Jul 20 05:09:58.904599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5009/6134] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jul 20 05:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471959119 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:09:59.511026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:59.511540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:59.521386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.521852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.522637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.523083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.537104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] HTTP exception thrown: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Request method failure captured: Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 HTTP/1.1 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi143CEapNhSCddjiI6IqEfDI31k2XrsCLe4BNVU6QcZJnAhYk2oIRO_ngHQN-J1Ok5AVfqVfDGLqQ5eL4jxHmREVlYEDf6n55Q5Zu-_8AAJHMpcWEFLf9NmM9bRbBFNVvR86To69ErgLmxRwFlsviVy2CmfegZv2RTVP_XzqH6fwxKFg Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 073013f61d084f3bbe2d8e81ca9a63f2 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_073013f61d084f3bbe2d8e81ca9a63f2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 073013f61d084f3bbe2d8e81ca9a63f2 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-461792078-project Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 12738444bccd4706adafbb95b0f79798 Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-461792078-project Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4159ce8b-604b-417d-9499-240ac915baa6'} Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:59.538711 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Returning 404 to user: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ac1d343a-227a-4def-b887-7bbb83bb736c tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 404 len: 111 microversion: 2.1 time: 0.033163 Jul 20 05:09:59.544925 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5010/6135] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:09:59 2022] DELETE /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:09:59.548917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:09:59.549535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] [instance: 4159ce8b-604b-417d-9499-240ac915baa6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:09:59.555621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.556084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.557239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:09:59.557693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:09:59.571236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] HTTP exception thrown: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Request method failure captured: Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 HTTP/1.1 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi143CEapNhSCddjiI6IqEfDI31k2XrsCLe4BNVU6QcZJnAhYk2oIRO_ngHQN-J1Ok5AVfqVfDGLqQ5eL4jxHmREVlYEDf6n55Q5Zu-_8AAJHMpcWEFLf9NmM9bRbBFNVvR86To69ErgLmxRwFlsviVy2CmfegZv2RTVP_XzqH6fwxKFg Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 073013f61d084f3bbe2d8e81ca9a63f2 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/073013f61d084f3bbe2d8e81ca9a63f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_073013f61d084f3bbe2d8e81ca9a63f2", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 073013f61d084f3bbe2d8e81ca9a63f2 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-461792078 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerDiskConfigTestJSON-461792078-project Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 12738444bccd4706adafbb95b0f79798 Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerDiskConfigTestJSON-461792078-project Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '4159ce8b-604b-417d-9499-240ac915baa6'} Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:09:59.572849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] Returning 404 to user: Instance 4159ce8b-604b-417d-9499-240ac915baa6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-338e28da-4471-4437-8be8-256eccf39d4b tempest-ServerDiskConfigTestJSON-461792078 tempest-ServerDiskConfigTestJSON-461792078-project] 10.222.0.49 "GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6" status: 404 len: 111 microversion: 2.1 time: 0.028914 Jul 20 05:09:59.578175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5011/6136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:09:59 2022] GET /compute/v2.1/servers/4159ce8b-604b-417d-9499-240ac915baa6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:10:07.887960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9451fc78-2c5e-45ab-80ab-736c288d4279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'create', calling method: .version_select at 0x7f8389ff5550>, body: {"keypair": {"name": "tempest-keypair-84344834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp1IB91GRsc7wr8XWKNitj3FmvncAeU2u3tvVSoLt7KPhrFi7iChEaZGVO4Lpy8rMMucisOshBWDUaLvVL9iMgpPYot2g6GaF3mNNxJkPOdXDdisTD2noq0gxmW1uZEHQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:07.902508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9451fc78-2c5e-45ab-80ab-736c288d4279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:07.908318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-9451fc78-2c5e-45ab-80ab-736c288d4279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:07.936380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9451fc78-2c5e-45ab-80ab-736c288d4279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.175882 Jul 20 05:10:07.937000 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5012/6137] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:10:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:10:09.283582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1392764892", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32a91fe3-ebe0-42c0-823f-1cf96ac2611c"}], "security_groups": [{"name": "tempest-securitygroup--1956813352"}], "key_name": "tempest-keypair-84344834", "user_data": "}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:09.393293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] validate_networks() for [('32a91fe3-ebe0-42c0-823f-1cf96ac2611c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:10:09.562932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=20 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:09.769717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:10:09.770157 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:10:09.770646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:10:09.771063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:10:09.771665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:10:09.782585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:09.783325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:09.783858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:09.784304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:09.801630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:10:09.807127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:10:09.820001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:10:09.822310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:10:09.871655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e140f1d4-d14d-4cb2-9596-3a9f72cc46cb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.593731 Jul 20 05:10:09.872734 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5013/6138] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:10:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:10:09.885850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b01314f1-1254-496b-90e5-773cbc7223ce tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:09.886607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b01314f1-1254-496b-90e5-773cbc7223ce tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:09.955058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b01314f1-1254-496b-90e5-773cbc7223ce tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:09.966494 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b01314f1-1254-496b-90e5-773cbc7223ce tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1237 microversion: 2.1 time: 0.084042 Jul 20 05:10:09.967806 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5014/6139] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:09 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:10.983861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:10.984566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:10.999845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:11.002045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:11.003688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:11.004331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:11.120032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:11.129145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cf8e60e-cf9b-420d-b742-251e445dd481 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1289 microversion: 2.1 time: 0.149894 Jul 20 05:10:11.139271 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5015/6140] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:10 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:12.148988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:12.150685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:12.163420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:12.163893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:12.168528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:12.168528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:12.385565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:12.394170 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7535339-6fd6-4753-a3f6-5003537d22e3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.250555 Jul 20 05:10:12.395378 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5016/6141] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:12 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:10:12.988433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-02de41a6-96e5-4004-b7b4-36721b143558 req-01db4847-3b03-4a36-9379-eecef8860096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:12.999375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-02de41a6-96e5-4004-b7b4-36721b143558 req-01db4847-3b03-4a36-9379-eecef8860096 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:12.999892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-02de41a6-96e5-4004-b7b4-36721b143558 req-01db4847-3b03-4a36-9379-eecef8860096 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:13.013316 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-02de41a6-96e5-4004-b7b4-36721b143558 req-01db4847-3b03-4a36-9379-eecef8860096 service nova] Creating event network-changed:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h1-764486-11 Jul 20 05:10:13.019261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-02de41a6-96e5-4004-b7b4-36721b143558 req-01db4847-3b03-4a36-9379-eecef8860096 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039607 Jul 20 05:10:13.020960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5017/6142] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:10:13.412691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:13.413499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:13.420434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:13.420905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:13.421702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:13.422154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:13.562916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:13.570587 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d87d939f-4058-43d4-8ff7-4fd48fcbd851 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.163089 Jul 20 05:10:13.571164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5018/6143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:13 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:14.587230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:14.587949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:14.595081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:14.595556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:14.596340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:14.596844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:14.795399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:14.802910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb26f43d-b3c1-434e-bec2-5204a18fcac3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.219703 Jul 20 05:10:14.803491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5019/6144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:14 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:15.820755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:15.821467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:15.828830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:15.829294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:15.830078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:15.830528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:15.964127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:15.972785 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59b2c89a-51ab-4ad1-8b4e-70a481d1b1ae tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.155956 Jul 20 05:10:15.973360 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5020/6145] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:15 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:16.990292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:16.991052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:16.993169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:16.998873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:16.999331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.000125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:17.000600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:17.148654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:17.157524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b36d0700-8ffd-432b-95b7-b4c9d1722936 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.171615 Jul 20 05:10:17.158222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5021/6146] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:16 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:18.175186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:18.175861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:18.183093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:18.183564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:18.185031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:18.185515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:18.314021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:18.321547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49680206-7686-4012-a302-1fb84ce87e0e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.150478 Jul 20 05:10:18.322117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5022/6147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:18 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:19.120046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0d4a0ace-ddb8-45ad-8fb8-115ecc130ee1 req-250ab2f8-c037-4e92-bfed-b66b9b84267d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "name": "network-vif-plugged", "status": "completed", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:19.129178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0d4a0ace-ddb8-45ad-8fb8-115ecc130ee1 req-250ab2f8-c037-4e92-bfed-b66b9b84267d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:19.129676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0d4a0ace-ddb8-45ad-8fb8-115ecc130ee1 req-250ab2f8-c037-4e92-bfed-b66b9b84267d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:19.141943 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0d4a0ace-ddb8-45ad-8fb8-115ecc130ee1 req-250ab2f8-c037-4e92-bfed-b66b9b84267d service nova] Creating event network-vif-plugged:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h1-764486-11 Jul 20 05:10:19.146920 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0d4a0ace-ddb8-45ad-8fb8-115ecc130ee1 req-250ab2f8-c037-4e92-bfed-b66b9b84267d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Jul 20 05:10:19.147557 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5023/6148] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:10:19.338698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:19.339436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:19.346108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:19.346571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:19.347352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:19.347793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:19.486056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:19.493865 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30a24e92-487a-43a3-9e03-9d9a6023b6ff tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1363 microversion: 2.1 time: 0.160173 Jul 20 05:10:19.494518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5024/6149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:19 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:20.511107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:20.511808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:20.514330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:20.515053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:20.522211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.522682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.523469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.523926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.650652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:20.658167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-179117fd-37ac-44df-823c-069bb6a13a1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1550 microversion: 2.1 time: 0.150999 Jul 20 05:10:20.658748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5025/6150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:20 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:20.674158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:20.674552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:20.680810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.681272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.682042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:20.682485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:20.765025 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a345da8-8de8-46c6-acdd-b3279192476f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094726 Jul 20 05:10:20.765660 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5026/6151] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 05:10:20 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:10:21.693913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-33325bb2-6625-4970-bd5c-735be426a95a req-9982c5b0-ae5c-470b-9793-02bff50818c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:21.702537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-33325bb2-6625-4970-bd5c-735be426a95a req-9982c5b0-ae5c-470b-9793-02bff50818c7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:21.702992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-33325bb2-6625-4970-bd5c-735be426a95a req-9982c5b0-ae5c-470b-9793-02bff50818c7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:21.714307 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-33325bb2-6625-4970-bd5c-735be426a95a req-9982c5b0-ae5c-470b-9793-02bff50818c7 service nova] Creating event network-changed:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h1-764486-11 Jul 20 05:10:21.719875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-33325bb2-6625-4970-bd5c-735be426a95a req-9982c5b0-ae5c-470b-9793-02bff50818c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Jul 20 05:10:21.720507 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5027/6152] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:10:57.459852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=13 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:57.460670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=66 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:10:57.465176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:57.465908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:57.473474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.473947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.474732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.475189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.612031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:57.619554 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea19d16f-a4df-4381-8bb7-2d730bb4c27f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1668 microversion: 2.1 time: 0.162069 Jul 20 05:10:57.620137 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5028/6153] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:57 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:57.635058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:57.635668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:57.641957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.642415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.643192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.643636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.771772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:57.779924 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0025ac52-7c4b-486a-ba1e-236c3448886f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1668 microversion: 2.1 time: 0.147804 Jul 20 05:10:57.780517 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5029/6154] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:57 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:57.795453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:57.796070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:57.801932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.802401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.803175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.803622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.929880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:57.938251 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95fe9a9d-35b1-4cfd-97d3-44dba455c9df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1668 microversion: 2.1 time: 0.146477 Jul 20 05:10:57.938826 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5030/6155] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:57 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:57.955317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:10:57.956306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:57.962360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.962843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.963622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:57.964070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:57.991541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:57.997205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:10:58.003849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:10:58.004282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:10:58.004795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:10:58.005247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:10:58.005670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:10:58.068066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ba9cb72-15b5-4b75-94bd-aad26154d270 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e/action" status: 202 len: 0 microversion: 2.1 time: 0.117201 Jul 20 05:10:58.068755 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5031/6156] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:10:57 2022] POST /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:10:58.077187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:58.077814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:58.083883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:58.084372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:58.085166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:58.085618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:58.227612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:58.235972 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c4a71b8c-efa2-4b8b-8e9b-6a7d0ae97017 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1677 microversion: 2.1 time: 0.163042 Jul 20 05:10:58.236578 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5032/6157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:58 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:10:59.253340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:10:59.254023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:10:59.261162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.261626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.262416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:10:59.262864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:10:59.398423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:10:59.406739 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d547011-bb56-4df4-a0dc-8d37492464fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1677 microversion: 2.1 time: 0.157152 Jul 20 05:10:59.407115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5033/6158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:10:59 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:00.424342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:00.425073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:00.432123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:00.432624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:00.433405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:00.433856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:00.566200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:00.574007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f6d8cdbf-5964-44a0-bff1-aff48c669aa3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.154221 Jul 20 05:11:00.574586 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5034/6159] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:00 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:01.592318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:01.592998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:01.599763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.600225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:01.601036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:01.601488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:01.731083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:01.739478 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55198f9a-c402-41da-987a-24da5f0cf566 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.151128 Jul 20 05:11:01.740064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5035/6160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:01 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:02.756067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:02.756735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:02.764372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:02.764841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.765629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:02.766084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:02.892746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:02.900368 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b05ead4a-4368-45fd-a96f-103e3dffc865 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.148226 Jul 20 05:11:02.900957 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5036/6161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:02 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:03.917670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:03.918443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:03.925173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.925631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:03.926402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:03.926849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:04.057803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:04.066348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92595f9b-2584-41f4-b5e7-a2668e2813c8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.152639 Jul 20 05:11:04.066982 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5037/6162] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:03 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:05.084137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:05.084827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:05.091622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:05.092086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:05.093537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:05.093985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:05.223706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:05.231198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fa612e1-a81e-46d6-8f8f-ca92febc7106 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.151103 Jul 20 05:11:05.231773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5038/6163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:05 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:06.248170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:06.249365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:06.256181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.256672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.257444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:06.257889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:06.386061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:06.394322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73d13eb2-a45f-4677-aae6-1b747a2f2024 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.150132 Jul 20 05:11:06.394901 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5039/6164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:06 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:07.410993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:07.411702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:07.418535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:07.418992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:07.419758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:07.420200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:07.551396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:07.559261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b168882f-a354-45ff-b6af-fd6b2c9f28e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.152189 Jul 20 05:11:07.559837 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5040/6165] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:07 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:08.576293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:08.576967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:08.583836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:08.584299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:08.585097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:08.585546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:08.722960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:08.730934 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1026990-bf4e-4928-8ccf-5833469f382f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.158578 Jul 20 05:11:08.731524 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5041/6166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:08 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:09.751255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:09.752571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:09.759031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:09.759503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:09.760285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:09.760763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:09.896425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:09.904272 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d038b96-46c2-45af-ae39-65c2ad8de02e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.156995 Jul 20 05:11:09.904884 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5042/6167] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:09 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:10.921634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:10.922852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:10.929841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:10.930302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:10.931328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:10.931772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:10.935698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:11.061384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:11.068890 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ade96898-54ba-4c03-a83d-ee00fb0ebb7b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.151210 Jul 20 05:11:11.069472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5043/6168] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:10 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:12.086080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:12.086719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:12.093637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:12.094818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:12.095599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:12.096048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:12.233323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:12.241429 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9df44b5d-5eb1-44cf-83fb-b9524f1a5899 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.159169 Jul 20 05:11:12.242033 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5044/6169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:12 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:13.259655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:13.260482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:13.272072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:13.272902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:13.274331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:13.275059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:13.414079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:13.421652 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-915ed81f-992b-40fa-a50d-a976a5dc9363 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.166417 Jul 20 05:11:13.422730 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5045/6170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:13 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:14.439590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:14.440250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:14.447700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:14.448312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:14.449430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:14.449923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:14.583927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:14.591740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5da652e-cc05-45c6-bc1e-155acf7731af tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.156555 Jul 20 05:11:14.592465 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5046/6171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:14 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:15.610766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:15.611422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:15.618962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:15.619504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:15.620560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:15.621171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:15.752842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:15.760556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32dc96ec-3d01-4e94-b4f5-e858ea60c9ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.154187 Jul 20 05:11:15.766637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5047/6172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:15 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:16.780591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:16.781239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:16.787986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:16.788788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:16.789474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:16.789960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.341820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:17.349618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa7a92b7-615c-40f2-a47f-3bf271efa77c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1682 microversion: 2.1 time: 0.572935 Jul 20 05:11:17.350206 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5048/6173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:16 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1682 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:17.959115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-cecfdd7e-4fe7-40aa-9d02-b2b47b4dde89 req-1ccd9768-cb71-4a76-b5e7-d98334912ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "name": "network-vif-unplugged", "status": "completed", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:17.969362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cecfdd7e-4fe7-40aa-9d02-b2b47b4dde89 req-1ccd9768-cb71-4a76-b5e7-d98334912ec7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:17.970439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-cecfdd7e-4fe7-40aa-9d02-b2b47b4dde89 req-1ccd9768-cb71-4a76-b5e7-d98334912ec7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:17.983460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-cecfdd7e-4fe7-40aa-9d02-b2b47b4dde89 req-1ccd9768-cb71-4a76-b5e7-d98334912ec7 service nova] Creating event network-vif-unplugged:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h2-764486-11 Jul 20 05:11:17.989014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-cecfdd7e-4fe7-40aa-9d02-b2b47b4dde89 req-1ccd9768-cb71-4a76-b5e7-d98334912ec7 service nova] Instance 2c2d7066-9778-4b65-816f-e5889c562f7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:11:18.000105 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-cecfdd7e-4fe7-40aa-9d02-b2b47b4dde89 req-1ccd9768-cb71-4a76-b5e7-d98334912ec7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045037 Jul 20 05:11:18.001029 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5049/6174] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:18.369608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:18.370462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:18.378501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.379469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.380446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:18.381011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:18.525806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:18.536245 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9cd89091-694d-434d-a664-3d5e938e6b14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1681 microversion: 2.1 time: 0.170183 Jul 20 05:11:18.538415 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5050/6175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:18 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:19.557765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:19.558530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:19.565453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:19.565925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:19.566711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:19.567166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:19.703423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:19.711598 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-05687374-6597-4a5b-841e-861a21b26519 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1679 microversion: 2.1 time: 0.158302 Jul 20 05:11:19.712171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5051/6176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:19 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:20.017869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-92779c29-2613-4383-b1aa-67fdf2263c50 req-3da9fe83-d22a-4882-8549-2b6c72ae71e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:20.025891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-92779c29-2613-4383-b1aa-67fdf2263c50 req-3da9fe83-d22a-4882-8549-2b6c72ae71e1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.026356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-92779c29-2613-4383-b1aa-67fdf2263c50 req-3da9fe83-d22a-4882-8549-2b6c72ae71e1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.037997 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-92779c29-2613-4383-b1aa-67fdf2263c50 req-3da9fe83-d22a-4882-8549-2b6c72ae71e1 service nova] Creating event network-changed:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h2-764486-11 Jul 20 05:11:20.043481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-92779c29-2613-4383-b1aa-67fdf2263c50 req-3da9fe83-d22a-4882-8549-2b6c72ae71e1 service nova] Instance 2c2d7066-9778-4b65-816f-e5889c562f7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:11:20.054700 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-92779c29-2613-4383-b1aa-67fdf2263c50 req-3da9fe83-d22a-4882-8549-2b6c72ae71e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040743 Jul 20 05:11:20.055308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5052/6177] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:20.730499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:20.731127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:20.737574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.738046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.738862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:20.739320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:20.877762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:20.886563 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b369797a-c830-4e20-8f56-482ca418e617 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1679 microversion: 2.1 time: 0.161337 Jul 20 05:11:20.887141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5053/6178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:20 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:21.904096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:21.904783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:21.912179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:21.912677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:21.913450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:21.913899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.043471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:22.051655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88c8aed4-61d2-4438-9df0-664e973a96fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1676 microversion: 2.1 time: 0.151699 Jul 20 05:11:22.052235 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5054/6179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:21 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:22.067957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:22.068537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:22.074329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.074788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.075563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.076016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.135867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba7a258b-d27c-444a-b56d-eb22cc5a1d77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e/action" status: 204 len: 0 microversion: 2.1 time: 0.070712 Jul 20 05:11:22.136634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5055/6180] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:11:22 2022] POST /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:11:22.146056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:22.146764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:22.153642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.154183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.154997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:22.155453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:22.376652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:22.385115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74e54d66-6f63-495c-bc8d-7209f56e5653 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1676 microversion: 2.1 time: 0.243371 Jul 20 05:11:22.385717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5056/6181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:22 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:23.114502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2be8c6e3-c455-421b-a22b-23383273d48f req-d4b362b8-f2e9-4fc2-92db-bdbc90f075f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "name": "network-vif-plugged", "status": "completed", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:23.123728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2be8c6e3-c455-421b-a22b-23383273d48f req-d4b362b8-f2e9-4fc2-92db-bdbc90f075f1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.124234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2be8c6e3-c455-421b-a22b-23383273d48f req-d4b362b8-f2e9-4fc2-92db-bdbc90f075f1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.139016 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2be8c6e3-c455-421b-a22b-23383273d48f req-d4b362b8-f2e9-4fc2-92db-bdbc90f075f1 service nova] Creating event network-vif-plugged:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h2-764486-11 Jul 20 05:11:23.144529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-2be8c6e3-c455-421b-a22b-23383273d48f req-d4b362b8-f2e9-4fc2-92db-bdbc90f075f1 service nova] Instance 2c2d7066-9778-4b65-816f-e5889c562f7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:11:23.156561 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2be8c6e3-c455-421b-a22b-23383273d48f req-d4b362b8-f2e9-4fc2-92db-bdbc90f075f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046301 Jul 20 05:11:23.156934 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5057/6182] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:23.403905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:23.404658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:23.412473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.413018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.413895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.414428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.553947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:23.562626 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d29d9ff9-caf2-4d14-9cc6-f9f095bd9066 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1668 microversion: 2.1 time: 0.163331 Jul 20 05:11:23.563208 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5058/6183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:23 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:23.578879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:23.579495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:23.585293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.585754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.586524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.586973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.716238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:23.718637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:23.727098 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fc93def7-3797-4085-a930-5baead2a65b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1668 microversion: 2.1 time: 0.151821 Jul 20 05:11:23.727667 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5059/6184] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:23 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:23.742986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:23.743606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:23.751205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.751663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.752475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.752927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.879984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:23.887603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-888965ec-7ed4-448f-926f-5dfd466d3159 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1668 microversion: 2.1 time: 0.148404 Jul 20 05:11:23.888185 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5060/6185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:23 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:23.903712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:23.904229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:23.910732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.911199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.911985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:23.912496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:23.937504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:11:24.015808 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10c29a52-e292-4262-ac78-b9b72e494ee1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 204 len: 0 microversion: 2.1 time: 0.115455 Jul 20 05:11:24.020129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5061/6186] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:11:23 2022] DELETE /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:11:24.025984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:24.026710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:24.032837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:24.033308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:24.034180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:24.035257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:24.168155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:24.175676 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1fe6e89-932b-4716-afd5-6c68b153e0b3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1674 microversion: 2.1 time: 0.153939 Jul 20 05:11:24.176252 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5062/6187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:24 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:25.193100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:25.193740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:25.200629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:25.201100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:25.201879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:25.202329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:25.332196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:25.339697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3fbe9b41-01ee-4e53-bf9d-79af5b428cac tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1674 microversion: 2.1 time: 0.150610 Jul 20 05:11:25.340266 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5063/6188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:25 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:26.216165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-48663b6a-d924-4678-af47-1e590aaca9ae req-8c7c939c-eebf-4fbe-9127-a25797ccad24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2d7066-9778-4b65-816f-e5889c562f7e", "name": "network-vif-deleted", "tag": "ee4d9a69-8b16-415a-9fce-1adbda7b071e"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:26.226468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48663b6a-d924-4678-af47-1e590aaca9ae req-8c7c939c-eebf-4fbe-9127-a25797ccad24 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.226936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-48663b6a-d924-4678-af47-1e590aaca9ae req-8c7c939c-eebf-4fbe-9127-a25797ccad24 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.247616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-48663b6a-d924-4678-af47-1e590aaca9ae req-8c7c939c-eebf-4fbe-9127-a25797ccad24 service nova] Creating event network-vif-deleted:ee4d9a69-8b16-415a-9fce-1adbda7b071e for instance 2c2d7066-9778-4b65-816f-e5889c562f7e on n-h2-764486-11 Jul 20 05:11:26.252591 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-48663b6a-d924-4678-af47-1e590aaca9ae req-8c7c939c-eebf-4fbe-9127-a25797ccad24 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040563 Jul 20 05:11:26.253764 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5064/6189] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:26.358609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:26.359609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:26.367063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.367520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.368304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.368777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.404269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:26.404931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:26.405487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lazy-loading 'fault' on Instance uuid 2c2d7066-9778-4b65-816f-e5889c562f7e {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:11:26.454284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:26.461821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e2c7727b-1015-45c7-9fde-e32c71017e2f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 200 len: 1327 microversion: 2.1 time: 0.107485 Jul 20 05:11:26.462474 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5065/6190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:26 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:27.480282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:27.480958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:27.483812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:27.490976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.491444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.492231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.492721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.506984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e HTTP/1.1 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2c2d7066-9778-4b65-816f-e5889c562f7e'} Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:27.508691 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dadf046b-cedb-4e07-a9a3-055a56b4753e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 404 len: 111 microversion: 2.1 time: 0.034162 Jul 20 05:11:27.514187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5066/6191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:27 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:11:27.522650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:27.523269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:27.529336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.529798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.530570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:27.531017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:27.544214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e HTTP/1.1 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2c2d7066-9778-4b65-816f-e5889c562f7e'} Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:11:27.545827 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dda24ee2-5332-42ea-933c-5ccdcb4ac4fb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 404 len: 111 microversion: 2.1 time: 0.028246 Jul 20 05:11:27.551770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5067/6192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:27 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:11:27.594750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-564303509", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "32a91fe3-ebe0-42c0-823f-1cf96ac2611c"}], "security_groups": [{"name": "tempest-securitygroup--1956813352"}], "key_name": "tempest-keypair-84344834", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:27.695889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] validate_networks() for [('32a91fe3-ebe0-42c0-823f-1cf96ac2611c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:11:28.063029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:11:28.063516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:11:28.063974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:11:28.064431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:11:28.064868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:11:28.074124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.074588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.075415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:28.075873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:28.092966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:11:28.098788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:11:28.111208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:11:28.114167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:11:28.159574 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35ce7cbd-d064-455d-bcf2-da290ca275d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.568146 Jul 20 05:11:28.160233 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5068/6193] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:11:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:11:28.170205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb480ed5-5bcd-416b-bef8-faff9aec76ca tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:28.170832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fb480ed5-5bcd-416b-bef8-faff9aec76ca tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:28.264443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fb480ed5-5bcd-416b-bef8-faff9aec76ca tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:28.264443 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb480ed5-5bcd-416b-bef8-faff9aec76ca tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1236 microversion: 2.1 time: 0.069338 Jul 20 05:11:28.264443 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5069/6194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:28 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:29.254774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:29.256095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:29.263385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.263859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.264681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:29.265139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:29.345120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:29.353377 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99b81680-539e-4981-91a9-93ce80cf575e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1294 microversion: 2.1 time: 0.103190 Jul 20 05:11:29.363568 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5070/6195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:29 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:30.371444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:30.373990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:30.381593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:30.382062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:30.383021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:30.383649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:30.647148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:30.655134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9413b12d-0a72-4732-ab20-8cca513e2659 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1362 microversion: 2.1 time: 0.287789 Jul 20 05:11:30.655729 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5071/6196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:30 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:11:30.660964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-85749c4a-5ea7-4f1a-a4c9-11255798d393 req-fa947334-6dbd-4798-be35-bad86ede4634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:30.669571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-85749c4a-5ea7-4f1a-a4c9-11255798d393 req-fa947334-6dbd-4798-be35-bad86ede4634 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:30.670037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-85749c4a-5ea7-4f1a-a4c9-11255798d393 req-fa947334-6dbd-4798-be35-bad86ede4634 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:30.681488 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-85749c4a-5ea7-4f1a-a4c9-11255798d393 req-fa947334-6dbd-4798-be35-bad86ede4634 service nova] Creating event network-changed:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h1-764486-11 Jul 20 05:11:30.686939 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-85749c4a-5ea7-4f1a-a4c9-11255798d393 req-fa947334-6dbd-4798-be35-bad86ede4634 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029927 Jul 20 05:11:30.687751 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5072/6197] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:11:31.675302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:31.676057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:31.683140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:31.683618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:31.684405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:31.684859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:31.910026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:31.918360 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-066f7958-767d-4241-b030-a030088febf8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1362 microversion: 2.1 time: 0.248145 Jul 20 05:11:31.918943 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5073/6198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:31 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:32.936034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:32.936697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:32.944335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:32.944825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:32.945605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:32.946059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:33.080715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:33.088129 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9fa428c7-f9b0-4cb2-bf0b-c5616dada5ab tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1362 microversion: 2.1 time: 0.156029 Jul 20 05:11:33.088752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5074/6199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:32 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:34.105049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:34.105752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:34.114631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:34.115091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:34.115870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:34.116313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:34.245047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:34.252450 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c40e7e22-4502-474a-b583-4253e612aec7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1362 microversion: 2.1 time: 0.151425 Jul 20 05:11:34.253018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5075/6200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:34 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:35.271025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:35.271660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:35.278667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:35.279138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:35.279925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:35.280409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:35.406376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:35.413904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97780405-65a0-4849-848f-469cba3a0b5f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1362 microversion: 2.1 time: 0.147374 Jul 20 05:11:35.414483 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5076/6201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:35 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:35.593202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6d188b8c-cfd8-4472-b53d-08557dabaa01 req-4fb26f26-98ab-4125-800e-22da849ca9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "name": "network-vif-plugged", "status": "completed", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:35.602153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6d188b8c-cfd8-4472-b53d-08557dabaa01 req-4fb26f26-98ab-4125-800e-22da849ca9d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:35.602607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6d188b8c-cfd8-4472-b53d-08557dabaa01 req-4fb26f26-98ab-4125-800e-22da849ca9d4 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:35.615735 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6d188b8c-cfd8-4472-b53d-08557dabaa01 req-4fb26f26-98ab-4125-800e-22da849ca9d4 service nova] Creating event network-vif-plugged:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h1-764486-11 Jul 20 05:11:35.620897 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6d188b8c-cfd8-4472-b53d-08557dabaa01 req-4fb26f26-98ab-4125-800e-22da849ca9d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Jul 20 05:11:35.621539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5077/6202] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:36.432200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:36.432878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:36.439273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:36.439740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:36.440556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:36.441007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:36.571188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:36.578602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84fb0297-01ec-48b9-aabc-9c8141a1b221 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1362 microversion: 2.1 time: 0.151985 Jul 20 05:11:36.579175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5078/6203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:36 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:37.595619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:37.596221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:37.603674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:37.604134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:37.604932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:37.605379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:37.620854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:37.741298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:11:37.749404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72fe24e8-be61-4b6f-8a53-5e79a1d009fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1549 microversion: 2.1 time: 0.157603 Jul 20 05:11:37.749991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5079/6204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:11:37 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:11:37.765665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:11:37.766199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:11:37.772101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:37.772620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:37.773404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:37.773859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:37.849769 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7031741-24f0-4258-b655-fa575c050479 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087650 Jul 20 05:11:37.850385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5080/6205] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 05:11:37 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:11:39.109754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:39.110589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:11:39.115284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7e2371fb-ee13-4378-a56a-25c0360187d9 req-9e70466b-3130-4a22-9190-e40f91d28f51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:11:39.124647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7e2371fb-ee13-4378-a56a-25c0360187d9 req-9e70466b-3130-4a22-9190-e40f91d28f51 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:11:39.125250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7e2371fb-ee13-4378-a56a-25c0360187d9 req-9e70466b-3130-4a22-9190-e40f91d28f51 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:11:39.137698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7e2371fb-ee13-4378-a56a-25c0360187d9 req-9e70466b-3130-4a22-9190-e40f91d28f51 service nova] Creating event network-changed:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h1-764486-11 Jul 20 05:11:39.142798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7e2371fb-ee13-4378-a56a-25c0360187d9 req-9e70466b-3130-4a22-9190-e40f91d28f51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033597 Jul 20 05:11:39.143410 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5081/6206] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:12.267759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:12.268685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:12.273134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47b39f67-1b0f-4c4a-ad8a-73995603123f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:12.281230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47b39f67-1b0f-4c4a-ad8a-73995603123f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:12.281705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47b39f67-1b0f-4c4a-ad8a-73995603123f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:12.305307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47b39f67-1b0f-4c4a-ad8a-73995603123f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:12:12.347082 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47b39f67-1b0f-4c4a-ad8a-73995603123f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action" status: 202 len: 0 microversion: 2.1 time: 0.081160 Jul 20 05:12:12.348157 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5082/6207] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:12 2022] POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:12:12.356959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:12.357686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:12.364916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:12.365388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:12.366183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:12.366641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:12.502112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:12.509981 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f89d3715-3381-4df2-a96d-f77c1f29ac04 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.157318 Jul 20 05:12:12.510985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5083/6208] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:12 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:13.528003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:13.528717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:13.536235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:13.536727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:13.537519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:13.537968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:13.677737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:13.685792 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-041e4e21-edde-4fbf-82d6-6a01d7cd63d2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.161755 Jul 20 05:12:13.686389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5084/6209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:13 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:14.703246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:14.703882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:14.710898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:14.711359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:14.712136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:14.712624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:14.847473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:14.855131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc2225b7-a60f-4293-b4bc-3366aa505626 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.155953 Jul 20 05:12:14.855709 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5085/6210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:14 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:15.872761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:15.873413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:15.880910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:15.881367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:15.882138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:15.882584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:16.014867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:16.023965 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99f3e717-58de-44d3-b38c-81dcb43b7f22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.155085 Jul 20 05:12:16.024566 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5086/6211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:15 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:17.042097 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:17.042680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:17.048999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:17.049468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:17.050264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:17.050717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:17.185762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:17.193346 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca9e8f6d-ca85-458d-a379-a879c9882783 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.155493 Jul 20 05:12:17.193923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5087/6212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:17 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:18.210796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:18.211505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:18.218561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.219031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.219831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:18.220290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:18.362503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:18.370933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-301f1331-5074-4986-8cca-cda2d0516027 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.164252 Jul 20 05:12:18.371510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5088/6213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:18 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:19.388760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:19.389435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:19.396838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:19.397305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:19.398094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:19.398546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:19.532783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:19.540398 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a640dd07-890c-4e02-b881-742ae016c329 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.155632 Jul 20 05:12:19.540980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5089/6214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:19 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:20.558773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:20.559429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:20.566608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:20.567147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:20.567947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:20.568469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:20.702553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:20.710809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f8bd677a-d775-412e-838d-1f90343fc348 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.156309 Jul 20 05:12:20.711384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5090/6215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:20 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:21.728225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:21.728975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:21.736173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:21.736690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:21.737490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:21.737948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:21.866321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:21.874125 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3302460-53a5-47e7-880e-2975c4980d3b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.149866 Jul 20 05:12:21.874712 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5091/6216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:21 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:22.891358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:22.892038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:22.899693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:22.900164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:22.901099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:22.901556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:23.089502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:23.097236 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a58bbc80-2163-401a-a5c4-b7c0cb096766 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1654 microversion: 2.1 time: 0.209931 Jul 20 05:12:23.097839 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5092/6217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:22 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1654 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:23.114170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:23.115151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:23.121513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:23.121975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:23.122755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:23.123200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:23.154037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:23.160049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:12:23.166966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:12:23.167398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:12:23.167879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:12:23.168298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:12:23.168737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:12:23.234059 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1e43169-9d23-4075-bee0-e5f8fe621e71 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action" status: 202 len: 0 microversion: 2.1 time: 0.123381 Jul 20 05:12:23.234896 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5093/6218] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:23 2022] POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:12:23.242730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:23.243358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:23.249710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:23.250289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:23.251233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:23.251453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:23.401878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:23.410237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58465acd-1564-413c-a81e-2013918f8965 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.171353 Jul 20 05:12:23.410843 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5094/6219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:23 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:24.427241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:24.427833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:24.435329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:24.435939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:24.436751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:24.437203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:24.631540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:24.639383 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b86907dc-b11a-48c3-8b39-2857fbe263a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1677 microversion: 2.1 time: 0.216138 Jul 20 05:12:24.640080 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5095/6220] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:24 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:25.657560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:25.658214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:25.665656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:25.666162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:25.666931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:25.667431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:25.671564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:25.806596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:25.814084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88c48a71-d741-4721-b947-0bbe8c33cb99 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1682 microversion: 2.1 time: 0.160800 Jul 20 05:12:25.814662 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5096/6221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:25 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:26.833747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:26.834364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:26.841376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:26.841833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:26.842613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:26.843206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:26.985615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:26.995081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a999b6e-96aa-4f3e-b70e-5acb6cb3f45b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1682 microversion: 2.1 time: 0.164983 Jul 20 05:12:27.000442 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5097/6222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:26 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:27.433128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-432d54cd-275e-453a-b8d4-a787a91c608d req-3c8a29bf-7ea1-4bda-93be-fe26043147c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "name": "network-vif-unplugged", "status": "completed", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:27.441101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-432d54cd-275e-453a-b8d4-a787a91c608d req-3c8a29bf-7ea1-4bda-93be-fe26043147c8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:27.441641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-432d54cd-275e-453a-b8d4-a787a91c608d req-3c8a29bf-7ea1-4bda-93be-fe26043147c8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:27.454130 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-432d54cd-275e-453a-b8d4-a787a91c608d req-3c8a29bf-7ea1-4bda-93be-fe26043147c8 service nova] Creating event network-vif-unplugged:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h2-764486-11 Jul 20 05:12:27.460037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-432d54cd-275e-453a-b8d4-a787a91c608d req-3c8a29bf-7ea1-4bda-93be-fe26043147c8 service nova] Instance 79a0ab95-c224-4419-8fea-510dade73843 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:12:27.470994 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-432d54cd-275e-453a-b8d4-a787a91c608d req-3c8a29bf-7ea1-4bda-93be-fe26043147c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043844 Jul 20 05:12:27.471611 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5098/6223] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:28.016547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:28.017306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:28.024398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:28.024796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:28.025673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:28.026023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:28.163937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:28.171921 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a3a2bf47-f22a-4782-95ec-5ea782ecb81c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1681 microversion: 2.1 time: 0.160522 Jul 20 05:12:28.172533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5099/6224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:28 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:29.190481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:29.191069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:29.198111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:29.198565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:29.199343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:29.199785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:29.327898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:29.336414 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19058fe1-27a2-42c2-ae9c-d1cbd378cfb7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1679 microversion: 2.1 time: 0.149930 Jul 20 05:12:29.337000 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5100/6225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:29 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:29.488672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4db59efe-add6-42be-ab9c-0b70e4b47e06 req-fef5a16c-82e4-406a-b2e8-02b7af14f013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:29.496968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4db59efe-add6-42be-ab9c-0b70e4b47e06 req-fef5a16c-82e4-406a-b2e8-02b7af14f013 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:29.497281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4db59efe-add6-42be-ab9c-0b70e4b47e06 req-fef5a16c-82e4-406a-b2e8-02b7af14f013 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:29.509613 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4db59efe-add6-42be-ab9c-0b70e4b47e06 req-fef5a16c-82e4-406a-b2e8-02b7af14f013 service nova] Creating event network-changed:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h2-764486-11 Jul 20 05:12:29.515010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-4db59efe-add6-42be-ab9c-0b70e4b47e06 req-fef5a16c-82e4-406a-b2e8-02b7af14f013 service nova] Instance 79a0ab95-c224-4419-8fea-510dade73843 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:12:29.527000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4db59efe-add6-42be-ab9c-0b70e4b47e06 req-fef5a16c-82e4-406a-b2e8-02b7af14f013 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042067 Jul 20 05:12:29.527693 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5101/6226] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:30.355791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:30.356533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:30.362907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:30.363369 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:30.364815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:30.365268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:30.502763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:30.510521 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a1b52f1-48e1-451e-9a51-4a3f71e68d47 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1675 microversion: 2.1 time: 0.159871 Jul 20 05:12:30.511489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5102/6227] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:30 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:30.527804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:30.528380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:30.535329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:30.536450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:30.537241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:30.537695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:30.600650 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18c77c16-eda8-4091-a79d-23cb4bd8abbc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action" status: 204 len: 0 microversion: 2.1 time: 0.076276 Jul 20 05:12:30.602046 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5103/6228] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:30 2022] POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:12:30.609786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:30.610510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:30.619420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:30.619892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:30.620745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:30.621197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:30.860068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:30.868086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-435e49ab-bd19-44c0-b04e-d7fcdf02d392 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1675 microversion: 2.1 time: 0.262495 Jul 20 05:12:30.868718 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5104/6229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:30 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:31.577324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-88004b4b-3d1a-4245-a153-319240d38753 req-af0433bb-dd9d-48fb-bee2-e62d9595b697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "name": "network-vif-plugged", "status": "completed", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:31.585604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-88004b4b-3d1a-4245-a153-319240d38753 req-af0433bb-dd9d-48fb-bee2-e62d9595b697 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:31.586065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-88004b4b-3d1a-4245-a153-319240d38753 req-af0433bb-dd9d-48fb-bee2-e62d9595b697 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:31.597725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-88004b4b-3d1a-4245-a153-319240d38753 req-af0433bb-dd9d-48fb-bee2-e62d9595b697 service nova] Creating event network-vif-plugged:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h2-764486-11 Jul 20 05:12:31.603576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-88004b4b-3d1a-4245-a153-319240d38753 req-af0433bb-dd9d-48fb-bee2-e62d9595b697 service nova] Instance 79a0ab95-c224-4419-8fea-510dade73843 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:12:31.614182 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-88004b4b-3d1a-4245-a153-319240d38753 req-af0433bb-dd9d-48fb-bee2-e62d9595b697 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104761 Jul 20 05:12:31.615277 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5105/6230] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:31.886090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:31.886811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:31.893208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:31.893680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:31.894465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:31.895412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:32.027588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:32.035188 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3915f81b-2cbc-4421-a3c0-2c3a9294a6ee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1654 microversion: 2.1 time: 0.153465 Jul 20 05:12:32.036444 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5106/6231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:31 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:12:32.051836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:32.052490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:32.058522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:32.058984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:32.059759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:32.060206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:32.192213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:32.200020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f12c26e8-4279-4e0b-ada5-9a7133243cc1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1654 microversion: 2.1 time: 0.151765 Jul 20 05:12:32.200635 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5107/6232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:32 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:32.216273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78f4b04c-2e1e-4367-861d-ef36d9755218 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:32.222186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f4b04c-2e1e-4367-861d-ef36d9755218 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:32.222654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f4b04c-2e1e-4367-861d-ef36d9755218 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:32.245670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78f4b04c-2e1e-4367-861d-ef36d9755218 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:12:32.287415 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78f4b04c-2e1e-4367-861d-ef36d9755218 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action" status: 202 len: 0 microversion: 2.1 time: 0.074534 Jul 20 05:12:32.287968 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5108/6233] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:12:32 2022] POST /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:12:32.296689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:32.297404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:32.303761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:32.304300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:32.305270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:32.305735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:32.437127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:32.445433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-21c1b692-5d72-4387-ba72-d20ddeced99a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1663 microversion: 2.1 time: 0.152881 Jul 20 05:12:32.446109 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5109/6234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:32 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:33.463627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:33.464271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:33.471439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.471900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.472716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.473801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.605704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:33.613477 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85e3cdee-a3ea-4a6d-a095-3739c5b9f1f0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1667 microversion: 2.1 time: 0.153857 Jul 20 05:12:33.614064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5110/6235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:33 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:33.630028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:33.630540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:33.636988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.637462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.638261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.638711 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.668229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:12:33.670354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:33.751704 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-99ff0b26-e504-4068-a90c-114f492bb731 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 204 len: 0 microversion: 2.1 time: 0.125211 Jul 20 05:12:33.752430 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5111/6236] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:12:33 2022] DELETE /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:12:33.762181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:33.762895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:33.769825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.770368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.771657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:33.772107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:33.907267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:33.914910 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0b211ad4-1681-4081-8d92-05da24d9cae7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1673 microversion: 2.1 time: 0.156989 Jul 20 05:12:33.915490 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5112/6237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:33 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:34.931346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:34.931982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:34.939267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:34.939737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:34.940544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:34.940989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:35.124656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:35.132548 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-45c232d0-4823-452f-b50e-379fb0a6a96d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1673 microversion: 2.1 time: 0.205354 Jul 20 05:12:35.133121 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5113/6238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:34 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:36.150570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:36.151362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:36.159401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:36.159869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:36.161198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:36.161649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:36.250511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:36.262957 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15a377e3-2640-43f6-ae50-1278cf2d17ba tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 200 len: 1605 microversion: 2.1 time: 0.116508 Jul 20 05:12:36.264057 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5114/6239] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:36 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 1605 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:36.306871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-13b07349-b9de-4120-8ae4-50b56aa7f6bf req-f163dc9f-d376-4c56-a441-20cd7af3d62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a0ab95-c224-4419-8fea-510dade73843", "name": "network-vif-deleted", "tag": "da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:36.318372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-13b07349-b9de-4120-8ae4-50b56aa7f6bf req-f163dc9f-d376-4c56-a441-20cd7af3d62a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:36.318372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-13b07349-b9de-4120-8ae4-50b56aa7f6bf req-f163dc9f-d376-4c56-a441-20cd7af3d62a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:36.331471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-13b07349-b9de-4120-8ae4-50b56aa7f6bf req-f163dc9f-d376-4c56-a441-20cd7af3d62a service nova] Creating event network-vif-deleted:da70c1b8-ab83-4ae4-bdf3-3244cddcbd0a for instance 79a0ab95-c224-4419-8fea-510dade73843 on n-h2-764486-11 Jul 20 05:12:36.337309 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-13b07349-b9de-4120-8ae4-50b56aa7f6bf req-f163dc9f-d376-4c56-a441-20cd7af3d62a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Jul 20 05:12:36.337987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5115/6240] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:37.285513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:37.286239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:37.293862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.294335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.295168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.295622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.310340 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 HTTP/1.1 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '79a0ab95-c224-4419-8fea-510dade73843'} Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:12:37.312020 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1f168c4b-3433-4f65-8608-4a17c059696e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 404 len: 111 microversion: 2.1 time: 0.032479 Jul 20 05:12:37.316281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5116/6241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:37 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:12:37.329793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:37.330414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:37.336516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.336979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.337754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.338307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.351614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 HTTP/1.1 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '79a0ab95-c224-4419-8fea-510dade73843'} Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:12:37.353182 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86441b66-eee5-433d-907d-ef69e856f527 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 404 len: 111 microversion: 2.1 time: 0.028567 Jul 20 05:12:37.356892 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5117/6242] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:37 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:12:37.402096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1074086167", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "32a91fe3-ebe0-42c0-823f-1cf96ac2611c"}], "security_groups": [{"name": "tempest-securitygroup--1956813352"}], "key_name": "tempest-keypair-84344834", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:37.504117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] validate_networks() for [('32a91fe3-ebe0-42c0-823f-1cf96ac2611c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:12:37.920056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:12:37.920556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:12:37.921048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:12:37.921480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:12:37.921907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:12:37.931547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.931946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.932829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:37.933278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:37.949793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:12:37.955091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:12:37.968196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:12:37.970537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:12:37.997755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:38.018249 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab9e04d4-c69c-4644-9a1f-6f800cbe905a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.619975 Jul 20 05:12:38.018897 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5118/6243] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:12:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:12:38.029978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea8b8001-0da3-4d1f-9068-cc16fbbc5e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:38.030616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea8b8001-0da3-4d1f-9068-cc16fbbc5e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:38.089500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea8b8001-0da3-4d1f-9068-cc16fbbc5e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:38.096392 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea8b8001-0da3-4d1f-9068-cc16fbbc5e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1237 microversion: 2.1 time: 0.070816 Jul 20 05:12:38.096987 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5119/6244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:38 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:39.115461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:39.116443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:39.124240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:39.124240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:39.124973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:39.125431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:39.229526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:39.237370 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1bdcc5a-d9d4-4b87-b89c-db8294425c22 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1295 microversion: 2.1 time: 0.126408 Jul 20 05:12:39.237977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5120/6245] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:39 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:40.256185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:40.257040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:40.264600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:40.265042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:40.266187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:40.266810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:40.533265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:40.541705 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-15ff6983-53be-4573-92dc-081c45ad5240 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1363 microversion: 2.1 time: 0.290209 Jul 20 05:12:40.542801 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5121/6246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:40 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:40.547660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1fd001a1-dfe8-49d4-a396-c2ee8ce8e62c req-af646a31-880c-404c-8569-02278d6ca89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:40.557079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1fd001a1-dfe8-49d4-a396-c2ee8ce8e62c req-af646a31-880c-404c-8569-02278d6ca89c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:40.557537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1fd001a1-dfe8-49d4-a396-c2ee8ce8e62c req-af646a31-880c-404c-8569-02278d6ca89c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:40.569406 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1fd001a1-dfe8-49d4-a396-c2ee8ce8e62c req-af646a31-880c-404c-8569-02278d6ca89c service nova] Creating event network-changed:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:12:40.576126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1fd001a1-dfe8-49d4-a396-c2ee8ce8e62c req-af646a31-880c-404c-8569-02278d6ca89c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Jul 20 05:12:40.577076 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5122/6247] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:12:41.561134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:41.561775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:41.568583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:41.569051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:41.569836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:41.570286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:41.779569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:41.787191 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e87d4a3-3cec-4e05-887f-95777104d5d9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1363 microversion: 2.1 time: 0.231667 Jul 20 05:12:41.787770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5123/6248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:41 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:42.804664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:42.805297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:42.812639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:42.813110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:42.813893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:42.814349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:42.941198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:42.949199 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-baca6ff1-98dc-4e03-a2f7-393adc4b42b5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1363 microversion: 2.1 time: 0.148494 Jul 20 05:12:42.949778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5124/6249] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:42 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:43.967218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:43.967845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:43.974850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:43.975312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:43.976115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:43.976593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:44.110272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:44.118372 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89f083d6-82f1-49b2-8b5b-a625542be696 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1363 microversion: 2.1 time: 0.155084 Jul 20 05:12:44.118952 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5125/6250] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:43 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:45.135867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:45.136465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:45.144126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:45.144613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:45.146050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:45.146501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:45.275830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:45.283303 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46e1f6a6-bf8f-40e0-8cb6-cc3e30fa6f14 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1363 microversion: 2.1 time: 0.151510 Jul 20 05:12:45.283878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5126/6251] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:45 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:45.955775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5d6526a6-83ca-4a75-92cd-2f0eaa655b17 req-d1a1db9a-6a06-4faa-9890-08db81e838d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "name": "network-vif-plugged", "status": "completed", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:45.963925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5d6526a6-83ca-4a75-92cd-2f0eaa655b17 req-d1a1db9a-6a06-4faa-9890-08db81e838d1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:45.964488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5d6526a6-83ca-4a75-92cd-2f0eaa655b17 req-d1a1db9a-6a06-4faa-9890-08db81e838d1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:45.976870 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5d6526a6-83ca-4a75-92cd-2f0eaa655b17 req-d1a1db9a-6a06-4faa-9890-08db81e838d1 service nova] Creating event network-vif-plugged:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:12:45.982087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5d6526a6-83ca-4a75-92cd-2f0eaa655b17 req-d1a1db9a-6a06-4faa-9890-08db81e838d1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030040 Jul 20 05:12:45.982695 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5127/6252] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:46.302203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:46.302915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:46.309465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:46.309928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:46.310701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:46.311150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:46.439073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:46.446589 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3618c2a4-6548-491d-a785-36f642c1bb11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1363 microversion: 2.1 time: 0.149611 Jul 20 05:12:46.447163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5128/6253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:46 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:47.463127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:47.463756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:47.470804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:47.471283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:47.472082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:47.472576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:47.601117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:12:47.608684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c44d0f6-4606-4629-af5a-0bb5e7334c9a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1549 microversion: 2.1 time: 0.149488 Jul 20 05:12:47.609267 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5129/6254] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:12:47 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:12:47.625667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:12:47.626263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:12:47.632050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:47.632583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:47.633361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:47.633812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:47.714163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b79c024-1a65-4122-a33e-e7a6e80e07d0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092033 Jul 20 05:12:47.714770 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5130/6255] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 05:12:47 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:48.639001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:48.639815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:12:48.644565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b6db090b-984d-4c0c-af32-2742fdcca4de req-926d9f39-1afe-4de6-87db-e7e551a52d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:12:48.653789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b6db090b-984d-4c0c-af32-2742fdcca4de req-926d9f39-1afe-4de6-87db-e7e551a52d4b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:12:48.654252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b6db090b-984d-4c0c-af32-2742fdcca4de req-926d9f39-1afe-4de6-87db-e7e551a52d4b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:12:48.665618 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b6db090b-984d-4c0c-af32-2742fdcca4de req-926d9f39-1afe-4de6-87db-e7e551a52d4b service nova] Creating event network-changed:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:12:48.670610 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b6db090b-984d-4c0c-af32-2742fdcca4de req-926d9f39-1afe-4de6-87db-e7e551a52d4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032261 Jul 20 05:12:48.671213 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5131/6256] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:12:54.588475 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:12:54.589109 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:13:21.737920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=28 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:21.738803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:21.744300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:21.745475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:21.753496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:21.753962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:21.754753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:21.755207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:21.784951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:21.791385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:13:21.797638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:13:21.798080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:13:21.798570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:13:21.798996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:13:21.799423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:13:21.862338 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-090c78a2-4c33-4513-a3dd-bc10f9721743 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7/action" status: 202 len: 0 microversion: 2.1 time: 0.126535 Jul 20 05:13:21.862956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5132/6257] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:13:21 2022] POST /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:13:21.871510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:21.872139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:21.878268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:21.878738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:21.879587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:21.880050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:22.023365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:22.031569 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f687c6b6-8971-4f73-b365-b6cece207701 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1676 microversion: 2.1 time: 0.163747 Jul 20 05:13:22.032154 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5133/6258] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:21 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:23.050654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:23.051305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:23.059261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:23.059731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:23.060564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:23.061022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:23.200103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:23.208304 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2c41a91c-8623-479a-a9ec-5ffe65d3e0d4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1676 microversion: 2.1 time: 0.161361 Jul 20 05:13:23.209292 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5134/6259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:23 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:24.226347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:24.227036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:24.234090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:24.234562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:24.235357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:24.235819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:24.373863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:24.381444 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94a1233e-31cb-4806-8909-7343ff19c5d3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1676 microversion: 2.1 time: 0.159602 Jul 20 05:13:24.382025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5135/6260] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:24 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:25.398599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:25.399247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:25.406182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:25.406643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:25.407421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:25.407870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:25.539652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:25.547299 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b527b79b-6fe0-48ed-b9d2-ad2606c08a95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.152640 Jul 20 05:13:25.547867 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5136/6261] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:25 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:26.565010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:26.565658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:26.573447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:26.573910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:26.574689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:26.575138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:26.702568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:26.710646 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8225b224-c7e2-4432-96e5-35e260cf424d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.149549 Jul 20 05:13:26.711221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5137/6262] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:26 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:27.728622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:27.729277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:27.736497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:27.736956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:27.737735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:27.738182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:27.870006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:27.877605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ed97a0bf-c02a-4911-889a-08fa47289639 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.153754 Jul 20 05:13:27.878181 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5138/6263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:27 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:28.895621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:28.896244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:28.903414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:28.903877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:28.904683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:28.905132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:29.035044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:29.043136 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d6bda184-817d-4811-a7ff-e03711df54a5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.152005 Jul 20 05:13:29.043993 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5139/6264] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:28 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:30.061048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:30.061665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:30.068489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:30.068949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:30.069768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:30.070176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:30.201113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:30.208764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82f6b9a1-c778-4159-b79e-fc3d79f8da29 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.151713 Jul 20 05:13:30.209338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5140/6265] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:30 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:31.226447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:31.227123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:31.234167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:31.234633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:31.235415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:31.235866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:31.369743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:31.377479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b1a5017-5d13-4c94-ae2f-1ed3afe24efe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.155065 Jul 20 05:13:31.378070 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5141/6266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:31 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:32.395298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:32.396587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:32.403727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:32.404190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:32.405003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:32.405453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:32.537953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:32.545666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-561f91be-a2a1-4c51-81b0-52940f81bdd0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.154435 Jul 20 05:13:32.546243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5142/6267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:32 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:33.563257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:33.563931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:33.570897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:33.571360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:33.572412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:33.572867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:33.706063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:33.714512 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e381b6db-dfc5-497d-8fac-ecd14079ed11 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.155250 Jul 20 05:13:33.715091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5143/6268] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:33 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:34.731869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:34.732589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:34.739770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:34.740889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:34.741672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:34.742113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:34.878282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:34.885860 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdf9a3f8-c540-4a55-bfb8-523c8953e16b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.157963 Jul 20 05:13:34.886429 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5144/6269] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:34 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:35.903243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:35.903862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:35.910907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:35.911375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:35.912158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:35.912640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:36.046250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:36.054961 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c64b623-a758-421a-bbda-07f4b9462c75 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1681 microversion: 2.1 time: 0.155745 Jul 20 05:13:36.055545 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5145/6270] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:35 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:36.971190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-fc67334e-cf09-4772-b052-a1e5e6bd6b72 req-d0cf985a-1b6f-414c-91ca-8e65a674d4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "name": "network-vif-unplugged", "status": "completed", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:36.982952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fc67334e-cf09-4772-b052-a1e5e6bd6b72 req-d0cf985a-1b6f-414c-91ca-8e65a674d4e7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:36.983412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-fc67334e-cf09-4772-b052-a1e5e6bd6b72 req-d0cf985a-1b6f-414c-91ca-8e65a674d4e7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:36.997620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-fc67334e-cf09-4772-b052-a1e5e6bd6b72 req-d0cf985a-1b6f-414c-91ca-8e65a674d4e7 service nova] Creating event network-vif-unplugged:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h2-764486-11 Jul 20 05:13:37.005052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-fc67334e-cf09-4772-b052-a1e5e6bd6b72 req-d0cf985a-1b6f-414c-91ca-8e65a674d4e7 service nova] Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:13:37.018665 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-fc67334e-cf09-4772-b052-a1e5e6bd6b72 req-d0cf985a-1b6f-414c-91ca-8e65a674d4e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112228 Jul 20 05:13:37.019853 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5146/6271] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:37.073283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:37.074017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:37.080685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:37.081153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:37.081961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:37.082420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:37.103690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:37.231956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:37.239698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d04df94f-376a-4eb5-bdb8-be8cffcd495b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1680 microversion: 2.1 time: 0.170946 Jul 20 05:13:37.240341 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5147/6272] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:37 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:38.258241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:38.258889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:38.265841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:38.266363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:38.267149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:38.267602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:38.399033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:38.406620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e115fa95-99b3-456f-b25e-7302b78b8561 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1678 microversion: 2.1 time: 0.153114 Jul 20 05:13:38.407199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5148/6273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:38 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:39.061604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b4bff69e-8053-4608-9fca-abe006387090 req-41bd54cd-0944-48ae-bdc9-983049c79417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:39.069731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b4bff69e-8053-4608-9fca-abe006387090 req-41bd54cd-0944-48ae-bdc9-983049c79417 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:39.070191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b4bff69e-8053-4608-9fca-abe006387090 req-41bd54cd-0944-48ae-bdc9-983049c79417 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:39.081556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b4bff69e-8053-4608-9fca-abe006387090 req-41bd54cd-0944-48ae-bdc9-983049c79417 service nova] Creating event network-changed:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h2-764486-11 Jul 20 05:13:39.086813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-b4bff69e-8053-4608-9fca-abe006387090 req-41bd54cd-0944-48ae-bdc9-983049c79417 service nova] Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:13:39.097390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b4bff69e-8053-4608-9fca-abe006387090 req-41bd54cd-0944-48ae-bdc9-983049c79417 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039600 Jul 20 05:13:39.097985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5149/6274] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:39.425631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:39.426427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:39.433244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:39.433786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:39.434644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:39.435165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:39.658604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:39.667470 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a00082c9-3803-437c-81e4-4eb2d496117b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1678 microversion: 2.1 time: 0.246935 Jul 20 05:13:39.668178 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5150/6275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:39 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:40.686121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:40.686764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:40.693849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:40.694310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:40.695848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:40.695848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:40.826811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:40.838030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-106fd022-5566-4210-9f0a-77868e8779db tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1675 microversion: 2.1 time: 0.156854 Jul 20 05:13:40.838616 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5151/6276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:40 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:40.854530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:40.855067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:40.860981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:40.861437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:40.862229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:40.862676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:40.902668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:40.903125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:40.903931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:40.904405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:40.927115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:13:40.932719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:13:41.031620 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de8bfed1-0924-4053-8f37-1269499acf6f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7/action" status: 202 len: 0 microversion: 2.1 time: 0.180529 Jul 20 05:13:41.032247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5152/6277] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:13:40 2022] POST /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:13:41.046957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:41.047714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:41.054743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:41.055227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:41.056033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:41.056772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:41.195195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:41.203036 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0d945216-af63-4cac-b72b-717115984b2e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1674 microversion: 2.1 time: 0.164654 Jul 20 05:13:41.203622 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5153/6278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:41 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:42.221220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:42.221867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:42.229396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:42.229855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:42.230633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:42.231079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:42.361201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:42.368845 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9dea7da-ee01-4f6c-b789-156ae13efe19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1674 microversion: 2.1 time: 0.152034 Jul 20 05:13:42.369426 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5154/6279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:42 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:43.386792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:43.387452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:43.394684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:43.395278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:43.396463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:43.397022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:43.536006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:43.544017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aed76f0a-b83d-4eb5-9abf-5eeac0b33e0b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1674 microversion: 2.1 time: 0.161109 Jul 20 05:13:43.544646 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5155/6280] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:43 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:43.836693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dd5bf340-d2c2-416d-b3cd-b4dfdbd154d8 req-c13a31fe-73a7-450b-9690-b431c7499f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "name": "network-vif-plugged", "status": "completed", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:43.844921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd5bf340-d2c2-416d-b3cd-b4dfdbd154d8 req-c13a31fe-73a7-450b-9690-b431c7499f66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:43.845363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd5bf340-d2c2-416d-b3cd-b4dfdbd154d8 req-c13a31fe-73a7-450b-9690-b431c7499f66 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:43.857732 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dd5bf340-d2c2-416d-b3cd-b4dfdbd154d8 req-c13a31fe-73a7-450b-9690-b431c7499f66 service nova] Creating event network-vif-plugged:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:13:43.863230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-dd5bf340-d2c2-416d-b3cd-b4dfdbd154d8 req-c13a31fe-73a7-450b-9690-b431c7499f66 service nova] Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:13:43.875268 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dd5bf340-d2c2-416d-b3cd-b4dfdbd154d8 req-c13a31fe-73a7-450b-9690-b431c7499f66 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104472 Jul 20 05:13:43.876317 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5156/6281] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:44.219845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-2d58848a-fefe-4052-b0e8-8e6ad0d2d876 req-155381c3-433f-404e-84e9-450fad0c1e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "name": "network-vif-unplugged", "status": "completed", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:44.228719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2d58848a-fefe-4052-b0e8-8e6ad0d2d876 req-155381c3-433f-404e-84e9-450fad0c1e9b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:44.229265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-2d58848a-fefe-4052-b0e8-8e6ad0d2d876 req-155381c3-433f-404e-84e9-450fad0c1e9b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:44.242280 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-2d58848a-fefe-4052-b0e8-8e6ad0d2d876 req-155381c3-433f-404e-84e9-450fad0c1e9b service nova] Creating event network-vif-unplugged:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:13:44.249454 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-2d58848a-fefe-4052-b0e8-8e6ad0d2d876 req-155381c3-433f-404e-84e9-450fad0c1e9b service nova] Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:13:44.262642 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-2d58848a-fefe-4052-b0e8-8e6ad0d2d876 req-155381c3-433f-404e-84e9-450fad0c1e9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108474 Jul 20 05:13:44.263273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5157/6282] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:44.563225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:44.564144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:44.571567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:44.572028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:44.572850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:44.573294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:44.868076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:44.874870 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73ed6164-e4e4-489e-8ad6-b53cd1c16078 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1674 microversion: 2.1 time: 0.316845 Jul 20 05:13:44.875460 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5158/6283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:44 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1674 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:45.893177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:45.893800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:45.901315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:45.901776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:45.902546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:45.902993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:46.037752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:46.047297 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f44e9a1d-8863-442e-a67d-ff296f70406e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1674 microversion: 2.1 time: 0.158006 Jul 20 05:13:46.047878 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5159/6284] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:45 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:46.282544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-addd8c52-90af-4555-9b2f-792cb6d53d34 req-93a01b68-7db0-40b2-8649-9bd5c8f182f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:46.291007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-addd8c52-90af-4555-9b2f-792cb6d53d34 req-93a01b68-7db0-40b2-8649-9bd5c8f182f9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:46.291399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-addd8c52-90af-4555-9b2f-792cb6d53d34 req-93a01b68-7db0-40b2-8649-9bd5c8f182f9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:46.303305 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-addd8c52-90af-4555-9b2f-792cb6d53d34 req-93a01b68-7db0-40b2-8649-9bd5c8f182f9 service nova] Creating event network-changed:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:13:46.308781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-addd8c52-90af-4555-9b2f-792cb6d53d34 req-93a01b68-7db0-40b2-8649-9bd5c8f182f9 service nova] Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:13:46.319794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-addd8c52-90af-4555-9b2f-792cb6d53d34 req-93a01b68-7db0-40b2-8649-9bd5c8f182f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040982 Jul 20 05:13:46.320396 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5160/6285] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:47.065910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:47.066517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:47.080875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:47.081530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:47.082732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:47.083234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:47.300104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:47.308602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a7f6d36-72c8-4b3d-847a-aae3aa8d2fa1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1674 microversion: 2.1 time: 0.247071 Jul 20 05:13:47.309169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5161/6286] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:47 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1674 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:48.325989 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:48.326646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:48.333531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.334626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.335400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.335837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.354234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:48.472515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:48.480085 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-040adfe7-9f88-4fee-b4c7-443ea74a41e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1667 microversion: 2.1 time: 0.158069 Jul 20 05:13:48.480699 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5162/6287] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:48 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:48.496457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:48.497078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:48.502925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.503391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.504166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.504666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.636778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:48.644446 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2542b101-bc82-4e79-807d-a29af494df90 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1667 microversion: 2.1 time: 0.151597 Jul 20 05:13:48.645045 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5163/6288] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:48 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:48.660557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:48.661188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:48.667394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.667808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.668620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.669075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.798341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:48.806917 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebfca784-1b33-4bda-a1b9-ea6a2cbab462 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1667 microversion: 2.1 time: 0.149917 Jul 20 05:13:48.807498 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5164/6289] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:48 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:48.823269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:48.823786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:48.829806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.830269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.831050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.831500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.856544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:13:48.937985 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9b75f6b-97d4-4ffd-8505-67fb78e99470 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 204 len: 0 microversion: 2.1 time: 0.118154 Jul 20 05:13:48.938434 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5165/6290] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:13:48 2022] DELETE /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:13:48.947149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:48.947867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:48.954075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.954541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:48.955323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:48.955776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:49.092611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:49.101044 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37ded426-8858-451e-9135-203f1ccf2b19 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1673 microversion: 2.1 time: 0.158082 Jul 20 05:13:49.101637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5166/6291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:48 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:50.118748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:50.119339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:50.126209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:50.126674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:50.127458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:50.127909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:50.273743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:50.281549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2c42218-4050-4dfb-838f-43c81616e198 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1673 microversion: 2.1 time: 0.167279 Jul 20 05:13:50.282144 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5167/6292] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:50 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:50.310746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e27b66d6-d54a-4c64-aa8e-9d0e3b5f14b6 req-6573973c-fea0-4a22-acf5-64bec55f54aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "name": "network-vif-plugged", "status": "completed", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:50.319386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e27b66d6-d54a-4c64-aa8e-9d0e3b5f14b6 req-6573973c-fea0-4a22-acf5-64bec55f54aa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:50.319951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e27b66d6-d54a-4c64-aa8e-9d0e3b5f14b6 req-6573973c-fea0-4a22-acf5-64bec55f54aa service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:50.333058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e27b66d6-d54a-4c64-aa8e-9d0e3b5f14b6 req-6573973c-fea0-4a22-acf5-64bec55f54aa service nova] Creating event network-vif-plugged:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:13:50.338624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e27b66d6-d54a-4c64-aa8e-9d0e3b5f14b6 req-6573973c-fea0-4a22-acf5-64bec55f54aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031613 Jul 20 05:13:50.339422 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5168/6293] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:51.238099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:51.243957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-92ddacb5-910c-4432-9a1d-43f1b70569db req-28ae0a1c-3822-41cc-a826-c13c8d2e5de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe86a35-4f2f-4e11-8fbb-de689c6e71c7", "name": "network-vif-deleted", "tag": "a00b2dd8-7627-40fc-8d0d-b42fb10b83fe"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:51.248109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:13:51.262042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-92ddacb5-910c-4432-9a1d-43f1b70569db req-28ae0a1c-3822-41cc-a826-c13c8d2e5de5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:51.262658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-92ddacb5-910c-4432-9a1d-43f1b70569db req-28ae0a1c-3822-41cc-a826-c13c8d2e5de5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:51.275017 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-92ddacb5-910c-4432-9a1d-43f1b70569db req-28ae0a1c-3822-41cc-a826-c13c8d2e5de5 service nova] Creating event network-vif-deleted:a00b2dd8-7627-40fc-8d0d-b42fb10b83fe for instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 on n-h1-764486-11 Jul 20 05:13:51.279979 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-92ddacb5-910c-4432-9a1d-43f1b70569db req-28ae0a1c-3822-41cc-a826-c13c8d2e5de5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042684 Jul 20 05:13:51.280953 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5169/6294] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:51.300487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:51.301208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:51.307892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:51.309368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:51.309478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:51.309840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:51.344148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:51.344735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:51.345199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lazy-loading 'fault' on Instance uuid ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:13:51.396345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:51.404233 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14468bab-437b-4794-ac98-0af8cd82fd3f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 200 len: 1327 microversion: 2.1 time: 0.108328 Jul 20 05:13:51.405066 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5170/6295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:51 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:13:52.422100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:52.422713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:52.430099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:52.430560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:52.431606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:52.432054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:52.445975 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 HTTP/1.1 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ffe86a35-4f2f-4e11-8fbb-de689c6e71c7'} Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:52.447657 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae9b24e0-6874-477f-a40d-55e900d9bb87 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 404 len: 111 microversion: 2.1 time: 0.031100 Jul 20 05:13:52.451967 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5171/6296] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:52 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:13:52.462036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:52.462654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:52.468591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:52.469050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:52.469817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:52.470262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:52.483805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 HTTP/1.1 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ffe86a35-4f2f-4e11-8fbb-de689c6e71c7'} Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:13:52.485375 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca0c4b39-b03f-4f37-bd06-927020f6bb5c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 404 len: 111 microversion: 2.1 time: 0.028479 Jul 20 05:13:52.489491 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5172/6297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:52 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:13:52.533633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-834443778", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "32a91fe3-ebe0-42c0-823f-1cf96ac2611c"}], "security_groups": [{"name": "tempest-securitygroup--1956813352"}], "key_name": "tempest-keypair-84344834", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:52.636927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] validate_networks() for [('32a91fe3-ebe0-42c0-823f-1cf96ac2611c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:13:53.077482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:13:53.077927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:13:53.078417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:13:53.078838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:13:53.079263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:13:53.091175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:53.091652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:53.092524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:53.092969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:53.112605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:13:53.117901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:13:53.130444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:13:53.132826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:13:53.178513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59f9bf99-19b4-4486-a284-72bac992a9c9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.648713 Jul 20 05:13:53.179501 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5173/6298] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:13:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:13:53.189558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ea167bc2-7dfb-41f3-80fc-c0ce82a1dda3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:53.190188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ea167bc2-7dfb-41f3-80fc-c0ce82a1dda3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:53.245041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ea167bc2-7dfb-41f3-80fc-c0ce82a1dda3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:53.252616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ea167bc2-7dfb-41f3-80fc-c0ce82a1dda3 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1236 microversion: 2.1 time: 0.066796 Jul 20 05:13:53.253188 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5174/6299] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:53 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:54.272927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:54.273608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:54.283277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:54.283786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:54.284691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:54.285142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:54.355946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:54.363984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-adbaff4e-4683-428b-a201-870b00e05c28 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1294 microversion: 2.1 time: 0.097020 Jul 20 05:13:54.364747 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5175/6300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:54 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:55.382001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:55.382650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:55.389613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:55.390080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:55.390901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:55.391356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:55.534147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:55.543143 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb2d2a1d-bc19-4eec-91ac-2f3cbbb8cbbb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.165029 Jul 20 05:13:55.544023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5176/6301] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:55 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:55.725379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ffe702d3-1c44-423d-9231-d1f0756cb27e req-8186673d-1431-4df2-87b4-bc1630fd7fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:13:55.736751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ffe702d3-1c44-423d-9231-d1f0756cb27e req-8186673d-1431-4df2-87b4-bc1630fd7fb8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:55.737759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ffe702d3-1c44-423d-9231-d1f0756cb27e req-8186673d-1431-4df2-87b4-bc1630fd7fb8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:55.752111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ffe702d3-1c44-423d-9231-d1f0756cb27e req-8186673d-1431-4df2-87b4-bc1630fd7fb8 service nova] Creating event network-changed:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h2-764486-11 Jul 20 05:13:55.758196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ffe702d3-1c44-423d-9231-d1f0756cb27e req-8186673d-1431-4df2-87b4-bc1630fd7fb8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036453 Jul 20 05:13:55.759520 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5177/6302] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:13:56.561842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:56.562593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:56.569789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:56.570254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:56.571031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:56.571489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:56.701280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:56.709278 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-66747314-2944-4c1b-b5d3-ceac0ae1e4fc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.151380 Jul 20 05:13:56.709856 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5178/6303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:56 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:57.726461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:57.727079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:57.734290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:57.734768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:57.735566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:57.736023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:57.869504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:57.877078 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9a520e6c-8db6-49b4-9310-6a7c97fe211c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.155029 Jul 20 05:13:57.877660 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5179/6304] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:57 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:13:58.894832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:13:58.895456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:13:58.903078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:58.903540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:58.904320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:13:58.904794 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:13:59.050001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:13:59.057891 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7db75e16-ec81-4b45-99bf-031b239b5e34 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.167714 Jul 20 05:13:59.058474 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5180/6305] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:13:58 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:14:00.075328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:00.075948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:00.082902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:00.083370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:00.084163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:00.084680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:00.226280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:00.233684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f590107b-5f11-4cff-a85a-1de777b2c63e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.162380 Jul 20 05:14:00.234546 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5181/6306] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:00 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:01.252627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:01.253241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:01.260255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:01.260756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:01.261531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:01.261978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:01.266068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:01.396646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:01.404606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88b4d482-8643-4bd7-b062-5d02590cabef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.155950 Jul 20 05:14:01.405187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5182/6307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:01 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:01.770263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dd01114d-0db8-45fb-b8a6-b2dd1c8281da req-4b94a36a-0b0a-49a0-bdba-a51538195fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "name": "network-vif-plugged", "status": "completed", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:01.779066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd01114d-0db8-45fb-b8a6-b2dd1c8281da req-4b94a36a-0b0a-49a0-bdba-a51538195fbc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:01.779519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dd01114d-0db8-45fb-b8a6-b2dd1c8281da req-4b94a36a-0b0a-49a0-bdba-a51538195fbc service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:01.792131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dd01114d-0db8-45fb-b8a6-b2dd1c8281da req-4b94a36a-0b0a-49a0-bdba-a51538195fbc service nova] Creating event network-vif-plugged:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h2-764486-11 Jul 20 05:14:01.797101 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dd01114d-0db8-45fb-b8a6-b2dd1c8281da req-4b94a36a-0b0a-49a0-bdba-a51538195fbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Jul 20 05:14:01.797706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5183/6308] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:14:02.423997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:02.424739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:02.432016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:02.432513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:02.433310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:02.433749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:02.563605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:02.571277 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9beb92a-9c3b-45ba-a5cf-9e1586233ffe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1362 microversion: 2.1 time: 0.152462 Jul 20 05:14:02.571862 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5184/6309] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:02 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:03.589082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:03.589776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:03.591837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:03.592567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:03.599644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:03.600111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:03.600931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:03.601383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:03.734257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:03.742640 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e21e7213-9b53-41b1-b1ce-6bb8ee78d65a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1549 microversion: 2.1 time: 0.157062 Jul 20 05:14:03.743236 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5185/6310] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:03 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:03.759504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:03.760015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:03.766198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:03.766672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:03.767462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:03.767917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:03.849295 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef04faec-8567-4462-b1d2-59ba0e5d0622 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093762 Jul 20 05:14:03.849906 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5186/6311] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jul 20 05:14:03 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:14:04.780431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e4bc6b0d-536d-45e8-904e-55c799a4f0b8 req-34cd7f46-be08-410e-a04c-87e5ea887776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:04.790210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e4bc6b0d-536d-45e8-904e-55c799a4f0b8 req-34cd7f46-be08-410e-a04c-87e5ea887776 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:04.790388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e4bc6b0d-536d-45e8-904e-55c799a4f0b8 req-34cd7f46-be08-410e-a04c-87e5ea887776 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:04.801782 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e4bc6b0d-536d-45e8-904e-55c799a4f0b8 req-34cd7f46-be08-410e-a04c-87e5ea887776 service nova] Creating event network-changed:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h2-764486-11 Jul 20 05:14:04.807374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e4bc6b0d-536d-45e8-904e-55c799a4f0b8 req-34cd7f46-be08-410e-a04c-87e5ea887776 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031397 Jul 20 05:14:04.807995 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5187/6312] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:14:46.861907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:46.862619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:46.865143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:46.865803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=24 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:46.872724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:46.873186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:46.873964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:46.874411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:47.008153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:47.015844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5de6f7b3-f640-43cd-bcd1-a5aa4482dbef tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1667 microversion: 2.1 time: 0.158455 Jul 20 05:14:47.016435 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5188/6313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:46 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:47.032222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbee0a01-4d1e-4ac7-bf00-eee6f85bc9fa"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:47.033331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:47.041637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:47.042106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:47.043531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:47.043988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:47.296159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32b0d2f6-2030-40f4-a302-439160031f7f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267621 Jul 20 05:14:47.296810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5189/6314] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 05:14:47 2022] POST /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:14:57.944078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:57.944902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:14:57.949881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:14:57.951134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:57.959411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:57.959872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:57.960678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:57.961127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:57.990923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:57.996780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:14:58.004089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:14:58.004546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:14:58.005032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:14:58.005450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:14:58.005869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:14:58.069348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8fb0d7f2-d3b6-488c-8a31-37e9c220da03 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/action" status: 202 len: 0 microversion: 2.1 time: 0.127315 Jul 20 05:14:58.070004 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5190/6315] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:14:57 2022] POST /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:14:58.077720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:58.078379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:58.084961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:58.085432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:58.086326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:58.086781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:58.227480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:58.236244 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3de00eb4-994f-4d6e-ba5f-54ed239599c0 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1722 microversion: 2.1 time: 0.162158 Jul 20 05:14:58.236854 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5191/6316] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:58 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:14:59.254376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:14:59.255023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:14:59.262011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:59.262471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:59.263831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:14:59.264278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:14:59.396491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:14:59.405030 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f69585a-51c2-4e83-824b-2ad15170ffee tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1722 microversion: 2.1 time: 0.154651 Jul 20 05:14:59.405608 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5192/6317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:14:59 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:00.422624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:00.423266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:00.430588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:00.431051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:00.432112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:00.432598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:00.565761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:00.573897 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9b0ee1b6-3863-4215-94a8-94d6ecb8069f tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.155382 Jul 20 05:15:00.574472 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5193/6318] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:00 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:01.592306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:01.592974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:01.600099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:01.600605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:01.601558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:01.601846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:01.729775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:01.737837 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ccffd8c-948b-463a-9d1a-d6309b7c3be4 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.150009 Jul 20 05:15:01.738420 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5194/6319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:01 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:02.755233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:02.755853 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:02.762740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:02.763220 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:02.763991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:02.764473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:02.902981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:02.911798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d83ecdec-1e69-458a-934f-901707869b74 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.160470 Jul 20 05:15:02.912382 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5195/6320] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:02 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:03.929172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:03.929832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:03.937648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:03.938111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:03.938888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:03.939338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:04.067419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:04.075449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f244a81e-bfa2-4c5e-bb81-47483f8dd7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.150302 Jul 20 05:15:04.076025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5196/6321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:03 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:05.093130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:05.093801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:05.100773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:05.101244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:05.102039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:05.102493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:05.240262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:05.248855 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca8b4202-dd02-404b-a2d7-9ab48838b0e5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.159814 Jul 20 05:15:05.249432 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5197/6322] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:05 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:06.266173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:06.266840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:06.273736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:06.274201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:06.274974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:06.275450 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:06.404827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:06.412903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aab5ffe0-44c2-4443-ba9a-c93e5bfda8dc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.151260 Jul 20 05:15:06.413501 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5198/6323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:06 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:07.475496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:07.476124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:07.482896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:07.483362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:07.484134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:07.484601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:07.614561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:07.622594 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c020eb18-1c24-417b-8c0f-de885134f12b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.196886 Jul 20 05:15:07.623181 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5199/6324] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:07 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:08.639712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:08.640401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:08.647420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:08.647881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:08.648688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:08.649137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:08.784427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:08.792496 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4eac9cff-278c-477c-96f4-107ade239279 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.157153 Jul 20 05:15:08.793075 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5200/6325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:08 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:09.811118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:09.811789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:09.818810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:09.819278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:09.820070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:09.820552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:09.962256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:09.971874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f33086d-7b89-4275-8ea1-079f83a1a8e6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.165356 Jul 20 05:15:09.972499 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5201/6326] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:09 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:10.989491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:10.990085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:10.997045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:10.997517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:10.998307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:10.998752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:11.462701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:11.470714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-effbc8e7-4009-4524-b779-7b6b85087b84 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.485279 Jul 20 05:15:11.471294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5202/6327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:10 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:12.487221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:12.488591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:12.496206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:12.496724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:12.497511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:12.498167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:12.675003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:12.687512 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b114bd6-dd5a-490a-aaea-497c81812d2a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.204242 Jul 20 05:15:12.688141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5203/6328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:12 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:13.705349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:13.705990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:13.713045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:13.713513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:13.714302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:13.714757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:13.846934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:13.855335 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9399a4f-64b4-4e1a-bc0b-2b1abde1ffcc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1727 microversion: 2.1 time: 0.153960 Jul 20 05:15:13.855917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5204/6329] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:13 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:14.877565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:14.878261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:14.885161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:14.885624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:14.886508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:14.886950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:14.892007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:15.097074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:15.107099 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7424a9b-13e5-43ab-abd0-44dfafba255d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1726 microversion: 2.1 time: 0.236578 Jul 20 05:15:15.107884 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5205/6330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:14 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:15.113321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-64f06c6b-50d8-46e6-aaa6-ebbdbe58f861 req-9b9d3af6-baee-4873-b6cb-f2cb53fabe82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "name": "network-vif-unplugged", "status": "completed", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:15.126208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-64f06c6b-50d8-46e6-aaa6-ebbdbe58f861 req-9b9d3af6-baee-4873-b6cb-f2cb53fabe82 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:15.126694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-64f06c6b-50d8-46e6-aaa6-ebbdbe58f861 req-9b9d3af6-baee-4873-b6cb-f2cb53fabe82 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:15.143697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-64f06c6b-50d8-46e6-aaa6-ebbdbe58f861 req-9b9d3af6-baee-4873-b6cb-f2cb53fabe82 service nova] Creating event network-vif-unplugged:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h1-764486-11 Jul 20 05:15:15.151166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-64f06c6b-50d8-46e6-aaa6-ebbdbe58f861 req-9b9d3af6-baee-4873-b6cb-f2cb53fabe82 service nova] Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:15:15.164309 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-64f06c6b-50d8-46e6-aaa6-ebbdbe58f861 req-9b9d3af6-baee-4873-b6cb-f2cb53fabe82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054675 Jul 20 05:15:15.165450 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5206/6331] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:16.127399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:16.128526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:16.135343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:16.135822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:16.136653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:16.137283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:16.282679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:16.291115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-97b64cb1-cfdb-4878-b0db-ab532f3e04df tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1726 microversion: 2.1 time: 0.168904 Jul 20 05:15:16.291694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5207/6332] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:16 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:17.183443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7c1bc3ca-0df6-4843-9f4a-be91c0263cca req-b6f8d9ca-97a5-436a-a9b5-1cc2a1434a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:17.192451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c1bc3ca-0df6-4843-9f4a-be91c0263cca req-b6f8d9ca-97a5-436a-a9b5-1cc2a1434a45 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:17.192918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7c1bc3ca-0df6-4843-9f4a-be91c0263cca req-b6f8d9ca-97a5-436a-a9b5-1cc2a1434a45 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:17.204897 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7c1bc3ca-0df6-4843-9f4a-be91c0263cca req-b6f8d9ca-97a5-436a-a9b5-1cc2a1434a45 service nova] Creating event network-changed:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h1-764486-11 Jul 20 05:15:17.210360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-7c1bc3ca-0df6-4843-9f4a-be91c0263cca req-b6f8d9ca-97a5-436a-a9b5-1cc2a1434a45 service nova] Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:15:17.221482 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7c1bc3ca-0df6-4843-9f4a-be91c0263cca req-b6f8d9ca-97a5-436a-a9b5-1cc2a1434a45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042056 Jul 20 05:15:17.222291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5208/6333] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:15:17.309915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:17.310641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:17.317570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:17.318042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:17.319131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:17.319589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:17.556337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:17.566202 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c2edfa7e-ec07-4829-84ff-f17324b9668e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.261133 Jul 20 05:15:17.567137 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5209/6334] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:17 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:18.584373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:18.585014 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:18.592198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:18.592777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:18.593574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:18.594150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:18.724439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:18.733123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbab94d9-7a99-4f7a-bc4a-cda1521d6f95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.152684 Jul 20 05:15:18.734006 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5210/6335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:18 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:19.751516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:19.752158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:19.759316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:19.759786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:19.760605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:19.761064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:19.901872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:19.910724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c59df138-0e68-4d2e-a792-606ede77c473 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.163930 Jul 20 05:15:19.911316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5211/6336] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:19 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:20.928966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:20.929633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:20.936609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:20.937070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:20.937884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:20.938335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:21.069684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:21.078857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41695f4a-f82f-4287-acfa-df79a48ec6f9 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.153363 Jul 20 05:15:21.079374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5212/6337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:20 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:22.096680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:22.097309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:22.104104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:22.104612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:22.105394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:22.105844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:22.240570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:22.248577 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95e1f57e-ecfc-48a6-b76d-e387180ab7ed tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.156003 Jul 20 05:15:22.249164 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5213/6338] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:22 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:23.266051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:23.267270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:23.274430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:23.274897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:23.275679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:23.276131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:23.408736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:23.416933 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dd4c4876-2dfe-4a04-987c-d3a717bc5c31 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.154909 Jul 20 05:15:23.417526 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5214/6339] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:23 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:24.434955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:24.435713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:24.442614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:24.443080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:24.443864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:24.444316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:24.575574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:24.584382 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1d3eccbc-0bd8-4d03-be3d-3f14b02e88f1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.153709 Jul 20 05:15:24.584968 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5215/6340] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:24 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:25.602074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:25.602755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:25.610619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:25.611111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:25.611901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:25.612411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:25.807438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:25.816196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-faa9cc34-8876-4a98-ae9b-86b59a14bfb5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.218238 Jul 20 05:15:25.817032 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5216/6341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:25 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:26.834567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:26.835200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:26.842126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:26.843395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:26.843395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:26.844315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:26.972683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:26.980667 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c963325-e234-4492-836d-17031aa2abcb tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1724 microversion: 2.1 time: 0.150013 Jul 20 05:15:26.981268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5217/6342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:26 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:27.999528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:28.000792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:28.003642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=61 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:28.009283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.009706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.011303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.011761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.151557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:28.160900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33fd3080-f45e-425b-a89a-857ee404eb4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1721 microversion: 2.1 time: 0.165956 Jul 20 05:15:28.161482 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5218/6343] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:27 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:28.177861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:28.178419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:28.184669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.185131 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.185900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.186347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.225011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.225482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.226381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.226852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.248807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:15:28.255026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Getting quotas for user a569d791bce24e5a8c6181e81f1ce316 and project a2b010939fc24ab4b7b295fa85a1905c. Resources: {'ram', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:15:28.338433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:28.371861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-67cb7aa3-78e0-40c5-a1c1-29bcf17b5b40 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "POST /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/action" status: 202 len: 0 microversion: 2.1 time: 0.197077 Jul 20 05:15:28.372982 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5219/6344] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:15:28 2022] POST /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:15:28.381409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:28.382134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:28.388502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.388984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.389778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:28.390230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:28.590772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:28.600544 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab8f59dd-b94b-425b-81b2-5ddd5694be39 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.223142 Jul 20 05:15:28.601524 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5220/6345] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:28 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:29.618732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:29.619397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:29.627012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:29.627476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:29.628255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:29.628746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:29.758182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:29.766144 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-312c01c5-8da9-412e-998c-10fe79542d4c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.151530 Jul 20 05:15:29.766717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5221/6346] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:29 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:30.784213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:30.784917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:30.791930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.792436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.793243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.793698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.933843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:30.942904 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4a6ecd7b-ad62-4eee-8c20-8797da249f24 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.163409 Jul 20 05:15:30.943657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5222/6347] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:30 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:30.948244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a46a218d-3682-4948-9e0d-7efb7a335354 req-82e5ea7f-bc26-4070-b024-65a3529b6756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "name": "network-vif-plugged", "status": "completed", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:30.956294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a46a218d-3682-4948-9e0d-7efb7a335354 req-82e5ea7f-bc26-4070-b024-65a3529b6756 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:30.956787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a46a218d-3682-4948-9e0d-7efb7a335354 req-82e5ea7f-bc26-4070-b024-65a3529b6756 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:30.971071 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a46a218d-3682-4948-9e0d-7efb7a335354 req-82e5ea7f-bc26-4070-b024-65a3529b6756 service nova] Creating event network-vif-plugged:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h1-764486-11 Jul 20 05:15:30.976515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-a46a218d-3682-4948-9e0d-7efb7a335354 req-82e5ea7f-bc26-4070-b024-65a3529b6756 service nova] Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-764486-11', 'n-h1-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:15:30.987878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a46a218d-3682-4948-9e0d-7efb7a335354 req-82e5ea7f-bc26-4070-b024-65a3529b6756 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043042 Jul 20 05:15:30.988501 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5223/6348] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:31.961845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:31.962532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:31.969658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:31.970120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:31.970906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:31.971349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:32.109609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:32.117842 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a9d0a99-3a40-4614-94e0-2ca836744cb2 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.161242 Jul 20 05:15:32.118418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5224/6349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:31 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:33.135946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:33.136620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:33.144705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:33.145341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:33.145978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:33.146431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:33.299031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:33.308266 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89094012-e58b-4fc9-9bc4-3b63534a0edc tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.176170 Jul 20 05:15:33.309036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5225/6350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:33 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:33.817422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c20e4c00-fd17-4252-978d-76dca15eb385 req-738f0c8a-64fc-473a-9ef5-3742a5164b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "name": "network-vif-unplugged", "status": "completed", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:33.827326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c20e4c00-fd17-4252-978d-76dca15eb385 req-738f0c8a-64fc-473a-9ef5-3742a5164b1e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:33.827838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c20e4c00-fd17-4252-978d-76dca15eb385 req-738f0c8a-64fc-473a-9ef5-3742a5164b1e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:33.841554 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c20e4c00-fd17-4252-978d-76dca15eb385 req-738f0c8a-64fc-473a-9ef5-3742a5164b1e service nova] Creating event network-vif-unplugged:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h2-764486-11 Jul 20 05:15:33.847382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-c20e4c00-fd17-4252-978d-76dca15eb385 req-738f0c8a-64fc-473a-9ef5-3742a5164b1e service nova] Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:15:33.861055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c20e4c00-fd17-4252-978d-76dca15eb385 req-738f0c8a-64fc-473a-9ef5-3742a5164b1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046141 Jul 20 05:15:33.861374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5226/6351] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:34.329088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:34.329920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:34.336716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:34.337411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:34.338213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:34.338855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:34.502633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:34.511476 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ead3c1d-b37b-419d-ac4d-35a2289e9e1d tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.188008 Jul 20 05:15:34.512090 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5227/6352] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:34 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:35.533217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:35.535073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:35.541754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:35.542219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:35.543013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:35.543468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:35.679569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:35.688763 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0d8689f-006a-479e-b539-abd18c02ffaa tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.163128 Jul 20 05:15:35.689358 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5228/6353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:35 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:35.878209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9cf94aab-512f-45fb-b22f-54d89e9afa39 req-fae4799a-64f0-4d8a-8c04-ea43b8ae7ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:35.889184 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9cf94aab-512f-45fb-b22f-54d89e9afa39 req-fae4799a-64f0-4d8a-8c04-ea43b8ae7ca6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:35.889823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9cf94aab-512f-45fb-b22f-54d89e9afa39 req-fae4799a-64f0-4d8a-8c04-ea43b8ae7ca6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:35.906920 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9cf94aab-512f-45fb-b22f-54d89e9afa39 req-fae4799a-64f0-4d8a-8c04-ea43b8ae7ca6 service nova] Creating event network-changed:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h2-764486-11 Jul 20 05:15:35.914747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-9cf94aab-512f-45fb-b22f-54d89e9afa39 req-fae4799a-64f0-4d8a-8c04-ea43b8ae7ca6 service nova] Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:15:35.926737 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9cf94aab-512f-45fb-b22f-54d89e9afa39 req-fae4799a-64f0-4d8a-8c04-ea43b8ae7ca6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052460 Jul 20 05:15:35.927368 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5229/6354] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:15:36.708111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:36.708774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:36.715345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:36.715810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:36.716625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:36.717079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:36.852240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:36.861593 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8448577-8d32-417d-8a02-1b0e35b6caf6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.159213 Jul 20 05:15:36.862758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5230/6355] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:36 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:37.879363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:37.880015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:37.887455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:37.887922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:37.888752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:37.889205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:38.038577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:38.048123 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-74cb6158-31b9-4791-918f-78b73806180c tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.172700 Jul 20 05:15:38.048986 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5231/6356] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:37 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:39.065884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:39.066499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:39.068550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:39.075052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:39.075518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:39.076316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:39.076799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:39.218134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:39.227353 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09eac3cc-768b-4ccc-8842-63f4754550bf tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.165289 Jul 20 05:15:39.227941 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5232/6357] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:39 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:40.244537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:40.245202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:40.252682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:40.253252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:40.254101 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:40.254462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:40.638728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:40.647257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d0c2313-17b5-40c6-b0a7-73eec47ff0dd tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.406692 Jul 20 05:15:40.647855 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5233/6358] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:40 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:41.665433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:41.666105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:41.673777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.674230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.675006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:41.675460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:41.814263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:41.822733 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46289081-08b2-4d56-b787-b7657a32825b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.161142 Jul 20 05:15:41.823361 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5234/6359] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:41 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:42.840111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:42.840766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:42.848672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:42.849095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:42.849880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:42.850322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:42.986217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:42.994342 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7c793e4-a695-4f41-80ab-adc8b3232f21 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.158189 Jul 20 05:15:42.994918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5235/6360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:42 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:44.012146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:44.012824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:44.020836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:44.021653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:44.023055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:44.023845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:44.156328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:44.164897 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-46d41579-30b6-4897-b5d3-5d455482383a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.156846 Jul 20 05:15:44.165477 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5236/6361] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:44 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:45.183577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:45.184201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:45.191722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:45.192189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:45.193042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:45.193492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:45.197664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:45.324781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:45.332824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7686df2f-0236-453a-ac1b-a64e0724b7d1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.153556 Jul 20 05:15:45.333403 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5237/6362] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:45 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:46.351406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:46.352037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:46.358497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:46.358954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:46.359747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:46.360203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:46.492954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:46.501478 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c1500fd6-7967-49d3-a190-b84a4abcef4b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1720 microversion: 2.1 time: 0.154487 Jul 20 05:15:46.502055 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5238/6363] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:46 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:47.519563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:47.520460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:47.527342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:47.527804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:47.528612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:47.529068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:47.659462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:47.669553 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-418fca08-99c3-4aeb-9b72-b04e8ef6702b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1713 microversion: 2.1 time: 0.154636 Jul 20 05:15:47.670145 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5239/6364] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:47 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:47.690412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:47.691044 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:47.698984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:47.699456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:47.700253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:47.700731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:47.834628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:47.842878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c80e7f35-a310-49fb-b45f-53c471a840a7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1713 microversion: 2.1 time: 0.157503 Jul 20 05:15:47.843468 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5240/6365] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:47 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:15:47.859180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:47.859812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:47.866395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:47.866867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:47.867660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:47.868116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:47.997404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:48.005724 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1278437-38ec-4457-871f-ac2294f2a1a6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1713 microversion: 2.1 time: 0.150235 Jul 20 05:15:48.006308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5241/6366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:47 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:48.021928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:48.022439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:48.028504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:48.028970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:48.029756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:48.030214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:48.056813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:15:48.133982 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dfaebaeb-57ff-43c4-b242-1b11d35807ad tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 204 len: 0 microversion: 2.1 time: 0.115469 Jul 20 05:15:48.134632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5242/6367] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:15:48 2022] DELETE /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:15:48.144754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:48.145462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:48.151727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:48.152187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:48.152998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:48.153476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:48.291942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:48.301172 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5b452da-70d9-454e-bfcc-ed1af5d1e712 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1719 microversion: 2.1 time: 0.161113 Jul 20 05:15:48.301783 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5243/6368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:48 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:49.319368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:49.320177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:49.327080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:49.327548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:49.328326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:49.328802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:49.467985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:49.476045 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abe78ffc-07ba-4aed-87d9-62cff2643412 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1719 microversion: 2.1 time: 0.160628 Jul 20 05:15:49.476658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5244/6369] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:49 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:50.494980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:50.496094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:50.504936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:50.505405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:50.507001 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:50.507456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:50.577511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:50.589006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9811bb95-1bca-4963-b98e-62e207749d85 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1651 microversion: 2.1 time: 0.100142 Jul 20 05:15:50.589825 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5245/6370] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:50 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1651 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:50.672721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f0feb645-e397-4eb0-8fc7-6d620f762e6d req-74307925-61ca-4235-8e08-2e652e54e69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1936e737-3385-4ff0-a8c0-69ad5fce7993", "name": "network-vif-deleted", "tag": "909a8d49-28fe-4f31-aab8-9ef7dc00560c"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:15:50.683487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0feb645-e397-4eb0-8fc7-6d620f762e6d req-74307925-61ca-4235-8e08-2e652e54e69c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:50.684067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f0feb645-e397-4eb0-8fc7-6d620f762e6d req-74307925-61ca-4235-8e08-2e652e54e69c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:50.698270 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f0feb645-e397-4eb0-8fc7-6d620f762e6d req-74307925-61ca-4235-8e08-2e652e54e69c service nova] Creating event network-vif-deleted:909a8d49-28fe-4f31-aab8-9ef7dc00560c for instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 on n-h2-764486-11 Jul 20 05:15:50.706619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f0feb645-e397-4eb0-8fc7-6d620f762e6d req-74307925-61ca-4235-8e08-2e652e54e69c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038060 Jul 20 05:15:50.707333 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5246/6371] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:15:51.611729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:51.612522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:51.620683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:51.621452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:51.622270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:51.622889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:51.698831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:51.707844 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-967a878c-eef5-4874-aa12-0662180528c1 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1367 microversion: 2.1 time: 0.100867 Jul 20 05:15:51.708620 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5247/6372] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:51 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1367 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:52.725029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:52.725660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:52.732682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:52.733145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:52.733927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:52.734372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:52.800667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:52.808959 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c6a31fad-1d8c-4a91-a1ee-25fc941c09ea tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1367 microversion: 2.1 time: 0.087826 Jul 20 05:15:52.809561 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5248/6373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:52 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:53.825835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:53.826482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:53.833914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:53.834379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:53.835260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:53.835716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:53.897777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:53.905863 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ec5ccc69-ccaa-44b2-85d8-508e1776380e tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1367 microversion: 2.1 time: 0.084015 Jul 20 05:15:53.906454 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5249/6374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:53 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:54.923187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:54.924509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:54.931846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:54.932326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:54.933480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:54.934673 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:54.969800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:54.970269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:54.970749 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lazy-loading 'fault' on Instance uuid 1936e737-3385-4ff0-a8c0-69ad5fce7993 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:15:55.011860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569d791bce24e5a8c6181e81f1ce316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b010939fc24ab4b7b295fa85a1905c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:15:55.020120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a929e44e-03dd-4fbe-8a26-2144735b664b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 200 len: 1372 microversion: 2.1 time: 0.100802 Jul 20 05:15:55.020819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5250/6375] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:54 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:15:56.038368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:56.039018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:56.045842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:56.046308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:56.047087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:56.047539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:56.061079 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 HTTP/1.1 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1936e737-3385-4ff0-a8c0-69ad5fce7993'} Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:56.062761 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6bd6d1c-e4ca-484c-b334-bca306b7a7e7 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 404 len: 111 microversion: 2.1 time: 0.029928 Jul 20 05:15:56.067255 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5251/6376] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:56 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:56.121110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:56.122060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:56.128783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:56.129252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:56.130026 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:56.130475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:56.144542 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-volume_attachments HTTP/1.1 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '1936e737-3385-4ff0-a8c0-69ad5fce7993'} Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:56.146203 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-334127a9-33ee-4349-bc24-1cba4ad3ff1a tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030912 Jul 20 05:15:56.149981 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5252/6377] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:15:56 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.450401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.451013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.454082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:59.460328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.460851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.461655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.462140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.477291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 HTTP/1.1 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1936e737-3385-4ff0-a8c0-69ad5fce7993'} Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.478866 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-de02fa95-cb0c-459f-bf24-c8ce5734734b tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 404 len: 111 microversion: 2.1 time: 0.033837 Jul 20 05:15:59.483011 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5253/6378] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:15:59 2022] DELETE /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.494475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.495350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 1936e737-3385-4ff0-a8c0-69ad5fce7993] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.501487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.501948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.502720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.503169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.517000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 HTTP/1.1 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '1936e737-3385-4ff0-a8c0-69ad5fce7993'} Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.518563 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 1936e737-3385-4ff0-a8c0-69ad5fce7993 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ca38911-e41c-43ef-a83c-6ab0cceca8c5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993" status: 404 len: 111 microversion: 2.1 time: 0.029222 Jul 20 05:15:59.522647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5254/6379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:59 2022] GET /compute/v2.1/servers/1936e737-3385-4ff0-a8c0-69ad5fce7993 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.528714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.529224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.535490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.535956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.537421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.538688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.542622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:15:59.554986 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 HTTP/1.1 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ffe86a35-4f2f-4e11-8fbb-de689c6e71c7'} Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.556990 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.560889 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6cb884ee-b25c-4643-88cd-82431e3bd1f6 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 404 len: 111 microversion: 2.1 time: 0.033407 Jul 20 05:15:59.562191 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5255/6380] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:15:59 2022] DELETE /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.567099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.567775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: ffe86a35-4f2f-4e11-8fbb-de689c6e71c7] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.576331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.576818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.577610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.578059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.595235 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 HTTP/1.1 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ffe86a35-4f2f-4e11-8fbb-de689c6e71c7'} Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.596845 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b8d598c5-e7d7-4b4f-8fbc-d80cd6bc2e95 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7" status: 404 len: 111 microversion: 2.1 time: 0.035065 Jul 20 05:15:59.602067 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5256/6381] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:59 2022] GET /compute/v2.1/servers/ffe86a35-4f2f-4e11-8fbb-de689c6e71c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:15:59.607534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.608045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.614239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.615537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.616046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.616541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.630434 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 HTTP/1.1 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '79a0ab95-c224-4419-8fea-510dade73843'} Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.632005 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f3227282-e8ae-41d4-ba53-7ea1f6970b61 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 404 len: 111 microversion: 2.1 time: 0.029841 Jul 20 05:15:59.635773 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5257/6382] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:15:59 2022] DELETE /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.641757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.642377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 79a0ab95-c224-4419-8fea-510dade73843] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.648783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.649245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.650024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.650471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.664764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 HTTP/1.1 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '79a0ab95-c224-4419-8fea-510dade73843'} Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.666423 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 79a0ab95-c224-4419-8fea-510dade73843 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.670484 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3120758-e27e-41e2-96c7-300f1d0210fe tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jul 20 05:15:59.671352 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5258/6383] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:59 2022] GET /compute/v2.1/servers/79a0ab95-c224-4419-8fea-510dade73843 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.675932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.676391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.682706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.683160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.683935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.684399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.698700 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e HTTP/1.1 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2c2d7066-9778-4b65-816f-e5889c562f7e'} Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.700304 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-52f7f472-5b8f-48c3-9a11-1164293a7a77 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 404 len: 111 microversion: 2.1 time: 0.029471 Jul 20 05:15:59.704167 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5259/6384] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:15:59 2022] DELETE /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.710510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.711127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [instance: 2c2d7066-9778-4b65-816f-e5889c562f7e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:15:59.717290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.717751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.718533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:15:59.718978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:15:59.737501 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] HTTP exception thrown: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Request method failure captured: Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e HTTP/1.1 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi144vysX3AzCX7sM3kYs4VO67jJ3xcdwZkK1xSU-w1fCzM3REpTL2gfYg9kt-XkZ_PvOeIVcTmop1k3IHD_qgNEwl3YXMS75kGbfuoPj4acA7wx8GEOV6-4MlhPOgjtYFBQAgQbpMswD_geYp7fw9abhO6VL0PAhKUoD3PHSQ5pyuo3Q Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2b010939fc24ab4b7b295fa85a1905c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2b010939fc24ab4b7b295fa85a1905c", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: a2b010939fc24ab4b7b295fa85a1905c Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1314244090 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: a569d791bce24e5a8c6181e81f1ce316 Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServerActionsTestJSON-1314244090-project Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '2c2d7066-9778-4b65-816f-e5889c562f7e'} Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:15:59.739089 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Returning 404 to user: Instance 2c2d7066-9778-4b65-816f-e5889c562f7e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:15:59.743062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1572e395-5126-4ada-8270-6bd49b1a53e8 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e" status: 404 len: 111 microversion: 2.1 time: 0.034236 Jul 20 05:15:59.744002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5260/6385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:15:59 2022] GET /compute/v2.1/servers/2c2d7066-9778-4b65-816f-e5889c562f7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:15:59.749670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ea251da-fcd8-4e96-97f6-724c594e79d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] Calling method '.version_select at 0x7f838b0f4700>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:15:59.753068 n-d-764486-11 devstack@n-api.service[123724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ea251da-fcd8-4e96-97f6-724c594e79d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [7bf5ac51-90a9-4ad8-a56a-6f64659177d7] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:16:00.760681 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ea251da-fcd8-4e96-97f6-724c594e79d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] [7bf5ac51-90a9-4ad8-a56a-6f64659177d7] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51132. Jul 20 05:16:00.780459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ea251da-fcd8-4e96-97f6-724c594e79d5 tempest-ServerActionsTestJSON-1314244090 tempest-ServerActionsTestJSON-1314244090-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84344834" status: 202 len: 0 microversion: 2.1 time: 1.034640 Jul 20 05:16:00.781058 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5261/6386] 10.222.0.49 () {58 vars in 1214 bytes} [Wed Jul 20 05:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84344834 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:16:09.815572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:09.938217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1371603945", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0c3c7fc6-8ac3-4f3c-afba-0cd4eb83bdc5"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:09.993511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] validate_networks() for [('0c3c7fc6-8ac3-4f3c-afba-0cd4eb83bdc5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:16:10.406727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:16:10.407175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:16:10.407659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:16:10.408092 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:16:10.408582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:16:10.418655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:10.419126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:10.419951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:10.420426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:10.439510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Getting quotas for project 84741dd63e264f168919d7959ed87a2e. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:16:10.445515 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Getting quotas for user 705e07bd02e141efa0f60fe46beadd18 and project 84741dd63e264f168919d7959ed87a2e. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:16:10.460456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:16:10.462908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:16:10.515096 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60dd5230-6c36-48e9-94fa-f3e877b970a7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706695 Jul 20 05:16:10.515769 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5262/6387] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:16:10.529287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-80e1424c-1319-4845-9be2-1b15a79463cf tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:10.529926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-80e1424c-1319-4845-9be2-1b15a79463cf tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:10.592072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-80e1424c-1319-4845-9be2-1b15a79463cf tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:10.600440 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-80e1424c-1319-4845-9be2-1b15a79463cf tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1217 microversion: 2.1 time: 0.077835 Jul 20 05:16:10.601384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5263/6388] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:10 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:11.618379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:11.619012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:11.627524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:11.627996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:11.628831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:11.629702 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:11.993970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:12.002366 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33c51776-727a-43a2-827c-0b7608f8544a tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1277 microversion: 2.1 time: 0.388718 Jul 20 05:16:12.002942 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5264/6389] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:11 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:13.025898 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:13.026563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:13.044558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.045652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.046481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.046939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.337112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:13.349681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3365df38-c8f1-4ec2-a21b-d259b23cabcb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.331490 Jul 20 05:16:13.359221 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5265/6390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:13 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:13.558395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b8ffc060-ab44-4ce1-99a2-0d64d29d23b8 req-bae66091-c96c-446f-a686-3e41d0d25365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4491adc-1122-4a03-ba45-498c9bf5150e", "tag": "1c376ebb-3d44-488a-93be-ff68505299b7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:13.574930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8ffc060-ab44-4ce1-99a2-0d64d29d23b8 req-bae66091-c96c-446f-a686-3e41d0d25365 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:13.575911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b8ffc060-ab44-4ce1-99a2-0d64d29d23b8 req-bae66091-c96c-446f-a686-3e41d0d25365 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:13.610217 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b8ffc060-ab44-4ce1-99a2-0d64d29d23b8 req-bae66091-c96c-446f-a686-3e41d0d25365 service nova] Creating event network-changed:1c376ebb-3d44-488a-93be-ff68505299b7 for instance f4491adc-1122-4a03-ba45-498c9bf5150e on n-h1-764486-11 Jul 20 05:16:13.615869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b8ffc060-ab44-4ce1-99a2-0d64d29d23b8 req-bae66091-c96c-446f-a686-3e41d0d25365 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061694 Jul 20 05:16:13.616787 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5266/6391] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:16:14.367686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:14.368447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:14.374725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:14.375192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:14.375976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:14.376456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:14.512803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:14.520148 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fbd5276b-5f1b-4504-8e54-af77209a54b6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.158075 Jul 20 05:16:14.520817 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5267/6392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:14 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:15.537710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:15.538325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:15.545457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:15.545921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:15.546707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:15.547156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:15.685149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:15.692805 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa0fb76e-5741-42cd-9654-b01ed7abb407 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.159616 Jul 20 05:16:15.693389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5268/6393] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:15 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:16.710070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:16.710809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:16.716888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:16.717355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:16.718139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:16.718591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:16.844153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:16.852602 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b81449d3-e293-422f-8925-7582d509f4a3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.146691 Jul 20 05:16:16.853131 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5269/6394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:16 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:17.869948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:17.870584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:17.877635 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:17.878094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:17.878868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:17.879317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:18.010753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:18.018472 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d2a51329-8b14-4592-9651-8295c83d5d0e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.152472 Jul 20 05:16:18.019064 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5270/6395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:17 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:19.038352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:19.039102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:19.046841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:19.048247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:19.049187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:19.049755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:19.187029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:19.195189 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-59886510-5b52-42be-9df6-6bdefd551d6e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.163043 Jul 20 05:16:19.195778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5271/6396] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:19 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:19.200215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9f666bca-7965-4ab4-9f46-9421d92906c1 req-5ba4e32a-f815-46b7-a818-3962587a8098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4491adc-1122-4a03-ba45-498c9bf5150e", "name": "network-vif-plugged", "status": "completed", "tag": "1c376ebb-3d44-488a-93be-ff68505299b7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:19.209306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f666bca-7965-4ab4-9f46-9421d92906c1 req-5ba4e32a-f815-46b7-a818-3962587a8098 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:19.209756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f666bca-7965-4ab4-9f46-9421d92906c1 req-5ba4e32a-f815-46b7-a818-3962587a8098 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:19.220614 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9f666bca-7965-4ab4-9f46-9421d92906c1 req-5ba4e32a-f815-46b7-a818-3962587a8098 service nova] Creating event network-vif-plugged:1c376ebb-3d44-488a-93be-ff68505299b7 for instance f4491adc-1122-4a03-ba45-498c9bf5150e on n-h1-764486-11 Jul 20 05:16:19.225692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9f666bca-7965-4ab4-9f46-9421d92906c1 req-5ba4e32a-f815-46b7-a818-3962587a8098 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028751 Jul 20 05:16:19.226287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5272/6397] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:20.214068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:20.214787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:20.221022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:20.221541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:20.222266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:20.222718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:20.360978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:20.368562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce2c9742-a02d-460e-bda4-b421cc367733 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1317 microversion: 2.1 time: 0.160229 Jul 20 05:16:20.369135 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5273/6398] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:20 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:21.385396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:21.386017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:21.387968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:21.388701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:21.395990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:21.396480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:21.397272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:21.397718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:21.529652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:21.537653 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e8e84bf-dc41-4a36-be32-18a9453441ce tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.156197 Jul 20 05:16:21.538226 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5274/6399] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:21 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:21.591572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1468433544", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "0c3c7fc6-8ac3-4f3c-afba-0cd4eb83bdc5"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:21.643216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] validate_networks() for [('0c3c7fc6-8ac3-4f3c-afba-0cd4eb83bdc5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:16:22.012171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:16:22.012631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:16:22.013120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:16:22.013540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:16:22.014008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:16:22.023744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:22.024204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:22.025059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:22.025530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:22.043279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Getting quotas for project 84741dd63e264f168919d7959ed87a2e. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:16:22.048603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Getting quotas for user 705e07bd02e141efa0f60fe46beadd18 and project 84741dd63e264f168919d7959ed87a2e. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:16:22.061018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:16:22.063274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:16:22.107603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6018a2c-31ae-420a-a51b-dfd8c567715e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519842 Jul 20 05:16:22.108299 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5275/6400] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:16:22.118021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63775bde-feb5-4ae9-ba91-7f47da240408 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:22.118642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63775bde-feb5-4ae9-ba91-7f47da240408 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:22.173109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63775bde-feb5-4ae9-ba91-7f47da240408 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:22.179809 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63775bde-feb5-4ae9-ba91-7f47da240408 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1217 microversion: 2.1 time: 0.065580 Jul 20 05:16:22.180685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5276/6401] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:22 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:23.198061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:23.198764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:23.207217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:23.207598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:23.208473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:23.208933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:23.271301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:23.278841 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-85406197-92dc-4190-b4a4-f2dd5ae635e3 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1275 microversion: 2.1 time: 0.085560 Jul 20 05:16:23.279433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5277/6402] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:23 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:24.295253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:24.295942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:24.304080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:24.305008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:24.306237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:24.306836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:24.486734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:24.495203 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10f1981b-c51d-45eb-9208-23d865652146 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.203920 Jul 20 05:16:24.496075 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5278/6403] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:24 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:24.504060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-820e85eb-bdf4-4f90-849e-959c195046d4 req-4fa4610d-8dd4-4a68-8ebe-c0b3808a0d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b35991-aa42-4201-a487-e66b7867b8ae", "tag": "f6b00e41-3a1a-4809-99dd-09d193823390"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:24.518064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-820e85eb-bdf4-4f90-849e-959c195046d4 req-4fa4610d-8dd4-4a68-8ebe-c0b3808a0d00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:24.518648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-820e85eb-bdf4-4f90-849e-959c195046d4 req-4fa4610d-8dd4-4a68-8ebe-c0b3808a0d00 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:24.531821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-820e85eb-bdf4-4f90-849e-959c195046d4 req-4fa4610d-8dd4-4a68-8ebe-c0b3808a0d00 service nova] Creating event network-changed:f6b00e41-3a1a-4809-99dd-09d193823390 for instance c4b35991-aa42-4201-a487-e66b7867b8ae on n-h2-764486-11 Jul 20 05:16:24.537707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-820e85eb-bdf4-4f90-849e-959c195046d4 req-4fa4610d-8dd4-4a68-8ebe-c0b3808a0d00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040256 Jul 20 05:16:24.538325 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5279/6404] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:16:25.513607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:25.514313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:25.521380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:25.521848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:25.522640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:25.523148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:25.652907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:25.660689 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d78169d-8a6d-42d4-8e08-ad624d8eef0c tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.152111 Jul 20 05:16:25.661270 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5280/6405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:25 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:26.678193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:26.678818 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:26.685966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:26.686423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:26.687197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:26.687643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:26.814533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:26.823234 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53718018-abf2-45d0-98ba-7d549a7bbdfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.149527 Jul 20 05:16:26.823818 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5281/6406] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:26 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:27.839996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:27.840659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:27.847618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:27.848085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:27.848901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:27.849372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:27.983385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:27.991419 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-34d4ff9e-39f6-4e51-98a8-5fb1c7e7e867 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.155356 Jul 20 05:16:27.991995 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5282/6407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:27 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:29.009050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:29.009632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:29.016589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:29.017055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:29.017837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:29.018318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:29.146874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:29.150418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:29.155325 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-14206454-2d2b-4427-a9ef-8e10766c6a03 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.150821 Jul 20 05:16:29.155912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5283/6408] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:29 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:30.173857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:30.174474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:30.177148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:30.182759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:30.183224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:30.184022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:30.184506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:30.324244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:30.331659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d7979702-9a80-4379-858f-728fe667dbd0 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.162106 Jul 20 05:16:30.332248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5284/6409] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:30 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:30.570905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d387deac-dd34-488b-8b95-a6c519c22ef3 req-70a7029d-b963-4efb-92d0-8dc90caf1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b35991-aa42-4201-a487-e66b7867b8ae", "name": "network-vif-plugged", "status": "completed", "tag": "f6b00e41-3a1a-4809-99dd-09d193823390"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:30.579727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d387deac-dd34-488b-8b95-a6c519c22ef3 req-70a7029d-b963-4efb-92d0-8dc90caf1e2a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:30.580195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d387deac-dd34-488b-8b95-a6c519c22ef3 req-70a7029d-b963-4efb-92d0-8dc90caf1e2a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:30.592399 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d387deac-dd34-488b-8b95-a6c519c22ef3 req-70a7029d-b963-4efb-92d0-8dc90caf1e2a service nova] Creating event network-vif-plugged:f6b00e41-3a1a-4809-99dd-09d193823390 for instance c4b35991-aa42-4201-a487-e66b7867b8ae on n-h2-764486-11 Jul 20 05:16:30.597271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d387deac-dd34-488b-8b95-a6c519c22ef3 req-70a7029d-b963-4efb-92d0-8dc90caf1e2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030627 Jul 20 05:16:30.597876 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5285/6410] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:16:31.351104 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:31.351816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:31.358085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:31.358545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:31.359313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:31.359763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:31.488209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:31.496068 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d2b94f2-9be6-40b4-8873-ca69c4ba1ce7 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1317 microversion: 2.1 time: 0.150537 Jul 20 05:16:31.496685 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5286/6411] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:31 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:32.513223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:32.513810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:32.515781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:32.516520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:32.523382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:32.523843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:32.524753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:32.525205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:32.659864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:32.667900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-589e1cc5-90c2-4805-ad68-9d427dd95bb9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1504 microversion: 2.1 time: 0.158758 Jul 20 05:16:32.668499 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5287/6412] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:32 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:32.684281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:32.684788 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:32.690600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:32.691057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:32.691828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:32.692271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:32.719190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:16:32.794018 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c250804d-b385-4c66-95a3-645706cac76f tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 204 len: 0 microversion: 2.1 time: 0.113133 Jul 20 05:16:32.794541 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5288/6413] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:16:32 2022] DELETE /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:16:32.804020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:32.804768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:32.811006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:32.811469 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:32.812243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:32.812719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:32.949193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:32.956801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d8a2bfbd-bb3c-4d3a-8f03-1fc88947fd77 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1510 microversion: 2.1 time: 0.157375 Jul 20 05:16:32.957874 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5289/6414] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:32 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:33.974199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:33.974828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:33.981838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:33.982306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:33.983188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:33.983644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:34.112658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:34.120825 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa059cd7-2476-4f58-b058-17a1acdf0b92 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1510 microversion: 2.1 time: 0.150518 Jul 20 05:16:34.121412 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5290/6415] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:33 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:34.675966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b16052dd-1c76-4518-a809-aceefdf6885c req-7f104e53-5402-4603-98aa-8b6a01a49c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b35991-aa42-4201-a487-e66b7867b8ae", "name": "network-vif-deleted", "tag": "f6b00e41-3a1a-4809-99dd-09d193823390"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:34.691929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b16052dd-1c76-4518-a809-aceefdf6885c req-7f104e53-5402-4603-98aa-8b6a01a49c6a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:34.692552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b16052dd-1c76-4518-a809-aceefdf6885c req-7f104e53-5402-4603-98aa-8b6a01a49c6a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:34.705790 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b16052dd-1c76-4518-a809-aceefdf6885c req-7f104e53-5402-4603-98aa-8b6a01a49c6a service nova] Creating event network-vif-deleted:f6b00e41-3a1a-4809-99dd-09d193823390 for instance c4b35991-aa42-4201-a487-e66b7867b8ae on n-h2-764486-11 Jul 20 05:16:34.713028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b16052dd-1c76-4518-a809-aceefdf6885c req-7f104e53-5402-4603-98aa-8b6a01a49c6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042877 Jul 20 05:16:34.717957 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5291/6416] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:16:35.140715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:35.141415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:35.149227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:35.149685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:35.150471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:35.150916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:35.188790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:35.189246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:35.189707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lazy-loading 'fault' on Instance uuid c4b35991-aa42-4201-a487-e66b7867b8ae {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:16:35.236497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:35.244212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-13569dd0-840d-4eb0-b6eb-18e8b5658c15 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 200 len: 1307 microversion: 2.1 time: 0.108836 Jul 20 05:16:35.244813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5292/6417] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:35 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:36.260483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:36.261144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.268024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.268523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.269297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.269741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.283396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] HTTP exception thrown: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae HTTP/1.1 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c4b35991-aa42-4201-a487-e66b7867b8ae'} Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:36.285077 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 404 to user: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5d97077a-5a33-4822-8fcb-44a5af20447d tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 404 len: 111 microversion: 2.1 time: 0.029973 Jul 20 05:16:36.289700 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5293/6418] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:36 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:16:36.295862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:36.296516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.302419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.302878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.303649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.304102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.431624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:36.439115 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eec1fc0d-a701-4ec6-af86-2d2589a15c88 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.146806 Jul 20 05:16:36.439694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5294/6419] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:36 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:36.455267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-689aa6d2-c8a0-4081-bd52-d63d3835bf83 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:36.456239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-689aa6d2-c8a0-4081-bd52-d63d3835bf83 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: 83683e79-3c5e-409b-a83a-4ccdfce43f75] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.462093 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-689aa6d2-c8a0-4081-bd52-d63d3835bf83 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] HTTP exception thrown: Instance 83683e79-3c5e-409b-a83a-4ccdfce43f75 could not be found. Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-689aa6d2-c8a0-4081-bd52-d63d3835bf83 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/83683e79-3c5e-409b-a83a-4ccdfce43f75/action HTTP/1.1 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 32 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: {"resize": {"flavorRef": "452"}} Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 83683e79-3c5e-409b-a83a-4ccdfce43f75 could not be found. Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '83683e79-3c5e-409b-a83a-4ccdfce43f75', 'body': {'resize': {'flavorRef': '452'}}} Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83683e79-3c5e-409b-a83a-4ccdfce43f75 could not be found. Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:16:36.463663 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83683e79-3c5e-409b-a83a-4ccdfce43f75 could not be found. Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83683e79-3c5e-409b-a83a-4ccdfce43f75 could not be found. Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-689aa6d2-c8a0-4081-bd52-d63d3835bf83 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 404 to user: Instance 83683e79-3c5e-409b-a83a-4ccdfce43f75 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-689aa6d2-c8a0-4081-bd52-d63d3835bf83 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "POST /compute/v2.1/servers/83683e79-3c5e-409b-a83a-4ccdfce43f75/action" status: 404 len: 111 microversion: 2.1 time: 0.013501 Jul 20 05:16:36.468168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5295/6420] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:36 2022] POST /compute/v2.1/servers/83683e79-3c5e-409b-a83a-4ccdfce43f75/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:16:36.472997 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:36.473619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.482579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.483048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.483831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.484283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.610579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:36.618106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e9f25f99-fbcc-496c-9287-ccba5e24b9eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.148489 Jul 20 05:16:36.618677 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5296/6421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:36 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:36.635275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:36.635897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.641823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.642286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.643096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.643553 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.775110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:36.782765 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7166363a-c738-4015-96eb-934f05d95d24 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.151143 Jul 20 05:16:36.783340 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5297/6422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:36 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:36.799432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "08f4dda7-62db-45df-b58d-50482c97ffe1"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:36.800446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.807146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.807615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.808420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.808879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.837371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:36.842400 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] HTTP exception thrown: Flavor 08f4dda7-62db-45df-b58d-50482c97ffe1 could not be found. Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e/action HTTP/1.1 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 65 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: {"resize": {"flavorRef": "08f4dda7-62db-45df-b58d-50482c97ffe1"}} Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: exception: Flavor 08f4dda7-62db-45df-b58d-50482c97ffe1 could not be found. Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f4491adc-1122-4a03-ba45-498c9bf5150e', 'body': {'resize': {'flavorRef': '08f4dda7-62db-45df-b58d-50482c97ffe1'}}} Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 05:16:36.844336 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 08f4dda7-62db-45df-b58d-50482c97ffe1 could not be found. Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 08f4dda7-62db-45df-b58d-50482c97ffe1 could not be found. Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 08f4dda7-62db-45df-b58d-50482c97ffe1 could not be found. Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 400 to user: Flavor 08f4dda7-62db-45df-b58d-50482c97ffe1 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-38d9042c-cb50-43ab-9841-67ba87ff6d75 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "POST /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e/action" status: 400 len: 107 microversion: 2.1 time: 0.050205 Jul 20 05:16:36.848627 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5298/6423] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:36 2022] POST /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e/action => generated 107 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 05:16:36.854337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:36.854959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:36.860830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.861303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.862081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:36.862560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:36.990830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:36.998403 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7757717-279b-41a1-929f-a489c77805eb tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.147586 Jul 20 05:16:36.998985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5299/6424] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:36 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:37.015731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:37.016377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:37.022376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.022832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.023611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.024062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.155061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:37.164821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56b4ea84-a003-4f41-88fc-c998d62ba4dd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.152720 Jul 20 05:16:37.165418 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5300/6425] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:37 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:37.181603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbccd314-0b17-465f-8888-e9bab0f9a2a9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbccd314-0b17-465f-8888-e9bab0f9a2a9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: request: POST /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e/action HTTP/1.1 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 29 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: {"resize": {"flavorRef": ""}} Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f4491adc-1122-4a03-ba45-498c9bf5150e', 'body': {'resize': {'flavorRef': ''}}} Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise error Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi '' Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.183855 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cbccd314-0b17-465f-8888-e9bab0f9a2a9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cbccd314-0b17-465f-8888-e9bab0f9a2a9 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "POST /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e/action" status: 400 len: 113 microversion: 2.1 time: 0.008294 Jul 20 05:16:37.187905 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5301/6426] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:16:37 2022] POST /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 05:16:37.192691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:37.193307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:37.199970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.200477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.201248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.201692 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.328165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:37.331805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:16:37.336728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-941d1b95-acb4-4266-8361-cc00484de711 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1504 microversion: 2.1 time: 0.147251 Jul 20 05:16:37.337297 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5302/6427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:37 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:37.357109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:37.357550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:37.364119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.365243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.366021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.366466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.380575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] HTTP exception thrown: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae HTTP/1.1 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c4b35991-aa42-4201-a487-e66b7867b8ae'} Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:16:37.382138 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 404 to user: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bbb1ab34-8c61-4362-8d14-2b5096836843 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 404 len: 111 microversion: 2.1 time: 0.030810 Jul 20 05:16:37.386091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5303/6428] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:16:37 2022] DELETE /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:16:37.391652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:37.392268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: c4b35991-aa42-4201-a487-e66b7867b8ae] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:37.398236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.398693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.399457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.399899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.416282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] HTTP exception thrown: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae HTTP/1.1 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c4b35991-aa42-4201-a487-e66b7867b8ae'} Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:37.417816 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 404 to user: Instance c4b35991-aa42-4201-a487-e66b7867b8ae could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-342fbaa4-01ae-4e40-9690-e1e43754ccfd tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae" status: 404 len: 111 microversion: 2.1 time: 0.031116 Jul 20 05:16:37.424273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5304/6429] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:37 2022] GET /compute/v2.1/servers/c4b35991-aa42-4201-a487-e66b7867b8ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 05:16:37.431459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:37.431649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:37.438277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.438736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.439514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.439960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.465261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:16:37.540802 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bc7a2517-8329-483f-980b-7b89e28e25d6 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 204 len: 0 microversion: 2.1 time: 0.115997 Jul 20 05:16:37.541410 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5305/6430] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:16:37 2022] DELETE /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:16:37.549937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:37.550681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:37.557143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.557604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.558391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:37.558844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:37.691665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:37.699516 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0e83295f-bf1e-413c-81b1-8fe41dfae83e tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1510 microversion: 2.1 time: 0.153681 Jul 20 05:16:37.700124 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5306/6431] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:37 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:16:38.717554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:38.718167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:38.725238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:38.725704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:38.726490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:38.726946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:38.859140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705e07bd02e141efa0f60fe46beadd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84741dd63e264f168919d7959ed87a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:16:38.866799 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bff9e450-51db-46f3-8128-fca489dc5381 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 200 len: 1510 microversion: 2.1 time: 0.153236 Jul 20 05:16:38.867387 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5307/6432] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:38 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:16:39.381362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7bbaf965-d7a4-478a-8254-b58872b361bf req-d90516af-9e01-48ec-a8d8-81d0dc10f2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4491adc-1122-4a03-ba45-498c9bf5150e", "name": "network-vif-deleted", "tag": "1c376ebb-3d44-488a-93be-ff68505299b7"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:16:39.395591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7bbaf965-d7a4-478a-8254-b58872b361bf req-d90516af-9e01-48ec-a8d8-81d0dc10f2b3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:39.396148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7bbaf965-d7a4-478a-8254-b58872b361bf req-d90516af-9e01-48ec-a8d8-81d0dc10f2b3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:39.409659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7bbaf965-d7a4-478a-8254-b58872b361bf req-d90516af-9e01-48ec-a8d8-81d0dc10f2b3 service nova] Creating event network-vif-deleted:1c376ebb-3d44-488a-93be-ff68505299b7 for instance f4491adc-1122-4a03-ba45-498c9bf5150e on n-h1-764486-11 Jul 20 05:16:39.416141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7bbaf965-d7a4-478a-8254-b58872b361bf req-d90516af-9e01-48ec-a8d8-81d0dc10f2b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039008 Jul 20 05:16:39.417024 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5308/6433] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:16:39.884795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:16:39.885551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] [instance: f4491adc-1122-4a03-ba45-498c9bf5150e] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:16:39.894508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:39.894973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:39.896306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:16:39.896865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:16:39.910691 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] HTTP exception thrown: Instance f4491adc-1122-4a03-ba45-498c9bf5150e could not be found. Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Request method failure captured: Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e HTTP/1.1 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14-ZvNzaC1G_nkl5CHBagAWzwTvL8HXyN7ts_p9HqFzDX_3csQ-D3RVq6XLgd2eiQ1KFgCNEmfeMYordLuY_cJclOkRO70aY43sq1VlhJe33kJ4UUXDkOLWES9K4Z8FZ-pHUkrZ0_ZQ1KqfKK2u9Sm3_M-493J-AHUqFdvv5cWvU6P8 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/84741dd63e264f168919d7959ed87a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_84741dd63e264f168919d7959ed87a2e", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 84741dd63e264f168919d7959ed87a2e Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1598681634 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 705e07bd02e141efa0f60fe46beadd18 Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-ServersNegativeTestJSON-1598681634-project Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance f4491adc-1122-4a03-ba45-498c9bf5150e could not be found. Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'f4491adc-1122-4a03-ba45-498c9bf5150e'} Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4491adc-1122-4a03-ba45-498c9bf5150e could not be found. Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4491adc-1122-4a03-ba45-498c9bf5150e could not be found. Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:16:39.912999 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4491adc-1122-4a03-ba45-498c9bf5150e could not be found. Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] Returning 404 to user: Instance f4491adc-1122-4a03-ba45-498c9bf5150e could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6b624039-7e64-4844-a651-d5d52abb4b23 tempest-ServersNegativeTestJSON-1598681634 tempest-ServersNegativeTestJSON-1598681634-project] 10.222.0.49 "GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e" status: 404 len: 111 microversion: 2.1 time: 0.035141 Jul 20 05:16:39.917222 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5309/6434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:16:39 2022] GET /compute/v2.1/servers/f4491adc-1122-4a03-ba45-498c9bf5150e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:17:13.633874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:13.634507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:13.837588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-82818f88-6166-40e4-93c9-c15303107710 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Action: 'create', calling method: .version_select at 0x7f838af19dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1343201524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN4fMuG4d/pAw3J6DSuQh0e8zDwf1HpxSW7G5DevZSps3nLyCX0IBFDIynKm3N4pr2pfmuLz6YNIPXHWWzcimKWnfy0EV8KF4RwAg9u2Uu5t9IB16bn5o0JAoQoVrZygg=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:13.853489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-82818f88-6166-40e4-93c9-c15303107710 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:13.860325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-82818f88-6166-40e4-93c9-c15303107710 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for user f3420ccf1cd0401d800e8fc0cf46c51e and project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:13.900294 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-82818f88-6166-40e4-93c9-c15303107710 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.273043 Jul 20 05:17:13.902163 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5310/6435] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:17:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:13.955493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1432785714", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1343201524", "networks": [{"uuid": "ff1d4d73-b12d-4cf9-9861-7f579b13fa5d"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:14.011880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] validate_networks() for [('ff1d4d73-b12d-4cf9-9861-7f579b13fa5d', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:17:14.393492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:17:14.393860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:17:14.394351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:17:14.394787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:17:14.395214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:17:14.404366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:14.404834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:14.405644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:14.406089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:14.422310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:14.428315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for user f3420ccf1cd0401d800e8fc0cf46c51e and project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:14.441479 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:17:14.444453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:17:14.497405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-884d9dec-6f30-4997-a3e3-c51025af39e8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545886 Jul 20 05:17:14.498065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5311/6436] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:17:14.508909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-772a29a5-7b0d-4e6c-adc5-644ea86430e3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:14.509543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-772a29a5-7b0d-4e6c-adc5-644ea86430e3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:14.571019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-772a29a5-7b0d-4e6c-adc5-644ea86430e3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:14.579094 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-772a29a5-7b0d-4e6c-adc5-644ea86430e3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1263 microversion: 2.1 time: 0.074978 Jul 20 05:17:14.580502 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5312/6437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:14 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1263 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:15.597998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:15.599075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:15.609904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:15.610381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:15.611376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:15.611970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:15.707272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:15.716126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-341a2836-27a3-4bd8-9edd-8140f72e58e7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1333 microversion: 2.1 time: 0.124341 Jul 20 05:17:15.718450 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5313/6438] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:15 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:16.735531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:16.736175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:16.746199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:16.747086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:16.748778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:16.750445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:16.914153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:16.924624 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b4ede42-63a5-4fd5-972c-17c4ebbc4176 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.193840 Jul 20 05:17:16.925929 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5314/6439] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:16 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:17:17.072871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d0ff7b0f-039c-41a9-98cc-b50443e82a4e req-36eb7855-29a6-40f6-b329-55196af37d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68aa8d6a-7d22-4ad6-9941-16042f16ef42", "tag": "7a4ddb79-0745-4075-bbb4-0f08e48811bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:17.097882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d0ff7b0f-039c-41a9-98cc-b50443e82a4e req-36eb7855-29a6-40f6-b329-55196af37d46 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.098597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d0ff7b0f-039c-41a9-98cc-b50443e82a4e req-36eb7855-29a6-40f6-b329-55196af37d46 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:17.120050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d0ff7b0f-039c-41a9-98cc-b50443e82a4e req-36eb7855-29a6-40f6-b329-55196af37d46 service nova] Creating event network-changed:7a4ddb79-0745-4075-bbb4-0f08e48811bc for instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 on n-h2-764486-11 Jul 20 05:17:17.126270 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d0ff7b0f-039c-41a9-98cc-b50443e82a4e req-36eb7855-29a6-40f6-b329-55196af37d46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069584 Jul 20 05:17:17.127571 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5315/6440] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:17.942597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:17.943231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:17.950318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.950778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:17.951548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:17.951996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:18.080023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:18.089012 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-830ec31a-b273-43d0-9f76-20c077f360bd tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.150902 Jul 20 05:17:18.089599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5316/6441] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:17 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:19.107917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:19.108594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:19.116162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:19.116773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:19.117573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:19.118275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:19.261193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:19.268764 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afbcf7c3-03f0-4c83-8115-4b643848c489 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.164858 Jul 20 05:17:19.269353 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5317/6442] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:19 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:20.285924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:20.286577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:20.293582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:20.294050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:20.294828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:20.295281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:20.422122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:20.430175 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41aff876-5ac3-4511-9e49-6dbc7dc51546 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.148304 Jul 20 05:17:20.431028 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5318/6443] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:20 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:21.448392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:21.449078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:21.455967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.456466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.457252 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:21.457698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:21.598889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:21.606901 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-92ed88ae-9133-4d3e-adde-9ca58c17c689 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.162378 Jul 20 05:17:21.607492 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5319/6444] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:21 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:22.624239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:22.624891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:22.631902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.632382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:22.633164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.633611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:22.773066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:22.781105 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdc3240f-060d-4ddf-92d3-b16fd965ab1d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.160779 Jul 20 05:17:22.781694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5320/6445] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:22 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:22.816081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-b74193d3-e5ed-4d7a-be3f-bd9ba29db638 req-80a66865-10b9-4a6b-9ccc-bb500384dfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68aa8d6a-7d22-4ad6-9941-16042f16ef42", "name": "network-vif-plugged", "status": "completed", "tag": "7a4ddb79-0745-4075-bbb4-0f08e48811bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:22.825837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b74193d3-e5ed-4d7a-be3f-bd9ba29db638 req-80a66865-10b9-4a6b-9ccc-bb500384dfee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:22.826354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-b74193d3-e5ed-4d7a-be3f-bd9ba29db638 req-80a66865-10b9-4a6b-9ccc-bb500384dfee service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:22.839390 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-b74193d3-e5ed-4d7a-be3f-bd9ba29db638 req-80a66865-10b9-4a6b-9ccc-bb500384dfee service nova] Creating event network-vif-plugged:7a4ddb79-0745-4075-bbb4-0f08e48811bc for instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 on n-h2-764486-11 Jul 20 05:17:22.844279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-b74193d3-e5ed-4d7a-be3f-bd9ba29db638 req-80a66865-10b9-4a6b-9ccc-bb500384dfee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032242 Jul 20 05:17:22.844917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5321/6446] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:23.800196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:23.800943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:23.808291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:23.808791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:23.809583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:23.810034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:23.940011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:23.947684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88cfc56f-f8f2-40cd-854d-139231b87306 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1363 microversion: 2.1 time: 0.152481 Jul 20 05:17:23.948316 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5322/6447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:23 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:24.964893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:24.965539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:24.967476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:24.968278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:24.975695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:24.976153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:24.976954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:24.977403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.111028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:25.118828 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-75c0ef19-eb05-4779-a0f0-f852f565147d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1554 microversion: 2.1 time: 0.157915 Jul 20 05:17:25.119406 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5323/6448] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:24 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:25.135059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:25.135686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:25.141732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.142139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.142921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:25.143376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:25.273034 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:25.280698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8f06e669-78b6-4dbf-a948-5d85da877d71 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1554 microversion: 2.1 time: 0.149204 Jul 20 05:17:25.281283 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5324/6449] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:25 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:26.929365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89eb75a8-9629-4460-a7b8-6c6661581947"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:26.930398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:26.937613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:26.938076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:26.938854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:26.939302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:27.173163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3a6df00-5ef6-4fc0-81bc-df8644d27be5 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "POST /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248315 Jul 20 05:17:27.173836 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5325/6450] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 05:17:26 2022] POST /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:37.828707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:37.829608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:37.834353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:37.834959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:37.842735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:37.843198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:37.843983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:37.844466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:37.926540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lazy-loading 'services' on Instance uuid 68aa8d6a-7d22-4ad6-9941-16042f16ef42 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:17:38.002648 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5af41191-585d-49a9-bf74-3c259987364d tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments/89eb75a8-9629-4460-a7b8-6c6661581947" status: 202 len: 0 microversion: 2.1 time: 0.175204 Jul 20 05:17:38.003260 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5326/6451] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:17:37 2022] DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments/89eb75a8-9629-4460-a7b8-6c6661581947 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:17:38.012782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:38.013865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:38.021072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:38.021544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:38.022389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:38.022837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:38.064090 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5303fa1-fa78-4f46-b14a-784d36bf8226 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056016 Jul 20 05:17:38.064736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5327/6452] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:38 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:39.076930 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:39.077880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:39.085154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:39.085611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:39.086398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:39.086844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:39.117432 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b263e9c4-ada1-41de-8a56-6cfab0bd4b97 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Jul 20 05:17:39.118002 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5328/6453] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:39 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:40.129534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:40.131744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:40.139314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:40.139780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:40.140615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:40.141072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:40.174158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba721d3a-a3e6-4ec2-a280-7662f4284cd0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048692 Jul 20 05:17:40.174955 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5329/6454] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:40 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:41.186434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:41.187410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:41.194607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.195069 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.195859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:41.196307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:41.228449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-658b4105-7674-45ad-80ac-438565a5da43 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Jul 20 05:17:41.228958 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5330/6455] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:41 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:42.239931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:42.241002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:42.248465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.248959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.249744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:42.250189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:42.281003 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c56b251-d526-423e-a2b4-c8a24df5f293 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045564 Jul 20 05:17:42.281593 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5331/6456] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:42 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:43.293805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:43.294654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:43.301231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:43.301771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:43.302550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:43.302996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:43.332452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b03b6fa7-4937-4d7c-b886-455e2ec1d978 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043415 Jul 20 05:17:43.333674 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5332/6457] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:17:43 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 05:17:43.343232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:43.343733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:43.349618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:43.350079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:43.350854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:43.351301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:43.481592 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] HTTP exception thrown: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 is not attached to volume 89eb75a8-9629-4460-a7b8-6c6661581947 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Request method failure captured: Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments/89eb75a8-9629-4460-a7b8-6c6661581947 HTTP/1.1 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14_TkF9b18vzs7Mv9QgPAR1uLl8XC3ZZRsMce345UMFBASUOtugjIcfIVD6Ew5DrBAJPwLcu0DuRetMNVbofpNZ3fDTQvcErrMx2br_14wdgH6lGqS-TmdTqQK8GrqXYFoR0K-kSsyrQl1pLlxAW5gkneunM3Oja9qBF0ItGCz4uWg4 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_678eae9119a54ebcaf3ea4b8752c7b46", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3420ccf1cd0401d800e8fc0cf46c51e Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 is not attached to volume 89eb75a8-9629-4460-a7b8-6c6661581947 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '68aa8d6a-7d22-4ad6-9941-16042f16ef42', 'id': '89eb75a8-9629-4460-a7b8-6c6661581947'} Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 89eb75a8-9629-4460-a7b8-6c6661581947. Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 is not attached to volume 89eb75a8-9629-4460-a7b8-6c6661581947 Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:43.499992 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 is not attached to volume 89eb75a8-9629-4460-a7b8-6c6661581947 Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Returning 404 to user: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 is not attached to volume 89eb75a8-9629-4460-a7b8-6c6661581947 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ee04176-d6a3-4423-b7ae-9e06fc3dd157 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments/89eb75a8-9629-4460-a7b8-6c6661581947" status: 404 len: 154 microversion: 2.1 time: 0.162148 Jul 20 05:17:43.505241 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5333/6458] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:17:43 2022] DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42/os-volume_attachments/89eb75a8-9629-4460-a7b8-6c6661581947 => generated 154 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:17:46.849321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:46.850147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:46.857261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:46.857751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:46.858542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:46.858999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:46.889254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:17:46.975449 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-855f219f-035e-4209-a382-284501e0cde3 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 204 len: 0 microversion: 2.1 time: 0.129874 Jul 20 05:17:46.976208 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5334/6459] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:17:46 2022] DELETE /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:17:46.986305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:46.986949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:46.994116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:46.994586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:46.995415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:46.995867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:47.412224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:47.420766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ad58bd3-1630-4806-8877-55ea5154a60a tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1560 microversion: 2.1 time: 0.439575 Jul 20 05:17:47.421404 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5335/6460] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:46 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1560 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:48.439665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:48.440343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:48.447866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:48.448333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:48.449145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:48.449591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:48.582180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:48.590198 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc041596-026b-4916-9c24-704f9cdf2139 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1560 microversion: 2.1 time: 0.154680 Jul 20 05:17:48.590951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5336/6461] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:48 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:49.125679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f804b961-acf1-4b3d-a373-fceabbfc57e3 req-3e37e13b-2586-4cfe-9477-c20b04b4ce92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68aa8d6a-7d22-4ad6-9941-16042f16ef42", "name": "network-vif-deleted", "tag": "7a4ddb79-0745-4075-bbb4-0f08e48811bc"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:49.135493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f804b961-acf1-4b3d-a373-fceabbfc57e3 req-3e37e13b-2586-4cfe-9477-c20b04b4ce92 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:49.136151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f804b961-acf1-4b3d-a373-fceabbfc57e3 req-3e37e13b-2586-4cfe-9477-c20b04b4ce92 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:49.150464 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f804b961-acf1-4b3d-a373-fceabbfc57e3 req-3e37e13b-2586-4cfe-9477-c20b04b4ce92 service nova] Creating event network-vif-deleted:7a4ddb79-0745-4075-bbb4-0f08e48811bc for instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 on n-h2-764486-11 Jul 20 05:17:49.156188 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f804b961-acf1-4b3d-a373-fceabbfc57e3 req-3e37e13b-2586-4cfe-9477-c20b04b4ce92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034092 Jul 20 05:17:49.156966 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5337/6462] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:49.609640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:49.610352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:49.617577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:49.618043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:49.618827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:49.619277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:49.653887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:49.654367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:49.654651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lazy-loading 'fault' on Instance uuid 68aa8d6a-7d22-4ad6-9941-16042f16ef42 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:17:49.698404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:49.705578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1ddfa34-b3d0-4738-91cc-10a953e9178c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 200 len: 1353 microversion: 2.1 time: 0.101049 Jul 20 05:17:49.706173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5338/6463] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:49 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:50.723362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:50.724057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 68aa8d6a-7d22-4ad6-9941-16042f16ef42] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:50.731047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:50.731517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:50.732301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:50.732777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:50.747240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] HTTP exception thrown: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 could not be found. Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Request method failure captured: Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 HTTP/1.1 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14_TkF9b18vzs7Mv9QgPAR1uLl8XC3ZZRsMce345UMFBASUOtugjIcfIVD6Ew5DrBAJPwLcu0DuRetMNVbofpNZ3fDTQvcErrMx2br_14wdgH6lGqS-TmdTqQK8GrqXYFoR0K-kSsyrQl1pLlxAW5gkneunM3Oja9qBF0ItGCz4uWg4 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_678eae9119a54ebcaf3ea4b8752c7b46", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3420ccf1cd0401d800e8fc0cf46c51e Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 could not be found. Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '68aa8d6a-7d22-4ad6-9941-16042f16ef42'} Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 could not be found. Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 could not be found. Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:17:50.749353 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 could not be found. Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Returning 404 to user: Instance 68aa8d6a-7d22-4ad6-9941-16042f16ef42 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79ae2c42-4067-4ab7-b09a-e97e6082153c tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42" status: 404 len: 111 microversion: 2.1 time: 0.031046 Jul 20 05:17:50.753632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5339/6464] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:50 2022] GET /compute/v2.1/servers/68aa8d6a-7d22-4ad6-9941-16042f16ef42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:17:50.759563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4388fbac-39df-4c92-906e-d0aa5fedc846 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '.version_select at 0x7f838a1b43a0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:50.779132 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4388fbac-39df-4c92-906e-d0aa5fedc846 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1343201524" status: 202 len: 0 microversion: 2.1 time: 0.023635 Jul 20 05:17:50.779726 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5340/6465] 10.222.0.49 () {58 vars in 1277 bytes} [Wed Jul 20 05:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1343201524 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:17:50.796959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5a10b5fa-d146-460a-bc5d-9e40472581d9 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Action: 'create', calling method: .version_select at 0x7f838a073310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1865261220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2eehkIPuXaaD+7F+xnVemR8wSlFWLkQb8qhsj0zyCUSJ6REwHkvdL2Flan0Njuc7nGFqagWPxvkytPrHDCn9opiyeF+xlR1Oevn0Jo1K1At6rFFm2u3/ND+6MWNbGpoQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:50.812641 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5a10b5fa-d146-460a-bc5d-9e40472581d9 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:50.818337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-5a10b5fa-d146-460a-bc5d-9e40472581d9 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for user f3420ccf1cd0401d800e8fc0cf46c51e and project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:50.842167 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5a10b5fa-d146-460a-bc5d-9e40472581d9 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048961 Jul 20 05:17:50.842775 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5341/6466] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:17:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:50.891223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1953446459", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1865261220", "networks": [{"uuid": "ff1d4d73-b12d-4cf9-9861-7f579b13fa5d"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:50.942310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] validate_networks() for [('ff1d4d73-b12d-4cf9-9861-7f579b13fa5d', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:17:51.318444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:17:51.318879 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:17:51.319366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:17:51.319782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:17:51.320229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:17:51.329777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:51.330232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:51.331119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:51.331589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:51.351824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:17:51.357122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Getting quotas for user f3420ccf1cd0401d800e8fc0cf46c51e and project 678eae9119a54ebcaf3ea4b8752c7b46. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:17:51.370425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:17:51.372737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:17:51.417979 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-98347d81-aa58-40d4-a0bb-66b879e247c7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530591 Jul 20 05:17:51.418861 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5342/6467] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:17:51.428591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4be9e0fc-5876-429f-a7ff-484e3efe6d3f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:51.429227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4be9e0fc-5876-429f-a7ff-484e3efe6d3f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:51.496855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4be9e0fc-5876-429f-a7ff-484e3efe6d3f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:51.504124 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4be9e0fc-5876-429f-a7ff-484e3efe6d3f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1263 microversion: 2.1 time: 0.079476 Jul 20 05:17:51.504738 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5343/6468] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:51 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:52.521308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:52.522747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:52.531416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:52.531985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:52.532895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:52.533433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:52.618623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:52.622238 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:17:52.627212 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aadcf463-0244-48ab-80f2-87fbcdd467bf tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1323 microversion: 2.1 time: 0.109897 Jul 20 05:17:52.638118 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5344/6469] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:52 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:53.647839 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:53.648552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:53.659086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:53.659552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:53.660368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:53.660845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:53.868618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:53.878344 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d0b685c-404c-4370-a4e2-665d55418e30 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1363 microversion: 2.1 time: 0.236141 Jul 20 05:17:53.879033 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5345/6470] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:53 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:53.978676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9728611b-76a7-46ed-9ec2-ff0bc59185aa req-7e600052-abd5-4ea4-a439-e0b5a2f2188c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965a65a0-d361-4d96-8bb4-fbd8dd4ea417", "tag": "231963d7-f8d1-46c7-bb74-543ae6dd8b8f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:53.988875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9728611b-76a7-46ed-9ec2-ff0bc59185aa req-7e600052-abd5-4ea4-a439-e0b5a2f2188c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:53.990028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9728611b-76a7-46ed-9ec2-ff0bc59185aa req-7e600052-abd5-4ea4-a439-e0b5a2f2188c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:54.011661 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9728611b-76a7-46ed-9ec2-ff0bc59185aa req-7e600052-abd5-4ea4-a439-e0b5a2f2188c service nova] Creating event network-changed:231963d7-f8d1-46c7-bb74-543ae6dd8b8f for instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 on n-h1-764486-11 Jul 20 05:17:54.017102 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9728611b-76a7-46ed-9ec2-ff0bc59185aa req-7e600052-abd5-4ea4-a439-e0b5a2f2188c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042861 Jul 20 05:17:54.018025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5346/6471] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:17:54.897857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:54.898572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:54.906513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:54.906975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:54.907759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:54.908201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:55.043562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:55.051696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e25a4a51-e3f2-4ff0-8a65-aa96888fa56f tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1363 microversion: 2.1 time: 0.158632 Jul 20 05:17:55.052289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5347/6472] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:54 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:56.068529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:56.069164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:56.076320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:56.076849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:56.077645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:56.078159 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:56.218114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:56.226517 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-139ef117-4c34-44fb-a6fa-f8439c141d38 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1363 microversion: 2.1 time: 0.161927 Jul 20 05:17:56.227110 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5348/6473] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:56 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:57.243919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:57.244730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:57.251756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:57.252231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:57.253052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:57.253578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:57.385718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:57.393590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9d584c0f-360e-4aa6-9959-bccf28d66179 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1363 microversion: 2.1 time: 0.154303 Jul 20 05:17:57.394176 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5349/6474] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:57 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:58.410913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:58.411581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:58.419142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:58.419610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:58.420419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:58.420874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:58.554414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:58.562196 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fcee050-1357-454c-bc27-cf477dcff064 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1363 microversion: 2.1 time: 0.155275 Jul 20 05:17:58.562786 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5350/6475] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:58 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:17:59.577649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-82fa49cf-2ec6-4b40-9c34-a265f00a9c70 req-69a33a83-e130-425d-8a53-4442cdfc3a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965a65a0-d361-4d96-8bb4-fbd8dd4ea417", "name": "network-vif-plugged", "status": "completed", "tag": "231963d7-f8d1-46c7-bb74-543ae6dd8b8f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:17:59.587265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-82fa49cf-2ec6-4b40-9c34-a265f00a9c70 req-69a33a83-e130-425d-8a53-4442cdfc3a03 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.588294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-82fa49cf-2ec6-4b40-9c34-a265f00a9c70 req-69a33a83-e130-425d-8a53-4442cdfc3a03 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.600600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-82fa49cf-2ec6-4b40-9c34-a265f00a9c70 req-69a33a83-e130-425d-8a53-4442cdfc3a03 service nova] Creating event network-vif-plugged:231963d7-f8d1-46c7-bb74-543ae6dd8b8f for instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 on n-h1-764486-11 Jul 20 05:17:59.606556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-82fa49cf-2ec6-4b40-9c34-a265f00a9c70 req-69a33a83-e130-425d-8a53-4442cdfc3a03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Jul 20 05:17:59.607344 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5351/6476] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:17:59.612586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:17:59.613305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:17:59.620606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.621080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.621887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:17:59.622381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:17:59.825536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:17:59.833589 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e52db721-f463-42f0-bc54-6c637d0f1318 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1363 microversion: 2.1 time: 0.224929 Jul 20 05:17:59.834181 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5352/6477] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:17:59 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:00.851186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:00.851888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:00.858994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:00.859478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:00.860263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:00.860743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:00.994776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:01.002321 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4cd06e69-0605-4f1f-9f9d-4f8a3741e7a7 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1555 microversion: 2.1 time: 0.155180 Jul 20 05:18:01.002833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5353/6478] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:00 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:18:01.017912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:01.018522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:01.024317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.024808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.025578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:01.026023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:01.152795 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:01.160279 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ee6135e7-eb16-494f-bc57-3862e304fec1 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1555 microversion: 2.1 time: 0.145891 Jul 20 05:18:01.160895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5354/6479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:01 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:02.622122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c2b268-f42a-4f50-975b-ea525a82cf89"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:02.623199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:02.625190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:02.625976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:02.633619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.634027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.634803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:02.635246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:02.872524 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c205541-40de-4959-be61-547490253a69 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "POST /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254706 Jul 20 05:18:02.873182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5355/6480] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 05:18:02 2022] POST /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:13.524655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:13.525557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:13.530116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:13.530707 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:13.538517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:13.539611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:13.540408 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:13.540855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:13.625027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lazy-loading 'services' on Instance uuid 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:18:13.694741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bc520c0-680e-4c8f-865a-08277e8eedd8 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments/c0c2b268-f42a-4f50-975b-ea525a82cf89" status: 202 len: 0 microversion: 2.1 time: 0.172339 Jul 20 05:18:13.695838 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5356/6481] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:18:13 2022] DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments/c0c2b268-f42a-4f50-975b-ea525a82cf89 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:18:13.704472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:13.705555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:13.713908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:13.714338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:13.715173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:13.715585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:13.749838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-716a2b5f-3fcf-4360-872a-1e77df24584e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049469 Jul 20 05:18:13.750420 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5357/6482] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:18:13 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:14.761906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:14.762936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:14.770033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.770576 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.771443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:14.771971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:14.802677 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16d690b4-742d-4237-b1ab-f4701d2197ab tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Jul 20 05:18:14.803471 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5358/6483] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:18:14 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:15.816061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:15.817036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:15.824864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:15.825328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:15.826121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:15.826570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:15.858394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ae2e7dc4-1f56-4acf-80fa-b9bdaee77222 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046317 Jul 20 05:18:15.859117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5359/6484] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:18:15 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:18:16.870400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:16.871234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:16.878614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:16.878758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:16.879493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:16.879971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:16.910404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0abaa4f5-20b5-42b6-a414-934700a2b1c0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Jul 20 05:18:16.910978 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5360/6485] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:18:16 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:17.922124 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:17.923105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:17.930940 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.931403 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.932196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:17.932679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:17.963586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b29725b3-8946-48c5-b5e9-822ecc269c17 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Jul 20 05:18:17.964166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5361/6486] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:18:17 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:18.975230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:18.976175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:18.983275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.983743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:18.984563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:18.985021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:19.013893 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bfee7255-0343-447d-8ed5-21e38e917338 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042649 Jul 20 05:18:19.014385 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5362/6487] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:18:18 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 05:18:19.024650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:19.025158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:19.031222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:19.031694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:19.032510 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:19.032962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:19.108176 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] HTTP exception thrown: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 is not attached to volume c0c2b268-f42a-4f50-975b-ea525a82cf89 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Request method failure captured: Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments/c0c2b268-f42a-4f50-975b-ea525a82cf89 HTTP/1.1 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14_TkF9b18vzs7Mv9QgPAR1uLl8XC3ZZRsMce345UMFBASUOtugjIcfIVD6Ew5DrBAJPwLcu0DuRetMNVbofpNZ3fDTQvcErrMx2br_14wdgH6lGqS-TmdTqQK8GrqXYFoR0K-kSsyrQl1pLlxAW5gkneunM3Oja9qBF0ItGCz4uWg4 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_678eae9119a54ebcaf3ea4b8752c7b46", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3420ccf1cd0401d800e8fc0cf46c51e Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 is not attached to volume c0c2b268-f42a-4f50-975b-ea525a82cf89 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': '965a65a0-d361-4d96-8bb4-fbd8dd4ea417', 'id': 'c0c2b268-f42a-4f50-975b-ea525a82cf89'} Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c0c2b268-f42a-4f50-975b-ea525a82cf89. Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 is not attached to volume c0c2b268-f42a-4f50-975b-ea525a82cf89 Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:19.109850 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 is not attached to volume c0c2b268-f42a-4f50-975b-ea525a82cf89 Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Returning 404 to user: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 is not attached to volume c0c2b268-f42a-4f50-975b-ea525a82cf89 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-93e3563a-8862-4046-bc39-209ca8ed0903 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments/c0c2b268-f42a-4f50-975b-ea525a82cf89" status: 404 len: 154 microversion: 2.1 time: 0.091165 Jul 20 05:18:19.113712 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5363/6488] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:18:19 2022] DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417/os-volume_attachments/c0c2b268-f42a-4f50-975b-ea525a82cf89 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:18:22.622280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:22.622878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:22.633215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.633668 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.634467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.634925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.660176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:18:22.746981 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6e2933ee-ffd8-4609-8fe7-2085d18f8a8e tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 204 len: 0 microversion: 2.1 time: 0.123492 Jul 20 05:18:22.747624 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5364/6489] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:18:22 2022] DELETE /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:18:22.756215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:22.756981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:22.763720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.764186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.765003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:22.765453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:22.904138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:22.911960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-16c75114-fbb3-482b-901f-d91137536c00 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1561 microversion: 2.1 time: 0.159911 Jul 20 05:18:22.912546 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5365/6490] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:22 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:23.929256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:23.929865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:23.937266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:23.937724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:23.938492 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:23.938934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:24.067191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:24.075150 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-802885af-05a5-4033-b2c1-b6a7807df7d0 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1561 microversion: 2.1 time: 0.149800 Jul 20 05:18:24.075912 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5366/6491] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:23 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:24.821944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-dae33c54-b6af-457a-a668-b4fd0f7bfbe5 req-04940a88-3c34-45c0-8a78-fa0852214ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965a65a0-d361-4d96-8bb4-fbd8dd4ea417", "name": "network-vif-deleted", "tag": "231963d7-f8d1-46c7-bb74-543ae6dd8b8f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:24.832446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dae33c54-b6af-457a-a668-b4fd0f7bfbe5 req-04940a88-3c34-45c0-8a78-fa0852214ded service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:24.832901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-dae33c54-b6af-457a-a668-b4fd0f7bfbe5 req-04940a88-3c34-45c0-8a78-fa0852214ded service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:24.848430 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-dae33c54-b6af-457a-a668-b4fd0f7bfbe5 req-04940a88-3c34-45c0-8a78-fa0852214ded service nova] Creating event network-vif-deleted:231963d7-f8d1-46c7-bb74-543ae6dd8b8f for instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 on n-h1-764486-11 Jul 20 05:18:24.854317 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-dae33c54-b6af-457a-a668-b4fd0f7bfbe5 req-04940a88-3c34-45c0-8a78-fa0852214ded service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036769 Jul 20 05:18:24.855242 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5367/6492] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:25.093010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:25.093720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:25.100855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:25.101845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:25.102616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:25.103062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:25.133400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:25.133856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:25.134313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lazy-loading 'fault' on Instance uuid 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:18:25.178226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3420ccf1cd0401d800e8fc0cf46c51e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678eae9119a54ebcaf3ea4b8752c7b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:25.186730 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79df6d7c-ac30-4885-99c6-4acf0aab1650 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 200 len: 1353 microversion: 2.1 time: 0.098121 Jul 20 05:18:25.187315 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5368/6493] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:25 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 1353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:26.204499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:26.205128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] [instance: 965a65a0-d361-4d96-8bb4-fbd8dd4ea417] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:26.212027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:26.212534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:26.213319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:26.213769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:26.227311 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] HTTP exception thrown: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 could not be found. Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Request method failure captured: Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 HTTP/1.1 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi14_TkF9b18vzs7Mv9QgPAR1uLl8XC3ZZRsMce345UMFBASUOtugjIcfIVD6Ew5DrBAJPwLcu0DuRetMNVbofpNZ3fDTQvcErrMx2br_14wdgH6lGqS-TmdTqQK8GrqXYFoR0K-kSsyrQl1pLlxAW5gkneunM3Oja9qBF0ItGCz4uWg4 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/678eae9119a54ebcaf3ea4b8752c7b46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_678eae9119a54ebcaf3ea4b8752c7b46", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 678eae9119a54ebcaf3ea4b8752c7b46 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-617275612 Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: f3420ccf1cd0401d800e8fc0cf46c51e Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestEncryptedCinderVolumes-617275612-project Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 could not be found. Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '965a65a0-d361-4d96-8bb4-fbd8dd4ea417'} Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 could not be found. Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 could not be found. Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:18:26.229086 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 could not be found. Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Returning 404 to user: Instance 965a65a0-d361-4d96-8bb4-fbd8dd4ea417 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cb2f042-37f0-4649-a50f-c7f916511759 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417" status: 404 len: 111 microversion: 2.1 time: 0.030126 Jul 20 05:18:26.232849 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5369/6494] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:26 2022] GET /compute/v2.1/servers/965a65a0-d361-4d96-8bb4-fbd8dd4ea417 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:18:26.238796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-354171e5-3801-4953-9109-ed5b35a38d13 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] Calling method '.version_select at 0x7f838b001820>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:26.258506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-354171e5-3801-4953-9109-ed5b35a38d13 tempest-TestEncryptedCinderVolumes-617275612 tempest-TestEncryptedCinderVolumes-617275612-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1865261220" status: 202 len: 0 microversion: 2.1 time: 0.023166 Jul 20 05:18:26.259079 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5370/6495] 10.222.0.49 () {58 vars in 1277 bytes} [Wed Jul 20 05:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1865261220 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:18:52.848748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:52.849530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:18:52.854517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f9cb48e6-b2fc-4446-8bd8-7797a65b4fa4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'create', calling method: .version_select at 0x7f838a0c2d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-153251192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr+jJArUk0KpYnUtqjIRJ2ea3+jXUugvkpTA198NveS6N7diiU1Yr0OHpQL8N3VvfeEEPDnaKMf1+zKaVABHXzVGziasF+7SP5n5Gjr1MIG0CZEHJIHPp36l3fM/XBD7A=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:52.873539 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f9cb48e6-b2fc-4446-8bd8-7797a65b4fa4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for project 7f3bfdcbd9864730999e911af1705d34. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:52.878644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-f9cb48e6-b2fc-4446-8bd8-7797a65b4fa4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for user 55e4eb0247c64440b4e4083d69970108 and project 7f3bfdcbd9864730999e911af1705d34. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:52.903135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f9cb48e6-b2fc-4446-8bd8-7797a65b4fa4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056417 Jul 20 05:18:52.903749 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5371/6496] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:18:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:18:52.951227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1446993931", "imageRef": "299e0349-fa52-46b4-a447-a00b35a92ba0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-153251192", "networks": [{"uuid": "e667369d-a36e-40d9-88b8-7d5e13944cd0"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:18:53.000029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] validate_networks() for [('e667369d-a36e-40d9-88b8-7d5e13944cd0', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:18:53.454110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:18:53.454547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:18:53.455031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:18:53.455484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:18:53.455903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:18:53.464873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:53.465336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:53.466153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:53.466607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:53.486935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for project 7f3bfdcbd9864730999e911af1705d34. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:18:53.492831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for user 55e4eb0247c64440b4e4083d69970108 and project 7f3bfdcbd9864730999e911af1705d34. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:18:53.505280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:18:53.507457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='299e0349-fa52-46b4-a447-a00b35a92ba0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:18:53.553394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa61eb15-26db-4280-85e0-48bd36b9605a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605811 Jul 20 05:18:53.554686 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5372/6497] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:18:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:18:53.564832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-60982e83-bfad-4bd4-b862-7674d997dfa7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:53.565458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-60982e83-bfad-4bd4-b862-7674d997dfa7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:53.618942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-60982e83-bfad-4bd4-b862-7674d997dfa7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:53.625580 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-60982e83-bfad-4bd4-b862-7674d997dfa7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1258 microversion: 2.1 time: 0.064556 Jul 20 05:18:53.626362 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5373/6498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:53 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:54.642548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:54.643180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:54.650962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:54.651434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:54.652228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:54.652877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:54.725354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:54.734980 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ee64cb3-68a8-4788-a05b-86c86a4ddaef tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1316 microversion: 2.1 time: 0.096189 Jul 20 05:18:54.745936 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5374/6499] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:54 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1316 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:55.752582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:55.753155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:55.763256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:55.764194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:55.765685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:55.766560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:55.910136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:55.918101 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5395012-3a4e-4e2f-9bd1-16d0841896de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.169495 Jul 20 05:18:55.918672 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5375/6500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:55 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:56.935614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:56.936951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:56.944062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:56.945825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:56.946718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:56.947187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:57.096161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:57.104052 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-616f8eda-7558-4491-bd46-076c75abd021 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.172204 Jul 20 05:18:57.104682 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5376/6501] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:56 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:58.121096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:58.121784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:58.129132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:58.129593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:58.130382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:58.130965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:58.277861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:58.286055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-327c0e19-8464-437e-a9b9-0b906a61b7f9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.168902 Jul 20 05:18:58.286647 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5377/6502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:58 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:18:59.305729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:18:59.307669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:18:59.315860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:59.316500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:59.317473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:18:59.317924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:18:59.483866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:18:59.493815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf1b3367-1172-4fef-a54b-0c3c3e30f6c0 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.193068 Jul 20 05:18:59.506284 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5378/6503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:18:59 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:00.513739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:00.514535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:00.523293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:00.523754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:00.525534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:00.525534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:00.685638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:00.694660 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2b9a05aa-3362-4dc8-abf0-6a0a9d35f5b2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.185038 Jul 20 05:19:00.695272 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5379/6504] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:00 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:01.711932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:01.712931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:01.719710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:01.720172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:01.720988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:01.721440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:01.863412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:01.872142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9aeda2e-40f6-4233-ba59-dc2871c2c98d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.164078 Jul 20 05:19:01.872780 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5380/6505] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:01 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:02.889061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:02.889719 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:02.897273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.897882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:02.898801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:02.899352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.354213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:03.362011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-45ed8d54-4c29-4351-9dfa-5ff231cdfc8a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.476571 Jul 20 05:19:03.362313 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5381/6506] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:02 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:03.723690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:03.724620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:03.889395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6c06bb81-4acb-44d5-9347-be598becd1e7 req-136200ee-0cf5-47ec-ae74-5320e26a391c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:03.899816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6c06bb81-4acb-44d5-9347-be598becd1e7 req-136200ee-0cf5-47ec-ae74-5320e26a391c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:03.900829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6c06bb81-4acb-44d5-9347-be598becd1e7 req-136200ee-0cf5-47ec-ae74-5320e26a391c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:03.914066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6c06bb81-4acb-44d5-9347-be598becd1e7 req-136200ee-0cf5-47ec-ae74-5320e26a391c service nova] Creating event network-changed:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:19:03.920487 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6c06bb81-4acb-44d5-9347-be598becd1e7 req-136200ee-0cf5-47ec-ae74-5320e26a391c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227552 Jul 20 05:19:03.921445 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5382/6507] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:04.379787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:04.380439 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:04.387378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.387837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.388632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:04.389079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:04.522954 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:04.530408 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f7dc2fb8-2cf2-4f2d-8326-a90338077f2c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.155039 Jul 20 05:19:04.530980 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5383/6508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:04 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:05.547151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:05.547801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:05.555105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.555569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.556378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:05.556831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:05.684025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:05.691530 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88fa6eab-d267-4076-a65b-a4f45ba1291a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.148329 Jul 20 05:19:05.692114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5384/6509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:05 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:06.708845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:06.709525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:06.716922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:06.717387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:06.718170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:06.718623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:06.848926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:06.857081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2902fef-facb-4d9e-a4ae-e0ba35196bd1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.152154 Jul 20 05:19:06.857666 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5385/6510] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:06 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:07.874019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:07.874698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:07.881526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:07.882484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:07.883265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:07.883713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.017453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:08.025481 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-18bd59f2-aabe-46f8-8095-d65c265ab564 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.155428 Jul 20 05:19:08.026062 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5386/6511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:07 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:08.084336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-803bef10-c0ba-4b75-8e1d-321ba84e90d8 req-38b284e8-79d4-40fa-b84d-bb6f9c7cf4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "name": "network-vif-plugged", "status": "completed", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:08.092375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-803bef10-c0ba-4b75-8e1d-321ba84e90d8 req-38b284e8-79d4-40fa-b84d-bb6f9c7cf4ac service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:08.092846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-803bef10-c0ba-4b75-8e1d-321ba84e90d8 req-38b284e8-79d4-40fa-b84d-bb6f9c7cf4ac service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:08.103776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-803bef10-c0ba-4b75-8e1d-321ba84e90d8 req-38b284e8-79d4-40fa-b84d-bb6f9c7cf4ac service nova] Creating event network-vif-plugged:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:19:08.108802 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-803bef10-c0ba-4b75-8e1d-321ba84e90d8 req-38b284e8-79d4-40fa-b84d-bb6f9c7cf4ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081519 Jul 20 05:19:08.109401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5387/6512] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:19:09.044740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:09.045363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:09.051606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:09.052072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:09.052868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:09.053316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:09.181811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:09.189484 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6895d14b-573b-4b70-99ce-3e9798266cc9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1358 microversion: 2.1 time: 0.149987 Jul 20 05:19:09.190096 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5388/6513] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:09 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:10.207986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.208658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:10.216763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.217254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.218209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.218775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.346665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.354768 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39686ca9-209b-46aa-aac6-048d8bdc3f75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1547 microversion: 2.1 time: 0.150873 Jul 20 05:19:10.355414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5389/6514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:10.370386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.371011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:10.376737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.377293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.378079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.378532 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.509624 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.520995 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0fc3ee0-dd1f-4c26-906a-39ffbb864dfe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1547 microversion: 2.1 time: 0.153680 Jul 20 05:19:10.522074 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5390/6515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:10.537236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.541314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.542093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Searching by: {'deleted': False, 'project_id': '7f3bfdcbd9864730999e911af1705d34'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:19:10.547464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.547931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.548783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.549370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.573438 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:19:10.577249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:10.601506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53a5dafc-f29b-4dca-a0df-bf2e9daab639 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067279 Jul 20 05:19:10.602106 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5391/6516] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:19:10.612006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:10.612657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:10.618473 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.618939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.619720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:10.620173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:10.754656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:10.762715 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-41542d02-f6ad-4834-ba76-0b9910be157c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1547 microversion: 2.1 time: 0.154285 Jul 20 05:19:10.763289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5392/6517] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:10 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:12.283905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "757dc55c-5ff5-42be-a22c-c9bfbcd1a26e"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:12.285008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:12.292035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.292546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:12.293326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:12.293767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:12.539829 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca6ddfc1-c36f-4d27-9e84-c26d1962ba0e tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259287 Jul 20 05:19:12.540475 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5393/6518] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 05:19:12 2022] POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:19:25.507838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:25.508596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:25.511337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:25.512183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:25.512815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:19:25.519421 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:25.519888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:25.520709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:25.521160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:25.656188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:25.664779 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c88eb6bc-be74-490a-a088-251ebbe1a3ca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1593 microversion: 2.1 time: 0.161383 Jul 20 05:19:25.665394 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5394/6519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:25 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:19:27.308945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9f7c69ad-08d4-4cdf-bba3-dfdc03940ff5 req-592f66f0-70cd-4045-aa7c-c6c2e8c230d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:27.319133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f7c69ad-08d4-4cdf-bba3-dfdc03940ff5 req-592f66f0-70cd-4045-aa7c-c6c2e8c230d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:27.319590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9f7c69ad-08d4-4cdf-bba3-dfdc03940ff5 req-592f66f0-70cd-4045-aa7c-c6c2e8c230d3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:27.334049 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9f7c69ad-08d4-4cdf-bba3-dfdc03940ff5 req-592f66f0-70cd-4045-aa7c-c6c2e8c230d3 service nova] Creating event network-changed:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:19:27.341104 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9f7c69ad-08d4-4cdf-bba3-dfdc03940ff5 req-592f66f0-70cd-4045-aa7c-c6c2e8c230d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035216 Jul 20 05:19:27.341104 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5395/6520] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:19:29.084265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-769785293"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:29.084927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:29.093169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.093505 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.094465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.095032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.224438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Adding security group 4bae54c2-bf1a-4fca-bfc1-fc1c082308eb to port 4700e489-7214-4124-8268-d47465060d08 Jul 20 05:19:29.571654 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5787de89-fde0-4530-bbee-f5d69bf62b3b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/action" status: 202 len: 0 microversion: 2.1 time: 0.492525 Jul 20 05:19:29.575536 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5396/6521] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:19:29 2022] POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:19:29.580931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:19:29.581566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:19:29.588659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.589329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.590332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.591111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.761484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:19:29.770527 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2fbb3a08-17b3-4985-8bf1-7b10feaadabe tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1758 microversion: 2.1 time: 0.193755 Jul 20 05:19:29.771372 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5397/6522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:19:29 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:19:29.777273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-30986198-e18e-4eeb-a0b0-3069f261cd1a req-ef1fb13f-4c18-4b3c-b172-6fe05a0ccac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:19:29.787490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-30986198-e18e-4eeb-a0b0-3069f261cd1a req-ef1fb13f-4c18-4b3c-b172-6fe05a0ccac9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:19:29.787947 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-30986198-e18e-4eeb-a0b0-3069f261cd1a req-ef1fb13f-4c18-4b3c-b172-6fe05a0ccac9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:19:29.800423 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-30986198-e18e-4eeb-a0b0-3069f261cd1a req-ef1fb13f-4c18-4b3c-b172-6fe05a0ccac9 service nova] Creating event network-changed:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:19:29.805862 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-30986198-e18e-4eeb-a0b0-3069f261cd1a req-ef1fb13f-4c18-4b3c-b172-6fe05a0ccac9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033215 Jul 20 05:19:29.806469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5398/6523] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:21:08.189970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:08.190991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=20 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:21:08.196638 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:21:08.197796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:08.205445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:08.205904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:08.206679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:08.207123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:08.280801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-364acd0e-688a-4c09-8171-2754d8912158 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/action" status: 202 len: 0 microversion: 2.1 time: 0.093820 Jul 20 05:21:08.281451 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5399/6524] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:21:08 2022] POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:21:08.290173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:08.290884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:08.297944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:08.298420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:08.299237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:08.299830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:08.531420 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:08.539426 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69dfee19-4ff4-45c3-b87e-d64dc1b670e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1760 microversion: 2.1 time: 0.253374 Jul 20 05:21:08.539998 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5400/6525] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:08 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1760 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:21:09.557623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:21:09.558766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:21:09.565652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:09.566109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:09.566896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:21:09.567328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:21:09.717304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:21:09.725655 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7893eeaf-c331-4a62-ba54-cd7833c3e7e4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1758 microversion: 2.1 time: 0.172197 Jul 20 05:21:09.726232 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5401/6526] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:21:09 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:21:14.602110 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:21:14.602811 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 05:22:22.620570 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=6 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:22.621340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:22.625414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-769785293"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:22.625964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:22.633135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:22.633595 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:22.634365 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:22.634809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:22.759874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Removing security group 4bae54c2-bf1a-4fca-bfc1-fc1c082308eb from port 4700e489-7214-4124-8268-d47465060d08 Jul 20 05:22:23.100905 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10f9c6ce-e9e9-481f-8202-4a89ab6498de tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/action" status: 202 len: 0 microversion: 2.1 time: 0.483049 Jul 20 05:22:23.102414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5402/6527] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:22:22 2022] POST /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:22:23.112905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-45f6b1e8-e4a8-434b-bbb7-3135e234ba6b req-783a614b-6ebd-47d0-9cb2-afd304c6ccce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:23.123975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45f6b1e8-e4a8-434b-bbb7-3135e234ba6b req-783a614b-6ebd-47d0-9cb2-afd304c6ccce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:23.125156 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-45f6b1e8-e4a8-434b-bbb7-3135e234ba6b req-783a614b-6ebd-47d0-9cb2-afd304c6ccce service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:23.146883 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-45f6b1e8-e4a8-434b-bbb7-3135e234ba6b req-783a614b-6ebd-47d0-9cb2-afd304c6ccce service nova] Creating event network-changed:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:22:23.153915 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-45f6b1e8-e4a8-434b-bbb7-3135e234ba6b req-783a614b-6ebd-47d0-9cb2-afd304c6ccce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044634 Jul 20 05:22:23.154740 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5403/6528] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:24.267110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-19487d49-f0c0-48b4-8b80-15ce63c52ea5 req-9399c4ff-f36a-477a-8d5a-5e31c5d0b841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:24.275962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19487d49-f0c0-48b4-8b80-15ce63c52ea5 req-9399c4ff-f36a-477a-8d5a-5e31c5d0b841 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:24.276378 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-19487d49-f0c0-48b4-8b80-15ce63c52ea5 req-9399c4ff-f36a-477a-8d5a-5e31c5d0b841 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:24.287163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-19487d49-f0c0-48b4-8b80-15ce63c52ea5 req-9399c4ff-f36a-477a-8d5a-5e31c5d0b841 service nova] Creating event network-changed:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:22:24.292343 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-19487d49-f0c0-48b4-8b80-15ce63c52ea5 req-9399c4ff-f36a-477a-8d5a-5e31c5d0b841 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093174 Jul 20 05:22:24.293392 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5404/6529] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:24.298620 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:24.299210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:24.306871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:24.307336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:24.308146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:24.308616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:24.396031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lazy-loading 'services' on Instance uuid efd31ecb-4ec3-4b81-8741-fb6dc24862f8 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:22:24.476018 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a45c0c0a-e5ff-4016-bf09-3b809584f13f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments/757dc55c-5ff5-42be-a22c-c9bfbcd1a26e" status: 202 len: 0 microversion: 2.1 time: 0.181238 Jul 20 05:22:24.476668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5405/6530] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:22:24 2022] DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments/757dc55c-5ff5-42be-a22c-c9bfbcd1a26e => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:22:24.486819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:24.488927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:24.498243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:24.498866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:24.500472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:24.500953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:24.540974 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca2fd5c4-14c2-4ee2-a2e6-b8f6c40b28bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059532 Jul 20 05:22:24.544396 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5406/6531] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:22:24 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:22:25.553041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:25.553984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:25.561180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:25.561646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:25.562432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:25.562882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:25.593097 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d42326e0-933e-4ba1-b23b-62bf28effcda tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Jul 20 05:22:25.593675 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5407/6532] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:22:25 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:26.605557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:26.606551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:26.613578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:26.614046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:26.614846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:26.615296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:26.646047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-764be20d-3e5e-4216-a98c-90c5513d0376 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Jul 20 05:22:26.646626 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5408/6533] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:22:26 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:27.658640 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:27.659582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:27.667212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:27.667670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:27.668494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:27.668941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:27.698678 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bdbd18c7-9558-4f40-a891-84910faa6394 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Jul 20 05:22:27.699245 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5409/6534] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:22:27 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:28.710995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:28.711951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:28.718973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:28.719443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:28.720235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:28.720714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:28.753515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a202bff-865d-4e23-a939-57e098a038d2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 Jul 20 05:22:28.754343 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5410/6535] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:22:28 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:29.766375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:29.767310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:29.774188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:29.774646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:29.775424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:29.775871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:29.804415 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9eea91c2-fe08-48b8-87bd-baa8b3b216d4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042371 Jul 20 05:22:29.805023 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5411/6536] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:22:29 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 05:22:29.815126 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:29.815629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:29.822114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:29.822578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:29.823351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:29.823800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:29.896821 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] HTTP exception thrown: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 is not attached to volume 757dc55c-5ff5-42be-a22c-c9bfbcd1a26e Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Request method failure captured: Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments/757dc55c-5ff5-42be-a22c-c9bfbcd1a26e HTTP/1.1 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15At8T5VrfKZyIkh4H9Pi55jk7jysgiIgFDj_YlvxvUsdGEkcfl6Powm9w8RmtJ8yvPoi8mjQiQcHqYQjNkDsf8e05A6R8bkmR_KraR3emo0TykAlQAp9qazjUb_PsNr-frIcuGaSGSY-iusnqLPH4yq4vged5n5CpP03UJa2IN3-S8 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f3bfdcbd9864730999e911af1705d34", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 55e4eb0247c64440b4e4083d69970108 Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 is not attached to volume 757dc55c-5ff5-42be-a22c-c9bfbcd1a26e Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': 'efd31ecb-4ec3-4b81-8741-fb6dc24862f8', 'id': '757dc55c-5ff5-42be-a22c-c9bfbcd1a26e'} Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 757dc55c-5ff5-42be-a22c-c9bfbcd1a26e. Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 is not attached to volume 757dc55c-5ff5-42be-a22c-c9bfbcd1a26e Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:22:29.898466 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 is not attached to volume 757dc55c-5ff5-42be-a22c-c9bfbcd1a26e Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Returning 404 to user: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 is not attached to volume 757dc55c-5ff5-42be-a22c-c9bfbcd1a26e {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-72992564-892c-4ba9-9d7d-49bfca6fea1b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments/757dc55c-5ff5-42be-a22c-c9bfbcd1a26e" status: 404 len: 154 microversion: 2.1 time: 0.088656 Jul 20 05:22:29.902807 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5412/6537] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:22:29 2022] DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8/os-volume_attachments/757dc55c-5ff5-42be-a22c-c9bfbcd1a26e => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:22:33.135701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:33.136344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:33.143316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:33.143779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:33.144582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:33.145030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:33.170305 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:22:33.250022 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-81296375-87ae-4007-a23f-5f87a240190d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 204 len: 0 microversion: 2.1 time: 0.118458 Jul 20 05:22:33.250977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5413/6538] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:22:33 2022] DELETE /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:22:33.260617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:33.261338 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:33.269246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:33.270090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:33.271587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:33.272495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:33.415210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:33.423145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-89959901-c014-420a-8384-b1ab2e9e61af tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1553 microversion: 2.1 time: 0.167407 Jul 20 05:22:33.423658 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5414/6539] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:33 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:34.441412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:34.442039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:34.449574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:34.450059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:34.450816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:34.451269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:34.582394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:34.590718 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48e7d456-4078-4f6b-874c-84232e07123f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1553 microversion: 2.1 time: 0.153439 Jul 20 05:22:34.591278 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5415/6540] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:34 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:35.328920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-c29a532e-6abd-4e8a-97bf-acdc83af7a51 req-5f644cf9-0c0d-4a48-9f1c-6b0fe2390bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd31ecb-4ec3-4b81-8741-fb6dc24862f8", "name": "network-vif-deleted", "tag": "4700e489-7214-4124-8268-d47465060d08"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:35.337633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c29a532e-6abd-4e8a-97bf-acdc83af7a51 req-5f644cf9-0c0d-4a48-9f1c-6b0fe2390bde service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:35.338093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-c29a532e-6abd-4e8a-97bf-acdc83af7a51 req-5f644cf9-0c0d-4a48-9f1c-6b0fe2390bde service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:35.349740 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-c29a532e-6abd-4e8a-97bf-acdc83af7a51 req-5f644cf9-0c0d-4a48-9f1c-6b0fe2390bde service nova] Creating event network-vif-deleted:4700e489-7214-4124-8268-d47465060d08 for instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 on n-h1-764486-11 Jul 20 05:22:35.355205 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-c29a532e-6abd-4e8a-97bf-acdc83af7a51 req-5f644cf9-0c0d-4a48-9f1c-6b0fe2390bde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029950 Jul 20 05:22:35.355787 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5416/6541] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:35.609328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:35.610055 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:35.617136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:35.617607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:35.618411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:35.618875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:35.656206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:35.656710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:35.657679 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lazy-loading 'fault' on Instance uuid efd31ecb-4ec3-4b81-8741-fb6dc24862f8 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:22:35.706206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:35.726534 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ccd1a505-84e0-4358-953c-caeb6daab11d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 200 len: 1348 microversion: 2.1 time: 0.123078 Jul 20 05:22:35.727134 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5417/6542] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:35 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 1348 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:36.745695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:36.746423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: efd31ecb-4ec3-4b81-8741-fb6dc24862f8] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:36.753224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:36.753681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:36.754458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:36.754902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:36.758953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:36.769142 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] HTTP exception thrown: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 could not be found. Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Request method failure captured: Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 HTTP/1.1 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15At8T5VrfKZyIkh4H9Pi55jk7jysgiIgFDj_YlvxvUsdGEkcfl6Powm9w8RmtJ8yvPoi8mjQiQcHqYQjNkDsf8e05A6R8bkmR_KraR3emo0TykAlQAp9qazjUb_PsNr-frIcuGaSGSY-iusnqLPH4yq4vged5n5CpP03UJa2IN3-S8 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f3bfdcbd9864730999e911af1705d34", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 55e4eb0247c64440b4e4083d69970108 Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 could not be found. Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'efd31ecb-4ec3-4b81-8741-fb6dc24862f8'} Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 could not be found. Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 could not be found. Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:22:36.770894 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 could not be found. Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Returning 404 to user: Instance efd31ecb-4ec3-4b81-8741-fb6dc24862f8 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be08f358-a923-4f12-83f8-1872c6138d99 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8" status: 404 len: 111 microversion: 2.1 time: 0.031158 Jul 20 05:22:36.775413 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5418/6543] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:36 2022] GET /compute/v2.1/servers/efd31ecb-4ec3-4b81-8741-fb6dc24862f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:22:36.781223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d5194ced-947d-4ef7-a41a-0a9b6e70eac4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '.version_select at 0x7f839ce18790>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:36.803776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d5194ced-947d-4ef7-a41a-0a9b6e70eac4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-153251192" status: 202 len: 0 microversion: 2.1 time: 0.026441 Jul 20 05:22:36.804346 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5419/6544] 10.222.0.49 () {58 vars in 1268 bytes} [Wed Jul 20 05:22:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-153251192 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:22:45.850596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-552fa638-4a5c-4dbb-8414-8ddc346113f4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'create', calling method: .version_select at 0x7f838af509d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1081090526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu5wn6y3mClJdf+b2BeSr5Kk1PLdh9Icmbxo0prsCITLeJj3K5e2Ce8hnoF+Qq4/uItmbClKoQlDvaJ+2LNANrGj3ZUuK4DImcZMZdxXq9/y+LvJff2w42Tp/+ojMg4TQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:45.865590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-552fa638-4a5c-4dbb-8414-8ddc346113f4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for project 7f3bfdcbd9864730999e911af1705d34. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:22:45.872221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-552fa638-4a5c-4dbb-8414-8ddc346113f4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for user 55e4eb0247c64440b4e4083d69970108 and project 7f3bfdcbd9864730999e911af1705d34. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:22:45.895331 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-552fa638-4a5c-4dbb-8414-8ddc346113f4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050140 Jul 20 05:22:45.895927 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5420/6545] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:22:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:22:45.943275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1971514602", "imageRef": "aad5b908-052c-4a98-a393-8cbf08ac5a21", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1081090526", "networks": [{"uuid": "e667369d-a36e-40d9-88b8-7d5e13944cd0"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:22:46.074817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] validate_networks() for [('e667369d-a36e-40d9-88b8-7d5e13944cd0', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:22:46.444174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:22:46.444649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:22:46.445141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:22:46.445555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:22:46.445976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:22:46.455264 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:46.455659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:46.456496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:46.456945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:46.474272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for project 7f3bfdcbd9864730999e911af1705d34. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:22:46.479394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Getting quotas for user 55e4eb0247c64440b4e4083d69970108 and project 7f3bfdcbd9864730999e911af1705d34. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:22:46.491560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:22:46.493743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aad5b908-052c-4a98-a393-8cbf08ac5a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:22:46.538467 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-782323d3-90ac-409b-bf86-c6af9fb86ac3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599020 Jul 20 05:22:46.539162 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5421/6546] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:22:46.549319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-27089e99-8b2f-4907-be3b-9c1c5fb6060f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:46.549953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-27089e99-8b2f-4907-be3b-9c1c5fb6060f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:46.603763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-27089e99-8b2f-4907-be3b-9c1c5fb6060f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:46.610616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-27089e99-8b2f-4907-be3b-9c1c5fb6060f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1259 microversion: 2.1 time: 0.065279 Jul 20 05:22:46.611193 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5422/6547] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:46 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:47.627062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d70844e9-5083-4368-a7b9-9134dec21da4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:47.627690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d70844e9-5083-4368-a7b9-9134dec21da4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:47.681390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d70844e9-5083-4368-a7b9-9134dec21da4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:47.688084 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d70844e9-5083-4368-a7b9-9134dec21da4 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1259 microversion: 2.1 time: 0.064888 Jul 20 05:22:47.688712 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5423/6548] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:47 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:48.704985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fa62170a-e5bb-411b-ad44-882eaa2daa46 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:48.705617 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fa62170a-e5bb-411b-ad44-882eaa2daa46 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:48.766074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fa62170a-e5bb-411b-ad44-882eaa2daa46 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:48.773682 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fa62170a-e5bb-411b-ad44-882eaa2daa46 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1259 microversion: 2.1 time: 0.072485 Jul 20 05:22:48.774433 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5424/6549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:48 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:49.791776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-231b6d4e-596c-4a52-96e2-1d9e95604517 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:49.792560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-231b6d4e-596c-4a52-96e2-1d9e95604517 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:49.849718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-231b6d4e-596c-4a52-96e2-1d9e95604517 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:49.857349 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-231b6d4e-596c-4a52-96e2-1d9e95604517 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1259 microversion: 2.1 time: 0.070378 Jul 20 05:22:49.858047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5425/6550] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:49 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:50.875543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:50.876181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:50.883112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:50.883575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:50.884343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:50.885457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:50.945240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:50.953222 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b33ecc6d-be34-4d2e-9a93-6ed2ceb2a25d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1263 microversion: 2.1 time: 0.081638 Jul 20 05:22:50.953952 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5426/6551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:50 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:51.971995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:51.972776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:51.988095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.988652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:51.991302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:51.991775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:52.065811 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:52.075041 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f05d3574-183e-48b0-b126-4850e18daaca tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1317 microversion: 2.1 time: 0.108173 Jul 20 05:22:52.085567 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5427/6552] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:51 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1317 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:53.093256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:53.093924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:53.096660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:53.102398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.102782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.104393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:53.105318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:53.321619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:53.330008 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-35ec170d-ebd6-445a-88ed-19eb1bd77454 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.240643 Jul 20 05:22:53.330601 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5428/6553] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:53 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:54.348010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:54.348805 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:54.356602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:54.357068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:54.357857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:54.358304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:54.505180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:54.513597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3681afbc-2bd8-45e9-af84-b53d8b9ed5a7 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.170060 Jul 20 05:22:54.514373 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5429/6554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:54 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:22:55.531908 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:55.532715 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:55.539578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.540038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.540851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:55.541990 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:55.691468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:55.699895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-169aec6b-9d04-4bea-b79b-da41eddb290c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.172331 Jul 20 05:22:55.700518 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5430/6555] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:55 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:56.717089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:56.717780 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:56.723588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:22:56.726910 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:56.727377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:56.728190 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:56.728836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:56.866645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:56.874955 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf1d0ab8-05aa-4365-95f1-702c1dec7a32 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.161938 Jul 20 05:22:56.875543 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5431/6556] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:56 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:57.893557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:57.894206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:57.901829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:57.902308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:57.903105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:57.903560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:58.041133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:58.050048 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2463af7c-3a7b-4100-9b2d-2355585ed21b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.160282 Jul 20 05:22:58.051111 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5432/6557] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:57 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:22:59.067259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:22:59.067925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:22:59.075496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:59.075957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:59.076766 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:22:59.077213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:22:59.211791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:22:59.220720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-648852d6-b5ec-460f-a7da-560ec5b8b5b5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.157401 Jul 20 05:22:59.221308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5433/6558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:22:59 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:00.178932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=18 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:00.188996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4c24edb4-f374-4148-a076-863cdf4e9ce7 req-520f74e5-9464-4aaf-aa38-da7e339b3752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:00.201935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4c24edb4-f374-4148-a076-863cdf4e9ce7 req-520f74e5-9464-4aaf-aa38-da7e339b3752 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.202772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4c24edb4-f374-4148-a076-863cdf4e9ce7 req-520f74e5-9464-4aaf-aa38-da7e339b3752 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.220668 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4c24edb4-f374-4148-a076-863cdf4e9ce7 req-520f74e5-9464-4aaf-aa38-da7e339b3752 service nova] Creating event network-changed:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:23:00.226356 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4c24edb4-f374-4148-a076-863cdf4e9ce7 req-520f74e5-9464-4aaf-aa38-da7e339b3752 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048631 Jul 20 05:23:00.227443 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5434/6559] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:23:00.243937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:00.245222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:00.254516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.255294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.256177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:00.256684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:00.405410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:00.413011 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-177f51dc-7cf2-4e00-8161-0ed5deb00c14 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.174552 Jul 20 05:23:00.413593 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5435/6560] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:00 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:01.430241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:01.430890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:01.437680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:01.438135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:01.438906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:01.439349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:01.571063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:01.579087 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b5ed24f6-06c9-4a6e-bac1-aca009853984 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.153061 Jul 20 05:23:01.579668 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5436/6561] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:01 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:02.597025 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:02.597689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:02.605269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:02.605730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:02.606507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:02.606951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:02.733926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:02.741474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a231cffe-7fef-48e6-a107-71e4f7a94599 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.148333 Jul 20 05:23:02.742078 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5437/6562] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:02 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:03.757242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:03.757872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:03.764833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:03.765297 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:03.766074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:03.766524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:03.897616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:03.905010 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53536b5f-d7f7-4bca-aa12-de5f364ca8e5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.151746 Jul 20 05:23:03.905603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5438/6563] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:03 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:04.922057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:04.922727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:04.929920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:04.930383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:04.931160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:04.931610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:05.058759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:05.066331 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5482f796-df85-47cd-a656-f3e5ac9ed44d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.148252 Jul 20 05:23:05.066910 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5439/6564] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:04 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:06.083676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:06.084303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:06.091875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:06.092383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:06.093164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:06.093609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:06.225655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:06.233949 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5c54f647-f872-48bd-9086-d103f8f9d7df tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.154101 Jul 20 05:23:06.234724 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5440/6565] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:06 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:06.386212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-eb9f7b65-99ce-4086-bae0-654149404c54 req-794090c3-3888-48f1-b498-5a11eb1e57e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "name": "network-vif-plugged", "status": "completed", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:06.395240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb9f7b65-99ce-4086-bae0-654149404c54 req-794090c3-3888-48f1-b498-5a11eb1e57e3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:06.395976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-eb9f7b65-99ce-4086-bae0-654149404c54 req-794090c3-3888-48f1-b498-5a11eb1e57e3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:06.407318 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-eb9f7b65-99ce-4086-bae0-654149404c54 req-794090c3-3888-48f1-b498-5a11eb1e57e3 service nova] Creating event network-vif-plugged:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:23:06.412424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-eb9f7b65-99ce-4086-bae0-654149404c54 req-794090c3-3888-48f1-b498-5a11eb1e57e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030827 Jul 20 05:23:06.413138 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5441/6566] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:23:07.251053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:07.251765 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:07.258987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:07.259452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:07.260232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:07.260718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:07.263385 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=91 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:07.398434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:07.406500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f972c33b-3bf3-492d-a354-51de302bc05a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1359 microversion: 2.1 time: 0.159778 Jul 20 05:23:07.407091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5442/6567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:07 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:08.423359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:08.424030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:08.431183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.432288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.433107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.433550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.559386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:08.566903 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d21d8e0d-42b6-4dc0-b33b-a0220fe1231b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1548 microversion: 2.1 time: 0.147527 Jul 20 05:23:08.567478 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5443/6568] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:08 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:08.582915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:08.583535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:08.590079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.590543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.591350 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.591803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.722015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:08.730235 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-86d4fae2-d4af-4f7f-aa04-2bbf8e1f2b75 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1548 microversion: 2.1 time: 0.150992 Jul 20 05:23:08.730813 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5444/6569] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:08 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:08.745840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:08.749217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:08.749880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Searching by: {'deleted': False, 'project_id': '7f3bfdcbd9864730999e911af1705d34'} {{(pid=123724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 05:23:08.755274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.755731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.756565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.757010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.780665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.multi_cell_list [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 05:23:08.807871 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b07ac716-52bd-433e-9b30-615b9c054ce3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.065781 Jul 20 05:23:08.808489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5445/6570] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jul 20 05:23:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:23:08.818261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:08.818907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:08.824661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.825122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.825890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:08.826332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:08.954547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:08.962159 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9390635-5b38-4733-847f-1b5952f76213 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1548 microversion: 2.1 time: 0.147443 Jul 20 05:23:08.962737 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5446/6571] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:08 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:10.445037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de670f86-2b13-441b-9b01-378e09502f51"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:10.446261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:10.453863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:10.454324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:10.455100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:10.455551 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:10.689770 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f1b1bddd-6a18-453b-9689-bd381700f307 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248618 Jul 20 05:23:10.690559 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5447/6572] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jul 20 05:23:10 2022] POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:23:21.381382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:21.382272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=39 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:21.382978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:21.387296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:21.388010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:21.396453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:21.396923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:21.397697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:21.398145 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:21.528240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:21.536466 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fe8c2e8a-d183-4045-a69f-b661fa3837e6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1594 microversion: 2.1 time: 0.157060 Jul 20 05:23:21.537042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5448/6573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:21 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:23.213597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-bd2f64d1-b4c2-4ab6-bc75-6c2b93caa42d req-b73ce8b0-5209-4adf-9637-ef8dc7a2f1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:23.225917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bd2f64d1-b4c2-4ab6-bc75-6c2b93caa42d req-b73ce8b0-5209-4adf-9637-ef8dc7a2f1c8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:23.226536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-bd2f64d1-b4c2-4ab6-bc75-6c2b93caa42d req-b73ce8b0-5209-4adf-9637-ef8dc7a2f1c8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:23.241498 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-bd2f64d1-b4c2-4ab6-bc75-6c2b93caa42d req-b73ce8b0-5209-4adf-9637-ef8dc7a2f1c8 service nova] Creating event network-changed:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:23:23.247033 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-bd2f64d1-b4c2-4ab6-bc75-6c2b93caa42d req-b73ce8b0-5209-4adf-9637-ef8dc7a2f1c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Jul 20 05:23:23.247972 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5449/6574] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:23:24.233916 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-855615578"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:24.234565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:24.242129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:24.242606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:24.243400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:24.243858 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:24.377502 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Adding security group 69578a22-f63f-4e21-a538-01d08a8a738c to port 22605015-fa20-48c0-ac48-8b8112f3ceb9 Jul 20 05:23:24.722950 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b777f0e-2df5-4b07-804d-9964144d134b tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/action" status: 202 len: 0 microversion: 2.1 time: 0.493872 Jul 20 05:23:24.724998 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5450/6575] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:24 2022] POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:23:24.731404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-11617fed-d2f3-478d-b011-7855d4fcb716 req-0fae95b0-1e72-4a82-bb49-41ff090cbe1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:24.745741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-11617fed-d2f3-478d-b011-7855d4fcb716 req-0fae95b0-1e72-4a82-bb49-41ff090cbe1b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:24.746566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-11617fed-d2f3-478d-b011-7855d4fcb716 req-0fae95b0-1e72-4a82-bb49-41ff090cbe1b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:24.762053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-11617fed-d2f3-478d-b011-7855d4fcb716 req-0fae95b0-1e72-4a82-bb49-41ff090cbe1b service nova] Creating event network-changed:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:23:24.769253 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-11617fed-d2f3-478d-b011-7855d4fcb716 req-0fae95b0-1e72-4a82-bb49-41ff090cbe1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042445 Jul 20 05:23:24.770637 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5451/6576] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:23:24.782393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:24.783304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:24.792887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:24.793405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:24.794285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:24.794812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:25.002274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:25.010393 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31e12c40-6d80-4d3c-84c4-b4c445208c16 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1759 microversion: 2.1 time: 0.238383 Jul 20 05:23:25.011103 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5452/6577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:24 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1759 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:47.767519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=10 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:47.768271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=20 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:23:47.844801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:23:47.845812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:47.851861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:47.852318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:47.853116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:47.853562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:47.926786 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7d51d4c-a5ca-4284-a378-b36b068e7ef1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/action" status: 202 len: 0 microversion: 2.1 time: 0.164458 Jul 20 05:23:47.927632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5453/6578] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:23:47 2022] POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:23:47.940270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:47.941604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:47.952137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:47.953722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:47.954772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:47.955562 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:48.102169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:48.111055 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03b9b806-4c39-4351-969d-387fd87408a6 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1751 microversion: 2.1 time: 0.178829 Jul 20 05:23:48.111833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5454/6579] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:47 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:23:49.129056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:49.129683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:49.136670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:49.137135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:49.137923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:49.138370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:49.285921 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:49.293936 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e5dca81a-28e1-4227-be81-251bf0a66bf3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.169414 Jul 20 05:23:49.294513 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5455/6580] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:49 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:50.312452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:50.313115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:50.319960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:50.320451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:50.321232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:50.321683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:50.464646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:50.472586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-488096e7-3ed4-4647-996f-df589dd3cb63 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.164117 Jul 20 05:23:50.473158 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5456/6581] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:50 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:51.490411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:51.491072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:51.497829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:51.498291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:51.499056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:51.499499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:51.645281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:51.658673 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-023a2dc9-d096-4ad7-ac4c-53f0c0319a36 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.172220 Jul 20 05:23:51.659273 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5457/6582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:51 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:52.677045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:52.677724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:52.684688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:52.685150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:52.685931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:52.686382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:52.826837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:52.834843 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9fd64a6b-9eb1-446c-9637-4bd61d605285 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.162519 Jul 20 05:23:52.835423 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5458/6583] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:52 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:53.852499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:53.853170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:53.860471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:53.860924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:53.861699 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:53.862140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:54.003216 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:54.011194 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-853fa621-454c-4aa1-835d-204a487b4544 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.162615 Jul 20 05:23:54.011765 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5459/6584] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:53 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:55.028311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:55.028961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:55.035825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:55.036304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:55.037118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:55.037568 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:55.179363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:55.187402 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2d664f4d-91a1-4682-ae78-22e0e6ac99bb tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.163004 Jul 20 05:23:55.188514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5460/6585] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:55 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:56.204274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:56.204936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:56.212028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:56.212534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:56.213320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:56.213770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:56.355642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:56.364157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-461c4ad4-a6c9-4c9d-aa5c-3d587a6106a9 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.163877 Jul 20 05:23:56.364761 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5461/6586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:56 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:57.382114 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:57.382768 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:57.389648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:57.390106 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:57.391475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:57.391926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:57.536642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:57.544545 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07a10eb5-8788-498f-9178-9fee5e753ea3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.166362 Jul 20 05:23:57.545129 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5462/6587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:57 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:58.567700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:58.568397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:58.575407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:58.575868 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:58.576686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:58.577134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:58.723402 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:58.731489 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b97907dd-ff73-4e7c-a308-9747e85bcca3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.172462 Jul 20 05:23:58.732063 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5463/6588] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:58 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:23:59.748758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:23:59.749388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:23:59.756321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:59.756873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:59.757648 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:23:59.758096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:23:59.905723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:23:59.914413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-02a27b64-b786-46df-b8aa-9d91ae49998a tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.169711 Jul 20 05:23:59.914991 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5464/6589] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:23:59 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:00.931797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:00.932471 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:00.939747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:00.940212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:00.941004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:00.941468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:01.086397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:01.095547 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ef8273d-7165-4bc8-88c2-860b5d229ade tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.167684 Jul 20 05:24:01.096139 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5465/6590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:00 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:02.113412 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:02.114082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:02.120959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:02.121426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:02.122212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:02.122662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:02.268967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:02.276960 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1984da75-159f-4a49-9974-a5018b5cc26d tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.168010 Jul 20 05:24:02.277533 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5466/6591] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:02 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:03.294080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:03.294790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:03.302263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:03.302736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:03.303540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:03.303994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:03.457456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:03.465586 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-adb6397a-ec33-48bc-ae3c-305727737c77 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1756 microversion: 2.1 time: 0.175479 Jul 20 05:24:03.466166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5467/6592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:03 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:04.482742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:04.483390 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:04.490286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:04.490745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:04.491512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:04.491985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:04.514657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:04.639950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:04.648533 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-980fd2a7-f9dd-457e-84e3-f8cf1bfa6fe5 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1759 microversion: 2.1 time: 0.169654 Jul 20 05:24:04.649119 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5468/6593] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:04 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:37.930118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-855615578"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:37.930821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:37.932913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=32 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:37.933608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:24:37.940552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:37.941024 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:37.941819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:37.942275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:38.072820 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.network.security_group_api [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Removing security group 69578a22-f63f-4e21-a538-01d08a8a738c from port 22605015-fa20-48c0-ac48-8b8112f3ceb9 Jul 20 05:24:38.406001 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f183136d-56f3-41dd-bb57-83d570a5e3d3 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/action" status: 202 len: 0 microversion: 2.1 time: 0.480401 Jul 20 05:24:38.414017 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5469/6594] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:24:37 2022] POST /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:24:38.515512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d4979463-2301-4b7f-9107-1431ebe2663e req-807796da-d270-4377-a658-b20a99eb6493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:38.529023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d4979463-2301-4b7f-9107-1431ebe2663e req-807796da-d270-4377-a658-b20a99eb6493 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:38.529801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d4979463-2301-4b7f-9107-1431ebe2663e req-807796da-d270-4377-a658-b20a99eb6493 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:38.545453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d4979463-2301-4b7f-9107-1431ebe2663e req-807796da-d270-4377-a658-b20a99eb6493 service nova] Creating event network-changed:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:24:38.553893 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d4979463-2301-4b7f-9107-1431ebe2663e req-807796da-d270-4377-a658-b20a99eb6493 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137979 Jul 20 05:24:38.555030 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5470/6595] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:39.837779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:39.838410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:39.845202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:39.845883 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:39.847173 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:39.847629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:39.933203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lazy-loading 'services' on Instance uuid c12f9410-52c1-49d6-b2f8-fd7baf2c6633 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:24:40.006261 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-952b65a5-7b04-4e62-85a9-fcb77c11fbc2 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments/de670f86-2b13-441b-9b01-378e09502f51" status: 202 len: 0 microversion: 2.1 time: 0.174350 Jul 20 05:24:40.007112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5471/6596] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:24:39 2022] DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments/de670f86-2b13-441b-9b01-378e09502f51 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:24:40.013222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3d4aaf61-3d30-4afb-b117-9a3deb815c9d req-9cac8ea0-79ba-417b-8dd4-a81b30d2e731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:40.022802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d4aaf61-3d30-4afb-b117-9a3deb815c9d req-9cac8ea0-79ba-417b-8dd4-a81b30d2e731 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:40.023621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3d4aaf61-3d30-4afb-b117-9a3deb815c9d req-9cac8ea0-79ba-417b-8dd4-a81b30d2e731 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:40.036783 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3d4aaf61-3d30-4afb-b117-9a3deb815c9d req-9cac8ea0-79ba-417b-8dd4-a81b30d2e731 service nova] Creating event network-changed:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:24:40.042253 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3d4aaf61-3d30-4afb-b117-9a3deb815c9d req-9cac8ea0-79ba-417b-8dd4-a81b30d2e731 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Jul 20 05:24:40.042880 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5472/6597] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:40.049315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:40.051234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:40.057993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:40.058460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:40.059417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:40.059885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:40.093086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5cb088ac-de85-4414-9f10-8e90a5832504 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048943 Jul 20 05:24:40.093690 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5473/6598] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:24:40 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:24:41.105336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:41.106200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:41.113756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:41.114215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:41.114998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:41.115447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:41.145248 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-759f58fc-f2ea-472d-98b9-6b578de887fc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Jul 20 05:24:41.145820 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5474/6599] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:24:41 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:42.157960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:42.159426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:42.167320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.167793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:42.168619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:42.169067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:42.201474 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-65787868-ebbc-4949-bc83-3f9897f25f18 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047616 Jul 20 05:24:42.202042 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5475/6600] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:24:42 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:43.214133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:43.214970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:43.222189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:43.222643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:43.223433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:43.223877 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:43.254376 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6bd5577-c621-4e02-881b-b94496e8596c tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Jul 20 05:24:43.254951 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5476/6601] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:24:43 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:44.266375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:44.267341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:44.274975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:44.275426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:44.276204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:44.276676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:44.309435 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-edbbaefe-11f2-4adf-ba58-bbb91e64884f tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Jul 20 05:24:44.310036 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5477/6602] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:24:44 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:45.321363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:45.322302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:45.329201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.329672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.330497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.330955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.359040 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f08bb291-f266-4cd9-a969-5e03e31261c1 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041739 Jul 20 05:24:45.359598 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5478/6603] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jul 20 05:24:45 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 05:24:45.369697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:45.370203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:45.375993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.376494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.377299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:45.377751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:45.452190 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] HTTP exception thrown: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 is not attached to volume de670f86-2b13-441b-9b01-378e09502f51 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Request method failure captured: Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: request: DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments/de670f86-2b13-441b-9b01-378e09502f51 HTTP/1.1 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15At8T5VrfKZyIkh4H9Pi55jk7jysgiIgFDj_YlvxvUsdGEkcfl6Powm9w8RmtJ8yvPoi8mjQiQcHqYQjNkDsf8e05A6R8bkmR_KraR3emo0TykAlQAp9qazjUb_PsNr-frIcuGaSGSY-iusnqLPH4yq4vged5n5CpP03UJa2IN3-S8 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f3bfdcbd9864730999e911af1705d34", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 55e4eb0247c64440b4e4083d69970108 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 is not attached to volume de670f86-2b13-441b-9b01-378e09502f51 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'server_id': 'c12f9410-52c1-49d6-b2f8-fd7baf2c6633', 'id': 'de670f86-2b13-441b-9b01-378e09502f51'} Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id de670f86-2b13-441b-9b01-378e09502f51. Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 is not attached to volume de670f86-2b13-441b-9b01-378e09502f51 Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:45.453871 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 is not attached to volume de670f86-2b13-441b-9b01-378e09502f51 Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Returning 404 to user: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 is not attached to volume de670f86-2b13-441b-9b01-378e09502f51 {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7cda162d-39e1-4ca6-9729-16fdb64858bc tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments/de670f86-2b13-441b-9b01-378e09502f51" status: 404 len: 154 microversion: 2.1 time: 0.089366 Jul 20 05:24:45.458330 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5479/6604] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jul 20 05:24:45 2022] DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633/os-volume_attachments/de670f86-2b13-441b-9b01-378e09502f51 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:24:48.695583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:48.696166 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:48.702422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:48.702890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:48.703666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:48.704112 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:48.730102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:24:48.812164 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-299b2a6b-5f8b-4ef4-8f1b-0669127b9126 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 204 len: 0 microversion: 2.1 time: 0.120390 Jul 20 05:24:48.816235 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5480/6605] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:24:48 2022] DELETE /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:24:48.823483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:48.824212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:48.831108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:48.831491 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:48.832284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:48.832808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:48.972396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:48.980590 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8baefbf0-586f-4d58-bc3f-096d39b8d086 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1554 microversion: 2.1 time: 0.161722 Jul 20 05:24:48.981200 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5481/6606] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:48 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:49.997540 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:49.998258 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:50.005244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:50.005716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:50.006502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:50.006956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:50.138058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:50.146134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4f59ca5-6e1c-486f-aa9f-bfe095ae7365 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1554 microversion: 2.1 time: 0.152691 Jul 20 05:24:50.146706 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5482/6607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:49 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:24:51.161740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9fa60f33-f34b-4bda-b6a4-a85c629e8a03 req-4230801a-e845-4c4b-9515-cdceb3b37564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12f9410-52c1-49d6-b2f8-fd7baf2c6633", "name": "network-vif-deleted", "tag": "22605015-fa20-48c0-ac48-8b8112f3ceb9"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:24:51.171631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9fa60f33-f34b-4bda-b6a4-a85c629e8a03 req-4230801a-e845-4c4b-9515-cdceb3b37564 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:51.172174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9fa60f33-f34b-4bda-b6a4-a85c629e8a03 req-4230801a-e845-4c4b-9515-cdceb3b37564 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:51.184631 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9fa60f33-f34b-4bda-b6a4-a85c629e8a03 req-4230801a-e845-4c4b-9515-cdceb3b37564 service nova] Creating event network-vif-deleted:22605015-fa20-48c0-ac48-8b8112f3ceb9 for instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 on n-h2-764486-11 Jul 20 05:24:51.189465 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9fa60f33-f34b-4bda-b6a4-a85c629e8a03 req-4230801a-e845-4c4b-9515-cdceb3b37564 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Jul 20 05:24:51.190896 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5483/6608] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:24:51.195924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:51.196664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:51.202994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:51.203463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:51.204244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:51.204820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:51.272573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e4eb0247c64440b4e4083d69970108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3bfdcbd9864730999e911af1705d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:24:51.280510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da0bcc9e-f972-47d7-9268-99bd0a6da2cd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 200 len: 1344 microversion: 2.1 time: 0.088428 Jul 20 05:24:51.281291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5484/6609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:51 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:24:52.298148 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:52.298837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] [instance: c12f9410-52c1-49d6-b2f8-fd7baf2c6633] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:24:52.306362 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:52.306820 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:52.307593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:24:52.308036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:24:52.321755 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] HTTP exception thrown: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 could not be found. Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Request method failure captured: Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 HTTP/1.1 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15At8T5VrfKZyIkh4H9Pi55jk7jysgiIgFDj_YlvxvUsdGEkcfl6Powm9w8RmtJ8yvPoi8mjQiQcHqYQjNkDsf8e05A6R8bkmR_KraR3emo0TykAlQAp9qazjUb_PsNr-frIcuGaSGSY-iusnqLPH4yq4vged5n5CpP03UJa2IN3-S8 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f3bfdcbd9864730999e911af1705d34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f3bfdcbd9864730999e911af1705d34", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 7f3bfdcbd9864730999e911af1705d34 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-385274827 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 55e4eb0247c64440b4e4083d69970108 Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestMinimumBasicScenario-385274827-project Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 could not be found. Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'c12f9410-52c1-49d6-b2f8-fd7baf2c6633'} Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 could not be found. Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 could not be found. Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:24:52.323383 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 could not be found. Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Returning 404 to user: Instance c12f9410-52c1-49d6-b2f8-fd7baf2c6633 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da4b1cdf-b310-4494-ae39-ee056964f385 tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633" status: 404 len: 111 microversion: 2.1 time: 0.030593 Jul 20 05:24:52.327600 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5485/6610] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:24:52 2022] GET /compute/v2.1/servers/c12f9410-52c1-49d6-b2f8-fd7baf2c6633 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:24:52.333105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4bef9b3d-6778-434a-bc1c-fd32c61576dd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] Calling method '.version_select at 0x7f838867c940>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:24:52.351513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4bef9b3d-6778-434a-bc1c-fd32c61576dd tempest-TestMinimumBasicScenario-385274827 tempest-TestMinimumBasicScenario-385274827-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1081090526" status: 202 len: 0 microversion: 2.1 time: 0.021911 Jul 20 05:24:52.352203 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5486/6611] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jul 20 05:24:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1081090526 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:25:01.514000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf71e28b-6326-4402-ae96-d942d39c92e8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: .version_select at 0x7f8389f3f3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1277749659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkQWUWG77M7Sb3eqADEWvpzTyQX0Kw/WZCZvEAV7jYzt9VIb81+Fvlfk9uwUZAQiLG2Kl05D33wqIlVxOUEYQCZICT4oL8ViVzSPPP+ywZlyjdHUKZlH6b32llKzaSKRw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:01.528629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cf71e28b-6326-4402-ae96-d942d39c92e8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:01.534729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-cf71e28b-6326-4402-ae96-d942d39c92e8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:01.559239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf71e28b-6326-4402-ae96-d942d39c92e8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.235639 Jul 20 05:25:01.559846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5487/6612] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:25:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:25:07.681725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:07.687052 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2062215340", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "09bd54d9-dabc-4646-a9d1-510c6ea5df1c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1277749659", "security_groups": [{"name": "tempest-secgroup-smoke-520398176"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:07.826183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] validate_networks() for [('09bd54d9-dabc-4646-a9d1-510c6ea5df1c', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:25:08.023691 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:08.270230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:25:08.270672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:25:08.271164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:25:08.271589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:25:08.272018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:25:08.281565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:08.282029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:08.282836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:08.283281 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:08.301560 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:25:08.306851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:25:08.320187 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:25:08.322938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:25:08.371810 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3b8ed18b-3686-494f-b62d-74322db7a522 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691049 Jul 20 05:25:08.377393 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5488/6613] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:25:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:25:08.382504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a028acba-7c93-4749-a8fb-e9486c3b4816 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:08.383249 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a028acba-7c93-4749-a8fb-e9486c3b4816 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:08.442262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a028acba-7c93-4749-a8fb-e9486c3b4816 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:08.450459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a028acba-7c93-4749-a8fb-e9486c3b4816 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1267 microversion: 2.1 time: 0.071802 Jul 20 05:25:08.451114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5489/6614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:08 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:09.470612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e4db6220-b03b-4ca1-9ecd-fc25235a08d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:09.472309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e4db6220-b03b-4ca1-9ecd-fc25235a08d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:09.533628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e4db6220-b03b-4ca1-9ecd-fc25235a08d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:09.554062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e4db6220-b03b-4ca1-9ecd-fc25235a08d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1267 microversion: 2.1 time: 0.087109 Jul 20 05:25:09.556659 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5490/6615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:09 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:10.572817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3debff6-c355-4a3b-8faa-41e0a1d3ff54 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:10.573446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3debff6-c355-4a3b-8faa-41e0a1d3ff54 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:10.634465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3debff6-c355-4a3b-8faa-41e0a1d3ff54 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:10.641396 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3debff6-c355-4a3b-8faa-41e0a1d3ff54 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1267 microversion: 2.1 time: 0.072468 Jul 20 05:25:10.641967 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5491/6616] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:10 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:11.658546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:11.659321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:11.667017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.667483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.668312 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:11.668786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:11.731580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:11.739557 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ab55daf5-92da-4e84-8b94-bd1a45ede872 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1271 microversion: 2.1 time: 0.085058 Jul 20 05:25:11.740147 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5492/6617] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:11 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:12.756907 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:12.757514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:12.764708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.765174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.766222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:12.766463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:12.841004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:12.858257 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8bb36015-3a4e-41cd-b966-c4d9eff5580d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1325 microversion: 2.1 time: 0.105666 Jul 20 05:25:12.870388 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5493/6618] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:12 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1325 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:13.877433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:13.879445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:13.886721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:13.887273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:13.888063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:13.888583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:14.110831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:14.120824 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e09c9ab8-97a3-406b-a950-402b53f1117e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1392 microversion: 2.1 time: 0.247292 Jul 20 05:25:14.121552 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5494/6619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:13 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:14.347809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e561f6e8-a2b6-4ec2-8153-f5deacbf6b0a req-5c96c4dc-c6a2-4594-a762-83470d999ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baad5a29-c1a8-43cf-8d30-e975cc9c00b6", "tag": "21048141-7225-4e88-bb7a-cac9f91992e8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:14.359363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e561f6e8-a2b6-4ec2-8153-f5deacbf6b0a req-5c96c4dc-c6a2-4594-a762-83470d999ad9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:14.360406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e561f6e8-a2b6-4ec2-8153-f5deacbf6b0a req-5c96c4dc-c6a2-4594-a762-83470d999ad9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:14.376950 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e561f6e8-a2b6-4ec2-8153-f5deacbf6b0a req-5c96c4dc-c6a2-4594-a762-83470d999ad9 service nova] Creating event network-changed:21048141-7225-4e88-bb7a-cac9f91992e8 for instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 on n-h1-764486-11 Jul 20 05:25:14.382649 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e561f6e8-a2b6-4ec2-8153-f5deacbf6b0a req-5c96c4dc-c6a2-4594-a762-83470d999ad9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043343 Jul 20 05:25:14.383278 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5495/6620] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:15.142643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:15.143959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:15.150406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:15.150850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:15.151625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:15.152073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:15.290822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:15.298378 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3b6b149-6cdc-4fdf-9f69-bd276741c566 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1392 microversion: 2.1 time: 0.161079 Jul 20 05:25:15.298956 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5496/6621] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:15 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:16.315196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:16.316192 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:16.322525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:16.323006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:16.323897 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:16.324380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:16.459388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:16.467037 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-655663d6-f7f3-4cc5-95e5-f1f0b1fcc3d0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1392 microversion: 2.1 time: 0.155828 Jul 20 05:25:16.467622 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5497/6622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:16 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:17.484231 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:17.484974 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:17.492690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.493158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.493941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.494391 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.632944 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:17.640584 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78f4f85d-3e81-411a-92cf-9accc2c8671f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1392 microversion: 2.1 time: 0.160221 Jul 20 05:25:17.641169 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5498/6623] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:17 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:17.896718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-a929dcd4-d816-46af-913e-0276c3b5a139 req-eeff787a-2f11-4ea6-8543-7c0b249d1cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baad5a29-c1a8-43cf-8d30-e975cc9c00b6", "name": "network-vif-plugged", "status": "completed", "tag": "21048141-7225-4e88-bb7a-cac9f91992e8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:17.905272 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a929dcd4-d816-46af-913e-0276c3b5a139 req-eeff787a-2f11-4ea6-8543-7c0b249d1cc3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:17.905735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-a929dcd4-d816-46af-913e-0276c3b5a139 req-eeff787a-2f11-4ea6-8543-7c0b249d1cc3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:17.918560 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-a929dcd4-d816-46af-913e-0276c3b5a139 req-eeff787a-2f11-4ea6-8543-7c0b249d1cc3 service nova] Creating event network-vif-plugged:21048141-7225-4e88-bb7a-cac9f91992e8 for instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 on n-h1-764486-11 Jul 20 05:25:17.924026 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-a929dcd4-d816-46af-913e-0276c3b5a139 req-eeff787a-2f11-4ea6-8543-7c0b249d1cc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090677 Jul 20 05:25:17.924708 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5499/6624] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:25:18.658613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:18.659321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:18.661337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:18.667803 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:18.668275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:18.669083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:18.669530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:18.807524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:18.814915 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb362231-b3ad-4725-91a4-deb46c192fb1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1392 microversion: 2.1 time: 0.160661 Jul 20 05:25:18.815528 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5500/6625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:18 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:25:19.834085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:19.834901 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:19.841977 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:19.842448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:19.843240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:19.843694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:19.978541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:19.986024 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79ad962b-a349-4db2-a096-8bb94fdaaf0f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1563 microversion: 2.1 time: 0.156952 Jul 20 05:25:19.986648 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5501/6626] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:19 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:20.003239 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:20.003854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:20.009706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:20.010161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:20.010933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:20.011374 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:20.146355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:20.153913 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-31195244-c844-46da-bd88-f7c59522d148 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1563 microversion: 2.1 time: 0.155007 Jul 20 05:25:20.154492 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5502/6627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:19 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:21.735951 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:21.737998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:21.741251 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=16 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:21.747442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:21.747917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:21.749211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:21.749211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:21.883033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:21.890232 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5b5d96e9-ce7a-4bb3-a86e-d51f23c336d8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1563 microversion: 2.1 time: 0.158882 Jul 20 05:25:21.890819 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5503/6628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:21 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:21.895287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7f88e5f8-94c8-41b0-81f5-28a4c39e9669 req-53b889fe-495d-4d00-86b4-18bfab20dfdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baad5a29-c1a8-43cf-8d30-e975cc9c00b6", "tag": "21048141-7225-4e88-bb7a-cac9f91992e8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:21.903383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7f88e5f8-94c8-41b0-81f5-28a4c39e9669 req-53b889fe-495d-4d00-86b4-18bfab20dfdb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:21.903844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7f88e5f8-94c8-41b0-81f5-28a4c39e9669 req-53b889fe-495d-4d00-86b4-18bfab20dfdb service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:21.915811 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7f88e5f8-94c8-41b0-81f5-28a4c39e9669 req-53b889fe-495d-4d00-86b4-18bfab20dfdb service nova] Creating event network-changed:21048141-7225-4e88-bb7a-cac9f91992e8 for instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 on n-h1-764486-11 Jul 20 05:25:21.921028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7f88e5f8-94c8-41b0-81f5-28a4c39e9669 req-53b889fe-495d-4d00-86b4-18bfab20dfdb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029049 Jul 20 05:25:21.922074 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5504/6629] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:43.133625 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:43.134308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=68 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:43.138537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:43.139558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:43.147329 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:43.147791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:43.148894 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:43.149127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:43.197638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d985171b-2051-41e1-8e8f-0f308ccd0f1c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action" status: 200 len: 24572 microversion: 2.1 time: 0.066855 Jul 20 05:25:43.198301 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5505/6630] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:43 2022] POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:25:54.189713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:54.190359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:54.193006 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:54.193687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:25:54.200452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:54.200865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:54.201649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:54.202102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:54.278751 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2019a1cc-a97d-4980-9824-25562184a7a8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action" status: 202 len: 0 microversion: 2.1 time: 0.093391 Jul 20 05:25:54.279405 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5506/6631] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:54 2022] POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:25:54.292656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:54.292656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:54.295906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:54.296662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:54.297444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:54.297925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:54.437235 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:54.446746 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-91d9c38b-bdb9-4e78-a170-d19acf773cd7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1686 microversion: 2.1 time: 0.162478 Jul 20 05:25:54.447263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5507/6632] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:54 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:55.465613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:55.466269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:55.473315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:55.473773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:55.474552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:55.475000 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:55.609389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:55.616861 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba688a50-31a6-4de2-a5ab-480a258db2b3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1666 microversion: 2.1 time: 0.155098 Jul 20 05:25:55.617438 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5508/6633] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:55 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:56.704291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:56.705259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:56.712478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.712948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:56.713732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.714182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:56.766184 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3d964e42-40f5-4456-b90b-c427ee44298e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action" status: 200 len: 32633 microversion: 2.1 time: 0.065639 Jul 20 05:25:56.766866 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5509/6634] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:56 2022] POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action => generated 32633 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:25:56.778423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:56.779046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:56.786759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.787217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:56.787985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.788486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:56.854686 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-237bfb8a-ea15-4737-b3ad-10e8bd8acdaf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action" status: 202 len: 0 microversion: 2.1 time: 0.080086 Jul 20 05:25:56.858008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5510/6635] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:56 2022] POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:25:56.865401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:56.866163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:56.872644 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.873110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:56.873895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:56.874342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:57.011237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:57.019188 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e3566eaa-e4e4-451d-8dda-c22157e859a5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1673 microversion: 2.1 time: 0.159195 Jul 20 05:25:57.019778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5511/6636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:56 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:58.037065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:58.037731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:58.044636 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:58.045099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:58.045873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:58.046327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:58.176580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:58.184698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b7cd0b92-3766-4d4d-aa51-854a25570384 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1681 microversion: 2.1 time: 0.151676 Jul 20 05:25:58.185275 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5512/6637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:58 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:25:58.278341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:58.279275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:58.285321 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:58.285783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:58.286610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:58.287056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:58.335867 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2e36c181-7dd1-4f1d-a20b-e11953166890 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action" status: 200 len: 38361 microversion: 2.1 time: 0.061189 Jul 20 05:25:58.336715 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5513/6638] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:25:58 2022] POST /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6/action => generated 38361 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:25:59.598496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:59.599158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:59.606733 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.607199 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.608198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.608678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.635687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:25:59.716511 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a661e8a4-c2d8-4239-b295-41cc18255506 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 204 len: 0 microversion: 2.1 time: 0.121929 Jul 20 05:25:59.720623 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5514/6639] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:25:59 2022] DELETE /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:25:59.724695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0de83843-b0ca-4a4e-8b75-87c37dff8681 req-cc0b5590-0c30-4fff-955c-9e0fc56fdda9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baad5a29-c1a8-43cf-8d30-e975cc9c00b6", "tag": "21048141-7225-4e88-bb7a-cac9f91992e8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:25:59.733139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0de83843-b0ca-4a4e-8b75-87c37dff8681 req-cc0b5590-0c30-4fff-955c-9e0fc56fdda9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.733597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0de83843-b0ca-4a4e-8b75-87c37dff8681 req-cc0b5590-0c30-4fff-955c-9e0fc56fdda9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.750384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0de83843-b0ca-4a4e-8b75-87c37dff8681 req-cc0b5590-0c30-4fff-955c-9e0fc56fdda9 service nova] Creating event network-changed:21048141-7225-4e88-bb7a-cac9f91992e8 for instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 on n-h1-764486-11 Jul 20 05:25:59.756286 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0de83843-b0ca-4a4e-8b75-87c37dff8681 req-cc0b5590-0c30-4fff-955c-9e0fc56fdda9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037102 Jul 20 05:25:59.757008 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5515/6640] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:25:59.762483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:25:59.763182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:25:59.769764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.770225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.771078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:25:59.771529 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:25:59.914931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:25:59.922992 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03e8959f-0a7f-41d6-b2ca-8645a158dff6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1687 microversion: 2.1 time: 0.164706 Jul 20 05:25:59.923591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5516/6641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:25:59 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:00.942049 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:00.943180 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:00.950146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:00.950613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:00.951392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:00.951842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:01.108440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:01.116425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-714c12c5-9719-4157-8487-5391600f811d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 200 len: 1687 microversion: 2.1 time: 0.178416 Jul 20 05:26:01.117006 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5517/6642] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:00 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:01.719987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-0eee1bc8-d8fa-44cc-9bc7-cb9e99babb5f req-a373aadc-d2be-4c5c-a361-c1f7b8106b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baad5a29-c1a8-43cf-8d30-e975cc9c00b6", "name": "network-vif-deleted", "tag": "21048141-7225-4e88-bb7a-cac9f91992e8"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:01.728607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0eee1bc8-d8fa-44cc-9bc7-cb9e99babb5f req-a373aadc-d2be-4c5c-a361-c1f7b8106b11 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:01.729076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-0eee1bc8-d8fa-44cc-9bc7-cb9e99babb5f req-a373aadc-d2be-4c5c-a361-c1f7b8106b11 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:01.740706 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-0eee1bc8-d8fa-44cc-9bc7-cb9e99babb5f req-a373aadc-d2be-4c5c-a361-c1f7b8106b11 service nova] Creating event network-vif-deleted:21048141-7225-4e88-bb7a-cac9f91992e8 for instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 on n-h1-764486-11 Jul 20 05:26:01.746066 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-0eee1bc8-d8fa-44cc-9bc7-cb9e99babb5f req-a373aadc-d2be-4c5c-a361-c1f7b8106b11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029747 Jul 20 05:26:01.746719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5518/6643] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:26:02.135538 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:02.136254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: baad5a29-c1a8-43cf-8d30-e975cc9c00b6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:02.143874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:02.144340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:02.145169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:02.145915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:02.160876 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] HTTP exception thrown: Instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 could not be found. Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Request method failure captured: Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 HTTP/1.1 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15GsgKaY51_76qMPtZRUSBLJ5JFVecnjhius4mtJ8QItAqqZSIQiIUFYiq89kRwxWorNfsf2ajJrJTKVUiZIBfrcpwkPx6wC9THGfqX23Xu6P4EBQDBYdTdWvxkHr55aq9uYP3ZnUwp-HdZ8XHYoywMv7rC9XXRdbA8WgYeytWE_-FQ Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aff796eba9244e8080b8afd901ac1d07", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d54f913d94584c04824dc01dbf2a1b12 Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 could not be found. Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'baad5a29-c1a8-43cf-8d30-e975cc9c00b6'} Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 could not be found. Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 could not be found. Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:26:02.164476 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 could not be found. Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Returning 404 to user: Instance baad5a29-c1a8-43cf-8d30-e975cc9c00b6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a96161d4-daa4-45f7-a0d5-48b55c0be69b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6" status: 404 len: 111 microversion: 2.1 time: 0.035707 Jul 20 05:26:02.168798 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5519/6644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:02 2022] GET /compute/v2.1/servers/baad5a29-c1a8-43cf-8d30-e975cc9c00b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:26:05.435311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-83fbc871-29c4-48d4-9416-099c186cd2c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '.version_select at 0x7f8389f42af0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:05.459615 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-83fbc871-29c4-48d4-9416-099c186cd2c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1277749659" status: 202 len: 0 microversion: 2.1 time: 0.028548 Jul 20 05:26:05.460198 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5520/6645] 10.222.0.49 () {58 vars in 1283 bytes} [Wed Jul 20 05:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1277749659 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:26:05.489611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ebdbc851-28b1-40e1-8624-fd1c2990304d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: .version_select at 0x7f838a0f1940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-623931816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQRSVGd+t+BIYvLn4/Fadog2aGuxbJaws1n5vLfmIJNMX0/e3/auPhtb8qTClJw7UNHatPCm8w667Y2QjLBUhjsc31scWMe1byLEe5iIIXtPThY72h1sVtCwvT7T7JeTQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:05.507091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebdbc851-28b1-40e1-8624-fd1c2990304d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:26:05.511764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-ebdbc851-28b1-40e1-8624-fd1c2990304d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:26:05.535149 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ebdbc851-28b1-40e1-8624-fd1c2990304d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050308 Jul 20 05:26:05.535753 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5521/6646] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:26:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:11.096064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-780595598", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "2b96b2af-976c-4902-8f39-e34eb7e5221f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-623931816", "security_groups": [{"name": "tempest-secgroup-smoke-576548725"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:11.223500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] validate_networks() for [('2b96b2af-976c-4902-8f39-e34eb7e5221f', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:26:11.684686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:26:11.685432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:26:11.686095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:26:11.697521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:26:11.698226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:26:11.709057 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:11.709804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:11.712270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:11.715748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:11.763982 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:26:11.771744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:26:11.791606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:26:11.794514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:26:11.872914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e00b0cf7-25e2-45e4-bcc5-e8b8ac887465 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777227 Jul 20 05:26:11.874114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5522/6647] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:26:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:26:11.889852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c86ccce8-c860-4124-aaf2-bbbff924e6ff tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:11.892013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c86ccce8-c860-4124-aaf2-bbbff924e6ff tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:12.040918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c86ccce8-c860-4124-aaf2-bbbff924e6ff tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:12.048760 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c86ccce8-c860-4124-aaf2-bbbff924e6ff tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1265 microversion: 2.1 time: 0.167549 Jul 20 05:26:12.052970 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5523/6648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:11 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:13.071563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:13.072583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:13.082227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:13.083325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:13.084371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:13.085048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:13.247443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:13.258039 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0913fdd4-7bfa-44ec-9872-61e650e32b6b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1317 microversion: 2.1 time: 0.192163 Jul 20 05:26:13.263642 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5524/6649] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:13 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:14.279410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:14.280759 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:14.288384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:14.289103 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:14.290158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:14.290767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:14.301847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:14.468189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:14.477702 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-473254ab-33c4-4a14-9ce6-0244854ffca5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.202222 Jul 20 05:26:14.488339 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5525/6650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:14 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:15.030960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-629b1693-8ec9-4ad9-8418-461d9ec51dae req-a3d507bd-932a-40ee-941b-e3f8a1b43afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbd3685-e8e0-48bd-977f-00cc2893a9f5", "tag": "efa8821b-f2bc-44c9-891f-59442035c759"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:15.041824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-629b1693-8ec9-4ad9-8418-461d9ec51dae req-a3d507bd-932a-40ee-941b-e3f8a1b43afe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:15.042549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-629b1693-8ec9-4ad9-8418-461d9ec51dae req-a3d507bd-932a-40ee-941b-e3f8a1b43afe service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:15.060848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-629b1693-8ec9-4ad9-8418-461d9ec51dae req-a3d507bd-932a-40ee-941b-e3f8a1b43afe service nova] Creating event network-changed:efa8821b-f2bc-44c9-891f-59442035c759 for instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 on n-h1-764486-11 Jul 20 05:26:15.066666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-629b1693-8ec9-4ad9-8418-461d9ec51dae req-a3d507bd-932a-40ee-941b-e3f8a1b43afe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039557 Jul 20 05:26:15.067591 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5526/6651] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:15.498283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:15.499017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:15.509161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:15.509632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:15.510431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:15.510887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:15.646833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:15.654438 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cdd66f4-bc52-4841-9398-861c15e8d55f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.162759 Jul 20 05:26:15.654994 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5527/6652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:15 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:16.672247 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:16.672963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:16.680474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:16.680955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:16.681723 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:16.682170 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:16.823531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:16.831047 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8b005f5-4be2-48d2-83c7-28e0af9767b5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.162826 Jul 20 05:26:16.832048 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5528/6653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:16 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:17.849115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:17.849761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:17.857139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:17.857615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:17.858700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:17.859152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:17.994343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:18.002035 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-88be0b96-02c4-4bae-96bf-d62e89b8c140 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.156832 Jul 20 05:26:18.002541 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5529/6654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:17 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:19.019053 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:19.019669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:19.027601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:19.028071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:19.028891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:19.029355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:19.159605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:19.167466 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-290f05c4-1f82-463b-a3a5-fbe5116488d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.152426 Jul 20 05:26:19.168058 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5530/6655] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:19 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:20.185273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:20.185923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:20.193348 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:20.193804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:20.194578 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:20.195032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:20.336039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:20.343803 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d74d4c44-7601-468d-9062-2027367ef72f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.162348 Jul 20 05:26:20.344469 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5531/6656] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:20 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:21.360926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:21.361566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:21.369093 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:21.369565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:21.370356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:21.370812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:21.732630 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:21.797463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:21.805738 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-78f0a8eb-caf7-4029-8ccd-2ee295dd9e26 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.448802 Jul 20 05:26:21.806310 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5532/6657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:21 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:22.040569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-82708a9f-02da-4ef4-b819-2c51cd695112 req-8fc70329-d158-4c63-96dc-3861f5f08189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbd3685-e8e0-48bd-977f-00cc2893a9f5", "name": "network-vif-plugged", "status": "completed", "tag": "efa8821b-f2bc-44c9-891f-59442035c759"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:22.047661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:22.050110 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-82708a9f-02da-4ef4-b819-2c51cd695112 req-8fc70329-d158-4c63-96dc-3861f5f08189 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:22.050690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-82708a9f-02da-4ef4-b819-2c51cd695112 req-8fc70329-d158-4c63-96dc-3861f5f08189 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:22.064453 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-82708a9f-02da-4ef4-b819-2c51cd695112 req-8fc70329-d158-4c63-96dc-3861f5f08189 service nova] Creating event network-vif-plugged:efa8821b-f2bc-44c9-891f-59442035c759 for instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 on n-h1-764486-11 Jul 20 05:26:22.069577 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-82708a9f-02da-4ef4-b819-2c51cd695112 req-8fc70329-d158-4c63-96dc-3861f5f08189 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 Jul 20 05:26:22.070638 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5533/6658] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:26:22.823829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:22.824564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:22.831695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:22.832147 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:22.832961 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:22.833482 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:22.969245 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:22.976766 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7f72cbee-0c41-493d-8527-4b05be8730db tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1390 microversion: 2.1 time: 0.157136 Jul 20 05:26:22.977334 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5534/6659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:22 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:23.993876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:23.994524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:24.002434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:24.002922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:24.003778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:24.004801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:24.147969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:24.156692 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-baea9cbc-14de-4230-ad49-8a8960d1c23f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1562 microversion: 2.1 time: 0.166808 Jul 20 05:26:24.157304 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5535/6660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:23 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:24.173399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:24.174013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:24.180364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:24.180836 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:24.181604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:24.182050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:24.320809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:24.328529 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e74de265-728f-4de4-9998-f01abb495bae tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1562 microversion: 2.1 time: 0.159027 Jul 20 05:26:24.329124 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5536/6661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:24 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:26:25.944931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:25.945727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:25.949330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:25.955202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:25.955915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:25.956783 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:25.957276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:26.098675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:26.106394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-484d008f-c70f-4ae9-8ecf-e716d0c54ff9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1562 microversion: 2.1 time: 0.166503 Jul 20 05:26:26.107236 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5537/6662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:25 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:26.111758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-46957173-b3cc-40bc-a8fa-632dcfcca944 req-2e7539e2-59a8-4fa7-80b0-cafe3d21401b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbd3685-e8e0-48bd-977f-00cc2893a9f5", "tag": "efa8821b-f2bc-44c9-891f-59442035c759"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:26.120592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-46957173-b3cc-40bc-a8fa-632dcfcca944 req-2e7539e2-59a8-4fa7-80b0-cafe3d21401b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:26.121058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-46957173-b3cc-40bc-a8fa-632dcfcca944 req-2e7539e2-59a8-4fa7-80b0-cafe3d21401b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:26.133296 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-46957173-b3cc-40bc-a8fa-632dcfcca944 req-2e7539e2-59a8-4fa7-80b0-cafe3d21401b service nova] Creating event network-changed:efa8821b-f2bc-44c9-891f-59442035c759 for instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 on n-h1-764486-11 Jul 20 05:26:26.138379 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-46957173-b3cc-40bc-a8fa-632dcfcca944 req-2e7539e2-59a8-4fa7-80b0-cafe3d21401b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029900 Jul 20 05:26:26.139117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5538/6663] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:26:47.358981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:47.359744 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=70 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:47.364807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:47.365826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:47.372900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:47.373368 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:47.374146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:47.374600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:47.428515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a84f53ff-3deb-4e9a-97a0-a76ac8b7100f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5/action" status: 200 len: 24572 microversion: 2.1 time: 0.071417 Jul 20 05:26:47.429166 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5539/6664] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:26:47 2022] POST /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:26:58.552012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:26:58.553118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:58.556067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:58.556754 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:26:58.566218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:58.566678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:58.567455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:58.567903 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:58.639565 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8391f89e-fb29-479d-ad07-c389ae1f4955 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.092679 Jul 20 05:26:58.643331 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5540/6665] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:26:58 2022] POST /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:26:58.648779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:58.649480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:58.655747 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:58.656261 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:58.657019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:58.657525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:58.801072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:58.811413 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55b3ef5e-9ae2-4a46-8657-b63e2f0fbaa7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1672 microversion: 2.1 time: 0.166481 Jul 20 05:26:58.811928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5541/6666] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:58 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:26:59.830633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:26:59.831286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:26:59.837307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:59.838051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:59.838822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:26:59.839271 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:26:59.968885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:26:59.976834 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0e7b07e-6b7f-4b26-b8b0-32a7de8a07fa tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.151026 Jul 20 05:26:59.977410 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5542/6667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:26:59 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:00.995376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:00.996041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:01.003353 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:01.003757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:01.005074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:01.005512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:01.135973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:01.143421 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7362b2e9-ed6a-42bb-a807-baa461edd5e6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.152076 Jul 20 05:27:01.143997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5543/6668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:00 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:02.161534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:02.162195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:02.169153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:02.169623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:02.170407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:02.170861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:02.303483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:02.310853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-887f0cbd-fdf7-4d37-aaef-ed143872476e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.154101 Jul 20 05:27:02.311414 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5544/6669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:02 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:03.328461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:03.329088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:03.335971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:03.336468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:03.337248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:03.337693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:03.470957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:03.478424 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73428fc2-18f7-48f2-a6ac-028613156655 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.153867 Jul 20 05:27:03.478995 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5545/6670] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:03 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:04.495900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:04.496786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:04.503632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:04.504664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:04.505465 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:04.505915 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:04.652490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:04.660322 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cdfdbfb4-7ce4-4cc6-b43b-eca7a617ef90 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.168512 Jul 20 05:27:04.661025 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5546/6671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:04 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:05.679056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:05.679745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:05.686799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:05.687266 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:05.688042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:05.688525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:05.820088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:05.827605 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ac5edd0-a0af-46d5-b20b-acefa32b9bdf tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.153196 Jul 20 05:27:05.828182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5547/6672] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:05 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:06.845033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:06.845698 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:06.852740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:06.853204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:06.853993 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:06.854440 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:06.994077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:07.001806 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f08ea5eb-5a68-4a92-8de8-a93060d0c845 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.160614 Jul 20 05:27:07.002331 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5548/6673] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:06 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:08.019651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:08.020278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:08.027132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:08.027590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:08.028379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:08.028833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:08.162237 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:08.170543 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a728c39-5857-4ee7-a2d6-5448af0e0e4d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.155079 Jul 20 05:27:08.171125 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5549/6674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:08 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:09.189136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:09.189771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:09.197597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:09.198059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:09.198841 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:09.199291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:09.333552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:09.341507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9738d6fe-fec6-4b83-bc27-280f0d561087 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.156395 Jul 20 05:27:09.342086 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5550/6675] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:09 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:10.359122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:10.359859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:10.366739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:10.367204 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:10.367983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:10.368463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:10.507735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:10.515404 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c15fc5d6-b273-41d8-b8d5-2b3a6ba89305 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.160237 Jul 20 05:27:10.516031 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5551/6676] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:10 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:11.532731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:11.533502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:11.541046 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:11.541514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:11.542280 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:11.542721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:11.673361 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:11.681268 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9e4212d1-1bab-44e8-8b64-b18c51b07124 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.152486 Jul 20 05:27:11.681849 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5552/6677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:11 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:12.699326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:12.699941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:12.707030 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:12.707984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:12.708808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:12.709259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:12.852387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:12.860671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-63c7bb39-a32e-4c81-8f8e-512958cd727f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.165848 Jul 20 05:27:12.861289 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5553/6678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:12 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:13.878844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:13.879509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:13.886528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:13.886988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:13.887757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:13.888203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:14.015444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:14.023442 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55d15c4e-010f-42d3-b69e-77a63f53d172 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.148519 Jul 20 05:27:14.024018 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5554/6679] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:13 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:15.040447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:15.041088 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:15.048340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:15.049084 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:15.049866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:15.050349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:15.068299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:15.188194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:15.197106 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ddd97236-8c8e-425d-ab88-72c0de06fc55 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1677 microversion: 2.1 time: 0.159479 Jul 20 05:27:15.205555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5555/6680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:15 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:16.213480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:16.214096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:16.220662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:16.221125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:16.222022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:16.222580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:16.356087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:16.364271 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2601728-9872-4e9f-8f99-d634a734606d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1680 microversion: 2.1 time: 0.154403 Jul 20 05:27:16.365179 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5556/6681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:16 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:40.543430 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:40.544293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:40.547262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=34 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:40.547943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:27:40.554623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:40.555091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:40.555872 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:40.556319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:40.610062 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bfbdb8d0-60a2-4879-9ca5-96ac441f2886 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5/action" status: 200 len: 69024 microversion: 2.1 time: 0.070492 Jul 20 05:27:40.610715 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5557/6682] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:27:40 2022] POST /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5/action => generated 69024 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:27:47.794745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:47.795583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:47.803827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.804288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:47.805144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.805615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:47.838150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:27:47.923877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7c99e821-89e5-42d4-913d-3a827ad313d7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 204 len: 0 microversion: 2.1 time: 0.132957 Jul 20 05:27:47.928396 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5558/6683] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:27:47 2022] DELETE /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 05:27:47.930463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-21679b22-01c1-4841-bd39-2eeb23cff1c0 req-865b6e52-07ac-4be9-a8e2-f6783c5536a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbd3685-e8e0-48bd-977f-00cc2893a9f5", "tag": "efa8821b-f2bc-44c9-891f-59442035c759"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:47.939117 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-21679b22-01c1-4841-bd39-2eeb23cff1c0 req-865b6e52-07ac-4be9-a8e2-f6783c5536a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.939757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-21679b22-01c1-4841-bd39-2eeb23cff1c0 req-865b6e52-07ac-4be9-a8e2-f6783c5536a0 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:47.952220 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-21679b22-01c1-4841-bd39-2eeb23cff1c0 req-865b6e52-07ac-4be9-a8e2-f6783c5536a0 service nova] Creating event network-changed:efa8821b-f2bc-44c9-891f-59442035c759 for instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 on n-h1-764486-11 Jul 20 05:27:47.957227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-21679b22-01c1-4841-bd39-2eeb23cff1c0 req-865b6e52-07ac-4be9-a8e2-f6783c5536a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030950 Jul 20 05:27:47.957833 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5559/6684] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:47.963425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:47.964181 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:47.970268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.970737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:47.971543 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:47.971967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:48.168660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:48.176674 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d52e764-fd80-47ca-8753-1d849d10b59a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1686 microversion: 2.1 time: 0.217669 Jul 20 05:27:48.177259 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5560/6685] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:47 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:27:49.194660 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:49.195279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:49.202137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:49.202602 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:49.203376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:49.203827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:49.339263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:49.346908 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9ec1e85e-c436-4850-b904-a79849462e67 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1686 microversion: 2.1 time: 0.156237 Jul 20 05:27:49.347715 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5561/6686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:49 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:50.089286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-6a39446e-5899-493e-a71d-69bfea1e08f0 req-53d6b635-577a-4cdb-836f-d3d74e8c9a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbd3685-e8e0-48bd-977f-00cc2893a9f5", "name": "network-vif-deleted", "tag": "efa8821b-f2bc-44c9-891f-59442035c759"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:50.100291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6a39446e-5899-493e-a71d-69bfea1e08f0 req-53d6b635-577a-4cdb-836f-d3d74e8c9a81 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.100855 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-6a39446e-5899-493e-a71d-69bfea1e08f0 req-53d6b635-577a-4cdb-836f-d3d74e8c9a81 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.112460 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-6a39446e-5899-493e-a71d-69bfea1e08f0 req-53d6b635-577a-4cdb-836f-d3d74e8c9a81 service nova] Creating event network-vif-deleted:efa8821b-f2bc-44c9-891f-59442035c759 for instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 on n-h1-764486-11 Jul 20 05:27:50.117223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-6a39446e-5899-493e-a71d-69bfea1e08f0 req-53d6b635-577a-4cdb-836f-d3d74e8c9a81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Jul 20 05:27:50.118084 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5562/6687] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:27:50.367241 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:50.368051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:50.374671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.375141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.375960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.376462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.410382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:50.410871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:50.411343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lazy-loading 'fault' on Instance uuid dcbd3685-e8e0-48bd-977f-00cc2893a9f5 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:27:50.736198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:27:50.743165 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-506e568f-39cf-4d2d-ad6e-737302e20981 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 200 len: 1355 microversion: 2.1 time: 0.381252 Jul 20 05:27:50.743735 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5563/6688] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:50 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 1355 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:27:51.760972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:51.761605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: dcbd3685-e8e0-48bd-977f-00cc2893a9f5] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:27:51.768477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:51.768945 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:51.769708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:27:51.770153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:27:51.783074 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] HTTP exception thrown: Instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 could not be found. Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Request method failure captured: Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 HTTP/1.1 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15GsgKaY51_76qMPtZRUSBLJ5JFVecnjhius4mtJ8QItAqqZSIQiIUFYiq89kRwxWorNfsf2ajJrJTKVUiZIBfrcpwkPx6wC9THGfqX23Xu6P4EBQDBYdTdWvxkHr55aq9uYP3ZnUwp-HdZ8XHYoywMv7rC9XXRdbA8WgYeytWE_-FQ Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aff796eba9244e8080b8afd901ac1d07", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d54f913d94584c04824dc01dbf2a1b12 Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 could not be found. Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'dcbd3685-e8e0-48bd-977f-00cc2893a9f5'} Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 could not be found. Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 could not be found. Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:27:51.784721 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 could not be found. Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Returning 404 to user: Instance dcbd3685-e8e0-48bd-977f-00cc2893a9f5 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-77863275-7b8e-4b9f-8fe8-a64e4c6de9cc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5" status: 404 len: 111 microversion: 2.1 time: 0.029802 Jul 20 05:27:51.789431 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5564/6689] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:27:51 2022] GET /compute/v2.1/servers/dcbd3685-e8e0-48bd-977f-00cc2893a9f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:27:54.799779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-969c1d32-974d-4dde-8403-be2de0b62e41 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '.version_select at 0x7f838a003160>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:27:54.841479 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-969c1d32-974d-4dde-8403-be2de0b62e41 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-623931816" status: 202 len: 0 microversion: 2.1 time: 0.045920 Jul 20 05:27:54.842102 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5565/6690] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 05:27:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-623931816 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 05:27:54.873352 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44dcceef-6557-413f-a858-d367bd199685 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: .version_select at 0x7f838a09bd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1167280373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3zZKQs/lsJsw/lgTvjm+X4U9AxJH8ebxTJVs2kVZiEWr5LmzG0MJy5zq9ZL+lqW8YxmJ2itS9sq31OCREgwxULSGkPt7O1UR9zAY1YbxOCPtq4SvA7eilaXOKwL6H28A=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:27:54.889983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-44dcceef-6557-413f-a858-d367bd199685 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:27:54.896130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-44dcceef-6557-413f-a858-d367bd199685 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:27:54.922291 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44dcceef-6557-413f-a858-d367bd199685 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053296 Jul 20 05:27:54.923505 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5566/6691] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:27:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:28:00.737688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1081179700", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "141c4f4f-75c0-44b9-8446-0d95ed9856b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1167280373", "security_groups": [{"name": "tempest-secgroup-smoke-1405434943"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:00.855414 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] validate_networks() for [('141c4f4f-75c0-44b9-8446-0d95ed9856b5', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:28:01.254434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:28:01.254865 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:28:01.255351 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:28:01.255767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:28:01.256222 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:28:01.265909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:01.266367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:01.267175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:01.267953 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:01.284926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:28:01.290130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:28:01.302802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:28:01.305115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:28:01.352135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c1ae2f7-f82d-4e6e-9b27-b0a1b48d722f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.618277 Jul 20 05:28:01.353136 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5567/6692] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:28:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:28:01.362888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2016c98-120d-4fb7-b1f2-753f6b18a0e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:01.363574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2016c98-120d-4fb7-b1f2-753f6b18a0e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:01.431970 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2016c98-120d-4fb7-b1f2-753f6b18a0e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:01.438928 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2016c98-120d-4fb7-b1f2-753f6b18a0e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1267 microversion: 2.1 time: 0.079890 Jul 20 05:28:01.439509 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5568/6693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:01 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:02.457895 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:02.458667 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:02.468732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:02.469209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:02.470027 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:02.470549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:02.551666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:02.560694 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6bf776a6-6d43-40ab-9bad-56f9889a537e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1337 microversion: 2.1 time: 0.107191 Jul 20 05:28:02.561286 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5569/6694] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:02 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:03.579542 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:03.580992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:03.590745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:03.591225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:03.592191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:03.592873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:03.839718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:03.849240 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e6a5a85a-7dbd-4f85-9671-84740583174f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.273611 Jul 20 05:28:03.852723 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5570/6695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:03 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:03.973548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-e4221dcc-1a80-4ad5-8a88-dec5f715d036 req-96c62938-2fc4-4f3f-b567-bc17ad4d1998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:03.986191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e4221dcc-1a80-4ad5-8a88-dec5f715d036 req-96c62938-2fc4-4f3f-b567-bc17ad4d1998 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:03.986658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-e4221dcc-1a80-4ad5-8a88-dec5f715d036 req-96c62938-2fc4-4f3f-b567-bc17ad4d1998 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:04.011275 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-e4221dcc-1a80-4ad5-8a88-dec5f715d036 req-96c62938-2fc4-4f3f-b567-bc17ad4d1998 service nova] Creating event network-changed:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h1-764486-11 Jul 20 05:28:04.017053 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-e4221dcc-1a80-4ad5-8a88-dec5f715d036 req-96c62938-2fc4-4f3f-b567-bc17ad4d1998 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047024 Jul 20 05:28:04.017603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5571/6696] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:04.868614 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:04.869282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:04.875426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:04.875881 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:04.876746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:04.877203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:05.009442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:05.016900 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3045dabe-87fa-4bcc-bedb-5ca460793498 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.153489 Jul 20 05:28:05.017477 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5572/6697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:04 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:06.034804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:06.035496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:06.042310 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:06.042775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:06.043558 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:06.044017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:06.179332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:06.186725 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6cbddd39-f666-45df-a2a8-a4fe829e77e3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.155919 Jul 20 05:28:06.187296 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5573/6698] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:06 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:07.204273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:07.204967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:07.212484 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:07.212955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:07.213738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:07.214188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:07.346016 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:07.353607 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be747352-b2a0-48fc-94fe-c5a875990567 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.153312 Jul 20 05:28:07.354203 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5574/6699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:07 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:08.371132 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:08.371971 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:08.380405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:08.380893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:08.382060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:08.383175 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:08.516528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:08.524110 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c909595b-3ff4-4308-8a34-689a68256663 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.156934 Jul 20 05:28:08.524717 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5575/6700] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:08 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:09.540996 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:09.541643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:09.548830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:09.549274 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:09.550059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:09.550508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:09.681738 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:09.689135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d90b516-856e-4ab3-b948-5d86ba813436 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.152119 Jul 20 05:28:09.689710 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5576/6701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:09 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:10.489483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-88f118d4-55c5-491d-914a-d4c99e953846 req-95513b85-d6fc-4d66-9cdc-21a7f0445490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "name": "network-vif-plugged", "status": "completed", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:10.498862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-88f118d4-55c5-491d-914a-d4c99e953846 req-95513b85-d6fc-4d66-9cdc-21a7f0445490 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:10.499318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-88f118d4-55c5-491d-914a-d4c99e953846 req-95513b85-d6fc-4d66-9cdc-21a7f0445490 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:10.511859 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-88f118d4-55c5-491d-914a-d4c99e953846 req-95513b85-d6fc-4d66-9cdc-21a7f0445490 service nova] Creating event network-vif-plugged:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h1-764486-11 Jul 20 05:28:10.516895 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-88f118d4-55c5-491d-914a-d4c99e953846 req-95513b85-d6fc-4d66-9cdc-21a7f0445490 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Jul 20 05:28:10.517536 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5577/6702] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:28:10.707109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:10.707830 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:10.711291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:10.717048 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:10.717507 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:10.718313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:10.718758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:10.721846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:10.859309 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:10.867539 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-602de663-54a6-4717-97fd-4045f9101d79 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1393 microversion: 2.1 time: 0.164645 Jul 20 05:28:10.868047 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5578/6703] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:10 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:11.885022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:11.885712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:11.887623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:11.888328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:11.895674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:11.896139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:11.896952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:11.897960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:12.036195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:12.044081 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f24d9564-909c-436a-b8e4-3fe0b522db20 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1565 microversion: 2.1 time: 0.163599 Jul 20 05:28:12.044691 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5579/6704] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:11 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:12.061060 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:12.061676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:12.067728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:12.068191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:12.068999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:12.070228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:12.205275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:12.213050 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f67073be-d27e-483c-9caf-87397145bfe2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1565 microversion: 2.1 time: 0.155640 Jul 20 05:28:12.213634 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5580/6705] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:12 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:14.121882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:14.122544 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:14.129926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:14.130392 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:14.131201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:14.132146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:14.273334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:14.280850 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6a042cca-5a5f-4d41-8e10-7f2cc0dc14c4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1565 microversion: 2.1 time: 0.162856 Jul 20 05:28:14.281431 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5581/6706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:14 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:14.286143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-3f0c2327-1e5f-407f-8906-675d6b50cfba req-f82b86a0-8699-4437-8d63-30018d369398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:14.294825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3f0c2327-1e5f-407f-8906-675d6b50cfba req-f82b86a0-8699-4437-8d63-30018d369398 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:14.295354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-3f0c2327-1e5f-407f-8906-675d6b50cfba req-f82b86a0-8699-4437-8d63-30018d369398 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:14.307857 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-3f0c2327-1e5f-407f-8906-675d6b50cfba req-f82b86a0-8699-4437-8d63-30018d369398 service nova] Creating event network-changed:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h1-764486-11 Jul 20 05:28:14.313168 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-3f0c2327-1e5f-407f-8906-675d6b50cfba req-f82b86a0-8699-4437-8d63-30018d369398 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030540 Jul 20 05:28:14.313992 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5582/6707] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:28:37.555087 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=9 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:37.555850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=25 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:37.560737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:37.561764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:37.568871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.569331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.570109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:37.570554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:37.626884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aaebcd23-7ae5-4545-ab86-cb59d7f4f83b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action" status: 200 len: 24567 microversion: 2.1 time: 0.073575 Jul 20 05:28:37.627692 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5583/6708] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:28:37 2022] POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:28:48.659959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:28:48.661496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:48.663619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:48.664545 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:28:48.671519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.671980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.673072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.673523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.715649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:48.722417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Old instance type m1.heat2, new instance type m1.heat {{(pid=123724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 05:28:48.729655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:28:48.730095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:28:48.730585 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:28:48.731010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:28:48.731443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:28:48.798365 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e62b4856-35df-44d4-a0d0-0a4a99ade959 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action" status: 202 len: 0 microversion: 2.1 time: 0.142899 Jul 20 05:28:48.802227 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5584/6709] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:28:48 2022] POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:28:48.807246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:48.807875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:48.815158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.815627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.816453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:48.816909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:48.953724 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:48.961735 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-160bf0d4-93f9-47ca-9545-965bc3555836 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1693 microversion: 2.1 time: 0.158152 Jul 20 05:28:48.972146 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5585/6710] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:48 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:28:49.980227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:49.980925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:49.987856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:49.988326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:49.989134 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:49.989586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:50.125415 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:50.134663 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8936e1ec-a10a-4442-aa34-232ed714fa72 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1693 microversion: 2.1 time: 0.158785 Jul 20 05:28:50.135262 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5586/6711] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:49 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:51.152651 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:51.153265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:51.160647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:51.161116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:51.161911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:51.162366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:51.304458 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:51.315984 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a2a99a4-9711-41f8-9262-270181c1142a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.167412 Jul 20 05:28:51.316633 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5587/6712] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:51 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:52.333687 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:52.334382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:52.341889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:52.342354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:52.343129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:52.343582 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:52.474028 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:52.481506 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-676aa4b7-fe51-4295-b959-bb01d78864c3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.151862 Jul 20 05:28:52.482112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5588/6713] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:52 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:53.498815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:53.499487 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:53.506583 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:53.507054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:53.508396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:53.508396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:53.653761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:53.661922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-68b8401f-8769-453c-8a37-0ae3e9feb4bb tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.167068 Jul 20 05:28:53.662493 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5589/6714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:53 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:54.680200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:54.680852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:54.687666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:54.688125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:54.688925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:54.689371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:54.820912 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:54.830659 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c28a492-d782-48bc-bfd3-90705b8e027e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.154332 Jul 20 05:28:54.831251 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5590/6715] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:54 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:55.848485 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:55.849165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:55.856606 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:55.857071 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:55.857847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:55.858299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:55.989822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:55.998000 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c3af1e4c-9039-44f2-a98c-b1e9a11490c9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.153489 Jul 20 05:28:55.998632 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5591/6716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:55 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:57.015731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:57.016341 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:57.023209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:57.023678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:57.024490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:57.024942 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:57.163622 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:57.171136 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f755b3aa-6a4f-4b12-957b-d941934458e5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.159359 Jul 20 05:28:57.171701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5592/6717] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:57 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:58.188604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:58.189244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:58.195926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:58.196407 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:58.197183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:58.197627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:58.331463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:58.339485 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf16d3f7-76f1-401e-a569-7ee1e5de2f52 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.154891 Jul 20 05:28:58.340100 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5593/6718] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:58 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:28:59.357200 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:28:59.357827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:28:59.365080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:59.365548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:59.366452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:28:59.366928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:28:59.792694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:28:59.800375 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fb100243-9b74-4421-a8cb-a32c0a66ad98 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.447687 Jul 20 05:28:59.800949 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5594/6719] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:28:59 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:00.817616 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:00.818296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:00.825497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:00.825962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:00.826755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:00.827208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:00.965686 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:00.973368 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-118da531-6954-495c-b0ff-f754e4d51ad0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.159632 Jul 20 05:29:00.973938 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5595/6720] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:00 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:01.991659 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:01.992345 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:01.999294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:01.999716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:02.000536 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:02.000995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:02.130397 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:02.138729 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-20f5db7c-09d2-459b-95c9-6af7849c7066 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.150990 Jul 20 05:29:02.139308 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5596/6721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:01 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:03.155670 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:03.156298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:03.163423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:03.163893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:03.164709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:03.165167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:03.301074 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:03.308597 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9683526-0594-4f83-bebb-d2e0e1c75669 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.156949 Jul 20 05:29:03.309175 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5597/6722] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:03 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:04.325779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:04.326452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:04.333301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:04.333760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:04.334534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:04.334980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:04.465435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:04.473386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1ffb5fb4-a872-4df5-b2af-ec6b54d74a46 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.151633 Jul 20 05:29:04.473960 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5598/6723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:04 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:05.491196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:05.491832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:05.499277 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:05.499755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:05.500587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:05.501039 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:05.505123 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:05.639639 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:05.647152 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8d2bad82-283f-4193-8ebd-51bac05f7559 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.159984 Jul 20 05:29:05.647729 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5599/6724] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:05 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:06.664308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:06.665019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:06.672167 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.672684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.673476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:06.673975 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:06.804442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:06.812669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-340557d8-fc7c-434e-8d97-f1b875ac16dc tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1698 microversion: 2.1 time: 0.152254 Jul 20 05:29:06.813247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5600/6725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:06 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:07.829657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:07.830359 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:07.837177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:07.837643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:07.838963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:07.839418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:07.977427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:07.985681 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3770d635-f751-4b20-ba6a-8cf0124b8536 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1697 microversion: 2.1 time: 0.159927 Jul 20 05:29:07.986265 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5601/6726] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:07 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:08.277949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-5cb63b4d-9e08-476a-8e09-1c2c91d3f14d req-37780b1a-fa21-48ae-8234-bea841178eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "name": "network-vif-unplugged", "status": "completed", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:08.286900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5cb63b4d-9e08-476a-8e09-1c2c91d3f14d req-37780b1a-fa21-48ae-8234-bea841178eb9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:08.287371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-5cb63b4d-9e08-476a-8e09-1c2c91d3f14d req-37780b1a-fa21-48ae-8234-bea841178eb9 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:08.301231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-5cb63b4d-9e08-476a-8e09-1c2c91d3f14d req-37780b1a-fa21-48ae-8234-bea841178eb9 service nova] Creating event network-vif-unplugged:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h2-764486-11 Jul 20 05:29:08.308012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-5cb63b4d-9e08-476a-8e09-1c2c91d3f14d req-37780b1a-fa21-48ae-8234-bea841178eb9 service nova] Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:29:08.320952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-5cb63b4d-9e08-476a-8e09-1c2c91d3f14d req-37780b1a-fa21-48ae-8234-bea841178eb9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106197 Jul 20 05:29:08.322077 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5602/6727] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:29:09.004867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:09.005584 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:09.012452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:09.012922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:09.013714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:09.014169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:09.147646 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:09.156019 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4452e55c-4666-4c96-adff-599d2a860948 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1697 microversion: 2.1 time: 0.156468 Jul 20 05:29:09.156728 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5603/6728] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:08 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:10.173530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:10.174169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:10.181213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:10.181690 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:10.182477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:10.182943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:10.319603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:10.327641 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7780a744-45b7-46d8-8f6b-2e9fd4c07013 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1695 microversion: 2.1 time: 0.158419 Jul 20 05:29:10.328238 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5604/6729] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:10 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:10.341094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-f6997cf9-bb9f-4522-a115-5516a0d63c96 req-150e26f6-a675-4ff9-b15c-9779f5c78e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:10.349095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f6997cf9-bb9f-4522-a115-5516a0d63c96 req-150e26f6-a675-4ff9-b15c-9779f5c78e5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:10.349550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-f6997cf9-bb9f-4522-a115-5516a0d63c96 req-150e26f6-a675-4ff9-b15c-9779f5c78e5f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:10.361060 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-f6997cf9-bb9f-4522-a115-5516a0d63c96 req-150e26f6-a675-4ff9-b15c-9779f5c78e5f service nova] Creating event network-changed:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h2-764486-11 Jul 20 05:29:10.366743 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [req-f6997cf9-bb9f-4522-a115-5516a0d63c96 req-150e26f6-a675-4ff9-b15c-9779f5c78e5f service nova] Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-764486-11', 'n-h2-764486-11'} {{(pid=123724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 05:29:10.378239 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-f6997cf9-bb9f-4522-a115-5516a0d63c96 req-150e26f6-a675-4ff9-b15c-9779f5c78e5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041369 Jul 20 05:29:10.378851 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5605/6730] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:11.346292 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:11.346905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:11.354637 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.355102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.355876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.356323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.491828 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:11.499433 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cc7a193c-be2a-4059-a37a-ccd168a6ded4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1692 microversion: 2.1 time: 0.157622 Jul 20 05:29:11.500015 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5606/6731] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:11 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:11.515834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:11.516388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:11.522250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.522712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.523486 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.523935 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.582006 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d1f55f60-6924-4fd3-a9bf-8750bf8fc373 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action" status: 204 len: 0 microversion: 2.1 time: 0.069687 Jul 20 05:29:11.582707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5607/6732] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:29:11 2022] POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:29:11.591603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:11.592319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:11.598850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.599230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.600029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.600514 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.823265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:11.831878 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8cbcd512-7afc-422e-98c9-ffdb5470f3f5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1692 microversion: 2.1 time: 0.244754 Jul 20 05:29:11.832511 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5608/6733] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:11 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1692 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:11.849205 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:11.849777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:11.857122 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.858080 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:11.858932 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:11.859586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:12.092876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:12.102815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c0c5f0c6-92db-4c83-8776-9829d78d115b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1692 microversion: 2.1 time: 0.257590 Jul 20 05:29:12.113719 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5609/6734] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:11 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1692 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:13.121095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:13.121755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:13.128924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:13.129389 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:13.130198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:13.130645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:13.271198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:13.279550 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9f5e2260-4576-4872-a944-47097b3a313a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1684 microversion: 2.1 time: 0.162455 Jul 20 05:29:13.280122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5610/6735] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:13 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:14.136627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-ed69ed94-f8cc-4edd-8cae-7194c874e9f1 req-7df71b04-ee4e-42b2-9976-a22e3c774e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "name": "network-vif-plugged", "status": "completed", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:14.146118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed69ed94-f8cc-4edd-8cae-7194c874e9f1 req-7df71b04-ee4e-42b2-9976-a22e3c774e76 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:14.146605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-ed69ed94-f8cc-4edd-8cae-7194c874e9f1 req-7df71b04-ee4e-42b2-9976-a22e3c774e76 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:14.158562 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-ed69ed94-f8cc-4edd-8cae-7194c874e9f1 req-7df71b04-ee4e-42b2-9976-a22e3c774e76 service nova] Creating event network-vif-plugged:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h2-764486-11 Jul 20 05:29:14.163456 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-ed69ed94-f8cc-4edd-8cae-7194c874e9f1 req-7df71b04-ee4e-42b2-9976-a22e3c774e76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030720 Jul 20 05:29:14.164417 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5611/6736] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:29:37.462688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=60 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:37.463633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:29:37.467941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:37.468988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:37.476534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:37.477005 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:37.477826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:37.478283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:37.542822 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1c9e0bc5-fd7f-4e2a-8170-de96ed42cf28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action" status: 200 len: 24567 microversion: 2.1 time: 0.082084 Jul 20 05:29:37.543477 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5612/6737] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:29:37 2022] POST /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6/action => generated 24567 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 05:29:45.005832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:45.006563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:45.015115 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.015581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.016398 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.016887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.044682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:29:45.125269 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54286c13-a219-4c58-9f09-cbbc725f825f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 204 len: 0 microversion: 2.1 time: 0.123619 Jul 20 05:29:45.125895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5613/6738] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:29:44 2022] DELETE /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:29:45.190550 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-72655a72-347f-4fd9-8083-c69717f0c564 req-85ef63a9-4834-4b7a-99cb-3a3ceb93f921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:45.200569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72655a72-347f-4fd9-8083-c69717f0c564 req-85ef63a9-4834-4b7a-99cb-3a3ceb93f921 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.201032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72655a72-347f-4fd9-8083-c69717f0c564 req-85ef63a9-4834-4b7a-99cb-3a3ceb93f921 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.212466 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-72655a72-347f-4fd9-8083-c69717f0c564 req-85ef63a9-4834-4b7a-99cb-3a3ceb93f921 service nova] Creating event network-changed:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h2-764486-11 Jul 20 05:29:45.217455 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-72655a72-347f-4fd9-8083-c69717f0c564 req-85ef63a9-4834-4b7a-99cb-3a3ceb93f921 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090124 Jul 20 05:29:45.218168 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5614/6739] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:29:45.223183 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:45.223928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:45.230888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.231354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.232143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:45.232634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:45.372862 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:45.380580 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a8630113-cc35-44f5-b108-7ce021838bde tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1690 microversion: 2.1 time: 0.161345 Jul 20 05:29:45.381389 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5615/6740] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:45 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:46.398179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:46.398848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:46.405658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:46.406120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:46.406917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:46.407346 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:46.541748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:46.549568 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1b2c33a2-549f-48fe-ba4a-1b5c906848b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 200 len: 1690 microversion: 2.1 time: 0.155562 Jul 20 05:29:46.550137 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5616/6741] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:46 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:47.232735 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4863569b-5ae6-4097-a830-e66fdabcc0f4 req-4050b250-53a4-4e30-92c3-658b1c961932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec35b011-d3bb-492c-8052-8a6fbe128cb6", "name": "network-vif-deleted", "tag": "f0cee5fd-52ce-4159-b6ec-47a4f9cbb112"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:47.242358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4863569b-5ae6-4097-a830-e66fdabcc0f4 req-4050b250-53a4-4e30-92c3-658b1c961932 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:47.242814 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4863569b-5ae6-4097-a830-e66fdabcc0f4 req-4050b250-53a4-4e30-92c3-658b1c961932 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:47.253386 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4863569b-5ae6-4097-a830-e66fdabcc0f4 req-4050b250-53a4-4e30-92c3-658b1c961932 service nova] Creating event network-vif-deleted:f0cee5fd-52ce-4159-b6ec-47a4f9cbb112 for instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 on n-h2-764486-11 Jul 20 05:29:47.258187 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4863569b-5ae6-4097-a830-e66fdabcc0f4 req-4050b250-53a4-4e30-92c3-658b1c961932 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029842 Jul 20 05:29:47.258771 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5617/6742] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:29:47.568634 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:47.569326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: ec35b011-d3bb-492c-8052-8a6fbe128cb6] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:47.576077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:47.576577 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:47.577363 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:47.577810 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:47.592137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] HTTP exception thrown: Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 could not be found. Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Request method failure captured: Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 HTTP/1.1 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15GsgKaY51_76qMPtZRUSBLJ5JFVecnjhius4mtJ8QItAqqZSIQiIUFYiq89kRwxWorNfsf2ajJrJTKVUiZIBfrcpwkPx6wC9THGfqX23Xu6P4EBQDBYdTdWvxkHr55aq9uYP3ZnUwp-HdZ8XHYoywMv7rC9XXRdbA8WgYeytWE_-FQ Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aff796eba9244e8080b8afd901ac1d07", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d54f913d94584c04824dc01dbf2a1b12 Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 could not be found. Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'ec35b011-d3bb-492c-8052-8a6fbe128cb6'} Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 could not be found. Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 could not be found. Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:29:47.593823 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 could not be found. Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Returning 404 to user: Instance ec35b011-d3bb-492c-8052-8a6fbe128cb6 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b2d1807d-051b-488b-9132-46513fced958 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6" status: 404 len: 111 microversion: 2.1 time: 0.031704 Jul 20 05:29:47.598437 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5618/6743] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:47 2022] GET /compute/v2.1/servers/ec35b011-d3bb-492c-8052-8a6fbe128cb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:29:50.570939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e020530-877d-4db6-b39d-d6e108b86d1f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '.version_select at 0x7f838a026c10>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:50.605664 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e020530-877d-4db6-b39d-d6e108b86d1f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167280373" status: 202 len: 0 microversion: 2.1 time: 0.038615 Jul 20 05:29:50.606341 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5619/6744] 10.222.0.49 () {58 vars in 1283 bytes} [Wed Jul 20 05:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167280373 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:29:50.632827 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-daa83419-0969-4960-b203-959189ed0623 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: .version_select at 0x7f838a16f8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1215765499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZlnrHYHzGUbT/ZWOVjlRIOGJkUA0MV8JXiHVB1WMclzzroY1j1noQrgejk8Fso/4zmJ1zBmN/Ju4DlwSfsyWbAV0udPUmQ0gqRSpwzwaAEQ7ZYF4zaewN75EADSF60fw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:50.649076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-daa83419-0969-4960-b203-959189ed0623 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:29:50.655612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-daa83419-0969-4960-b203-959189ed0623 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:29:50.681819 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-daa83419-0969-4960-b203-959189ed0623 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052819 Jul 20 05:29:50.682428 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5620/6745] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:29:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:29:56.458064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1394045113", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "7fcb02cf-6cb5-4866-84be-946237a6b24f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1215765499", "security_groups": [{"name": "tempest-secgroup-smoke-1692318279"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:56.571817 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] validate_networks() for [('7fcb02cf-6cb5-4866-84be-946237a6b24f', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:29:57.003884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:29:57.004333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:29:57.004871 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:29:57.005306 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:29:57.005741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:29:57.018657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:57.019125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:57.019955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:57.020443 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:57.044086 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:29:57.050314 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:29:57.064278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:29:57.066611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:29:57.123111 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2df7f4df-1518-45de-baf8-193e6a3c3492 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669822 Jul 20 05:29:57.129035 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5621/6746] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:29:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:29:57.142293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-94908347-8d55-4f10-9e02-1c488cfa0cb3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:57.142928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-94908347-8d55-4f10-9e02-1c488cfa0cb3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:57.209832 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-94908347-8d55-4f10-9e02-1c488cfa0cb3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:57.219509 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-94908347-8d55-4f10-9e02-1c488cfa0cb3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1267 microversion: 2.1 time: 0.081909 Jul 20 05:29:57.220108 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5622/6747] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:57 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:58.242472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:58.244792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:58.259597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:58.260387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:58.261472 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:58.262128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:58.360081 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:58.370952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7d29bb32-3208-477b-8c62-dda4281aee35 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1327 microversion: 2.1 time: 0.135868 Jul 20 05:29:58.372155 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5623/6748] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:58 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:29:59.389287 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:29:59.390008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:29:59.397324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:59.398118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:59.402676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:59.402676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:59.654373 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:29:59.664631 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4c386f3f-84ce-4a47-9407-25b3cf86ca28 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1393 microversion: 2.1 time: 0.278364 Jul 20 05:29:59.665804 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5624/6749] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:29:59 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1393 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:29:59.883774 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-93b9bc3c-0868-48a0-bcc0-0183c2485327 req-b973f053-629a-4137-bc33-f37e5025395e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168b6277-8ba3-4edc-b6d2-fb180f0ac69b", "tag": "cb414a32-6bd2-4613-9147-bfadf931856f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:29:59.896279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-93b9bc3c-0868-48a0-bcc0-0183c2485327 req-b973f053-629a-4137-bc33-f37e5025395e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:29:59.896917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-93b9bc3c-0868-48a0-bcc0-0183c2485327 req-b973f053-629a-4137-bc33-f37e5025395e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:29:59.913214 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-93b9bc3c-0868-48a0-bcc0-0183c2485327 req-b973f053-629a-4137-bc33-f37e5025395e service nova] Creating event network-changed:cb414a32-6bd2-4613-9147-bfadf931856f for instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b on n-h1-764486-11 Jul 20 05:29:59.919556 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-93b9bc3c-0868-48a0-bcc0-0183c2485327 req-b973f053-629a-4137-bc33-f37e5025395e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040643 Jul 20 05:29:59.921109 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5625/6750] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:30:00.684107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:00.684846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:00.691278 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:00.691729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:00.692556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:00.693019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:00.827725 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:00.835157 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7edf252b-88f9-459d-860f-26afc2bf82c6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1393 microversion: 2.1 time: 0.156387 Jul 20 05:30:00.835721 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5626/6751] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:00 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:01.899623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:01.900318 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:01.906566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:01.907035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:01.907821 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:01.908275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:02.046483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:02.054057 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-32bcd8a5-bb68-4f09-a168-b58f72d79923 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1393 microversion: 2.1 time: 0.205518 Jul 20 05:30:02.054636 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5627/6752] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:01 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1393 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:03.071740 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:03.072470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:03.080143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:03.080642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:03.081457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:03.081909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:03.215886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:03.223463 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0956fc7b-ca91-40c0-bdb1-9d24eab4ec14 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1393 microversion: 2.1 time: 0.155694 Jul 20 05:30:03.224038 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5628/6753] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:03 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:04.240722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:04.241377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:04.248211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:04.248717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:04.249494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:04.249943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:04.386917 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:04.394671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a2c870b4-b980-40e9-9001-a483fab95346 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1393 microversion: 2.1 time: 0.158153 Jul 20 05:30:04.395249 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5629/6754] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:04 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:05.098661 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1239a4d8-4c50-489f-9966-62200ead8f75 req-bb94611e-9e29-45c9-98be-097a4ceb8ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168b6277-8ba3-4edc-b6d2-fb180f0ac69b", "name": "network-vif-plugged", "status": "completed", "tag": "cb414a32-6bd2-4613-9147-bfadf931856f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:05.107481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1239a4d8-4c50-489f-9966-62200ead8f75 req-bb94611e-9e29-45c9-98be-097a4ceb8ee1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:05.108140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1239a4d8-4c50-489f-9966-62200ead8f75 req-bb94611e-9e29-45c9-98be-097a4ceb8ee1 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:05.120124 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-1239a4d8-4c50-489f-9966-62200ead8f75 req-bb94611e-9e29-45c9-98be-097a4ceb8ee1 service nova] Creating event network-vif-plugged:cb414a32-6bd2-4613-9147-bfadf931856f for instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b on n-h1-764486-11 Jul 20 05:30:05.125384 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1239a4d8-4c50-489f-9966-62200ead8f75 req-bb94611e-9e29-45c9-98be-097a4ceb8ee1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030615 Jul 20 05:30:05.126171 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5630/6755] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:30:05.412677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:05.413426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:05.420445 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:05.421119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:05.421904 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:05.422358 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:05.556076 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:05.563776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce6dd71a-a105-4e93-b80c-2e0cd971b489 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1393 microversion: 2.1 time: 0.156365 Jul 20 05:30:05.564379 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5631/6756] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:05 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:06.581924 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:06.582601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:06.589527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:06.589991 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:06.590767 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:06.591215 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:06.721284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:06.728928 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b589ac99-f1de-46e5-aa3d-aa55d1c2d3a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1564 microversion: 2.1 time: 0.150971 Jul 20 05:30:06.729510 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5632/6757] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:06 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:06.744888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:06.745535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:06.752099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:06.752607 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:06.753396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:06.753848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:06.881976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:06.890385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f154984f-789b-4ef5-b198-9ba5525ef55d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1564 microversion: 2.1 time: 0.149389 Jul 20 05:30:06.890963 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5633/6758] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:06 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:08.498846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:08.499684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:08.502860 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:08.503663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:08.505527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:08.510146 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:08.510610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:08.511417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:08.511880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:08.516163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:08.657077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:08.664776 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0648c76a-9bd0-443c-834b-b2141597bb5d tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1564 microversion: 2.1 time: 0.171214 Jul 20 05:30:08.665748 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5634/6759] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:08 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:30:08.670388 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-edca6ea0-7c4a-4509-9007-4f79f7c1db98 req-59c62852-c86d-4e1e-a2cf-265fa2fd2af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168b6277-8ba3-4edc-b6d2-fb180f0ac69b", "tag": "cb414a32-6bd2-4613-9147-bfadf931856f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:08.678880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-edca6ea0-7c4a-4509-9007-4f79f7c1db98 req-59c62852-c86d-4e1e-a2cf-265fa2fd2af6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:08.679349 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-edca6ea0-7c4a-4509-9007-4f79f7c1db98 req-59c62852-c86d-4e1e-a2cf-265fa2fd2af6 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:08.691051 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-edca6ea0-7c4a-4509-9007-4f79f7c1db98 req-59c62852-c86d-4e1e-a2cf-265fa2fd2af6 service nova] Creating event network-changed:cb414a32-6bd2-4613-9147-bfadf931856f for instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b on n-h1-764486-11 Jul 20 05:30:08.696146 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-edca6ea0-7c4a-4509-9007-4f79f7c1db98 req-59c62852-c86d-4e1e-a2cf-265fa2fd2af6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029156 Jul 20 05:30:08.696963 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5635/6760] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:30:31.945140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:31.945976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=7 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:31.950410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:31.951435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:31.958573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:31.959043 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:31.959829 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:31.960288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:32.012253 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca30d108-af2b-4d8b-8672-f69ee13aab44 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action" status: 200 len: 24573 microversion: 2.1 time: 0.068934 Jul 20 05:30:32.013113 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5636/6761] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:31 2022] POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action => generated 24573 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:30:38.400519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c8a5a83-803a-4661-83a1-f1a3e8e4cec7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:38.408801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c8a5a83-803a-4661-83a1-f1a3e8e4cec7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:38.409270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c8a5a83-803a-4661-83a1-f1a3e8e4cec7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:38.435941 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c8a5a83-803a-4661-83a1-f1a3e8e4cec7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Going to try to stop instance {{(pid=123724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 05:30:38.478666 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c8a5a83-803a-4661-83a1-f1a3e8e4cec7 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action" status: 202 len: 0 microversion: 2.1 time: 0.082372 Jul 20 05:30:38.479281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5637/6762] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:38 2022] POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:30:38.490096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:38.490834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:38.497878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:38.498343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:38.499137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:38.499770 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:38.642531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:38.650437 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-12a947ac-86c2-4e21-aee1-e6d9b962b825 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.166017 Jul 20 05:30:38.651075 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5638/6763] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:38 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:39.669355 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:39.669994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:39.677946 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:39.678531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:39.679206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:39.679665 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:39.895409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:39.902944 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f68eed5-4983-42c5-810c-33cc28328224 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.237611 Jul 20 05:30:39.903525 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5639/6764] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:39 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:40.921457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:40.922144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:40.929177 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:40.929672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:40.930444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:40.930905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:41.062677 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:41.070394 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2ecbb99c-d1ac-4f74-b957-92bd3ff5bf13 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.153513 Jul 20 05:30:41.070985 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5640/6765] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:40 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:42.087931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:42.088621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:42.097612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:42.098326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:42.099172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:42.099628 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:42.236713 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:42.245407 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-23f00119-45fc-431b-8d67-6270444fae24 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.161438 Jul 20 05:30:42.246005 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5641/6766] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:42 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:43.262815 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:43.263497 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:43.270535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:43.271008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:43.271799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:43.272262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:43.410933 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:43.418672 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a256894c-d5a1-408e-b527-ea196d09e7b0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.159709 Jul 20 05:30:43.419252 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5642/6767] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:43 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:44.437127 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:44.437778 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:44.444730 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:44.445198 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:44.445979 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:44.446429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:44.580934 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:44.588603 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0780eeb0-3631-409d-814b-ae182019bde2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.155909 Jul 20 05:30:44.589187 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5643/6768] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:44 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:45.605852 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:45.606520 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:45.613793 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:45.614265 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:45.615056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:45.615509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:45.754776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:45.762425 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-39b5b166-6f24-4d0e-8ea8-d092b6757528 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.160506 Jul 20 05:30:45.763004 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5644/6769] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:45 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:46.780683 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:46.781342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:46.788105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:46.788619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:46.789404 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:46.789851 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:46.926158 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:46.933693 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5227475e-0281-46bc-ba65-f1f42d98a016 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.157457 Jul 20 05:30:46.934264 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5645/6770] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:46 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:47.950739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:47.951920 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:47.958960 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:47.959426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:47.960213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:47.960688 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:48.098172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:48.105695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a1d16002-f826-4805-a390-38e51b0db657 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1693 microversion: 2.1 time: 0.158888 Jul 20 05:30:48.106268 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5646/6771] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:47 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:49.123587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:49.124227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:49.131185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:49.131656 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:49.132466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:49.132925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:49.270137 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:49.278625 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-84637ae9-6e67-4563-8963-619a32c0c20a tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1670 microversion: 2.1 time: 0.159374 Jul 20 05:30:49.279218 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5647/6772] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:49 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:50.367130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:50.368020 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:50.375571 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.376031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.376840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.377293 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.429447 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-49801b67-a353-4ca1-9be6-c081524fd085 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action" status: 200 len: 35034 microversion: 2.1 time: 0.066152 Jul 20 05:30:50.430180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5648/6773] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:50 2022] POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action => generated 35034 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:30:50.442632 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f16ab9f7-b059-4efa-8712-dd3fb952367c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:30:50.449849 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f16ab9f7-b059-4efa-8712-dd3fb952367c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.450315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f16ab9f7-b059-4efa-8712-dd3fb952367c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.472697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f16ab9f7-b059-4efa-8712-dd3fb952367c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Going to try to start instance {{(pid=123724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 05:30:50.513537 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f16ab9f7-b059-4efa-8712-dd3fb952367c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action" status: 202 len: 0 microversion: 2.1 time: 0.074971 Jul 20 05:30:50.514173 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5649/6774] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:30:50 2022] POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:30:50.524209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:50.524965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:50.532197 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.532709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.534209 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:50.534676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:50.762383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:50.770300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0dbf6ce1-1496-4bf6-bcc4-999c9cadad39 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1679 microversion: 2.1 time: 0.250847 Jul 20 05:30:50.770900 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5650/6775] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:50 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:30:51.788004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:30:51.788722 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:30:51.795957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:51.796447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:51.797225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:30:51.797676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:30:51.801900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:30:51.935400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:30:51.943518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0732f977-d14d-44e6-83bd-1fcc4d1797fe tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1683 microversion: 2.1 time: 0.159436 Jul 20 05:30:51.944091 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5651/6776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:30:51 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:16.124842 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:16.125695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:16.128786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=32 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:16.129455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:16.135757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:16.136752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:16.137556 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:16.138047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:16.192875 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fdae5582-ae8c-47ac-86df-6abbde20c4c2 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action" status: 200 len: 59592 microversion: 2.1 time: 0.072084 Jul 20 05:31:16.193539 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5652/6777] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:31:16 2022] POST /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b/action => generated 59592 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:31:23.176037 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:23.176763 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:23.185151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:23.185705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:23.186596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:23.187169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:23.215211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:31:23.297189 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-399f35b6-d388-4be7-b1e7-8279a1ab109f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 204 len: 0 microversion: 2.1 time: 0.125128 Jul 20 05:31:23.297810 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5653/6778] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:31:23 2022] DELETE /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:31:23.304383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-208510ae-c6a8-4fe5-916d-a5b51fb63c3f req-2efb1942-3b14-4257-8e97-4f7c9ed8e458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168b6277-8ba3-4edc-b6d2-fb180f0ac69b", "tag": "cb414a32-6bd2-4613-9147-bfadf931856f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:23.312335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-208510ae-c6a8-4fe5-916d-a5b51fb63c3f req-2efb1942-3b14-4257-8e97-4f7c9ed8e458 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:23.312819 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-208510ae-c6a8-4fe5-916d-a5b51fb63c3f req-2efb1942-3b14-4257-8e97-4f7c9ed8e458 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:23.324116 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-208510ae-c6a8-4fe5-916d-a5b51fb63c3f req-2efb1942-3b14-4257-8e97-4f7c9ed8e458 service nova] Creating event network-changed:cb414a32-6bd2-4613-9147-bfadf931856f for instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b on n-h1-764486-11 Jul 20 05:31:23.329797 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-208510ae-c6a8-4fe5-916d-a5b51fb63c3f req-2efb1942-3b14-4257-8e97-4f7c9ed8e458 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030499 Jul 20 05:31:23.330404 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5654/6779] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:31:23.336067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:23.337708 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:23.343320 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:23.343790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:23.344611 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:23.345068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:23.494717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:23.503518 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48f715af-8d4b-4e04-bb0e-b6817513e839 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1689 microversion: 2.1 time: 0.171818 Jul 20 05:31:23.504114 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5655/6780] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:23 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:24.521386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:24.522065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:24.529601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:24.530061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:24.530847 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:24.531303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:24.783023 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:24.791380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-afa8dd23-c27a-4def-8002-c3eb4bde99b8 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1689 microversion: 2.1 time: 0.273866 Jul 20 05:31:24.792432 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5656/6781] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:24 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1689 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:25.507176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-65b8d28e-1895-4906-bc5d-3e1940e50115 req-e852c08e-e68c-4499-968e-d3e9030d254e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168b6277-8ba3-4edc-b6d2-fb180f0ac69b", "name": "network-vif-deleted", "tag": "cb414a32-6bd2-4613-9147-bfadf931856f"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:25.518726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65b8d28e-1895-4906-bc5d-3e1940e50115 req-e852c08e-e68c-4499-968e-d3e9030d254e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:25.519116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-65b8d28e-1895-4906-bc5d-3e1940e50115 req-e852c08e-e68c-4499-968e-d3e9030d254e service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:25.532584 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-65b8d28e-1895-4906-bc5d-3e1940e50115 req-e852c08e-e68c-4499-968e-d3e9030d254e service nova] Creating event network-vif-deleted:cb414a32-6bd2-4613-9147-bfadf931856f for instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b on n-h1-764486-11 Jul 20 05:31:25.537698 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-65b8d28e-1895-4906-bc5d-3e1940e50115 req-e852c08e-e68c-4499-968e-d3e9030d254e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034859 Jul 20 05:31:25.538317 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5657/6782] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:31:25.810806 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:25.811537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:25.826242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:25.826714 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:25.827575 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:25.828036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:25.864621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:25.865121 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:25.865604 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lazy-loading 'fault' on Instance uuid 168b6277-8ba3-4edc-b6d2-fb180f0ac69b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:31:25.913315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:25.922458 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e59d28e8-1ddf-49d4-9bbb-0083ab9a827e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 200 len: 1357 microversion: 2.1 time: 0.116685 Jul 20 05:31:25.923180 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5658/6783] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:25 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 1357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:26.939769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:26.940464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: 168b6277-8ba3-4edc-b6d2-fb180f0ac69b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:26.947526 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:26.947992 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:26.948799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:26.949250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:26.963131 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] HTTP exception thrown: Instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b could not be found. Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Request method failure captured: Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b HTTP/1.1 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15GsgKaY51_76qMPtZRUSBLJ5JFVecnjhius4mtJ8QItAqqZSIQiIUFYiq89kRwxWorNfsf2ajJrJTKVUiZIBfrcpwkPx6wC9THGfqX23Xu6P4EBQDBYdTdWvxkHr55aq9uYP3ZnUwp-HdZ8XHYoywMv7rC9XXRdbA8WgYeytWE_-FQ Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aff796eba9244e8080b8afd901ac1d07", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d54f913d94584c04824dc01dbf2a1b12 Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b could not be found. Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '168b6277-8ba3-4edc-b6d2-fb180f0ac69b'} Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b could not be found. Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b could not be found. Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:31:26.964826 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b could not be found. Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Returning 404 to user: Instance 168b6277-8ba3-4edc-b6d2-fb180f0ac69b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b9583129-8efe-49cf-8ac4-88903a0ffa51 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b" status: 404 len: 111 microversion: 2.1 time: 0.030518 Jul 20 05:31:26.969619 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5659/6784] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:26 2022] GET /compute/v2.1/servers/168b6277-8ba3-4edc-b6d2-fb180f0ac69b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:31:29.902357 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-9c075b6c-42b8-47e1-81b7-74ce7b2f3df3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '.version_select at 0x7f838a026ee0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:29.933362 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-9c075b6c-42b8-47e1-81b7-74ce7b2f3df3 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1215765499" status: 202 len: 0 microversion: 2.1 time: 0.034808 Jul 20 05:31:29.934197 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5660/6785] 10.222.0.49 () {58 vars in 1283 bytes} [Wed Jul 20 05:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1215765499 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:31:29.965984 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-10f904a7-9b8b-4cd7-ad93-2b87b395b875 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: .version_select at 0x7f838a9fcb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-488212668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEylPRPwjyWypx/9MArz38ZurlgJWvXt97eUB9catRYGj+HMu0VXoXupXp+KfDCEvTp6C8HpuGwWu3JriGzFBv9whGC7N5UPb2xjM6xdGIOI90kXtmsmZOOCImLUpbM7w=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:29.981059 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-10f904a7-9b8b-4cd7-ad93-2b87b395b875 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:31:29.986937 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-10f904a7-9b8b-4cd7-ad93-2b87b395b875 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:31:30.010348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-10f904a7-9b8b-4cd7-ad93-2b87b395b875 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.048838 Jul 20 05:31:30.010953 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5661/6786] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:31:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:31:35.380393 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-7276914", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "networks": [{"uuid": "2f55be90-625f-489f-a062-3a89fdc16f55"}], "key_name": "tempest-TestNetworkAdvancedServerOps-488212668", "security_groups": [{"name": "tempest-secgroup-smoke-1827860345"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:35.562072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] validate_networks() for [('2f55be90-625f-489f-a062-3a89fdc16f55', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:31:36.058207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:31:36.058649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:31:36.059676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:31:36.060102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:31:36.060569 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:31:36.070633 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:36.070900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:36.071983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:36.072566 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:36.093105 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:31:36.099395 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Getting quotas for user d54f913d94584c04824dc01dbf2a1b12 and project aff796eba9244e8080b8afd901ac1d07. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:31:36.116994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:31:36.119650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:31:36.172227 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-941e1ab7-cb50-4435-9b52-15aa5cf4a215 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.795708 Jul 20 05:31:36.173238 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5662/6787] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:31:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 05:31:36.183409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-eed812e6-631b-417b-a92c-a1cdaa1e2476 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:36.184129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-eed812e6-631b-417b-a92c-a1cdaa1e2476 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:36.243169 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-eed812e6-631b-417b-a92c-a1cdaa1e2476 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:36.250780 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-eed812e6-631b-417b-a92c-a1cdaa1e2476 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1263 microversion: 2.1 time: 0.071316 Jul 20 05:31:36.251599 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5663/6788] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:36 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:37.269892 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:37.270506 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:37.278988 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:37.279728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:37.280758 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:37.281375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:37.381480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:37.390778 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-47597e04-0a8a-4b7d-bc0e-21821bce0a74 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1323 microversion: 2.1 time: 0.127409 Jul 20 05:31:37.392186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5664/6789] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:37 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1323 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:38.410798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:38.412509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:38.420779 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:38.421523 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:38.422323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:38.422771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:38.588689 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:38.597134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7fe6e291-c0e5-482f-afeb-a612816560e9 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1389 microversion: 2.1 time: 0.192442 Jul 20 05:31:38.598101 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5665/6790] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:38 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1389 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:38.932712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9e6bfd8e-0074-4c84-b4ef-42279611ad85 req-152d90e9-abdb-4a07-a698-2e94683f020d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32a18a4-aaca-41f0-9d46-4d4f173c65a0", "tag": "6e5b3fdd-4acf-4909-9276-a287e7d65e8b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:38.955757 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9e6bfd8e-0074-4c84-b4ef-42279611ad85 req-152d90e9-abdb-4a07-a698-2e94683f020d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:38.957653 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9e6bfd8e-0074-4c84-b4ef-42279611ad85 req-152d90e9-abdb-4a07-a698-2e94683f020d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:38.986616 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9e6bfd8e-0074-4c84-b4ef-42279611ad85 req-152d90e9-abdb-4a07-a698-2e94683f020d service nova] Creating event network-changed:6e5b3fdd-4acf-4909-9276-a287e7d65e8b for instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 on n-h1-764486-11 Jul 20 05:31:38.992440 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9e6bfd8e-0074-4c84-b4ef-42279611ad85 req-152d90e9-abdb-4a07-a698-2e94683f020d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063572 Jul 20 05:31:38.993754 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5666/6791] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:31:39.616218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:39.616902 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:39.623919 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:39.624411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:39.625219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:39.625675 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:39.763775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:39.771405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0c555eca-f889-4722-876f-4be51c39124c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1389 microversion: 2.1 time: 0.160498 Jul 20 05:31:39.771983 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5667/6792] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:39 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:40.787752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:40.788425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:40.795674 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:40.796136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:40.796958 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:40.797406 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:40.935876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:40.943499 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-30754e6f-ebb7-4921-b5a2-2349131bca15 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1389 microversion: 2.1 time: 0.159678 Jul 20 05:31:40.944086 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5668/6793] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:40 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:41.962712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:41.963874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:41.972610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:41.973079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:41.973876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:41.974326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:42.112732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:42.121515 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5e9d227c-481c-4847-a34e-d67a4283cbea tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1389 microversion: 2.1 time: 0.163491 Jul 20 05:31:42.122115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5669/6794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:41 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:31:43.138791 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:43.139446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:43.146464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:43.146938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:43.147728 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:43.148185 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:43.284697 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:43.292163 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2fcb7a48-edc5-4b69-ab94-c7b9742934d4 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1389 microversion: 2.1 time: 0.157474 Jul 20 05:31:43.292781 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5670/6795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:43 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:43.717118 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7deb94b6-d950-4def-a2f2-ececb5e75458 req-c2d8df53-8666-4125-80dc-f3a760d3651a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32a18a4-aaca-41f0-9d46-4d4f173c65a0", "name": "network-vif-plugged", "status": "completed", "tag": "6e5b3fdd-4acf-4909-9276-a287e7d65e8b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:43.725383 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7deb94b6-d950-4def-a2f2-ececb5e75458 req-c2d8df53-8666-4125-80dc-f3a760d3651a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:43.725845 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7deb94b6-d950-4def-a2f2-ececb5e75458 req-c2d8df53-8666-4125-80dc-f3a760d3651a service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:43.742727 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7deb94b6-d950-4def-a2f2-ececb5e75458 req-c2d8df53-8666-4125-80dc-f3a760d3651a service nova] Creating event network-vif-plugged:6e5b3fdd-4acf-4909-9276-a287e7d65e8b for instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 on n-h1-764486-11 Jul 20 05:31:43.749013 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7deb94b6-d950-4def-a2f2-ececb5e75458 req-c2d8df53-8666-4125-80dc-f3a760d3651a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087051 Jul 20 05:31:43.749013 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5671/6796] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:31:44.311447 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:44.312090 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:44.319608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:44.320082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:44.320918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:44.321380 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:44.455290 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:44.462763 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-25562507-1590-490b-a6f2-1f41b6c4c205 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1389 microversion: 2.1 time: 0.156260 Jul 20 05:31:44.463338 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5672/6797] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:44 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:45.479684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:45.480307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:45.487303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.487914 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.488721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.489168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.622581 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:45.626227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:45.630728 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-abebf382-214c-412d-beaa-70549308a046 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1561 microversion: 2.1 time: 0.155003 Jul 20 05:31:45.631322 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5673/6798] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:45 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:45.647663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:45.648291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:45.656003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.656495 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.657279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:45.657727 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:45.797011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:45.804560 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-56d92411-b924-44c2-956e-c15f9612d0a0 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1561 microversion: 2.1 time: 0.161071 Jul 20 05:31:45.805141 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5674/6799] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:45 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:47.400129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:31:47.400899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:31:47.404142 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:47.405143 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:47.406503 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:31:47.411561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:47.412275 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:47.413171 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:47.413629 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:47.557468 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:31:47.565952 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5bb8d0f6-5221-4bf2-8282-56da50a46b5c tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1561 microversion: 2.1 time: 0.169815 Jul 20 05:31:47.566555 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5675/6800] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:31:47 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:31:47.582174 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-012ddb4a-f3b9-4458-8247-341dd5b8fc6e req-31c0feba-b5a6-4271-a706-b1a262b24ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32a18a4-aaca-41f0-9d46-4d4f173c65a0", "tag": "6e5b3fdd-4acf-4909-9276-a287e7d65e8b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:31:47.590694 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-012ddb4a-f3b9-4458-8247-341dd5b8fc6e req-31c0feba-b5a6-4271-a706-b1a262b24ed8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:31:47.591164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-012ddb4a-f3b9-4458-8247-341dd5b8fc6e req-31c0feba-b5a6-4271-a706-b1a262b24ed8 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:31:47.602958 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-012ddb4a-f3b9-4458-8247-341dd5b8fc6e req-31c0feba-b5a6-4271-a706-b1a262b24ed8 service nova] Creating event network-changed:6e5b3fdd-4acf-4909-9276-a287e7d65e8b for instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 on n-h1-764486-11 Jul 20 05:31:47.608838 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-012ddb4a-f3b9-4458-8247-341dd5b8fc6e req-31c0feba-b5a6-4271-a706-b1a262b24ed8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030508 Jul 20 05:31:47.609757 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5676/6801] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:10.829923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:10.830717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=14 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:10.835325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:10.836427 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:10.843488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:10.843959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:10.844784 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:10.845244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:10.897401 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3042fa2d-a69a-4216-8df9-6381b72adcf5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action" status: 200 len: 24571 microversion: 2.1 time: 0.069262 Jul 20 05:32:10.898076 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5677/6802] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:10 2022] POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:32:17.273130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:17.273864 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:17.281613 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:17.282083 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:17.282870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:17.283327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:17.307422 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lazy-loading 'flavor' on Instance uuid e32a18a4-aaca-41f0-9d46-4d4f173c65a0 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:32:17.376145 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4136175b-41b4-4bd6-b113-6f15e4cd9a29 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action" status: 202 len: 0 microversion: 2.1 time: 0.107253 Jul 20 05:32:17.376841 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5678/6803] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:17 2022] POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:32:17.385481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:17.386201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:17.392995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:17.393650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:17.394483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:17.395073 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:17.536179 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:17.543937 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9507090-a166-4f78-8a1b-9afd3382777f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1687 microversion: 2.1 time: 0.162524 Jul 20 05:32:17.544541 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5679/6804] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:17 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:18.562599 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:18.563276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:18.570125 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:18.570594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:18.571370 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:18.571826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:18.701965 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:18.709560 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d462b38c-8ec9-4b21-be69-51ecf99876f1 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1670 microversion: 2.1 time: 0.151457 Jul 20 05:32:18.710142 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5680/6805] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:18 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:19.800535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:19.801488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:19.808498 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.808968 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.809752 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.810207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.860578 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2a1d419a-0c67-44b0-b590-5ef252c7bec5 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action" status: 200 len: 35564 microversion: 2.1 time: 0.063793 Jul 20 05:32:19.861243 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5681/6806] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:19 2022] POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action => generated 35564 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:32:19.872423 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:19.873079 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:19.880100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.880598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.881381 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.881831 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.947606 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ad129cac-3261-4e13-be3b-ac29470b4156 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action" status: 202 len: 0 microversion: 2.1 time: 0.078928 Jul 20 05:32:19.948248 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5682/6807] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:19 2022] POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:32:19.957773 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:19.958496 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:19.965775 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.966246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:19.967270 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:19.967731 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:20.111488 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:20.119309 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6143eccb-df52-4947-bd6d-689e7bfdce42 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1676 microversion: 2.1 time: 0.166090 Jul 20 05:32:20.120263 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5683/6808] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:19 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:21.138095 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:21.138751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:21.145652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:21.146113 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:21.146888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:21.147337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:21.281552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:21.289310 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c29f7199-ab15-494c-af3f-517d6d30b576 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1676 microversion: 2.1 time: 0.155691 Jul 20 05:32:21.289895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5684/6809] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:21 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:22.306929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:22.307601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:22.315194 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:22.315664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:22.316480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:22.316938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:22.455442 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:22.463014 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ce7b1d32-678e-4bc8-94a7-92ba9c006006 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1679 microversion: 2.1 time: 0.160090 Jul 20 05:32:22.463831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5685/6810] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:22 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:22.560816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:22.561685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:22.567786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:22.568250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:22.569077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:22.569531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:22.611124 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-699e3802-3aef-4018-87bc-d01ef84dfb47 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action" status: 200 len: 35564 microversion: 2.1 time: 0.054839 Jul 20 05:32:22.611784 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5686/6811] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:32:22 2022] POST /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0/action => generated 35564 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 05:32:23.658610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:23.659206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:23.666967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.667435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.668950 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.669419 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.696490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:32:23.775877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7e0ba864-4208-4a46-8a23-719055d5d75e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 204 len: 0 microversion: 2.1 time: 0.121248 Jul 20 05:32:23.776777 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5687/6812] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:32:23 2022] DELETE /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:32:23.785706 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d12700f1-17af-4469-8bac-fb13e0fe9de3 req-5d6b22e6-6fed-44b6-89bc-01acc6586fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32a18a4-aaca-41f0-9d46-4d4f173c65a0", "tag": "6e5b3fdd-4acf-4909-9276-a287e7d65e8b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:23.794347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d12700f1-17af-4469-8bac-fb13e0fe9de3 req-5d6b22e6-6fed-44b6-89bc-01acc6586fc5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.794808 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d12700f1-17af-4469-8bac-fb13e0fe9de3 req-5d6b22e6-6fed-44b6-89bc-01acc6586fc5 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.806657 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d12700f1-17af-4469-8bac-fb13e0fe9de3 req-5d6b22e6-6fed-44b6-89bc-01acc6586fc5 service nova] Creating event network-changed:6e5b3fdd-4acf-4909-9276-a287e7d65e8b for instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 on n-h1-764486-11 Jul 20 05:32:23.811584 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d12700f1-17af-4469-8bac-fb13e0fe9de3 req-5d6b22e6-6fed-44b6-89bc-01acc6586fc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029905 Jul 20 05:32:23.812182 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5688/6813] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:23.817233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:23.817949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:23.824411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.824956 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.825861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:23.826316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:23.967612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:23.975184 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-53c5f9a8-1340-413e-8926-557bb52bed9e tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1685 microversion: 2.1 time: 0.161869 Jul 20 05:32:23.975769 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5689/6814] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:23 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:24.993082 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:24.993710 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:25.001212 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:25.001680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:25.002460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:25.002911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:25.133504 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:25.137129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:25.142471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-11ad706f-8fd0-4954-9dc5-acc338e04af6 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1685 microversion: 2.1 time: 0.153347 Jul 20 05:32:25.143065 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5690/6815] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:24 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:25.891736 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-9ed53180-b027-4e08-abfd-e5490ead9c42 req-8c974859-0fd6-4c3d-9502-a0fbcfd8f9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32a18a4-aaca-41f0-9d46-4d4f173c65a0", "name": "network-vif-deleted", "tag": "6e5b3fdd-4acf-4909-9276-a287e7d65e8b"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:25.901425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ed53180-b027-4e08-abfd-e5490ead9c42 req-8c974859-0fd6-4c3d-9502-a0fbcfd8f9bf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:25.901967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-9ed53180-b027-4e08-abfd-e5490ead9c42 req-8c974859-0fd6-4c3d-9502-a0fbcfd8f9bf service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:25.914289 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-9ed53180-b027-4e08-abfd-e5490ead9c42 req-8c974859-0fd6-4c3d-9502-a0fbcfd8f9bf service nova] Creating event network-vif-deleted:6e5b3fdd-4acf-4909-9276-a287e7d65e8b for instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 on n-h1-764486-11 Jul 20 05:32:25.919133 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-9ed53180-b027-4e08-abfd-e5490ead9c42 req-8c974859-0fd6-4c3d-9502-a0fbcfd8f9bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033358 Jul 20 05:32:25.919733 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5691/6816] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:32:26.160149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:26.160909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:26.167285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.167746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.168561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.169013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.213035 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:26.213500 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:26.213972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lazy-loading 'fault' on Instance uuid e32a18a4-aaca-41f0-9d46-4d4f173c65a0 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:32:26.264792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54f913d94584c04824dc01dbf2a1b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff796eba9244e8080b8afd901ac1d07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:26.273802 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-54efae96-dd85-4416-922d-f4af4147ca59 tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 200 len: 1353 microversion: 2.1 time: 0.118205 Jul 20 05:32:26.276387 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5692/6817] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:26 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 1353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:27.291225 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:27.291905 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] [instance: e32a18a4-aaca-41f0-9d46-4d4f173c65a0] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:27.299567 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:27.300067 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:27.300888 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:27.301343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:27.315695 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] HTTP exception thrown: Instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 could not be found. Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Request method failure captured: Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 HTTP/1.1 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15GsgKaY51_76qMPtZRUSBLJ5JFVecnjhius4mtJ8QItAqqZSIQiIUFYiq89kRwxWorNfsf2ajJrJTKVUiZIBfrcpwkPx6wC9THGfqX23Xu6P4EBQDBYdTdWvxkHr55aq9uYP3ZnUwp-HdZ8XHYoywMv7rC9XXRdbA8WgYeytWE_-FQ Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aff796eba9244e8080b8afd901ac1d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aff796eba9244e8080b8afd901ac1d07", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: aff796eba9244e8080b8afd901ac1d07 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1725453591 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: d54f913d94584c04824dc01dbf2a1b12 Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1725453591-project Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 could not be found. Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': 'e32a18a4-aaca-41f0-9d46-4d4f173c65a0'} Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 could not be found. Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 could not be found. Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:32:27.317399 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 could not be found. Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Returning 404 to user: Instance e32a18a4-aaca-41f0-9d46-4d4f173c65a0 could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6994dc64-c52b-43bc-a794-d43895d0d47f tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0" status: 404 len: 111 microversion: 2.1 time: 0.031660 Jul 20 05:32:27.322010 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5693/6818] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:27 2022] GET /compute/v2.1/servers/e32a18a4-aaca-41f0-9d46-4d4f173c65a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:32:30.841091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-836e32a0-21f6-4120-aa8f-51bdca0bcd2b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] Calling method '.version_select at 0x7f838aaceaf0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:30.861223 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-836e32a0-21f6-4120-aa8f-51bdca0bcd2b tempest-TestNetworkAdvancedServerOps-1725453591 tempest-TestNetworkAdvancedServerOps-1725453591-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-488212668" status: 202 len: 0 microversion: 2.1 time: 0.023894 Jul 20 05:32:30.862022 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5694/6819] 10.222.0.49 () {58 vars in 1280 bytes} [Wed Jul 20 05:32:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-488212668 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:32:41.792541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:41.793302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:41.960878 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-247767d2-c400-4254-9073-7a2f8e805d2e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'create', calling method: .version_select at 0x7f838a9d2b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-279855877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNe23P60aOFQmYyGDlzpIhzbyi9Huw7qhSB7ahJLWMe5wKTiXx/GD8PsYI3Wmh1G0Wntpj5KflgVHlz7AiTVJ0QfvIf8pBs5KQdupi60orwNZHY05oMenn2qyhmT/3cstw=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:41.975537 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-247767d2-c400-4254-9073-7a2f8e805d2e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:32:41.982880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-247767d2-c400-4254-9073-7a2f8e805d2e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for user 57c3464a93a3452384484b74f780b053 and project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:32:42.013374 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-247767d2-c400-4254-9073-7a2f8e805d2e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.226700 Jul 20 05:32:42.014736 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5695/6820] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:32:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:32:43.092559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1316223314", "imageRef": "015a4084-97ff-4146-83ba-116b77f93e6a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-279855877", "security_groups": [{"name": "tempest-secgroup-smoke-437333747"}], "networks": [{"uuid": "a8913ea1-2a28-4bd8-934d-1760ddc44e86"}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:43.218753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] validate_networks() for [('a8913ea1-2a28-4bd8-934d-1760ddc44e86', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:32:43.615886 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:32:43.616615 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:32:43.617108 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:32:43.617530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:32:43.617957 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:32:43.628873 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:43.629356 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:43.630196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:43.630658 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:43.649107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:32:43.655985 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for user 57c3464a93a3452384484b74f780b053 and project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:32:43.669444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:32:43.672282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='015a4084-97ff-4146-83ba-116b77f93e6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:32:43.733510 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-aa79fd45-edd6-4a66-b185-1220cfefb2e6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.645867 Jul 20 05:32:43.734199 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5696/6821] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:32:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:32:43.745062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-dc5b5fbe-3776-4bad-9d8b-24b8e76393ed tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:43.745704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-dc5b5fbe-3776-4bad-9d8b-24b8e76393ed tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:43.818164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-dc5b5fbe-3776-4bad-9d8b-24b8e76393ed tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:43.827707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-dc5b5fbe-3776-4bad-9d8b-24b8e76393ed tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1246 microversion: 2.1 time: 0.087227 Jul 20 05:32:43.828917 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5697/6822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:43 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:32:44.845300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:44.846880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:44.858966 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:44.859435 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:44.860242 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:44.860721 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:44.981411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:44.989869 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0bed7f0-336b-45ec-99cc-262f7407731a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1306 microversion: 2.1 time: 0.148555 Jul 20 05:32:44.999750 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5698/6823] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:44 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1306 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:46.007718 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:46.008424 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:46.024603 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:46.025096 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:46.025923 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:46.026387 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:46.325007 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:46.339405 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cf4fc1b4-c949-4577-bff2-4cca51ec9ea3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1371 microversion: 2.1 time: 0.336032 Jul 20 05:32:46.341907 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5699/6824] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:46 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:46.503160 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-8e177651-4b23-4d5b-adf2-05f9ebd8b5aa req-6f5823bd-deba-4231-a3fc-8706867eeedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:46.516555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8e177651-4b23-4d5b-adf2-05f9ebd8b5aa req-6f5823bd-deba-4231-a3fc-8706867eeedd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:46.517303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-8e177651-4b23-4d5b-adf2-05f9ebd8b5aa req-6f5823bd-deba-4231-a3fc-8706867eeedd service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:46.535385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-8e177651-4b23-4d5b-adf2-05f9ebd8b5aa req-6f5823bd-deba-4231-a3fc-8706867eeedd service nova] Creating event network-changed:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:32:46.540835 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-8e177651-4b23-4d5b-adf2-05f9ebd8b5aa req-6f5823bd-deba-4231-a3fc-8706867eeedd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045121 Jul 20 05:32:46.542398 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5700/6825] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:32:47.358294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:47.359004 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:47.365608 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:47.366070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:47.366843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:47.367288 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:47.611541 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:47.619141 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-58e992c0-8a34-439e-ad55-b6b3f0e3bf48 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1371 microversion: 2.1 time: 0.266008 Jul 20 05:32:47.619729 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5701/6826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:47 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:48.636452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:48.637116 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:48.643876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:48.644340 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:48.645138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:48.645588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:48.781376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:48.789007 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c29a0369-f1f9-4597-ab0a-374711736c8e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1371 microversion: 2.1 time: 0.156556 Jul 20 05:32:48.789603 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5702/6827] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:48 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:49.807136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:49.807963 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:49.815885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:49.816331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:49.817128 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:49.817573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:49.954343 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:49.962276 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0ac69837-c0e9-42f3-a628-ae48d02890f3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1371 microversion: 2.1 time: 0.159124 Jul 20 05:32:49.972133 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5703/6828] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:49 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:50.980011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:50.980685 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:50.988219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:50.988734 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:50.989522 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:50.989978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:51.118168 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:51.126409 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef8f03b5-64d7-40e4-b5de-d7ea3f76d230 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1371 microversion: 2.1 time: 0.150362 Jul 20 05:32:51.126997 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5704/6829] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:50 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:52.035669 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-800a1f1a-db7e-403c-9657-bbef99344ca4 req-620ff821-3b49-424d-95fd-723da22c8796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "name": "network-vif-plugged", "status": "completed", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:52.046307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-800a1f1a-db7e-403c-9657-bbef99344ca4 req-620ff821-3b49-424d-95fd-723da22c8796 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:52.046762 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-800a1f1a-db7e-403c-9657-bbef99344ca4 req-620ff821-3b49-424d-95fd-723da22c8796 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:52.058638 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-800a1f1a-db7e-403c-9657-bbef99344ca4 req-620ff821-3b49-424d-95fd-723da22c8796 service nova] Creating event network-vif-plugged:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:32:52.064471 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-800a1f1a-db7e-403c-9657-bbef99344ca4 req-620ff821-3b49-424d-95fd-723da22c8796 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Jul 20 05:32:52.065115 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5705/6830] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:32:52.143846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:52.144601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:52.150949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:52.151418 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:52.152210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:52.152693 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:52.315761 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:52.323549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-07e194d3-d078-43cd-8aa5-ca267ba8c577 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1371 microversion: 2.1 time: 0.184069 Jul 20 05:32:52.324117 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5706/6831] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:52 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:53.340431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:53.341058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:53.348243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:53.348739 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:53.349533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:53.349987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:53.479289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:53.487201 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-03398faa-b31d-45c7-a922-773f860999e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1554 microversion: 2.1 time: 0.150746 Jul 20 05:32:53.487778 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5707/6832] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:53 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:53.503882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:32:53.504535 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:32:53.510525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:53.510995 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:53.511776 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:53.512226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:53.638409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:53.646716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:32:53.654324 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4dc57de7-1cc5-411f-b2ab-5fe35539992c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1554 microversion: 2.1 time: 0.154351 Jul 20 05:32:53.654896 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5708/6833] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:32:53 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:32:55.539980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-7756927c-d406-45cf-96f3-5782bfa9db66 req-db10563c-835f-4e3d-8eeb-97312632296d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:32:55.543516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=12 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:32:55.550552 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7756927c-d406-45cf-96f3-5782bfa9db66 req-db10563c-835f-4e3d-8eeb-97312632296d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:32:55.551019 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-7756927c-d406-45cf-96f3-5782bfa9db66 req-db10563c-835f-4e3d-8eeb-97312632296d service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:32:55.562815 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-7756927c-d406-45cf-96f3-5782bfa9db66 req-db10563c-835f-4e3d-8eeb-97312632296d service nova] Creating event network-changed:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:32:55.567874 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-7756927c-d406-45cf-96f3-5782bfa9db66 req-db10563c-835f-4e3d-8eeb-97312632296d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032162 Jul 20 05:32:55.569079 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5709/6834] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:34:50.733432 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:50.734360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=62 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:34:50.738911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:34:50.740300 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:50.748322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:50.748809 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:50.749597 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:50.750047 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:50.772896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lazy-loading 'flavor' on Instance uuid 03e2c156-3001-4dfb-ae98-ab67f271af1b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:34:51.034028 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-246a435c-4b11-48ce-9b93-cac2924635cb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b/action" status: 202 len: 0 microversion: 2.1 time: 0.302675 Jul 20 05:34:51.034669 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5710/6835] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:34:50 2022] POST /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:34:51.044234 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:51.045546 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:51.051948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:51.052530 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:51.053331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:51.053884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:51.187998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:51.195714 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4d5fe085-797f-4e28-84c7-8b4bda74cb8d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.155700 Jul 20 05:34:51.196291 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5711/6836] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:51 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:52.213999 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:52.214643 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:52.222360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:52.222822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:52.223598 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:52.224042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:52.363013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:52.371077 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4834e773-fd76-4ce8-978b-980b6348e1e9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.161251 Jul 20 05:34:52.371645 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5712/6837] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:52 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:53.388375 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:53.389072 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:53.395986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:53.396475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:53.397256 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:53.397705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:53.533335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:53.541348 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-888ad12d-972d-4860-a239-f2a4944caf28 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.157094 Jul 20 05:34:53.541923 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5713/6838] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:53 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:54.560301 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:54.561590 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:54.569790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:54.569790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:54.569790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:54.572229 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:54.721219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:54.728798 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-da55a687-66a7-42b5-8d7d-240179453706 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.173273 Jul 20 05:34:54.729371 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5714/6839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:54 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:34:55.747203 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:55.747889 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:55.753973 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:55.754467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:55.755254 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:55.756226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:55.892785 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:55.901086 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37323c4e-02ff-4b93-84b4-12bcb5b9ca8c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.158813 Jul 20 05:34:55.901663 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5715/6840] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:55 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:56.918433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:56.919102 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:56.926333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:56.926797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:56.927745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:56.928243 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:57.062401 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:57.070183 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a67ba1b6-85c4-4f62-b9b3-e4028000c0ad tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.155782 Jul 20 05:34:57.070758 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5716/6841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:56 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:58.087153 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:58.087918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:58.094857 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:58.095326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:58.096109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:58.096596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:58.231952 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:58.239576 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-be5f60f9-2875-4c25-9fdf-537bc8061537 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.156368 Jul 20 05:34:58.240823 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5717/6842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:58 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:34:59.258289 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:34:59.258998 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:34:59.266040 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:59.266511 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:59.267298 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:34:59.267746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:34:59.397133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:34:59.404915 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f2ba00c7-4201-4e0d-8d34-52c9792890fc tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.151212 Jul 20 05:34:59.405495 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5718/6843] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:34:59 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:00.421273 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:00.422227 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:00.429201 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:00.429664 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:00.430449 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:00.430896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:00.568524 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:00.576777 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1a2b8a23-51cd-43b4-b632-33a1a4b26cf8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.159308 Jul 20 05:35:00.577387 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5719/6844] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:00 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:01.594684 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:01.595324 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:01.603130 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:01.603609 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:01.604428 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:01.604884 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:01.745518 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:01.753237 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-558947e0-833e-41f7-b7fe-1631c1e99a4e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1699 microversion: 2.1 time: 0.162625 Jul 20 05:35:01.753831 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5720/6845] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:01 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:02.770962 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:02.771618 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:02.778596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:02.779152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:02.780010 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:02.780563 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:02.915729 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:02.923634 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cddbe873-13c6-40d4-8ae5-83cdfe8b19de tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1699 microversion: 2.1 time: 0.156498 Jul 20 05:35:02.924194 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5721/6846] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:02 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:03.941466 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:03.942109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:03.949601 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:03.950164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:03.951322 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:03.951867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:04.112460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:04.122758 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-3c343256-7ef0-48f8-9d81-f366c80a3dd8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.185647 Jul 20 05:35:04.123743 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5722/6847] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:03 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:04.797109 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-80ef5abb-c258-412a-87c2-b13bd371d9af req-5c029fa5-6ab5-44d7-87de-acf79cc17c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "name": "network-vif-plugged", "status": "completed", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:04.808135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-80ef5abb-c258-412a-87c2-b13bd371d9af req-5c029fa5-6ab5-44d7-87de-acf79cc17c3f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:04.809587 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-80ef5abb-c258-412a-87c2-b13bd371d9af req-5c029fa5-6ab5-44d7-87de-acf79cc17c3f service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:04.825722 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-80ef5abb-c258-412a-87c2-b13bd371d9af req-5c029fa5-6ab5-44d7-87de-acf79cc17c3f service nova] Creating event network-vif-plugged:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:35:04.831500 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-80ef5abb-c258-412a-87c2-b13bd371d9af req-5c029fa5-6ab5-44d7-87de-acf79cc17c3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038723 Jul 20 05:35:04.832752 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5723/6848] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:35:05.144882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:05.145621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:05.153572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:05.154230 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:05.155219 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:05.155678 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:05.310709 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:05.319671 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6fb1bc0b-10c5-4521-a3c9-70da5004569c tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.181896 Jul 20 05:35:05.320602 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5724/6849] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:05 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:06.338790 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:06.339494 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:06.346499 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:06.346969 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:06.347753 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:06.348207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:06.353202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:35:06.497554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:06.506058 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4f4a03ed-d93d-4193-9694-c09df67d59dd tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.171321 Jul 20 05:35:06.507295 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5725/6850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:06 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:07.525516 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:07.526224 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:07.533399 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:07.533866 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:07.534655 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:07.535100 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:07.690748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:07.702817 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8943db17-8ac7-46aa-8cd0-6c2554d97f3b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.181859 Jul 20 05:35:07.703935 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5726/6851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:07 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:08.721480 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:08.722555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:08.731376 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:08.731846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:08.732720 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:08.733426 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:08.903232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:08.911283 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c9b633cd-6bea-4485-b440-773b14831ea8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.193890 Jul 20 05:35:08.912111 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5727/6852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:08 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:09.929822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:09.930525 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:09.937967 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:09.938444 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:09.939244 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:09.939861 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:10.115913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:10.124801 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-718c0f4f-4ebc-4e60-87fe-c58ab9ebb61b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.199476 Jul 20 05:35:10.125384 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5728/6853] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:09 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:11.141452 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:11.142228 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:11.150294 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:11.152002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:11.152002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:11.152002 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:11.300436 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:11.308513 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ca93e13b-da29-4072-a00f-772a0fb94446 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.170940 Jul 20 05:35:11.309122 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5729/6854] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:11 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:12.326064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:12.326840 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:12.335094 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:12.335565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:12.336446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:12.336928 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:12.490226 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:12.498598 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-19402e81-a729-4e41-b3bb-dcedb4c3b6b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1694 microversion: 2.1 time: 0.176639 Jul 20 05:35:12.499176 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5730/6855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:12 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:13.515666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:13.516332 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:13.523347 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.523812 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.524859 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:13.525417 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:13.655196 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:13.662836 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95367ba0-19d0-4a2f-8135-7f4ca4d53877 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1676 microversion: 2.1 time: 0.151105 Jul 20 05:35:13.663412 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5731/6856] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:13 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:14.681029 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:14.681703 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:14.688804 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:14.689253 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:14.690045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:14.690501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:14.825528 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:14.833120 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4ca38b2f-3f05-4632-b63c-955c4b153abf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1676 microversion: 2.1 time: 0.156017 Jul 20 05:35:14.833701 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5732/6857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:14 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:15.849307 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:15.849949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:15.857559 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:15.858022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:15.858800 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:15.859250 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:15.991470 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:15.999158 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5079a39f-4cfe-411f-a3d2-0fc2673d3477 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1619 microversion: 2.1 time: 0.153874 Jul 20 05:35:15.999737 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5733/6858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:15 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1619 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:16.015339 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:16.015925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:16.021704 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:16.022163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:16.022938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:16.023386 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:16.111345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b0f43267-0545-431a-b8bd-02cccf2d1d42 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b/action" status: 202 len: 0 microversion: 2.1 time: 0.099461 Jul 20 05:35:16.111928 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5734/6859] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:35:16 2022] POST /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:35:16.119844 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:16.120513 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:16.126807 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:16.127284 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:16.128075 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:16.128565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:16.261666 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:16.269617 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-24586671-7117-43e2-9677-3eb2f7c5e917 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1627 microversion: 2.1 time: 0.153644 Jul 20 05:35:16.270247 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5735/6860] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:16 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1627 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:16.806163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-1b1dbf5b-28ea-4f66-b21e-c091352d41b7 req-a64b70c5-d40c-4552-90c7-27cca2beeea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "name": "network-vif-unplugged", "status": "completed", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:16.815008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1b1dbf5b-28ea-4f66-b21e-c091352d41b7 req-a64b70c5-d40c-4552-90c7-27cca2beeea7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:16.815502 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-1b1dbf5b-28ea-4f66-b21e-c091352d41b7 req-a64b70c5-d40c-4552-90c7-27cca2beeea7 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:16.827182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.compute.server_external_events [req-1b1dbf5b-28ea-4f66-b21e-c091352d41b7 req-a64b70c5-d40c-4552-90c7-27cca2beeea7 service nova] Unable to find a host for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b. Dropping event network-vif-unplugged {{(pid=123724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 05:35:16.828085 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-1b1dbf5b-28ea-4f66-b21e-c091352d41b7 req-a64b70c5-d40c-4552-90c7-27cca2beeea7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026512 Jul 20 05:35:16.828707 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5736/6861] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 05:35:17.287695 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:17.288425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:17.295835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:17.296303 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:17.297377 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:17.297833 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:17.467489 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:17.475126 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1cee6837-53db-4562-b715-3baf7c13716d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.191321 Jul 20 05:35:17.475727 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5737/6862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:17 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:18.493850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:18.495206 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:18.512163 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:18.512737 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:18.513448 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:18.513890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:18.740882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:18.755137 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5deec3a7-ae7e-4013-9c27-5a1b79411d35 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.265475 Jul 20 05:35:18.766514 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5738/6863] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:18 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:19.773379 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:19.774032 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:19.782009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:19.782573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:19.783437 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:19.784119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:19.938579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:19.948134 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-612c00ee-0d32-4631-b4c9-bae443bb0469 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.178656 Jul 20 05:35:19.948939 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5739/6864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:19 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:20.967457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:20.969360 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:20.978257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=63 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:35:20.981335 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:20.981943 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:20.984890 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:20.985555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:21.130922 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:21.140105 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-44ab996e-888a-4c11-a66e-7078e10b02ee tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.178258 Jul 20 05:35:21.151160 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5740/6865] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:20 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:22.158701 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:22.160236 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:22.168645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:22.169456 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:22.170257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:22.170717 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:22.191580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:35:22.319464 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:22.327853 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-33a6cc18-5999-4e86-b4ba-1dc282a79e51 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.173263 Jul 20 05:35:22.337112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5741/6866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:22 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:23.347210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:23.349058 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:23.359188 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:23.360099 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:23.361716 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:23.362626 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:23.506191 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:23.513753 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a6c58d1c-6871-4e26-b5e9-fd4c16a2d4ef tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.171577 Jul 20 05:35:23.514294 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5742/6867] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:23 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:24.533649 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:24.534983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:24.545033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:24.545512 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:24.546366 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:24.546781 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:24.704214 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:24.713326 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bf4d9448-e8af-4c8b-bbdd-fa371bc0b3a6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.184312 Jul 20 05:35:24.714116 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5743/6868] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:24 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:35:25.731139 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:25.731792 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:25.738816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:25.739285 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:25.740078 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:25.740572 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:25.869527 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:25.877189 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-0f9a63c8-d601-47e6-9e9a-dcbc85d29241 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.150120 Jul 20 05:35:25.877782 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5744/6869] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:25 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:26.894605 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:26.895233 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:26.902751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:26.903210 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:26.903983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:26.904457 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:27.036980 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:27.045226 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d10880ad-74d1-46c7-996d-bd70c3327383 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.154520 Jul 20 05:35:27.045822 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5745/6870] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:26 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:28.063409 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:28.064089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:28.071009 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:28.071476 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:28.072372 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:28.072745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:28.205384 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:28.212977 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8ea361f6-c211-4649-a697-8853674c5d63 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.153533 Jul 20 05:35:28.213610 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5746/6871] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:28 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:29.230461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:29.231133 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:29.238008 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:29.238463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:29.239240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:29.239682 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:29.372302 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:29.379775 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-043a4965-46c7-4a53-b53d-cabf81ceb7a3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.153520 Jul 20 05:35:29.380374 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5747/6872] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:29 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:30.397286 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:30.397981 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:30.405676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:30.406141 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:30.406918 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:30.407371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:30.540891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:30.549385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-973b9fa6-7431-49ff-9610-d96d93f81cc4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.156014 Jul 20 05:35:30.549977 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5748/6873] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:30 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:30.870978 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-4c592a95-8954-4300-aaa8-b94e6f13b55d req-83677207-e9f1-42b6-9631-aa6df086bf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "name": "network-vif-plugged", "status": "completed", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:35:30.880519 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4c592a95-8954-4300-aaa8-b94e6f13b55d req-83677207-e9f1-42b6-9631-aa6df086bf92 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:30.881068 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-4c592a95-8954-4300-aaa8-b94e6f13b55d req-83677207-e9f1-42b6-9631-aa6df086bf92 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:30.893548 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-4c592a95-8954-4300-aaa8-b94e6f13b55d req-83677207-e9f1-42b6-9631-aa6df086bf92 service nova] Creating event network-vif-plugged:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:35:30.898848 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-4c592a95-8954-4300-aaa8-b94e6f13b55d req-83677207-e9f1-42b6-9631-aa6df086bf92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031901 Jul 20 05:35:30.899466 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5749/6874] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:35:31.568596 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:31.569304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:31.576580 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:31.577045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:31.577822 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:31.578267 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:31.712909 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:31.721035 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-daca26fe-d9ac-44d1-81dc-baf56e36fe37 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1685 microversion: 2.1 time: 0.157585 Jul 20 05:35:31.721609 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5750/6875] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:31 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:35:32.738248 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:35:32.738887 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:35:32.746155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:32.746642 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:32.747425 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:35:32.747959 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:35:32.879413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:35:32.887040 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-48fd19c9-c9be-40e0-8b0d-c4d3c98d1c5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1672 microversion: 2.1 time: 0.152735 Jul 20 05:35:32.887625 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5751/6876] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:35:32 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:36:43.270336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=23 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:43.271263 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=58 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:36:43.275676 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:43.276195 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:43.283269 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.284501 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.285483 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.285938 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.315217 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Going to try to terminate instance {{(pid=123724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 05:36:43.394549 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8f92f02-eb49-4197-a7f4-74a997bda209 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 204 len: 0 microversion: 2.1 time: 0.126136 Jul 20 05:36:43.395186 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5752/6877] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jul 20 05:36:43 2022] DELETE /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 05:36:43.460813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-d5ec9b59-3e7c-406d-bba0-e4c73a9f1977 req-9a39a846-04bf-4420-aa5b-13a508c210f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:43.469246 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d5ec9b59-3e7c-406d-bba0-e4c73a9f1977 req-9a39a846-04bf-4420-aa5b-13a508c210f3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.469797 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-d5ec9b59-3e7c-406d-bba0-e4c73a9f1977 req-9a39a846-04bf-4420-aa5b-13a508c210f3 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.481922 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-d5ec9b59-3e7c-406d-bba0-e4c73a9f1977 req-9a39a846-04bf-4420-aa5b-13a508c210f3 service nova] Creating event network-changed:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:36:43.486826 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-d5ec9b59-3e7c-406d-bba0-e4c73a9f1977 req-9a39a846-04bf-4420-aa5b-13a508c210f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090189 Jul 20 05:36:43.487427 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5753/6878] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:36:43.493813 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:43.494534 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:43.501054 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.501517 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.502364 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:43.502824 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:43.641394 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:43.649684 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c7fc0de2-e286-4950-a2ba-7a46f35d2e66 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.159815 Jul 20 05:36:43.650210 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5754/6879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:43 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:36:44.667777 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:44.668477 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:44.677178 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:44.677652 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:44.678654 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:44.679799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:44.897764 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:44.905786 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ba971910-f521-47a5-a783-417337993c25 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1678 microversion: 2.1 time: 0.241951 Jul 20 05:36:44.907287 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5755/6880] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:44 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:36:45.219453 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-81d9e839-228d-454c-b7a0-df532f62098b req-8d993332-1d2d-4669-a61b-29587eeb1281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e2c156-3001-4dfb-ae98-ab67f271af1b", "name": "network-vif-deleted", "tag": "8f7d51f6-b66c-46d7-b3ed-4a8671571571"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:45.228154 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-81d9e839-228d-454c-b7a0-df532f62098b req-8d993332-1d2d-4669-a61b-29587eeb1281 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.228650 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-81d9e839-228d-454c-b7a0-df532f62098b req-8d993332-1d2d-4669-a61b-29587eeb1281 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.239651 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-81d9e839-228d-454c-b7a0-df532f62098b req-8d993332-1d2d-4669-a61b-29587eeb1281 service nova] Creating event network-vif-deleted:8f7d51f6-b66c-46d7-b3ed-4a8671571571 for instance 03e2c156-3001-4dfb-ae98-ab67f271af1b on n-h1-764486-11 Jul 20 05:36:45.244897 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-81d9e839-228d-454c-b7a0-df532f62098b req-8d993332-1d2d-4669-a61b-29587eeb1281 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082308 Jul 20 05:36:45.245499 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5756/6881] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:36:45.926296 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:45.927011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:45.935276 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.935742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.936555 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.937003 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.969900 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:45.970354 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:45.970835 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lazy-loading 'fault' on Instance uuid 03e2c156-3001-4dfb-ae98-ab67f271af1b {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:36:46.014260 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:36:46.021688 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-f399f03b-0082-4246-82eb-505cb4b43376 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 200 len: 1336 microversion: 2.1 time: 0.101115 Jul 20 05:36:46.022302 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5757/6882] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:45 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:36:47.039474 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:47.040140 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 03e2c156-3001-4dfb-ae98-ab67f271af1b] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:36:47.046574 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:47.047036 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:47.048066 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:36:47.048548 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:36:47.062520 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.wsgi [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] HTTP exception thrown: Instance 03e2c156-3001-4dfb-ae98-ab67f271af1b could not be found. Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Request method failure captured: Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: request: GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b HTTP/1.1 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Accept: application/json Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Accept-Encoding: identity Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Connection: close Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Content-Length: 0 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Content-Type: application/json Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Host: 10.222.0.49 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: Openstack-System-Scope: None Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: User-Agent: python-urllib3/1.26.9 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Auth-Token: gAAAAABi15N05KpSEa7yYz6s3QQpUFZrZnNZKZfHInDDIoMie0rUD1GYCwKX_1R3Syf4Xvf8BbAAXveMRXJkXI-MtwKy4YiNSXK_J0oc0LCiXyX6FvewHAbFmfTokIgQgNTUJhJmNMfh_qVg-HPdE18ocVPbKmav04O3VxS8AGBph9lu9kOmPms Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Id: None Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Domain-Name: None Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Identity-Status: Confirmed Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Is-Admin-Project: True Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Id: default Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Domain-Name: Default Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Id: 821b300f6c9c46bfb4b28902c593c7b3 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Project-Name: tempest-TestShelveInstance-583363390 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Role: member,reader Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Roles: member,reader Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/821b300f6c9c46bfb4b28902c593c7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/821b300f6c9c46bfb4b28902c593c7b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/821b300f6c9c46bfb4b28902c593c7b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_821b300f6c9c46bfb4b28902c593c7b3", "adminURL": "http://10.222.0.49:8080"}]}] Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant: tempest-TestShelveInstance-583363390 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Id: 821b300f6c9c46bfb4b28902c593c7b3 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-Tenant-Name: tempest-TestShelveInstance-583363390 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-User: tempest-TestShelveInstance-583363390-project Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Id: default Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Domain-Name: Default Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Id: 57c3464a93a3452384484b74f780b053 Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: X-User-Name: tempest-TestShelveInstance-583363390-project Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: method: > Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: exception: Instance 03e2c156-3001-4dfb-ae98-ab67f271af1b could not be found. Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: action_args: {'id': '03e2c156-3001-4dfb-ae98-ab67f271af1b'} Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e2c156-3001-4dfb-ae98-ab67f271af1b could not be found. Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e2c156-3001-4dfb-ae98-ab67f271af1b could not be found. Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 05:36:47.064202 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e2c156-3001-4dfb-ae98-ab67f271af1b could not be found. Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: ERROR nova.api.openstack.wsgi Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Returning 404 to user: Instance 03e2c156-3001-4dfb-ae98-ab67f271af1b could not be found. {{(pid=123724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6ad3fec0-8032-4d39-8b5d-c3647d195fb5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b" status: 404 len: 111 microversion: 2.1 time: 0.030129 Jul 20 05:36:47.069135 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5758/6883] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:36:47 2022] GET /compute/v2.1/servers/03e2c156-3001-4dfb-ae98-ab67f271af1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 05:36:47.230304 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-37f17059-02d6-4818-a56f-a207a8f5f98f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '.version_select at 0x7f838ae905e0>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:36:47.249669 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-37f17059-02d6-4818-a56f-a207a8f5f98f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-279855877" status: 202 len: 0 microversion: 2.1 time: 0.023175 Jul 20 05:36:47.250270 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5759/6884] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jul 20 05:36:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-279855877 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:36:47.271400 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c5ba8700-8e08-4351-b7a3-5d654fc1b3f8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'create', calling method: .version_select at 0x7f838ae7fdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1926752914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCaNzu04mVXjPdcXMVKsvhX6JCGGvh6okMHnfjdD2kh68Ws8ZvPcUwNbzEV+JQSI/ObSQ62l74C6MX8vXhX76xI78om3K7uhApN59T5saq5UdXgc4UGqO45o7FyTKAwhQ=="}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:36:47.287268 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c5ba8700-8e08-4351-b7a3-5d654fc1b3f8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:36:47.292705 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-c5ba8700-8e08-4351-b7a3-5d654fc1b3f8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for user 57c3464a93a3452384484b74f780b053 and project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'key_pairs'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:36:47.316246 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c5ba8700-8e08-4351-b7a3-5d654fc1b3f8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.049314 Jul 20 05:36:47.316874 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5760/6885] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jul 20 05:36:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:37:03.391531 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:03.392313 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:03.392983 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:03.397323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1348371472", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1926752914", "security_groups": [{"name": "tempest-secgroup-smoke-1197025052"}], "networks": [{"uuid": "a8913ea1-2a28-4bd8-934d-1760ddc44e86"}], "block_device_mapping_v2": [{"uuid": "4ce88a46-a6d8-4b29-92a8-cf53a112ab8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:03.517152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.network.neutron [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] validate_networks() for [('a8913ea1-2a28-4bd8-934d-1760ddc44e86', None, None, None, None, None)] {{(pid=123724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 05:37:03.920460 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Flavor limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 05:37:03.920899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Image limits 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 05:37:03.921382 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Flavor pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 05:37:03.921801 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Image pref 0:0:0 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 05:37:03.922221 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.virt.hardware [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 05:37:03.931493 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:03.931949 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:03.932789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:03.933240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:03.952771 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 05:37:03.958431 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.quota [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Getting quotas for user 57c3464a93a3452384484b74f780b053 and project 821b300f6c9c46bfb4b28902c593c7b3. Resources: {'ram', 'instances', 'cores'} {{(pid=123724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 05:37:04.018838 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Going to run 1 instances... {{(pid=123724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 05:37:04.020972 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ce88a46-a6d8-4b29-92a8-cf53a112ab8d',volume_size=None,volume_type=None)] {{(pid=123724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 05:37:04.148459 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-73d2487a-5a16-485d-8a81-145b5007670d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758641 Jul 20 05:37:04.149112 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5761/6886] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jul 20 05:37:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 05:37:04.158826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-8c21f37a-f1a5-4af5-959d-6cea37a791c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:04.159451 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-8c21f37a-f1a5-4af5-959d-6cea37a791c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:04.212913 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-8c21f37a-f1a5-4af5-959d-6cea37a791c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:04.219697 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-8c21f37a-f1a5-4af5-959d-6cea37a791c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1089 microversion: 2.1 time: 0.064613 Jul 20 05:37:04.220281 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5762/6887] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:04 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:05.237232 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:05.237863 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:05.246164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:05.246870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:05.248013 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:05.248579 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:05.318045 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:05.326345 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-95b01fb6-30c4-4f1e-891d-7fac2f557443 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1205 microversion: 2.1 time: 0.093009 Jul 20 05:37:05.328401 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5763/6888] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:05 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:06.346508 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:06.347976 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:06.356846 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.358240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.361325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.361875 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.517151 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:06.526707 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-d200d7d0-b206-4358-8cfc-12fff9482a5b tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1273 microversion: 2.1 time: 0.187168 Jul 20 05:37:06.527694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5764/6889] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:06 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:06.532331 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-70dfa0fb-bb2a-4d91-93a0-1a2129eddcdb req-6109097f-8f00-405c-9d5d-7583157d4f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d1a914-fc63-40b6-8149-2002f2acc473", "tag": "8eb8cda9-cb3b-4c16-b01f-13c8516acb47"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:06.542742 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-70dfa0fb-bb2a-4d91-93a0-1a2129eddcdb req-6109097f-8f00-405c-9d5d-7583157d4f6c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:06.543211 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-70dfa0fb-bb2a-4d91-93a0-1a2129eddcdb req-6109097f-8f00-405c-9d5d-7583157d4f6c service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:06.555696 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-70dfa0fb-bb2a-4d91-93a0-1a2129eddcdb req-6109097f-8f00-405c-9d5d-7583157d4f6c service nova] Creating event network-changed:8eb8cda9-cb3b-4c16-b01f-13c8516acb47 for instance 30d1a914-fc63-40b6-8149-2002f2acc473 on n-h1-764486-11 Jul 20 05:37:06.562059 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-70dfa0fb-bb2a-4d91-93a0-1a2129eddcdb req-6109097f-8f00-405c-9d5d-7583157d4f6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032989 Jul 20 05:37:06.562694 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5765/6890] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:37:07.544789 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:07.545680 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:07.552662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:07.553062 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:07.553867 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:07.554326 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:07.688259 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:07.696127 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-909e732a-b606-47b0-8ba0-8164d47e18b0 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1273 microversion: 2.1 time: 0.156580 Jul 20 05:37:07.696676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5766/6891] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:07 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:08.713926 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:08.714561 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:08.722015 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:08.722475 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:08.723255 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:08.723700 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:08.860786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:08.869139 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c8817795-d9e1-4228-ab5c-3b6172430bc7 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1273 microversion: 2.1 time: 0.159561 Jul 20 05:37:08.869940 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5767/6892] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:08 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:09.885748 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:09.886405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:09.894193 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:09.894657 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:09.895446 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:09.895891 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:10.034586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:10.042685 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-c315d423-64b1-49cd-9193-2d82e05c06c1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1273 microversion: 2.1 time: 0.160948 Jul 20 05:37:10.043489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5768/6893] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:09 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:11.060413 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:11.061033 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:11.068593 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:11.069065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:11.069850 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:11.070311 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:11.206594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:11.214231 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-1fca0cc3-6817-4078-884e-a86a164f1526 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.157838 Jul 20 05:37:11.214816 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5769/6894] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:11 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:12.231344 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:12.232065 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:12.239798 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:12.240257 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:12.241077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:12.241521 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:12.376334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:12.383885 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-fabb51c9-e4ec-4a83-9009-c68665cc568a tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.156603 Jul 20 05:37:12.384489 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5770/6895] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:12 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:13.400796 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:13.401509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:13.408455 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:13.408927 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:13.409726 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:13.410162 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:13.541672 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:13.549964 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-55dc0d26-6046-4206-8846-c9667712d451 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.153178 Jul 20 05:37:13.550544 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5771/6896] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:13 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:14.566223 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:14.566816 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:14.568825 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=2 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:14.569745 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell0:SELECT=8 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:14.577152 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:14.577647 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:14.578410 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:14.578856 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:14.715893 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:14.723575 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-6c55a677-d82d-4b8f-b616-e675c2d714a9 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.161354 Jul 20 05:37:14.724183 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5772/6897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:14 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:15.741135 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:15.741837 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:15.749592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:15.749592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:15.750328 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:15.750782 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:15.883799 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:15.891380 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-69443ee3-c2df-4f0a-9e25-1cdb8da54c6e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.154831 Jul 20 05:37:15.891961 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5773/6898] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:15 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:16.908478 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:16.909119 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:16.915308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:16.915772 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:16.916589 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:16.917042 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:17.048129 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:17.055794 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-5ef736f3-40aa-4e69-83f6-823b69382ca6 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.151515 Jul 20 05:37:17.056408 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5774/6899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:16 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:18.072240 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:18.072948 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:18.079874 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:18.080342 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:18.081150 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:18.081600 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:18.212834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:18.220258 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e8a167d7-350a-4783-918c-d2a901c8e370 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.151964 Jul 20 05:37:18.220863 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5775/6900] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:18 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:19.237189 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:19.237848 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:19.244755 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:19.245218 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:19.245986 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:19.246434 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:19.379165 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:19.387072 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e0d360a1-7d88-44be-a7b1-dcbccaa374eb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.153782 Jul 20 05:37:19.387676 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5776/6901] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:19 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:19.548120 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-72b5ee81-e26f-405f-859e-8c2c340ef16d req-a9018318-42ee-4ca8-baea-2c5db018ac17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d1a914-fc63-40b6-8149-2002f2acc473", "name": "network-vif-plugged", "status": "completed", "tag": "8eb8cda9-cb3b-4c16-b01f-13c8516acb47"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:19.557279 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72b5ee81-e26f-405f-859e-8c2c340ef16d req-a9018318-42ee-4ca8-baea-2c5db018ac17 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:19.557751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-72b5ee81-e26f-405f-859e-8c2c340ef16d req-a9018318-42ee-4ca8-baea-2c5db018ac17 service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:19.569452 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-72b5ee81-e26f-405f-859e-8c2c340ef16d req-a9018318-42ee-4ca8-baea-2c5db018ac17 service nova] Creating event network-vif-plugged:8eb8cda9-cb3b-4c16-b01f-13c8516acb47 for instance 30d1a914-fc63-40b6-8149-2002f2acc473 on n-h1-764486-11 Jul 20 05:37:19.574385 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-72b5ee81-e26f-405f-859e-8c2c340ef16d req-a9018318-42ee-4ca8-baea-2c5db018ac17 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087873 Jul 20 05:37:19.574982 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5777/6902] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 05:37:20.406467 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:20.407172 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:20.414091 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:20.414549 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:20.415315 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:20.415760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:20.549645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:20.557383 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-641d92c2-0d85-460f-b178-efebf2a7ce7f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1261 microversion: 2.1 time: 0.156065 Jul 20 05:37:20.558058 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5778/6903] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:20 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 05:37:21.573565 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:21.574213 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:21.581323 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:21.581786 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:21.582564 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:21.583017 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:21.714631 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:21.722877 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-b1b6d3c4-0bf4-454f-b965-f494ffee97c4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1444 microversion: 2.1 time: 0.153351 Jul 20 05:37:21.723453 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5779/6904] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:21 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:21.738834 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:37:21.739461 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:37:21.745621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:21.746085 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:21.746870 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:21.747319 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:21.766490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=100 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:37:21.885107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:37:21.893273 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-657889e2-ed9b-46c4-9e44-87aac087f68e tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1444 microversion: 2.1 time: 0.157798 Jul 20 05:37:21.893846 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5780/6905] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:37:21 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:37:23.750441 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [req-44d8d001-a4d7-46aa-8023-ea5eb6b74e16 req-0165268b-c6bd-4de0-a85b-99c28745f62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d1a914-fc63-40b6-8149-2002f2acc473", "tag": "8eb8cda9-cb3b-4c16-b01f-13c8516acb47"}]} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:37:23.761011 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-44d8d001-a4d7-46aa-8023-ea5eb6b74e16 req-0165268b-c6bd-4de0-a85b-99c28745f62b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:37:23.761594 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [req-44d8d001-a4d7-46aa-8023-ea5eb6b74e16 req-0165268b-c6bd-4de0-a85b-99c28745f62b service nova] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:37:23.773503 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.compute.server_external_events [req-44d8d001-a4d7-46aa-8023-ea5eb6b74e16 req-0165268b-c6bd-4de0-a85b-99c28745f62b service nova] Creating event network-changed:8eb8cda9-cb3b-4c16-b01f-13c8516acb47 for instance 30d1a914-fc63-40b6-8149-2002f2acc473 on n-h1-764486-11 Jul 20 05:37:23.778839 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [req-44d8d001-a4d7-46aa-8023-ea5eb6b74e16 req-0165268b-c6bd-4de0-a85b-99c28745f62b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032342 Jul 20 05:37:23.779515 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5781/6906] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jul 20 05:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 05:39:18.945016 n-d-764486-11 devstack@n-api.service[123724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7d8453db-b494-4f77-8fbb-6fd93e2eea16] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:39:18.945841 n-d-764486-11 devstack@n-api.service[123724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed159f5b-c8c3-4f72-9e8d-10afd691f49f] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 05:39:18.946416 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:18.947186 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=4 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:19.000994 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:19.001592 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:19.008481 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:19.008955 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:19.009746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:19.010208 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:19.037433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.objects.instance [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lazy-loading 'flavor' on Instance uuid 30d1a914-fc63-40b6-8149-2002f2acc473 {{(pid=123724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 05:39:19.108507 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7daecac0-0d06-467c-94eb-af197532a46d tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "POST /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action" status: 202 len: 0 microversion: 2.1 time: 0.165320 Jul 20 05:39:19.109111 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5782/6907] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jul 20 05:39:18 2022] POST /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 05:39:19.117750 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:19.118463 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:19.124802 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:19.125299 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:19.126161 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:19.126612 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:19.314936 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:19.323103 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-4aeaf6d5-1c71-47d9-a489-7bb0df7f60ce tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.209388 Jul 20 05:39:19.323711 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5783/6908] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:19 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:20.340429 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:20.341050 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:20.352138 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:20.352623 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:20.353396 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:20.353876 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:20.358306 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] [7d8453db-b494-4f77-8fbb-6fd93e2eea16] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 54576. Jul 20 05:39:20.361429 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed159f5b-c8c3-4f72-9e8d-10afd691f49f] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 54578. Jul 20 05:39:20.487182 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:20.494741 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-09b20081-c429-4001-811e-62ae84892dfb tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.158350 Jul 20 05:39:20.495306 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5784/6909] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:20 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:21.511176 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:21.511843 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:21.518854 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:21.519317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:21.520089 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:21.520573 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:21.653282 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:21.660720 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-ef2fa959-622f-469a-a0ea-558ac8f2b5b5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.153508 Jul 20 05:39:21.661918 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5785/6910] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:21 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:22.679291 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:22.679987 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:22.687051 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:22.687509 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:22.689325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:22.689325 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:22.823337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:22.831083 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-7b458d10-d5a9-4c8e-9035-06dbfc452771 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.156223 Jul 20 05:39:22.831665 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5786/6911] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:22 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:23.848334 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:23.849018 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:23.855869 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:23.856330 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:23.857136 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:23.857586 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:23.992056 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:23.999662 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a23b2ee4-81b1-4ed9-b542-d443ce5090be tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.155291 Jul 20 05:39:24.000232 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5787/6912] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:23 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:25.018070 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:25.018741 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:25.026327 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:25.026787 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:25.027591 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:25.028038 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:25.159896 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:25.167554 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-79ee5d76-f2af-4791-b83e-24b547e4e320 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.153660 Jul 20 05:39:25.168139 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5788/6913] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:25 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:26.185022 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:26.185671 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:26.192459 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:26.192929 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:26.193911 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:26.194317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:26.328746 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:26.336916 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-57e9ea36-953f-4625-9f18-ad577e833caf tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.155911 Jul 20 05:39:26.337498 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5789/6914] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:26 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:27.354662 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:27.355337 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:27.362308 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:27.362769 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:27.363547 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:27.364021 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:27.494333 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:27.501914 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb80e793-4ecd-4e9c-b5f1-933fbeecc698 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.151832 Jul 20 05:39:27.502486 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5790/6915] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:27 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:28.519064 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:28.519732 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:28.526681 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:28.527149 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:28.527925 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:28.528405 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:28.657283 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:28.665282 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-e52b8ffd-ba96-4a82-8af4-cd43169b54e8 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.150198 Jul 20 05:39:28.665860 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5791/6916] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:28 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:29.683433 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:29.684077 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:29.691411 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:29.691882 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:29.692712 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:29.693164 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:29.837588 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:29.845313 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-a9ad7fed-64b2-4aa6-ba33-3909d28d47e3 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.166580 Jul 20 05:39:29.845914 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5792/6917] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:29 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:30.862826 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:30.863462 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:30.870906 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:30.871367 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:30.872144 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:30.872627 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:31.005031 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:31.012884 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-cb601395-0416-4a06-9946-44c1c0874fe1 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.153966 Jul 20 05:39:31.013462 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5793/6918] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:30 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:32.030316 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:32.030931 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:32.037899 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:32.038371 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:32.039155 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:32.039610 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:32.179533 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:32.187300 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-605abc14-a67e-4e57-950c-fb45e3944fc5 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.161036 Jul 20 05:39:32.187895 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5794/6919] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:32 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:33.205061 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:33.205760 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:33.213107 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:33.213663 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:33.214554 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:33.215012 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:33.352041 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:33.360020 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-bb09f913-e03f-4d73-bc40-ee3448cedbd4 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1569 microversion: 2.1 time: 0.158868 Jul 20 05:39:33.360643 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5795/6920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:33 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:34.377063 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Calling method '>' {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 05:39:34.377756 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:34.385490 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:34.385964 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:34.386751 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:34.387207 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:34.405621 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:34.520317 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.policy [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c3464a93a3452384484b74f780b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821b300f6c9c46bfb4b28902c593c7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 05:39:34.528048 n-d-764486-11 devstack@n-api.service[123724]: INFO nova.api.openstack.requestlog [None req-2f6f39eb-26e3-4f90-be97-7fceb21cfae2 tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] 10.222.0.49 "GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473" status: 200 len: 1510 microversion: 2.1 time: 0.155025 Jul 20 05:39:34.528657 n-d-764486-11 devstack@n-api.service[123724]: [pid: 123724|app: 0|req: 5796/6921] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jul 20 05:39:34 2022] GET /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 05:39:34.543939 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.api.openstack.wsgi [None req-3b4161b0-e20e-498c-898d-be0e34570f5f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 05:39:34.544557 n-d-764486-11 devstack@n-api.service[123724]: DEBUG nova.compute.api [None req-3b4161b0-e20e-498c-898d-be0e34570f5f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] [instance: 30d1a914-fc63-40b6-8149-2002f2acc473] Fetching instance by UUID {{(pid=123724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 05:39:34.550645 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b4161b0-e20e-498c-898d-be0e34570f5f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:34.551111 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b4161b0-e20e-498c-898d-be0e34570f5f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:34.551885 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b4161b0-e20e-498c-898d-be0e34570f5f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 05:39:34.552336 n-d-764486-11 devstack@n-api.service[123724]: DEBUG oslo_concurrency.lockutils [None req-3b4161b0-e20e-498c-898d-be0e34570f5f tempest-TestShelveInstance-583363390 tempest-TestShelveInstance-583363390-project] Lock "23363e6a-51fb-4308-934e-3fa03f8bc04e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 05:39:34.628641 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:39:34.629114 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:39:34.648819 n-d-764486-11 devstack@n-api.service[123724]: Traceback (most recent call last): Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: timer() Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: cb(*args, **kw) Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: waiter.switch() Jul 20 05:39:34.648974 n-d-764486-11 devstack@n-api.service[123724]: greenlet.error: cannot switch to a different thread Jul 20 05:39:44.578880 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_api:SELECT=34 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:39:44.617262 n-d-764486-11 devstack@n-api.service[123724]: DEBUG dbcounter [-] [123724] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 05:42:54.655127 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:42:54.655853 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:45:00.098400 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:45:00.099057 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:46:14.663141 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:46:14.663879 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:46:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:48:20.107400 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:48:20.107987 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:49:34.672054 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:49:34.672800 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:51:40.115739 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:51:40.116895 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:52:54.681059 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:52:54.681778 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:55:00.124334 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:55:00.125126 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:56:14.689412 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:56:14.690615 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:58:20.134329 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:58:20.134985 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 05:59:34.698056 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 05:59:34.698735 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 05:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:01:40.143039 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:01:40.143039 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:02:54.706982 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:02:54.707649 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:05:00.153204 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:05:00.153950 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:06:14.715288 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:06:14.715982 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:06:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:08:20.161321 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:08:20.162056 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:08:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:09:34.722964 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:09:34.723657 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:09:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:11:40.168954 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:11:40.169676 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:12:54.731131 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:12:54.731737 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:15:00.177233 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:15:00.177909 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:15:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:16:14.742762 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:16:14.743400 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:18:20.186077 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:18:20.186772 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:19:34.753985 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:19:34.754553 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:21:40.194691 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:21:40.195663 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:21:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!! Jul 20 06:22:54.762904 n-d-764486-11 devstack@n-api.service[123724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 06:22:54.763795 n-d-764486-11 devstack@n-api.service[123724]: Wed Jul 20 06:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30d1a914-fc63-40b6-8149-2002f2acc473/action (ip 10.222.0.49) !!!